SysTech Internationl Inc

AWS Data Engineer (Remote: Part Time)

AWS Data Engineer (Remote: Part Time)

The Data Engineer will play a crucial role in the data infrastructure team, working with growth team stakeholders to configure, maintain, and automate data pipelines for new and existing partners. This position requires a mix of technical skills, problem-solving abilities, and clear communication skills to ensure efficient and error-free data operations.
Responsibilities
New Partner Launch Configuration
● Set up and configure data pipelines for new partner eligibility files, ensuring that data transfer from SFTP servers to our systems is seamless and efficient.
● Validate and test the initial setup to guarantee data integrity and system compatibility.
● Write data format and file integration documentation to be shared with partners.
Ongoing Partner Maintenance
● Support ongoing marketing efforts for our existing partners (preparing new cohorts and marketing campaigns)
● Regularly update and modify pipeline processes to accommodate changes in data formats or partner requirements.
● Monitor data pipelines for performance issues and errors, implementing fixes and enhancements as needed.
● Building and maintaining automated partner reports, ensuring utilization data is passed back to our partners in a timely manner.
● Ensure secure and compliant data handling practices are maintained throughout all processes.
Pipeline Automation Projects
 
 ● Identify opportunities for automation within the existing data processes to reduce manual intervention and increase efficiency.
● Develop and deploy automation solutions to streamline data operations.
Skills / Experience
Technical
● BS/BA degree in Computer Science, Math, Physics, or a related field, or equivalent years of experience in a relevant field
● 3+ years development experience with Python
● 2+ year experience in SQL or similar languages
● Experience with ETL tools and methodologies, particularly in a cloud environment (AWS)
● Comfortable working in bash on linux systems
● Familiarity with SFTP and file encryption (PGP) for secure data exchange.
● Experience in handling and processing CSV files effectively, including data validation
and cleansing.
Problem-Solving
● Ability to troubleshoot and resolve data pipeline issues swiftly and effectively.
● Analytical skills to assess pipeline performance and identify improvement areas.
● Experience in managing small to medium-scale projects, including timeline
management, resource allocation, and documentation.
Collaboration
● Strong communication skills to interact clearly with both technical and non-technical stakeholders.
● Ability to work collaboratively with teams, maintaining transparency and ensuring continuity in project goals and guidelines

Job Category: Technical
Job Type: Contract
Job Location: Remote

Apply for this position

Allowed Type(s): .pdf, .doc, .docx
No Comments

Sorry, the comment form is closed at this time.