Senior Data Engineer (Python / AWS / ML Pipelines)

United StatesRemoteFull-timesenior

Data EngineerData

2 views0 saves0 applied

Apply Now

Quick Summary

Requirements Summary

Strong professional experience with Python and its application to data engineering and production systems.

Technical Tools

Data EngineerData

As a Senior Data Engineer, you will build and operate large-scale data and machine learning pipelines in a production environment.
You will work across data engineering, cloud infrastructure, and machine learning operations to turn models into reliable production workflows.
The role focuses heavily on Python, AWS, ETL, workflow orchestration, and scalable ML infrastructure.
You will collaborate closely with Data Scientists and ML Engineers to productionize forecasting and data-driven solutions.
You will also help improve the reliability, performance, and observability of critical data pipelines.
Working within distributed Agile teams, you will contribute to architecture decisions and technical improvements across the data platform.
This is an opportunity to work on challenging production systems while continuing to develop your cloud and ML engineering expertise.

Build, maintain, and improve production-grade data and machine learning pipelines supporting forecasting and data-driven decision-making.
Develop ETL and data-processing workflows using Python, ensuring they are scalable, reliable, and maintainable.
Design and orchestrate workflows using technologies such as Apache Airflow and AWS Step Functions.
Use AWS Glue for data processing, transformation, and pipeline execution.
Support the deployment and operationalization of machine learning models using AWS SageMaker.
Work closely with Data Scientists and ML Engineers to move models and analytical solutions reliably into production.
Monitor pipeline health and performance, troubleshoot production issues, and implement improvements to reliability, scalability, and efficiency.
Contribute to architectural and technical decisions related to the data platform, ML infrastructure, and production workflows.
Collaborate effectively with distributed, cross-functional Agile teams and contribute ideas that improve engineering practices and delivery.

Requirements

~1 min read

Strong professional experience with Python and its application to data engineering and production systems.
Proven experience building and maintaining data pipelines and/or machine learning pipelines in production.
Hands-on experience with Apache Airflow for workflow orchestration.
Practical experience with AWS Step Functions and AWS Glue.
Experience deploying and supporting machine learning models using AWS SageMaker.
Strong hands-on experience with AWS cloud services and cloud-based production environments.
Experience working with systems operating at significant scale, with a strong understanding of reliability and performance considerations.
Experience collaborating closely with Data Scientists, ML Engineers, and other technical stakeholders.
Strong troubleshooting, analytical, and problem-solving abilities.
Excellent written and verbal English communication skills.
Comfortable working independently and collaboratively within distributed, cross-functional teams.
Experience with GCP is a plus but not required.
Familiarity with monitoring and observability tools is also advantageous.