ZipRecruiter

Log In

1

Overnight Data Pipeline Engineer Jobs (NOW HIRING)

Tech Mahindra

$110 - $120/hr

Build and manage the AWS cloud infrastructure, CI/CD pipelines, serverless data ingestion, and observability platform for CQRE One Portal -- ensuring the application is securely deployed, scalable ...

previous pagenext page

Showing results 21-40

All JobsData Pipeline Engineer JobsOvernight Data Pipeline Engineer Jobs

Overnight Data Pipeline Engineer information

See salary details

$44.5K

$129.7K

$177.5K

How much do overnight data pipeline engineer jobs pay per year?

As of Sep 4, 2026, the average yearly pay for overnight data pipeline engineer in the United States is $129,716.00, according to ZipRecruiter salary data. Most workers in this role earn between $114,500.00 and $137,500.00 per year, depending on experience, location, and employer.

What is an overnight data pipeline engineer?

Overnight Data Pipeline Engineers are professionals responsible for managing, monitoring, and optimizing data pipelines during overnight hours. They ensure that data ingestion, transformation, and loading processes run smoothly while most business operations are offline. Their work is crucial for maintaining up-to-date data for analytics and reporting by the start of each business day. These engineers often troubleshoot issues, perform maintenance, and implement improvements to ensure data reliability and efficiency.

What are the key skills and qualifications needed to thrive as an overnight data pipeline engineer?

To thrive as an Overnight Data Pipeline Engineer, you need expertise in data engineering, ETL processes, and programming skills in languages like Python or Scala, often supported by a degree in computer science or a related field. Familiarity with data pipeline tools such as Apache Airflow, Spark, and cloud platforms (AWS, GCP, or Azure), as well as knowledge of database systems, is typically expected. Strong problem-solving abilities, attention to detail, and effective communication are crucial soft skills, especially for resolving issues during off-hours. These skills ensure the reliability, efficiency, and timely delivery of data critical for business operations that depend on overnight data processing.

What are some common challenges faced by overnight data pipeline engineers, and how can they be addressed?

Overnight Data Pipeline Engineers often encounter challenges such as monitoring and troubleshooting data flows during off-hours when fewer team members are available. This requires strong problem-solving skills and the ability to work independently to quickly resolve issues that might impact downstream analytics or operations. Effective communication with both day and night teams is crucial, as is maintaining detailed documentation to ensure smooth handoffs. Proactively setting up automated alerts and robust error handling can help minimize disruptions and ensure data reliability during overnight runs.

What is the difference between Overnight Data Pipeline Engineer vs Data Engineer?

AspectOvernight Data Pipeline EngineerData Engineer
Primary FocusDesigning, building, and maintaining data pipelines that run overnight or during off-peak hoursDeveloping and managing overall data architecture, including pipelines, databases, and data models
Work ScheduleTypically overnight shifts or off-hoursStandard business hours, with flexibility for project deadlines
Skills & CertificationsSQL, ETL tools, cloud platforms, scripting languages, certifications like AWS or GCPData modeling, programming, cloud skills, certifications in data management or cloud platforms

While both roles involve data pipeline development, the Overnight Data Pipeline Engineer specializes in managing pipelines during off-hours, focusing on operational stability. Data Engineers have a broader scope, including designing overall data systems and architecture. Both roles require similar technical skills and certifications, but their work schedules and specific responsibilities differ.

What cities are hiring for Overnight Data Pipeline Engineer jobs?

Cities with the most Overnight Data Pipeline Engineer job openings:

What are the most commonly searched types of Data Pipeline Engineer jobs?

The most popular types of Data Pipeline Engineer jobs are:

What states have the most Overnight Data Pipeline Engineer jobs?

States with the most job openings for Overnight Data Pipeline Engineer jobs include:

Overnight Data Pipeline Engineer jobs near you

MLOps Data Pipeline Engineer (Airflow & MLflow) - Q125

R2 Technologies Corporation

Alpharetta, GA • On-site

$111K - $134K/yr

Full-time

Medical, Retirement, PTO

Re-posted yesterday

Job description

Overview:
R2 Technologies Corporation (R2), headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial Intelligence (AI), Machine Learning (ML), software development, project management, SAP, and enterprise resource planning (ERP). We empower clients-from startups to Fortune 1000 companies-with scalable, platform-based solutions and data-driven insights using modern cloud technologies. Our commitment to blending highly skilled talent with innovative productivity platforms ensures rapid delivery of business value, making us one of the most respected and trusted technology companies in the United States. At R2, we're passionate about driving operational excellence and competitive advantage for our clients through cutting-edge AI, ML, and cloud solutions. Join our team and help shape the future of technology innovation!
MLOps Data Pipeline Engineer (Airflow & MLflow)
Location: Alpharetta, GA (willing to travel to client locations)
Employment Type: Full-Time (W2)
Role Overview
We are seeking a skilled MLOps Data Pipeline Engineer to build and manage machine learning pipelines using Airflow and MLflow. This role focuses on integrating Spark or Python-based data workflows for efficient model training and deployment.
Key Responsibilities
  • Design and implement machine learning pipelines using Airflow for orchestration and MLflow for model management.
  • Develop data workflows with Spark or Python to preprocess and feed data into ML models.
  • Automate MLOps processes for model training, validation, and deployment using Kubeflow or similar tools.
  • Collaborate with data scientists to monitor and optimize ML pipeline performance and accuracy.
  • Ensure data pipeline scalability, reliability, and governance in production environments.
  • Troubleshoot and resolve issues in data workflows to maintain seamless ML operations.

Required Qualifications
  • Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
  • 3 years of experience as a Data Engineer with a focus on MLOps and machine learning pipelines.
  • Proficiency in using Airflow for pipeline orchestration and MLflow for model lifecycle management.
  • Experience with Spark or Python for building scalable data workflows in ML environments.
  • Strong understanding of MLOps practices and their integration into data engineering pipelines.

Preferred Qualifications
  • Familiarity with Kubeflow for advanced MLOps workflows and Kubernetes-based deployments.
  • Exposure to cloud platforms like AWS or GCP for hosting MLOps pipelines.
  • Knowledge of data versioning tools like DVC for managing ML datasets and models.

Compensation & Benefits
  • Competitive salary and comprehensive benefits package (healthcare, PTO, 401k).
  • Opportunities for professional growth and upskilling in AI and cloud technologies.

R2 Technologies Corporation is an equal opportunity employer and values diversity in the workplace.
Skills:
Data Engineer, MLOps, Airflow, MLflow, Kubeflow, Spark, Python, Machine Learning Pipelines

Apply