ZipRecruiter

Log In

1

Overnight Data Pipeline Engineer Jobs in Michigan

Brightwing

Pipeline Engineer

Detroit, MI

$50 - $60/hr

Pipeline Engineering experience in: part 192 utility work Synergi modeling regulator station design ... Develops models and analyzes data to support improvement programs, techniques and solutions.

Stellantis

Data Engineer

Auburn Hills, MI · On-site

$108K - $130K/yr

Data Engineering & Pipeline Development: * Design, build, and maintain secure, scalable data pipelines that support reporting, analytics, and machine learning initiatives * Develop and optimize ETL ...

Stellantis

Data Engineer

Auburn Hills, MI · On-site

$108K - $130K/yr

Data Engineering & Pipeline Development: * Design, build, and maintain secure, scalable data pipelines that support reporting, analytics, and machine learning initiatives * Develop and optimize ETL ...

Stellantis

Data Engineer

Auburn Hills, MI · On-site

$108K - $130K/yr

Data Engineering & Pipeline Development: * Design, build, and maintain secure, scalable data pipelines that support reporting, analytics, and machine learning initiatives * Develop and optimize ETL ...

Stellantis

Data Engineer

Auburn Hills, MI · On-site

$108K - $130K/yr

Data Engineering & Pipeline Development: * Design, build, and maintain secure, scalable data pipelines that support reporting, analytics, and machine learning initiatives * Develop and optimize ETL ...

Saransh Inc

GCP Data Engineer with Python

Dearborn, MI · On-site

$105K - $126K/yr

The engineer will work closely with cross-functional teams to build, optimize, and maintain data pipelines and workflows using GCP, Python, and ETL tools. Required Technical Skills: * Minimum 3+ ...

Ford Motor Company

Data Engineer

Dearborn, MI · On-site

$105K - $127K/yr

In this role, you will work on building scalable and robust data pipelines to process large volumes ... Data engineering, data product development and software product launches * At least three of the ...

Stonhard

$95K - $120K/yr

The Data Solutions Engineer is responsible for developing, maintaining, and enhancing enterprise ... Data Pipeline Development * Design, build, and maintain data pipelines for ingestion ...

New

Contact Government Services, LLC

Data Engineer

Detroit, MI · On-site

$113K - $136K/yr

Skills and attributes for success: -Complete development efforts across data pipeline to store ... engineering principles and practices such as API-first design, simple design, continuous ...

next page

Showing results 1-20

All JobsData Pipeline Engineer JobsOvernight Data Pipeline Engineer JobsOvernight Data Pipeline Engineer Jobs in Michigan

Overnight Data Pipeline Engineer information

What is an overnight data pipeline engineer?

Overnight Data Pipeline Engineers are professionals responsible for managing, monitoring, and optimizing data pipelines during overnight hours. They ensure that data ingestion, transformation, and loading processes run smoothly while most business operations are offline. Their work is crucial for maintaining up-to-date data for analytics and reporting by the start of each business day. These engineers often troubleshoot issues, perform maintenance, and implement improvements to ensure data reliability and efficiency.

What are the key skills and qualifications needed to thrive as an overnight data pipeline engineer?

To thrive as an Overnight Data Pipeline Engineer, you need expertise in data engineering, ETL processes, and programming skills in languages like Python or Scala, often supported by a degree in computer science or a related field. Familiarity with data pipeline tools such as Apache Airflow, Spark, and cloud platforms (AWS, GCP, or Azure), as well as knowledge of database systems, is typically expected. Strong problem-solving abilities, attention to detail, and effective communication are crucial soft skills, especially for resolving issues during off-hours. These skills ensure the reliability, efficiency, and timely delivery of data critical for business operations that depend on overnight data processing.

What are some common challenges faced by overnight data pipeline engineers, and how can they be addressed?

Overnight Data Pipeline Engineers often encounter challenges such as monitoring and troubleshooting data flows during off-hours when fewer team members are available. This requires strong problem-solving skills and the ability to work independently to quickly resolve issues that might impact downstream analytics or operations. Effective communication with both day and night teams is crucial, as is maintaining detailed documentation to ensure smooth handoffs. Proactively setting up automated alerts and robust error handling can help minimize disruptions and ensure data reliability during overnight runs.

What is the difference between Overnight Data Pipeline Engineer vs Data Engineer?

AspectOvernight Data Pipeline EngineerData Engineer
Primary FocusDesigning, building, and maintaining data pipelines that run overnight or during off-peak hoursDeveloping and managing overall data architecture, including pipelines, databases, and data models
Work ScheduleTypically overnight shifts or off-hoursStandard business hours, with flexibility for project deadlines
Skills & CertificationsSQL, ETL tools, cloud platforms, scripting languages, certifications like AWS or GCPData modeling, programming, cloud skills, certifications in data management or cloud platforms

While both roles involve data pipeline development, the Overnight Data Pipeline Engineer specializes in managing pipelines during off-hours, focusing on operational stability. Data Engineers have a broader scope, including designing overall data systems and architecture. Both roles require similar technical skills and certifications, but their work schedules and specific responsibilities differ.

What are the most commonly searched types of Data Pipeline Engineer jobs in Michigan?

The most popular types of Data Pipeline Engineer jobs in Michigan are:

What cities in Michigan are hiring for Overnight Data Pipeline Engineer jobs?

Cities in Michigan with the most Overnight Data Pipeline Engineer job openings:

Overnight Data Pipeline Engineer jobs near you

Pipeline Engineer

Brightwing

Detroit, MI

$50 - $60/hr

Full-time

Re-posted 15 days ago

Job description

Job Description Looking for the following in backgrounds: Distribution engineering Regulator station design Hydraulic modeling Sizing meters Working with regulators, valves and pressure pipes Looking for someone with more utilities Summary Senior level engineer responsible for planning and conducting intermediate to more complex engineering related activities requiring the use of creative techniques, as well as application of thorough knowledge of engineering or scientific principles and practice in multiple areas. Incumbents have the authority to makes decisions on engineering problems and methods applicable to the resolution of important issues, which may be complex at times. Participates on and leads teams, as well as develops effective relationships with key decision makers, as needed.

Pipeline Engineering experience in: part 192 utility work Synergi modeling regulator station design or natural gas distribution engineering Key Accountabilities Applies strong knowledge and background of engineering and scientific principles and practices in a variety of assignments. Develops, coordinates, and directs critical projects or field engineering assignments that are large or complex. Leads or plays key role on process improvement teams.

Initiates or performs engineering studies, proposing solutions or recommending alternatives. Develops presentations of engineering-related projects to stakeholders. Develops models and analyzes data to support improvement programs, techniques and solutions.

Conducts studies and analyses to assist in the resolution of engineering-related issues; may assist with developing engineering standards and practices. Mentors and provides guidance/direction for less experienced engineers. Minimum Education & Experience Requirements Bachelor's Degree in Engineering or Engineering Technology and a minimum of 4 - 6 years of job relevant experience.

Apply