ZipRecruiter

Log In

1

Overnight Data Pipeline Engineer Jobs (NOW HIRING)

Exp Global Inc.

Senior Pipeline Engineer

Houston, TX · On-site

$90 - $120/hr

Senior Pipeline Engineer Your work environment at EXP In this role, you will be a part of the ... Will provide direction to junior/intermediate engineers to complete data analysis, drawing and ...

SpaceXAI

Gas Pipeline Engineer

Memphis, TN

We are seeking an exceptional Gas Pipeline Engineer to design, develop, and maintain high ... For details on data processing, view our Recruitment Privacy Notice.

Brightwing

Pipeline Engineer

Detroit, MI · On-site

$50 - $60/hr

Pipeline Engineering experience in: part 192 utility work Synergi modeling regulator station design ... Develops models and analyzes data to support improvement programs, techniques and solutions.

SpaceXAI

Gas Pipeline Engineer

Memphis, TN

We are seeking an exceptional Gas Pipeline Engineer to design, develop, and maintain high ... Direct experience supporting natural gas turbine power plants or data center/ hyperscale backup ...

exp

Senior Pipeline Engineer

Houston, TX · On-site

Be our next Senior Pipeline Engineer! Your work environment at EXP In this role, you will be a part ... Will provide direction to junior/intermediate engineers to complete data analysis, drawing and ...

SpaceXAI

Gas Pipeline Engineer

Memphis, TN · On-site

We are seeking an exceptional Gas Pipeline Engineer to design, develop, and maintain high ... For details on data processing, view our Recruitment Privacy Notice.

Monroe Energy

MIPC Pipeline Engineer

Aston, PA

Key Role Description The Pipeline Engineer sustains project management and integrity management for ... HCA) data, Environmental and many other inputs. * Assumes budgeting stewardship of OpEx/CapEx as ...

previous pagenext page

Showing results 21-40

All JobsData Pipeline Engineer JobsOvernight Data Pipeline Engineer Jobs

Overnight Data Pipeline Engineer information

See salary details

$44.5K

$129.7K

$177.5K

How much do overnight data pipeline engineer jobs pay per year?

As of Aug 14, 2026, the average yearly pay for overnight data pipeline engineer in the United States is $129,716.00, according to ZipRecruiter salary data. Most workers in this role earn between $114,500.00 and $137,500.00 per year, depending on experience, location, and employer.

What are some common challenges faced by overnight data pipeline engineers, and how can they be addressed?

Overnight Data Pipeline Engineers often encounter challenges such as monitoring and troubleshooting data flows during off-hours when fewer team members are available. This requires strong problem-solving skills and the ability to work independently to quickly resolve issues that might impact downstream analytics or operations. Effective communication with both day and night teams is crucial, as is maintaining detailed documentation to ensure smooth handoffs. Proactively setting up automated alerts and robust error handling can help minimize disruptions and ensure data reliability during overnight runs.

What is the difference between Overnight Data Pipeline Engineer vs Data Engineer?

AspectOvernight Data Pipeline EngineerData Engineer
Primary FocusDesigning, building, and maintaining data pipelines that run overnight or during off-peak hoursDeveloping and managing overall data architecture, including pipelines, databases, and data models
Work ScheduleTypically overnight shifts or off-hoursStandard business hours, with flexibility for project deadlines
Skills & CertificationsSQL, ETL tools, cloud platforms, scripting languages, certifications like AWS or GCPData modeling, programming, cloud skills, certifications in data management or cloud platforms

While both roles involve data pipeline development, the Overnight Data Pipeline Engineer specializes in managing pipelines during off-hours, focusing on operational stability. Data Engineers have a broader scope, including designing overall data systems and architecture. Both roles require similar technical skills and certifications, but their work schedules and specific responsibilities differ.

What are the key skills and qualifications needed to thrive as an overnight data pipeline engineer?

To thrive as an Overnight Data Pipeline Engineer, you need expertise in data engineering, ETL processes, and programming skills in languages like Python or Scala, often supported by a degree in computer science or a related field. Familiarity with data pipeline tools such as Apache Airflow, Spark, and cloud platforms (AWS, GCP, or Azure), as well as knowledge of database systems, is typically expected. Strong problem-solving abilities, attention to detail, and effective communication are crucial soft skills, especially for resolving issues during off-hours. These skills ensure the reliability, efficiency, and timely delivery of data critical for business operations that depend on overnight data processing.

What is an overnight data pipeline engineer?

Overnight Data Pipeline Engineers are professionals responsible for managing, monitoring, and optimizing data pipelines during overnight hours. They ensure that data ingestion, transformation, and loading processes run smoothly while most business operations are offline. Their work is crucial for maintaining up-to-date data for analytics and reporting by the start of each business day. These engineers often troubleshoot issues, perform maintenance, and implement improvements to ensure data reliability and efficiency.

What cities are hiring for Overnight Data Pipeline Engineer jobs?

Cities with the most Overnight Data Pipeline Engineer job openings:

What are the most commonly searched types of Data Pipeline Engineer jobs?

The most popular types of Data Pipeline Engineer jobs are:

What states have the most Overnight Data Pipeline Engineer jobs?

States with the most job openings for Overnight Data Pipeline Engineer jobs include:

Overnight Data Pipeline Engineer jobs near you

Principal Scientist - Data Pipeline Engineer

Adobe

San Francisco, CA • On-site

Full-time

Posted 27 days ago

Adobe rating

8.9

Company rating: 8.9 out of 10

Based on 10 frontline employees who took The Breakroom Quiz

39th of 244 rated software companies

Job description

ABOUT THE ROLE

We'relookingfor a PrincipalMLEngineer to architect and scale themultimodaldataprocessingpipelines and infrastructure behind Adobe Firefly's multimodal foundation models (image, video, audio). In this role,you'llsit at the intersection of data engineering and applied ML building distributed, GPU-accelerated systems that turn billions of raw assets into training-ready data at scale.

Your work will directlydeterminehow fast and how wellAdobemodels can learndirectlyimpactedbythe throughput and reliability of our data pipelines, and thequality of data that reaches training. This is a senior individual contributor role with broad technical influence across data, infrastructure, and modeling teams.

WHAT YOU'LL DO

OPTIMIZE DATA PROCESSING PIPELINES AT SCALE

  • Architect andoptimizelarge-scaledistributed pipelines that process billions of images, video, and audio assetsthrough ML workflowsinto training-ready data

  • Scale up inference throughput across the pipeline(batching, parallelism, hardwareutilization)to turn raw collected data into training data faster and more cheaply

  • Identifyandeliminatebottlenecks across ingestion, processing, and delivery, from storage and I/O to compute scheduling

ARCHITECTSCALABLE DATA INFRASTRUCTURE

  • Design systems that reliably store, index, and serve billions of data points, each requiring substantial processingspanning large-scale databases, distributed storage, and high-throughput compute

  • Apply deepexpertisein distributed systems and frameworks such as Ray (or equivalent) to orchestrate large-scale, GPU/CPU-heavy data workloads

  • Own architecture decisionsincludingdatabase and storage choices, job scheduling, GPU clusterutilizationthat let the platform scale alongside data and model growth

DRIVE DATA CURATION FOR MODEL TRAINING

  • Bring a strong ML background,especially inference optimization for VLMs and LLMsanddatacurationfor training

  • Partner closely with modeling teams to understand what dataimprovestraining outcomes, and translate that into pipeline and curation requirements

  • Operate as a hands-on technical leader who bridges data engineering and applied ML

WHAT YOU NEED TO SUCCEED

  • 10+ years of experience in data engineering, ML infrastructure, or distributed systems, including work at large scale (billions of records or assets)

  • Strong software engineering background, with hands-onexpertisein distributed systems and frameworks such as Ray, Spark, or equivalent large-scaledataprocessing frameworks

  • Proficiencyin Python, plus strong experience in a systems-level language (C++, Rust, Go, or Java) with strong debugging skills across distributed and ML-centric runtime environments.

  • Deep knowledge of databases and storage systems at scalesuch asdata lakes, indexing, and retrieval across billions of data points

  • Strong ML background, particularlyexpertiseinoptimizingGPU inference pipelines for VLMs, LLMs, or other large models (batching, quantization, serving, throughput/latency tradeoffs)

  • Experience with data curation for model training:understanding what makes data valuable for training generative or multimodal models, not just how to move it efficiently

  • Comfortoperatingacross the full stack, from low-level systems and GPU optimization to higher-level data strategy and curation decisions

  • Ability to communicate clearly and partner effectively across data, infrastructure, and modeling teams

  • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Machine Learning, or a related field

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe's industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We're on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours.


Let's Adobe together

At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.

Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.

Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call +1 408-536-3015.

AI Use Guidelines for Interviews:
Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.

At Adobe, we empower employees to innovate with AI - and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it's restricted during live interviews. See how we think about AI in the hiring experience.

Expected Pay Range:

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $206,300 -- $388,000 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $268,000 - $388,000 In Washington, the pay range for this position is $247,200 - $357,900

At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).

In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.

State-Specific Notices:

California:

Fair Chance Ordinances

Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances.

Colorado:

Application Window Notice

If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.

Massachusetts:

Massachusetts Legal Notice

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

What Adobe employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Adobe logo

About Adobe

Sourced by ZipRecruiter

Adobe for All is our vision to advance diversity, equity, and inclusion (DEI) across our company and in our communities. We’re focused on creating a more diverse and inclusive workforce; unleashing the full potential of every employee; and driving meaningful impact for Adobe, our industry, and society at large. Creativity has the power to unite us and inspire us to change the world. Through a vision we call Creativity for All, we’re empowering millions of people of all ages and backgrounds to express themselves, reach their full potential, and share their diverse perspectives with the world. We’re committed to advancing the responsible use of technology and driving a positive environmental impact through sustainability and climate action. Our innovations are making a significant impact across AI ethics, security, privacy, trust and safety, accessibility, and sustainability.

Industry

Computer and computer peripheral equipment and software wholesalers

Company size

10,000+ Employees

Headquarters location

San Jose, CA, US

Year founded

1982

View All Adobe Jobs

Apply