ZipRecruiter

Log In

1

Weekend Data Pipeline Engineer Jobs in California

Wayve

Tech Lead, Ingestion Systems

Sunnyvale, CA · On-site

$276K - $293K/yr

Contribute to the hiring and onboarding processes to expand the capabilities of the data pipeline engineering team. About you In order to set you up for success at Wayve, we're looking for the ...

GEI Consultants

Data Engineer

Rancho Cordova, CA · On-site

$122K - $146K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... This includes building ingestion pipelines, managing data stores, implementing quality and ...

GEI Consultants

Data Engineer

Rancho Cordova, CA · On-site

$90K - $150K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... This includes building ingestion pipelines, managing data stores, implementing quality and ...

GEI Consultants

Data Engineer

Pasadena, CA · On-site

$90K - $150K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... This includes building ingestion pipelines, managing data stores, implementing quality and ...

YO AI Labs

Senior Data Engineer

Glendale, CA

$112K - $152K/yr

Qualifications: * 5+ years of data engineering experience developing large data pipelines * Proficiency in at least one major programming language. * Expertise on databricks and Python. * Hands-on ...

GEI Consultants

Data Engineer

Pasadena, CA · On-site

$124K - $150K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... This includes building ingestion pipelines, managing data stores, implementing quality and ...

Circadia Health

Data Engineer

El Segundo, CA · On-site

$122K - $146K/yr

Ensure pipelines are robust, fault-tolerant, and capable of handling large data volumes ... Collaborate with backend engineers to develop internal tooling for data ingestion, validation, and ...

Circadia Health

Data Engineer

El Segundo, CA · On-site

$122K - $146K/yr

Ensure pipelines are robust, fault-tolerant, and capable of handling large data volumes ... Collaborate with backend engineers to develop internal tooling for data ingestion, validation, and ...

BREVIAN

Data Engineer

Sunnyvale, CA · On-site

$133K - $160K/yr

Required : • Bachelor's degree in Computer Science, Engineering, or a related field. • 4+ years of experience in working with Data systems and Data pipeline, preferably for enterprise-level ...

The Marlin Alliance, Inc.

Data Engineer

San Diego, CA · On-site

$121K - $146K/yr

Responsibilities : • Build and optimize robust data pipelines: ingestion, transformation, storage ... engineer, database administrator, geospatial analyst, geospatial engineer, machine learning ...

Circadia Health

Data Engineer

El Segundo, CA

$150K - $220K/yr

Ensure pipelines are robust, fault-tolerant, and capable of handling large data volumes ... Collaborate with backend engineers to develop internal tooling for data ingestion, validation, and ...

UJET

AI Data Engineer

Los Angeles, CA

$123K - $148K/yr

This is a hybrid role that combines pre-sale technical scoping with hands-on data-pipeline engineering. You will be the customer's technical counterpart from the first discovery call through steady ...

UJET

AI Data Engineer

Los Angeles, CA · On-site

$123K - $148K/yr

This is a hybrid role that combines pre-sale technical scoping with hands-on data-pipeline engineering. You will be the customer's technical counterpart from the first discovery call through steady ...

Staffingine LLC

AWS Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

Job Title: AWS Data Engineer Job Location: San Francisco, CA Job Type: Contract * 7+ years of ... Strong background in designing, developing, and maintaining scalable data pipelines for ingestion ...

previous page

Showing results 41-60

All JobsData Pipeline Engineer JobsWeekend Data Pipeline Engineer JobsWeekend Data Pipeline Engineer Jobs in California

Weekend Data Pipeline Engineer information

What does a weekend data pipeline engineer do?

A Weekend Data Pipeline Engineer is responsible for designing, building, and maintaining data pipelines that process and move data efficiently, specifically during weekend shifts. They ensure data flows smoothly between systems, monitor performance, troubleshoot issues, and implement improvements. Their work supports data analysts, scientists, and other stakeholders who rely on timely and accurate data delivery. This role often requires expertise in ETL tools, programming, and cloud platforms, as well as availability for on-call or shift-based work during weekends.

What are the key skills and qualifications needed to thrive as a weekend data pipeline engineer, and why are they important?

To thrive as a Weekend Data Pipeline Engineer, you need a solid background in computer science, data engineering principles, and experience building and maintaining data pipelines, often supported by a relevant degree. Proficiency with ETL tools, cloud platforms like AWS or GCP, and data processing frameworks such as Apache Spark or Airflow is typically required. Strong problem-solving skills, attention to detail, and effective communication are vital soft skills for managing off-hours incidents and collaborating remotely. These skills and qualities ensure the reliability, efficiency, and scalability of data systems during critical weekend operations.

What are the unique challenges of working as a weekend data pipeline engineer, and how can I effectively manage them?

As a Weekend Data Pipeline Engineer, you may face challenges such as working with limited real-time support, handling system issues during off-peak hours, and managing updates or maintenance with minimal disruption. Success in this role often requires strong problem-solving skills, the ability to work independently, and clear documentation for handoff to weekday teams. Establishing proactive communication channels and automating monitoring or alerting systems can also help ensure smooth weekend operations and collaboration with your colleagues.
What are the most commonly searched types of Data Pipeline Engineer jobs in California? The most popular types of Data Pipeline Engineer jobs in California are:
What cities in California are hiring for Weekend Data Pipeline Engineer jobs? Cities in California with the most Weekend Data Pipeline Engineer job openings:
Weekend Data Pipeline Engineer jobs near you

Tech Lead, Ingestion Systems

Wayve

Sunnyvale, CA • On-site

$276K - $293K/yr

Full-time

Re-posted 7 days ago

Job description

The role
As the Technical Lead for Data Ingestion Systems within our Wayve Corpus division, you will play a pivotal role in Wayve's mission to revolutionise autonomous driving. Each day, our teams handle and process multiple petabytes of data collected from our fleet of autonomous vehicles and critical partner integrations.
Your technical leadership will directly impact our ability to transform vast amounts of raw data from diverse internal and external sources into structured, actionable insights that power advanced machine learning models and groundbreaking research. By continuously innovating our ingestion and processing pipelines, you'll help accelerate the development of safer, more efficient autonomous driving technologies, enabling Wayve to maintain its position at the forefront of embodied AI.
Key responsibilities
Technical Vision & Roadmap
  • Define and execute a strategic technical roadmap for enhancing and scaling data pipeline capabilities.
  • Drive innovation in pipeline architecture to support dynamic and evolving use-cases.

Pipeline Development & Innovation
  • Lead the design and implementation of advanced data pipeline features for efficient data ingestion, transformation, and distribution.
  • Normalise and unify multiple disparate data sources - including data ingested from external partners - into a consistent and optimised format tailored specifically for AI training and research needs.
  • Collaborate closely with robotics, ML engineering, and research teams to continuously enhance pipeline performance and functionality.
  • Develop robust interfaces and systems to reduce bottlenecks and improve reliability and scalability.

Operational Efficiency & Excellence
  • Establish and maintain best practices for pipeline reliability, including comprehensive observability, alerting, and monitoring systems.
  • Manage initiatives aimed at minimising pipeline latency, failure recovery, and ensuring compliance with defined service-level agreements (SLAs).

Collaboration & Cross-Functional Integration
  • Engage actively with cross-functional teams (robotics, ML, data governance) to ensure alignment of technical efforts with overall business goals.
  • Foster a culture of transparency, collaboration, and shared ownership across teams.

Team Development
  • Mentor and develop engineering talent, promoting professional growth and technical excellence within your team.
  • Contribute to the hiring and onboarding processes to expand the capabilities of the data pipeline engineering team.

About you
In order to set you up for success at Wayve, we're looking for the following skills and experience.
Essential skills
  • Strong experience (8+ years) in software engineering, specifically focused on developing and operating scalable, complex data pipelines, including at least 3+ years leading or architecting data engineering projects.
  • Proven technical leadership experience in a pipeline engineering or related domain.
  • Expertise in modern data pipeline architectures, including DAG-based orchestration (e.g., Airflow, Flyte, Ray).
  • Solid understanding of data engineering practices, distributed processing frameworks, and pipeline optimisation techniques.
  • Excellent communication and collaborative skills, capable of working effectively with interdisciplinary teams.
  • Track record of mentorship and talent development.
  • Bachelor's degree or higher in Computer Science, Engineering, or related technical discipline.

Desirable skills
  • Experience with robotics or autonomous vehicle sensor data processing pipelines.
  • Familiarity with third-party dataset ingestion and transformation.
  • Understanding of compliance and data governance frameworks (e.g., GDPR, TISAX, ASPICE).
  • Hands-on experience integrating observability and monitoring solutions.

This role is a full-time role based in Sunnyvale, CA (hybrid) and the reasonably estimated salary for this role ranges from $276,100 to $293,800, plus a competitive equity package. Actual compensation is based on the candidate's skills, qualifications, and experience.
#LI-HH1

Apply