Belmont, CA · On-site
$138K - $166K/yr
Omega Solutions, Inc. is seeking a Data Pipeline Engineer to contribute to their software development efforts. The role involves writing production quality software and working with various ...
Belmont, CA · On-site
$138K - $166K/yr
Omega Solutions, Inc. is seeking a Data Pipeline Engineer to contribute to their software development efforts. The role involves writing production quality software and working with various ...
Sunnyvale, CA · On-site
$150 - $250/hr
Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality. Required Experience * A proven ...
Sunnyvale, CA · On-site
$150 - $250/hr
Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality. Required Experience * A proven ...
Sunnyvale, CA · On-site
$150 - $250/hr
Responsible for architecting end‑to‑end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality. Required Experience * A ...
Sunnyvale, CA · On-site
$150 - $250/hr
Responsible for architecting end‑to‑end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality. Required Experience * A ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect andoptimizelarge-scaledistributed pipelines that process billions of images, video, and audio assetsthrough ML workflowsinto ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect andoptimizelarge-scaledistributed pipelines that process billions of images, video, and audio assetsthrough ML workflowsinto ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect and optimize large-scale distributed pipelines that process billions of images, video, and audio assets through ML workflows ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect and optimize large-scale distributed pipelines that process billions of images, video, and audio assets through ML workflows ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect andoptimizelarge-scaledistributed pipelines that process billions of images, video, and audio assetsthrough ML workflowsinto ...
WHAT YOU'LL DO OPTIMIZE DATA PROCESSING PIPELINES AT SCALE * Architect andoptimizelarge-scaledistributed pipelines that process billions of images, video, and audio assetsthrough ML workflowsinto ...
San Francisco, CA · On-site
$120 - $150/hr
A worn glove and a camera produce a raw demonstration, not training data. You will build the pipeline and the annotation operation that turn raw demonstrations into clean, labeled, training-ready ...
San Francisco, CA · On-site
$120 - $150/hr
A worn glove and a camera produce a raw demonstration, not training data. You will build the pipeline and the annotation operation that turn raw demonstrations into clean, labeled, training-ready ...
Sunnyvale, CA · On-site
$133 - $254/hr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133 - $254/hr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133 - $254/hr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133 - $254/hr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133K - $254K/yr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133K - $254K/yr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133K - $254K/yr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Sunnyvale, CA · On-site
$133K - $254K/yr
Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We develop the distributed system of a scalable data ...
Burbank, CA · On-site
$121K - $146K/yr
Data Engineer - Data Pipeline & ETL 46034 Overview and Responsibilities Job Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain ...
Burbank, CA · On-site
$121K - $146K/yr
Data Engineer - Data Pipeline & ETL 46034 Overview and Responsibilities Job Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain ...
Data Engineer - Data Pipeline & ETL 46034 Overview and Responsibilities Job Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain ...
Data Engineer - Data Pipeline & ETL 46034 Overview and Responsibilities Job Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain ...
Burbank, CA · On-site
$121K - $146K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
Burbank, CA · On-site
$121K - $146K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
$121K - $146K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
$121K - $146K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
Burbank, CA · On-site
$99 - $147/hr
Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this ...
Burbank, CA · On-site
$99 - $147/hr
Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this ...
San Francisco, CA · On-site
$134K - $161K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
San Francisco, CA · On-site
$134K - $161K/yr
Modern Data Pipeline Development * Build and maintain modular data components following established framework patterns. * Contribute to architectural decisions across streaming systems, data lakes ...
Santa Clara, CA · On-site
$74.75 - $96.25/hr
You are an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. What will you do :- * The Data Engineer will support our ...
Santa Clara, CA · On-site
$74.75 - $96.25/hr
You are an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. What will you do :- * The Data Engineer will support our ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
A Data Pipeline job involves designing, building, and maintaining systems that automate the flow of data from various sources to storage and processing destinations. It includes extracting data from databases, APIs, or streaming sources, transforming it into the desired format, and loading it into data warehouses, lakes, or analytics platforms. The role requires expertise in data engineering, ETL (Extract, Transform, Load) processes, cloud computing, and workflow orchestration tools. Strong knowledge of programming languages like Python or SQL and experience with frameworks like Apache Airflow or Spark is often essential. The goal is to ensure data is efficiently collected, processed, and made available for analysis and decision-making.
To excel in a Data Pipeline role, you need strong skills in data engineering, programming (often Python, Java, or Scala), and experience with ETL (Extract, Transform, Load) processes, usually supported by a degree in computer science or a related field. Familiarity with technologies such as Apache Spark, Hadoop, Airflow, Kafka, and cloud platforms like AWS or GCP, along with relevant data engineering certifications, is highly valuable. Strong problem-solving abilities, attention to detail, and effective communication skills are critical for success in this position. These technical and interpersonal skills are essential for building, maintaining, and optimizing reliable data workflows that support business decision-making.
Professionals in Data Pipeline roles often encounter challenges such as handling large volumes of rapidly changing data, ensuring data quality, and minimizing downtime during data transfers. Addressing these issues typically involves implementing robust error-handling processes, automating data validation steps, and using scalable, resilient technologies. Collaboration with data analysts, software engineers, and business stakeholders is key to ensuring that pipelines meet organizational needs and remain flexible with evolving requirements. Continuous learning and adapting to new tools or frameworks also help Data Pipeline engineers stay ahead in this dynamic field.
For Data Pipeline jobs in California, the most frequently searched job titles are:
The top searched job categories for Data Pipeline jobs in California are:
Cities in California with the most Data Pipeline job openings:
$138K - $166K/yr
Full-time
Re-posted 20 days ago
