Bellevue, WA · On-site
$129K - $155K/yr
Knowledge of Big Data pipelines, Data Engineering * Working Knowledge of the MSBI stack on Azure * Working Knowledge of Azure Data factory, Azure Data Lake, and Azure Data lake storage * Hands-on in ...
Quick apply
Bellevue, WA · On-site
$129K - $155K/yr
Knowledge of Big Data pipelines, Data Engineering * Working Knowledge of the MSBI stack on Azure * Working Knowledge of Azure Data factory, Azure Data Lake, and Azure Data lake storage * Hands-on in ...
Tampa, FL · On-site
$108K - $129K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
Quick apply
Tampa, FL · On-site
$108K - $129K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
$119K - $143K/yr
Monitor data pipeline performance and troubleshoot issues as needed * Collaborate with data analysts, data scientists, and software engineers to understand data needs * Ensure data quality, integrity ...
$119K - $143K/yr
Monitor data pipeline performance and troubleshoot issues as needed * Collaborate with data analysts, data scientists, and software engineers to understand data needs * Ensure data quality, integrity ...
Irving, TX · On-site
$110K - $133K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
Quick apply
Irving, TX · On-site
$110K - $133K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
NJ · On-site
$116K - $140K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
NJ · On-site
$116K - $140K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
Jackson, NJ · On-site
$116K - $140K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
Quick apply
Jackson, NJ · On-site
$116K - $140K/yr
Design, develop, and maintain scalable data pipelines and ETL processes * Work extensively with MEM SQL (SingleStore) for real-time and large-scale data processing * Optimize database performance ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
Santa Clara, CA · On-site
$127K - $173K/yr
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in ...
$109K - $132K/yr
This role focuses heavily on ETL/ELT pipeline optimization, distributed data architectures, Python-based automation, platform governance, and operational scalability while serving as a technical ...
$109K - $132K/yr
This role focuses heavily on ETL/ELT pipeline optimization, distributed data architectures, Python-based automation, platform governance, and operational scalability while serving as a technical ...
Reston, VA · On-site
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and ...
Quick apply
Reston, VA · On-site
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and ...
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and ...
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and ...
You'll be a member of a 6-person Data Pipeline team, which plays a critical role within a broader 20+ person development organization. Together, the team supports a robust web-based platform that ...
You'll be a member of a 6-person Data Pipeline team, which plays a critical role within a broader 20+ person development organization. Together, the team supports a robust web-based platform that ...
Reston, VA · On-site
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME).You will work directly with government, technical, and industry stakeholders design, implement, and ...
Reston, VA · On-site
$119K - $143K/yr
S eeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME).You will work directly with government, technical, and industry stakeholders design, implement, and ...
$131K - $158K/yr
Develop and operate automated, end-to-end data pipelines, create and maintain data models and schemas, and contribute to the overall scalability, reliability, and security of the data platform.
$131K - $158K/yr
Develop and operate automated, end-to-end data pipelines, create and maintain data models and schemas, and contribute to the overall scalability, reliability, and security of the data platform.
San Francisco, CA · On-site
$134K - $162K/yr
Data Pipeline Development & Management: * Design, develop, and maintain scalable, reliable, and efficient ETL/ELT pipelines for batch and real-time data processing (e.g., MQTT/Kafka data ingestion)
San Francisco, CA · On-site
$134K - $162K/yr
Data Pipeline Development & Management: * Design, develop, and maintain scalable, reliable, and efficient ETL/ELT pipelines for batch and real-time data processing (e.g., MQTT/Kafka data ingestion)
Mclean, VA · On-site
$115K - $139K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Quick apply
Mclean, VA · On-site
$115K - $139K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Chantilly, VA · On-site
$117K - $140K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Quick apply
Chantilly, VA · On-site
$117K - $140K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Chantilly, VA · On-site
$117K - $140K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Chantilly, VA · On-site
$117K - $140K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
San Francisco, CA · On-site
$134K - $162K/yr
Overview: • AWS, Glue, PySpark, Redshift/S3, Data Modelling, Git • Strong experience in ETL/data pipeline development and data integration from FLEX, Agiloft, CARS systems. • Proficient in SQL ...
San Francisco, CA · On-site
$134K - $162K/yr
Overview: • AWS, Glue, PySpark, Redshift/S3, Data Modelling, Git • Strong experience in ETL/data pipeline development and data integration from FLEX, Agiloft, CARS systems. • Proficient in SQL ...
Herndon, VA · On-site
$117K - $141K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
Quick apply
Herndon, VA · On-site
$117K - $141K/yr
Data Pipeline Development & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources * Build and optimize data workflows ...
$24K - $40K
10% of jobs
$40K - $56K
9% of jobs
$56K - $72K
4% of jobs
$85.3K is the 25th percentile. Wages below this are outliers.
$72K - $88K
3% of jobs
$88K - $104K
5% of jobs
$104K - $120K
12% of jobs
The median wage is $127K / yr.
$120K - $136K
17% of jobs
$150.5K is the 75th percentile. Wages above this are outliers.
$136K - $152K
17% of jobs
$152K - $168K
12% of jobs
$168K - $184K
6% of jobs
$184K - $200K
5% of jobs
$24K
$123.1K
$200K
Professionals in Data Pipeline roles often encounter challenges such as handling large volumes of rapidly changing data, ensuring data quality, and minimizing downtime during data transfers. Addressing these issues typically involves implementing robust error-handling processes, automating data validation steps, and using scalable, resilient technologies. Collaboration with data analysts, software engineers, and business stakeholders is key to ensuring that pipelines meet organizational needs and remain flexible with evolving requirements. Continuous learning and adapting to new tools or frameworks also help Data Pipeline engineers stay ahead in this dynamic field.
To excel in a Data Pipeline role, you need strong skills in data engineering, programming (often Python, Java, or Scala), and experience with ETL (Extract, Transform, Load) processes, usually supported by a degree in computer science or a related field. Familiarity with technologies such as Apache Spark, Hadoop, Airflow, Kafka, and cloud platforms like AWS or GCP, along with relevant data engineering certifications, is highly valuable. Strong problem-solving abilities, attention to detail, and effective communication skills are critical for success in this position. These technical and interpersonal skills are essential for building, maintaining, and optimizing reliable data workflows that support business decision-making.
A Data Pipeline job involves designing, building, and maintaining systems that automate the flow of data from various sources to storage and processing destinations. It includes extracting data from databases, APIs, or streaming sources, transforming it into the desired format, and loading it into data warehouses, lakes, or analytics platforms. The role requires expertise in data engineering, ETL (Extract, Transform, Load) processes, cloud computing, and workflow orchestration tools. Strong knowledge of programming languages like Python or SQL and experience with frameworks like Apache Airflow or Spark is often essential. The goal is to ensure data is efficiently collected, processed, and made available for analysis and decision-making.
Job Title: Data Engineer
Location: Bellevue, WA
Job Type: Onsite/Remote: Hybrid
Job Description:
Mandatory Skills: Java, Python, Scala, Snowflake, Azure Blob, Azure Data Factory, Azure Functions, Azure SQL. Azure Synapse Analytics, Azure Data Lake, ANSI-SQL, Databricks, HDInsight
Good to Have Skills: Python, Azure BLOB, Azure Data Factory, AZURE DATA LAKE
Sourced by ZipRecruiter
Recruiting and staffing services
51 - 200 Employees
Atlanta, GA, US
2016
