ZipRecruiter

Log In

1

Senior Data Pipeline Engineer Jobs (NOW HIRING)

MSR Technology Group

ETL Data Engineer

Springfield, IL · Remote

$113K - $136K/yr

S.) with Minimal travel (2-3x per year) Overview We're hiring a Senior Data Engineer to lead enterprise ETL modernization initiatives, transitioning legacy data pipelines (e.g., Informatica, on-prem ...

1 point system

Senior Data Engineer

Boca Raton, FL · On-site

$100K - $136K/yr

* Seeking a Senior Data Engineer to support and scale critical AI‑driven data initiatives powering ... Build and optimize micro‑batch data pipelines with refresh intervals of ~1-2 minutes * Ensure ...

VDart

Data Integration & Pipeline Engineer

Dallas, TX

$113K - $136K/yr

Data Integration & Pipeline Engineer Location: Dallas, TX 75206 - 3 days onsite Duration: 6 CTH The Data Integration & Pipeline Engineer builds and maintains reliable, scalable data pipelines that ...

Keylent Inc

Sr. Data Engineer

Lewisville, TX

$107K - $128K/yr

Sr. Data Engineer Role: Data Engineer Location: Seattle, WA / Lewisville, Texas Duration: Full Time ... Design, build and maintain scalable and high-performance data pipeline * Write clean, maintainable ...

Aquity Solutions

Senior Data Engineer

$108K - $147K/yr

Senior Data Engineer - (Remote) Position Overview IKS Health is seeking a Senior Data Engineer who ... Key Responsibilities Data Platform & Pipeline Engineering Design, develop, and maintain robust ELT ...

Ellisor Group

Senior Data Engineer

San Francisco, CA

$125K - $169K/yr

Senior Data Engineer Comp Range: 150-200K base USD + benefits etc.. No 3rd party/C2C Client is re ... pipeline -engineering non-QM-specific inputs for SAI's triage, hazard pricing, and defect detection ...

next page

Showing results 1-20

All JobsSenior Data Pipeline Engineer Jobs

Senior Data Pipeline Engineer information

See salary details

$81K

$126.3K

$175K

How much do senior data pipeline engineer jobs pay per year?

As of Jun 10, 2026, the average yearly pay for senior data pipeline engineer in the United States is $126,328.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,000.00 and $144,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Senior Data Pipeline Engineer, and why are they important?

To thrive as a Senior Data Pipeline Engineer, you need strong expertise in data engineering, programming (Python, Java, or Scala), and a solid understanding of ETL processes, often backed by a degree in computer science or a related field. Familiarity with big data tools such as Apache Spark, Kafka, Airflow, and cloud platforms like AWS or GCP, as well as relevant certifications, is typically required. Excellent problem-solving, collaboration, and communication skills help you work effectively with cross-functional teams and address complex data challenges. These skills and qualifications are crucial for building robust, scalable, and efficient data pipelines that support critical business analytics and decision-making.

What are some typical challenges Senior Data Pipeline Engineers face when ensuring data quality and reliability?

Senior Data Pipeline Engineers frequently encounter challenges such as handling large volumes of diverse data, ensuring timely and accurate data delivery, and implementing robust monitoring to detect failures early. Managing data consistency across distributed systems and balancing real-time processing with batch workloads are also common hurdles. Collaborating closely with data scientists, analysts, and DevOps teams is essential to resolve data quality issues and maintain reliable pipelines in a dynamic environment.

What is a Senior Data Pipeline Engineer?

A Senior Data Pipeline Engineer is a highly skilled professional responsible for designing, building, and maintaining the systems that move and process large amounts of data within an organization. They ensure data is collected, transformed, and made available to analysts, data scientists, and business applications in a reliable and efficient manner. Senior engineers typically lead projects, mentor junior staff, and make critical decisions about data architecture and technology choices. Their work is essential for organizations that rely on data-driven insights and operations.
More about Senior Data Pipeline Engineer jobs
What cities are hiring for Senior Data Pipeline Engineer jobs? Cities with the most Senior Data Pipeline Engineer job openings:
What are the most commonly searched types of Data Pipeline Engineer jobs? The most popular types of Data Pipeline Engineer jobs are:
What states have the most Senior Data Pipeline Engineer jobs? States with the most job openings for Senior Data Pipeline Engineer jobs include:
What job categories do people searching Senior Data Pipeline Engineer jobs look for? The top searched job categories for Senior Data Pipeline Engineer jobs are:
Senior Data Pipeline Engineer jobs near you

ETL Data Engineer

MSR Technology Group

Springfield, IL • Remote

$113K - $136K/yr

Full-time

Posted 18 days ago

Job description

Senior Data Engineer – Azure / Python ETL Modernization
Remote (U.S.) with Minimal travel (2–3x per year)
Overview
We’re hiring a Senior Data Engineer to lead enterprise ETL modernization initiatives, transitioning legacy data pipelines (e.g., Informatica, on-prem data warehouses) into modern Azure-based, Python-driven data platforms.
This is a hands-on engineering role focused on building scalable data pipelines, refactoring legacy logic into Python/PySpark, and delivering production-grade data solutions that support analytics, reporting, and downstream data use cases.
The right candidate will have a strong background in Python-based data engineering, Azure data services, and experience modernizing legacy ETL environments.
Core Responsibilities
ETL Modernization (Primary Focus)
  • Refactor and migrate legacy ETL pipelines (e.g., Informatica) into Python/PySpark-based pipelines
  • Translate business logic into scalable, code-driven transformations (not tool-based ETL)
  • Support large-scale migration from on-prem data warehouses to Azure
Data Pipeline Engineering
  • Build and maintain pipelines using Azure Data Factory, Synapse Pipelines, and/or Databricks
  • Develop reusable, parameter-driven frameworks for ingestion and transformation
  • Implement ELT patterns leveraging SQL pushdown and distributed processing
Python & Spark Development
  • Develop and optimize PySpark jobs for large-scale data processing
  • Write clean, testable Python code for transformation, orchestration, and data quality
  • Integrate with APIs and external data sources
Data Architecture & Modeling
  • Implement lakehouse architecture (ADLS Gen2, Delta Lake, Parquet)
  • Design dimensional models (star/snowflake) for analytics use
  • Handle SCD (Type 1/2), CDC, and complex transformation logic
Platform & DevOps
  • Build CI/CD pipelines using Azure DevOps (YAML, Terraform/Bicep)
  • Implement monitoring, logging, and alerting (Azure Monitor, Log Analytics)
  • Ensure security and access controls (RBAC, Key Vault, networking)
Required Skills
  • Strong hands-on experience with Python for data engineering (non-negotiable)
  • Solid experience with PySpark / Spark-based processing frameworks
  • Experience with Azure Data Factory, Synapse, or Databricks
  • Advanced SQL (complex transformations, optimization, performance tuning)
  • Experience working with modern data lakes (ADLS Gen2, Delta Lake)
  • Experience with ETL modernization or legacy system migration
  • Familiarity with CI/CD and DevOps practices in data engineering
Preferred Experience
  • Background migrating Informatica or similar ETL tools into Python-based frameworks
  • Experience with large enterprise data warehouse environments (Teradata, SQL Server, Oracle)
  • Exposure to regulated environments (healthcare, financial, etc.)
  • Snowflake experience is a plus
Why This Role Is Different
  • Focus on real modernization work, not legacy ETL maintenance
  • Heavy emphasis on Python-first data engineering
  • Opportunity to influence architecture and engineering standards
  • Long-term, high-impact enterprise data platform