1

Data Pipeline Jobs (NOW HIRING)

Senior Engineer Data, Pipeline Team

Schaumburg, IL · On-site

$103K - $141K/yr

Position Overview Join our Pipeline Team as a Senior Data Engineer - a role designed for a software engineer who thrives at the intersection of high-scale data and distributed systems. You won't just ...

Data Engineer - GCP

Atlanta, GA · On-site

$110K - $132K/yr

Data Pipeline Development and Management: * Design, build, and maintain scalable and reliable data pipelines using Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer. * Develop ETL/ELT processes to ...

Responsibilities Peraton seeks a ETL/DATA Pipeline Engineer as a Lead Associate to support Department of Defense Cyber Defense Command (DCDC) with DCO AI Cyber Security Support. Location: Fort Meade ...

Data Engineer

Kansas City, MO · On-site

$111K - $134K/yr

Responsibilities : • Own MFour's consumer-data pipeline -- the core engine behind insights hundreds of leading brands rely on. • Solve a genuinely hard problem: unifying real-time app, web ...

next page

Showing results 1-20

Data Pipeline information

See salary details

$24K

$123.1K

$200K

How much do data pipeline jobs pay per year?

As of Jun 7, 2026, the average yearly pay for data pipeline in the United States is $123,131.00, according to ZipRecruiter salary data. Most workers in this role earn between $85,000.00 and $155,500.00 per year, depending on experience, location, and employer.

What are some common challenges faced in Data Pipeline roles, and how are they addressed?

Professionals in Data Pipeline roles often encounter challenges such as handling large volumes of rapidly changing data, ensuring data quality, and minimizing downtime during data transfers. Addressing these issues typically involves implementing robust error-handling processes, automating data validation steps, and using scalable, resilient technologies. Collaboration with data analysts, software engineers, and business stakeholders is key to ensuring that pipelines meet organizational needs and remain flexible with evolving requirements. Continuous learning and adapting to new tools or frameworks also help Data Pipeline engineers stay ahead in this dynamic field.

What are the key skills and qualifications needed to thrive in the Data Pipeline position, and why are they important?

To excel in a Data Pipeline role, you need strong skills in data engineering, programming (often Python, Java, or Scala), and experience with ETL (Extract, Transform, Load) processes, usually supported by a degree in computer science or a related field. Familiarity with technologies such as Apache Spark, Hadoop, Airflow, Kafka, and cloud platforms like AWS or GCP, along with relevant data engineering certifications, is highly valuable. Strong problem-solving abilities, attention to detail, and effective communication skills are critical for success in this position. These technical and interpersonal skills are essential for building, maintaining, and optimizing reliable data workflows that support business decision-making.

What does a Data Pipeline job involve?

A Data Pipeline job involves designing, building, and maintaining systems that automate the flow of data from various sources to storage and processing destinations. It includes extracting data from databases, APIs, or streaming sources, transforming it into the desired format, and loading it into data warehouses, lakes, or analytics platforms. The role requires expertise in data engineering, ETL (Extract, Transform, Load) processes, cloud computing, and workflow orchestration tools. Strong knowledge of programming languages like Python or SQL and experience with frameworks like Apache Airflow or Spark is often essential. The goal is to ensure data is efficiently collected, processed, and made available for analysis and decision-making.

More about Data Pipeline jobs
What cities are hiring for Data Pipeline jobs? Cities with the most Data Pipeline job openings:
What are the most commonly searched types of Data Pipeline jobs? The most popular types of Data Pipeline jobs are:
What states have the most Data Pipeline jobs? States with the most job openings for Data Pipeline jobs include:
Senior Engineer Data, Pipeline Team

Senior Engineer Data, Pipeline Team

Paylocity

Schaumburg, IL • On-site

$103K - $141K/yr

Full-time

Posted 3 days ago


Paylocity rating

8.5

Company rating: 8.5 out of 10

Based on 34 frontline employees who took The Breakroom Quiz

46th of 425 rated business services


Job description

Description:

Location: Remote (Must be based anywhere in the Czech Republic)


About Paylocity

Paylocity is an award-winning provider of cloud-based HR and payroll software solutions, offering the most complete platform for the modern workforce. The company has become one of the fastest-growing HCM software providers worldwide by offering an intuitive, easy-to-use product suite that helps businesses automate and streamline HR and payroll processes, attract and retain talent, and build a strong workplace culture. While traditional HR and payroll providers automate basic HR processes such as payroll and benefits administration, Paylocity goes further by developing tools that HR and businesses need to compete for talent and deliver against the expectations of the modern workforce.


Want to develop the strategies and principles needed to deliver compelling software?

Join our team and help us enhance our all-in-one software platform, elevate our one-of-a-kind technology, and improve the employee experience.


Take your career to the next level at one of G2's Top 100 Software Companies. Explore our Product & Technology positions to see where you fit!


Position Overview
Join our Pipeline Team as a Senior Data Engineer - a role designed for a software engineer who thrives at the intersection of high-scale data and distributed systems. You won’t just be writing ETL; you will be engineering the high-performance delivery systems that power our customer-facing data products and serve as the governed source for our future Agentic AI initiatives. We are looking for a candidate who treats data as a product and infrastructure as code, applying rigorous software engineering principles (CI/CD, modular design, and automated testing) to solve complex puzzles in Snowflake optimization and native data-tier security.


Primary Responsibilities
The below represents the primary duties of the position, others may be assigned as needed. To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • Architect, implement, and manage complex data pipelines and storage solutions that deliver high-fidelity data directly to customer-facing applications and AI-ready endpoints.
  • Optimize data workflows for performance, scalability, and reliability, specifically solving the challenge of maintaining low-latency refresh rates while ensuring strict Snowflake cost-efficiency.
  • Design and deploy scalable architectural frameworks and shared platforms to solve foundational needs, such as implementing native Attribute-Based Access Control (ABAC) security models or automated governance tooling.
  • Deconstruct and solve multi-layered technical challenges in an effective and systematic manner, applying organized analysis and methodical execution to resolve intricate data engineering problems.
  • Lead projects related to modern integration, developing and extending internal tooling like reusable dbt packages, custom macros, and automated data-quality guardrails.
  • Mentor junior data engineers and enforce software engineering best practices, including modular design patterns, rigorous code reviews, and comprehensive documentation.
  • Work closely with stakeholders to define data strategy and solutions that natively support the broader ecosystem of modern metadata, governance, and AI-enabled workflows.

Education and Experience

  • Bachelor’s degree in a technical field (Computer Science, Engineering, or related). Master’s preferred.
  • 5+ years of experience in data engineering or software development, with a proven track record of building production-grade distributed systems.
  • Expertise with DBT and Snowflake, including a deep understanding of Snowflake internals, performance tuning, and cost-optimization strategies.
  • Strong knowledge of software development patterns, applying Python and “Infrastructure as Code” principles to the data domain (DRY, testing, modularity).
  • Expertise in big data streaming technologies and event-driven architectures (Kafka, AWS Kinesis, Eventbridge).
  • Experience in data modeling, real-time processing, and implementing complex, native security and access control models at scale.

Physical requirements

  • Ability to sit for extended periods: The role requires sitting at a desk or workstation for long periods, typically 7-8 hours a day.
  • Use of computer and phone systems: The employee must be able to operate a computer, use phone systems, and type. This includes using multiple software programs and inquiries simultaneously.

Paylocity is an equal-opportunity employer. Paylocity is committed to the full inclusion of all individuals. We recruit, train, compensate, and promote regardless of race, religion, color, national origin, sex, disability, age, veteran status, and other protected status as required by applicable law. At Paylocity, we believe diversity makes us better.


We embrace and encourage our employees' differences in age, culture, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion or spiritual belief, sexual orientation, socio-economic status, veteran status, and other characteristics that make our employees unique. We actively cultivate these differences through our employee resource groups (ERGs), employee experiences, perspectives, talents, and approaches to drive innovation in the software and services we provide our customers.


We comply with federal and state disability laws and make reasonable accommodations for applicants and employees with disabilities. To request reasonable accommodation in the job application or interview process, please contact Leave Benefits@paylocity.com. This email address is exclusively designated for such requests, aligning with federal and state disability laws. Please do not send resumes to this email address, as they will be removed.


#LI-Remote

Requirements:



What Paylocity employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom