ZipRecruiter

Log In

1

Data Engineer Airflow Jobs in Elgin, IL (NOW HIRING)

Apex Informatics

Data engineer

Chicago, IL · On-site

$118K - $141K/yr

Looking for 2 to 4 years of professional experience as a Data engineer Chicago, IL. Skills required ... SAAS, SQL, Snowflake and Airflow. * Strong SQL Skills: Proficiency in writing complex queries ...

1 point system

Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

... g., Airflow, Control-M) Automate data pipelines, deployments, and operational processes through CI/CD pipelines Leverage cloud-native services (AWS/Azure) for data processing, storage, and event ...

Omnicom

Senior Data Engineer

Chicago, IL · On-site

$109K - $148K/yr

Data Engineering WHO WE ARE: We are RAPP - world leaders in activating growth with precision and ... The ideal candidate is highly skilled in Python, Apache Airflow, AWS Lambda, DynamoDB, and dbt, and ...

Omnicom

Senior Data Engineer

Chicago, IL

$109K - $148K/yr

Data Engineering WHO WE ARE: We are RAPP - world leaders in activating growth with precision and ... The ideal candidate is highly skilled in Python, Apache Airflow, AWS Lambda, DynamoDB, and dbt ...

Excel Sports Management

Data Engineer

Chicago, IL · On-site

$100K - $115K/yr

The Excel Analytics team is growing, and we are seeking a Data Engineer to help build and maintain ... Experience with Apache Airflow or other workflow orchestration tools. * Familiarity with Terraform ...

The Hartford

Data Engineer

Chicago, IL · Hybrid

$100K - $151K/yr

Data Engineer - GE08AE We're determined to make a difference and are proud to be an insurance ... Experience in Automation tools (Autosys, Cron, Airflow, etc.) * Exposure to AWS Services (i.e. S3 ...

Donato Technologies Inc

Databricks Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

Experience with workflow tools (Airflow, Azure Data Factory, or Prefect) for scheduling and ... Engineer). · Experience with dbt (data build tool) and transformation testing. · Exposure to ...

Bcbsa

Data Engineer (AI/ML)

Chicago, IL

$118K - $141K/yr

Collaborate with platform and DevOps teams to deploy, scale, and monitor data pipelines using Airflow and Kubernetes. * Participate in code reviews, documentation, and continuous improvement efforts ...

Excel Sports Management

Data Engineer

Chicago, IL · On-site

$100K - $115K/yr

The Excel Analytics team is growing, and we are seeking a Data Engineer to help build and maintain ... Experience with Apache Airflow or other workflow orchestration tools. * Familiarity with Terraform ...

Excel Sports Management

Data Engineer

Chicago, IL · On-site

$100K - $115K/yr

The Excel Analytics team is growing, and we are seeking a Data Engineer to help build and maintain ... Experience with Apache Airflow or other workflow orchestration tools. * Familiarity with Terraform ...

Epsilon

Senior Data Engineer

Chicago, IL · On-site

$109K - $148K/yr

We are looking for a Senior Data Engineer to help build the next generation of our cloud data ... Experience with Kafka, Airflow, Docker, Kubernetes, relational and NoSQL databases, and enterprise ...

Fitch Group

Principal Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

Fitch Group is currently seeking a Lead/Principal Data Engineer based out of our Chicago office. As ... Deep hands-on experience with Apache Airflow, Snowflake (data warehousing, modeling, optimization ...

Fitch Solutions

Principal Data Engineer

Chicago, IL

$118K - $141K/yr

Fitch Group is currently seeking a Lead/Principal Data Engineer based out of our Chicago office. As ... Deep hands-on experience with Apache Airflow, Snowflake (data warehousing, modeling, optimization ...

Gerber Collision & Glass

Sr. Data Engineer

Elmhurst, IL · On-site

$114K - $136K/yr

Experience working with Apache Airflow for orchestrating analytics workload * Experience with IaC ... Multiple data engineering, cloud or talend related certifications * Experience with AWS EKS service ...

The Boyd Group

Sr. Data Engineer

Elmhurst, IL · On-site

$114K - $136K/yr

... with Apache Airflow for orchestrating analytics workload Experience with IaC solutions like ... data engineering, cloud or talend related certifications Experience with AWS EKS service, setting ...

The Boyd Group

Sr. Data Engineer

Elmhurst, IL · On-site

$114K - $136K/yr

... with Apache Airflow for orchestrating analytics workload Experience with IaC solutions like ... data engineering, cloud or talend related certifications Experience with AWS EKS service, setting ...

next page

Showing results 1-20

All JobsData Engineer Airflow JobsData Engineer Airflow Jobs in Elgin, IL

Data Engineer Airflow information

See Elgin, IL salary details

$44K

$128.2K

$175.5K

How much do data engineer airflow jobs pay per year?

As of Aug 22, 2026, the average yearly pay for data engineer airflow in Elgin, IL is $128,226.00, according to ZipRecruiter salary data. Most workers in this role earn between $113,200.00 and $135,900.00 per year, depending on experience, location, and employer.

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What are popular job titles related to Data Engineer Airflow jobs in Elgin, IL?

For Data Engineer Airflow jobs in Elgin, IL, the most frequently searched job titles are:

What job categories do people searching Data Engineer Airflow jobs in Elgin, IL look for?

The top searched job categories for Data Engineer Airflow jobs in Elgin, IL are:

What cities near Elgin, IL are hiring for Data Engineer Airflow jobs?

Cities near Elgin, IL with the most Data Engineer Airflow job openings:

Data Engineer Airflow jobs near you

Senior Workflow Orchestration Engineer (Airflow & Scheduling Platforms)

Benton Partners

Chicago, IL • On-site

$140 - $210/hr

Other

Posted 4 days ago

Job description

Senior Workflow Orchestration Engineer (Airflow & Scheduling Platforms)
  • NY or Chi, NYC
About therole

We'reseeking a seasoned engineer to design,operate, and scale our workflow orchestration platform with a primary focus on Apache Airflow.You'llown the Airflow control plane and developer experience end-to-end-architecture, automation, security, observability, and reliability-while also evaluating andoperatingcomplementary schedulers whereappropriate.You'llbuild automation infrastructure and partner across data, trading, and engineering teams to deliver mission-critical pipelines at scale.

Whatyou'lldo
  • Architect, deploy, andoperateproduction-grade Airflow on Kubernetes including all components and user application dependencies, with focus on upgrades, capacity planning, HA, security, and performance tuning
  • Operate a multi-scheduler ecosystem:determinewhen to use Airflow, distributed compute schedulers, or lightweight task runners based on workload requirements; provide unified developer experience across schedulers
  • Build automation infrastructure: Terraform modules and Helm charts withGitOps-driven CI/CD for environment provisioning, upgrades, and zero-downtime rollouts
  • Standardize the developer experience: DAG repo templates, shared operator libraries, connection and secrets management, dependency packaging, code ownership, linting, unit testing, and pre-commit hooks
  • Implement comprehensive observability: metrics collection, dashboards, distributed tracing, SLA/latency monitoring, intelligent alerting, and runbook automation
  • Enable resilient workflow patterns: build idempotency frameworks, retry/backoff strategies, deferrable operators and sensors, dynamic task mapping, and data-aware scheduling
  • Ensure reliability at enterprise scale: architect and tune resource allocation (pools, queues, concurrency limits) to support high-throughput workloads-optimizelarge-scale backfill strategies; develop comprehensive runbooks and lead incident response/postmortems
  • Partner with teams across the organization to provide enablement, documentation, and self-service tooling
  • Mentor engineers, contribute to platform roadmap and technical standards, and drive engineering best practices
Required qualifications
  • 5-8+ years building/operating data or platform systems; 3+ years running Airflow in production at scale (hundreds-thousands DAGs and high task throughput).
  • Deep Airflowexpertise: DAG design and testing, idempotency, deferrable operators/sensors, dynamic task mapping, task groups, datasets, pools/queues, SLAs, retries/backfills, cross-DAG dependencies.
  • Strong Kubernetes experience running Airflow and supporting services: Helm, autoscaling, node/pod tuning, topology spread, network policies, PDBs, and blue/green or canary strategies.
  • Automation-first mindset: Terraform, Helm,GitOps(Argo CD/Flux), and CI/CD for platform lifecycle; policy-as-code (OPA/Gatekeeper/Conftest) for DAG, connection, andsecretschanges.
  • Proficiencyin Python for authoring operators/hooks/utilities; solid Bash; familiarity with Go or Java is a plus.
  • Observability and SRE practices: Prometheus/Grafana/StatsD, centralized logging, alert design, capacity/throughput modeling, performance tuning.
  • Data platform experience with at least one major cloud (AWS/Azure/GCP) and systems like Snowflake/BigQuery/Redshift, Databricks/Spark, EMR/Dataproc; strong grasp of IAM, VPC networking, and storage (S3/GCS/ADLS).
  • Security/compliance: SSO/OIDC, RBAC,secretsmanagement (Vault/Secrets Manager), auditing, least-privilege connection management, and change control.
  • Proven incident leadership, runbook creation, and platform roadmap execution; excellent cross-functional communication.
Nice to have
  • Experience operating alternative orchestrators (Prefect 2.x,Dagster, Argo Workflows, AWS Step Functions) and leading migrations to/from Airflow.
  • OpenLineage/Marquez adoption; Great Expectations or other data quality frameworks; data contracts.
  • Cost optimization and capacity planning for schedulers and workers; spot instance strategies.
  • Multi-region HA/DR for Airflow metadata DB; backup/restore and disaster drills.
  • Building internal developer platforms/portals (e.g., Backstage) for self-service pipelines.
  • Contributions to Apache Airflow or provider packages; familiarity with recent AIPs/Airflow 2.7+ features.
#J-18808-Ljbffr

Apply