1

Data Engineer Airflow Jobs in Minnesota (NOW HIRING)

Data Engineer

Minneapolis, MN ยท Hybrid

$50 - $55/hr

Data Engineer Richfield, MN 55423 (Local - Hybrid 2 Days/Week) 12+ Months Contract Project ... Apache Airflow (Cloud Composer) (3+ years) * GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ ...

Data Engineer

Minneapolis, MN ยท On-site

$119K - $143K/yr

Data Engineer Richfield, MN 55423 (Local - Hybrid 2 Days/Week) 12+ Months Contract Project ... SQL (5+ years) Apache Airflow (Cloud Composer) (3+ years) Google Cloud Platform (BigQuery, Dataflow ...

Data Engineer

Minneapolis, MN ยท On-site

$119K - $143K/yr

Data Engineer Richfield, MN 55423 (Local - Hybrid 2 Days/Week) 12+ Months Contract Project ... Skills Overview: โ€ข SQL (5+ years) โ€ข Apache Airflow (Cloud Composer) (3+ years) โ€ข GCP ...

Data Engineer

Eagan, MN ยท On-site

$95 - $110/hr

Experience building and supporting orchestration workflows using Apache Airflow and/or Google Cloud ... Relevant ETL or data engineering certifications. Experience with Confluent Kafka libraries or ...

Data Engineer

Minneapolis, MN ยท On-site +1

$75.75 - $83.33/hr

Senior experience with ETL and data pipeline tools such as Dataproc, Airflow, Dataform, dbt, or ... Strong communication and collaboration skills with the ability to work closely with engineering ...

Data Engineer

Minneapolis, MN ยท On-site +1

$90K - $113K/yr

The Data Engineer will play a foundational role in building and maintaining the data infrastructure ... Composer or Apache Airflow. * Implement and manage both batch and real-time data streaming ...

Senior Data Engineer

Eden Prairie, MN ยท On-site

$91K - $163K/yr

Growing together As a Senior Data Engineer, you will be responsible for developing complex data ... Create and maintain data pipelines using Airflow and Snowflake as primary tools * Develop SQL ...

Senior Data Engineer

Eden Prairie, MN ยท On-site

$91K - $163K/yr

Growing together As a Senior Data Engineer, you will be responsible for developing complex data ... Create and maintain data pipelines using Airflow and Snowflake as primary tools * Develop SQL ...

Data Engineer

Minneapolis, MN ยท On-site

$119K - $143K/yr

... * 3+ years of Apache Airflow (Cloud Composer) * 3+ years of Google Cloud Platform (BigQuery ... Strong understanding of data quality, performance tuning, and CI/CD

Senior Data Engineer

Minneapolis, MN ยท On-site

$110K - $150K/yr

Airflow, Dagster, or other orchestration tools * Healthcare or Health Insurance domain experience (Claims, Provider, Clinical, Payer) Ideal Candidate * Senior-level hands-on Data Engineer * Strong ...

Principal Data Engineer - Remote

Eagan, MN ยท On-site

$120 - $150/hr

Hands-on experience developing orchestration workflows using Apache Airflow and/or Cloud Composer ... Master's Degree in Computer Science, Engineering, Data Science, Statistics, or related field Google ...

Principal Data Engineer - Remote

Eagan, MN ยท On-site

$120 - $150/hr

Build and maintain ETL/ELT and streaming data pipelines using Apache Beam, Apache Airflow, Google ... Champion Agile software development, DevOps, CI/CD, and modern engineering practices * Translate ...

Sr Databricks Data Engineer

Minneapolis, MN ยท On-site

$119K - $143K/yr

... Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD) pipelines, and performance optimization of data engineering pipelines, code, and compute resources Ability ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Airflow and Apache Hadoop for scalable data processing and workflow management - Building and ...

next page

Showing results 1-20

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a Data Engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a Data Engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a Data Engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.
What are popular job titles related to Data Engineer Airflow jobs in Minnesota? For Data Engineer Airflow jobs in Minnesota, the most frequently searched job titles are:
What job categories do people searching Data Engineer Airflow jobs in Minnesota look for? The top searched job categories for Data Engineer Airflow jobs in Minnesota are:
What cities in Minnesota are hiring for Data Engineer Airflow jobs? Cities in Minnesota with the most Data Engineer Airflow job openings:

Full-time

Posted 25 days ago


Job description

Data Engineer | Eagan, Minnesota, United States Data Engineer - Tech Lead (GCP, Apache Beam, Airflow) Location: Eagan, MN (Remote Eligible) | Job Type: C2C About the Role Join a dynamic Rebate Data Warehouse team as a tech lead/principal data engineer. You'll drive strategic initiatives, lead engineering best practices, and mentor a collaborative team of nine data engineers. This is a rare opportunity to shape the future of our data platform, influence roadmap decisions, and play a key role in critical projects within a highly visible healthcare or financial environment. Responsibilities - Design, build, and optimize robust, scalable ETL/ELT data pipelines using GCP technologies, Apache Beam, Airflow, Python, and SQL - Lead technical decision-making, set engineering standards, and ensure data quality and reliability across the platform - Guide and mentor junior and mid-level engineers through code reviews, technical support, and knowledge sharing - Collaborate closely with product owners and stakeholders to develop and execute data engineering strategy - Drive continuous improvement and innovation within the Rebate Data Warehouse ecosystem Required Skills and Experience - Hands-on experience with GCP Data Engineering tools: Google Cloud Storage, BigQuery, Looker Studio, Cloud Composer, Gsutil, Dataplex - Deep knowledge of Apache Beam and Apache Airflow - Strong proficiency in Python and SQL for data processing and transformation - Proven track record using GitHub in a collaborative environment - Experience in PBM, healthcare, or financial industry data environments - Flexibility, adaptability, and excellent communication skills Preferred Skills - Java familiarity or experience - Exposure to SnapLogic Benefits - Opportunity to drive strategy and influence technology direction - Leadership and mentorship opportunities to advance your career - Collaborative, supportive team culture - Exposure to cutting-edge cloud and data technologies How to Apply Ready to take the lead in data engineering and make a real impact? Submit your resume today to join our high-performing team!

Indotronix logo

About Indotronix

Sourced by ZipRecruiter

In 1986, Indotronix established itself in the staffing space. 22 years later, Avani entered the scene, offering consulting and technology development. Finally, in 2016, the two joined forces to begin delivering talent across all areas, from Staffing to Consulting to unique platform development.

Industry

Recruiting and staffing services

Company size

1,001 - 5,000 Employees

Headquarters location

Rochester, NY, US