ZipRecruiter

Log In

1

Data Engineer Airflow Jobs in Minnesota (NOW HIRING)

Stellar IT Group

Data Engineer

Minneapolis, MN · On-site

$119K - $143K/yr

Data Engineer Richfield, MN 55423 (Local - Hybrid 2 Days/Week) 12+ Months Contract Project ... Skills Overview: • SQL (5+ years) • Apache Airflow (Cloud Composer) (3+ years) • GCP ...

Ryan Companies

Data Engineer

Minneapolis, MN · On-site +1

$90K - $113K/yr

The Data Engineer will play a foundational role in building and maintaining the data infrastructure ... Composer or Apache Airflow. * Implement and manage both batch and real-time data streaming ...

Conch Technologies Inc

Senior Data Engineer

Minneapolis, MN · On-site

$110K - $150K/yr

Airflow, Dagster, or other orchestration tools * Healthcare or Health Insurance domain experience (Claims, Provider, Clinical, Payer) Ideal Candidate * Senior-level hands-on Data Engineer * Strong ...

Palomar Holdings, Inc.

Sr. Data Engineer

Edina, MN · On-site

$125K - $165K/yr

As a Senior Data Engineer at Palomar, you will lead the design, development, and optimization of ... Experience with orchestration tools (e.g., Airflow, dbt, Cloud Composer). * Strong problem-solving ...

Cargill

Sr. Data Engineer

Wayzata, MN · On-site

$116K - $139K/yr

... Airflow/Astronomer). Deep experience with modeling concepts like SCD and schema evolution. * Data ... Advanced programming skills in Python, Java, Scala, or similar languages. Expert-level proficiency ...

Cargill

Sr. Data Engineer

Wayzata, MN · On-site

$116K - $139K/yr

... Airflow/Astronomer). Deep experience with modeling concepts like SCD and schema evolution. * Data ... Advanced programming skills in Python, Java, Scala, or similar languages. Expert-level proficiency ...

Genesis10

Principal Data Engineer - Remote

Eagan, MN · On-site

$120 - $150/hr

Hands-on experience developing orchestration workflows using Apache Airflow and/or Cloud Composer ... Master's Degree in Computer Science, Engineering, Data Science, Statistics, or related field Google ...

Cargill

Sr. Data Engineer

Wayzata, MN

$116K - $139K/yr

... Airflow/Astronomer). Deep experience with modeling concepts like SCD and schema evolution. * Data ... Advanced programming skills in Python, Java, Scala, or similar languages. Expert-level proficiency ...

Ryan Companies

Senior Data Engineer

Minneapolis, MN · Hybrid

$11K - $144K/yr

... Composer or Apache Airflow. * Implement and manage both batch and real-time data streaming ... Platform Engineering and Automation * Build and maintain CI/CD pipelines for the automated testing ...

The Whiteside Agency

Senior Data Engineer

Saint Paul, MN

$139K - $230K/yr

Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to ... Experience building and operating pipeline orchestration with tools such as Apache Airflow and ...

next page

Showing results 1-20

All JobsData Engineer Airflow JobsData Engineer Airflow Jobs in Minnesota

Data Engineer Airflow information

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What are popular job titles related to Data Engineer Airflow jobs in Minnesota?

For Data Engineer Airflow jobs in Minnesota, the most frequently searched job titles are:

What job categories do people searching Data Engineer Airflow jobs in Minnesota look for?

The top searched job categories for Data Engineer Airflow jobs in Minnesota are:

What cities in Minnesota are hiring for Data Engineer Airflow jobs?

Cities in Minnesota with the most Data Engineer Airflow job openings:

Data Engineer Airflow jobs near you

Data Engineer

Stellar IT Group

Minneapolis, MN • On-site

$119K - $143K/yr

Contractor

Re-posted 12 days ago

Job description

Overview:
Data Engineer
Richfield, MN 55423 (Local - Hybrid 2 Days/Week)
12+ Months Contract
Project Description:
You will be part of the Myads reporting team responsible for building the measurement, reporting, and insights platform that powers Ads and the broader Retail Media Network. In this role, you will design, develop, and maintain scalable, reliable, and high-performance data solutions that enable advertisers, merchants, and internal teams to measure campaign performance and business impact.
As a Developer, you will build and enhance data pipelines, APIs, and cloud-based services on Google Cloud Platform (GCP) while contributing to the architecture and implementation of measurement platforms. You will collaborate closely with Product Management, Ads Engineering, Analytics, Data Science, and other cross-functional teams to deliver high-quality solutions that meet business needs and support growth objectives. You will participate in the full software development lifecycle, including design, implementation, testing, deployment, and ongoing optimization of data and measurement systems. This role is hybrid, which means you will work some days on site at the client's location and some days virtually from home.
Position Summary/Job Description:
Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.
Skills Overview:
• SQL (5+ years)
• Apache Airflow (Cloud Composer) (3+ years)
• GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
• Python (5+ years)
• Big Data (warehousing/processing concepts, performance)(5+ years)
• Postgres (3+)
Experience
• Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
• Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
• Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
• Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
• Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
• Integrate Postgres sources/targets
• Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.
What are some preferred/nice to have skills the manager is looking for?
• Who has worked in ads domain.
• Should be able to talk to stakeholders and understand the problem and solve it efficiently
• Preventing data quality issues before they impact users.
• Prioritizing projects and handling multiple requests.
Skills:
SQL,APACHE,PYTHON,GCP,POSTGRES

Apply