1

Data Engineer Airflow Jobs in Minnesota (NOW HIRING)

Data Engineer

Eagan, MN ยท On-site

$116K - $140K/yr

Data Engineer | Eagan, Minnesota, United States Data Engineer - Tech Lead (GCP, Apache Beam, Airflow) Location: Eagan, MN (Remote Eligible) | Job Type: C2C About the Role Join a dynamic Rebate Data ...

New

Data Engineer

Saint Paul, MN ยท On-site

$101K - $130K/yr

Data Engineer * Full Time * Onsite/Hybrid Preferred Data Engineer provides technical leadership ... The ideal candidate has 2 to 5 years of experience using Orchestration tools (Apache Airflow) and ...

Data Engineer

Eagan, MN ยท On-site

$95 - $110/hr

Experience building and supporting orchestration workflows using Apache Airflow and/or Google Cloud ... Relevant ETL or data engineering certifications. Experience with Confluent Kafka libraries or ...

New

Data Engineer

Eagan, MN ยท On-site

$95 - $110/hr

Experience building and supporting orchestration workflows using Apache Airflow and/or Google Cloud ... Master's degree in Computer Engineering, Data Science, Statistics, or a related field.

New

Data Engineer

Minneapolis, MN ยท On-site +1

$90K - $113K/yr

The Data Engineer will play a foundational role in building and maintaining the data infrastructure ... Composer or Apache Airflow. * Implement and manage both batch and real-time data streaming ...

Senior Data Engineer

Eden Prairie, MN ยท On-site

$91K - $163K/yr

Growing together As a Senior Data Engineer, you will be responsible for developing complex data ... Create and maintain data pipelines using Airflow and Snowflake as primary tools * Develop SQL ...

Senior Data Engineer

Rochester, MN ยท On-site

$103K - $140K/yr

We are seeking a talented Senior Data Engineer to join our Advanced Data Lake (ADL) team. This is ... Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline ...

New

Senior Data Engineer

Minneapolis, MN ยท On-site

$110K - $150K/yr

Airflow, Dagster, or other orchestration tools * Healthcare or Health Insurance domain experience (Claims, Provider, Clinical, Payer) Ideal Candidate * Senior-level hands-on Data Engineer * Strong ...

Senior Data Engineer

Rochester, MN ยท On-site +1

$103K - $140K/yr

Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline ... A GCP Professional Data Engineer certification is required. Exemption Status Exempt Compensation ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Airflow and Apache Hadoop for scalable data processing and workflow management - Building and ...

Senior Data Engineer

Minnetonka, MN ยท On-site +1

$108K - $146K/yr

... data pipelines using Python, PySpark, and other modern programming languages to support both batch ... Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable ...

Senior Data Engineer

Minnetonka, MN ยท On-site

$108K - $146K/yr

... data pipelines using Python, PySpark, and other modern programming languages to support both batch ... Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable ...

Senior Data Engineer

Rochester, MN ยท On-site +1

$107K - $146K/yr

Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline ... A GCP Professional Data Engineer certification is required.

New

Senior Data Engineer

Rochester, MN ยท On-site +1

$103K - $140K/yr

Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline ... A GCP Professional Data Engineer certification is required.

New

next page

Showing results 1-20

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a Data Engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a Data Engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a Data Engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.
What are popular job titles related to Data Engineer Airflow jobs in Minnesota? For Data Engineer Airflow jobs in Minnesota, the most frequently searched job titles are:
What job categories do people searching Data Engineer Airflow jobs in Minnesota look for? The top searched job categories for Data Engineer Airflow jobs in Minnesota are:
What cities in Minnesota are hiring for Data Engineer Airflow jobs? Cities in Minnesota with the most Data Engineer Airflow job openings:
Data Engineer

$116K - $140K/yr

Full-time

Posted 4 days ago

New


Job description

Data Engineer | Eagan, Minnesota, United States Data Engineer - Tech Lead (GCP, Apache Beam, Airflow) Location: Eagan, MN (Remote Eligible) | Job Type: C2C About the Role Join a dynamic Rebate Data Warehouse team as a tech lead/principal data engineer. You'll drive strategic initiatives, lead engineering best practices, and mentor a collaborative team of nine data engineers. This is a rare opportunity to shape the future of our data platform, influence roadmap decisions, and play a key role in critical projects within a highly visible healthcare or financial environment. Responsibilities - Design, build, and optimize robust, scalable ETL/ELT data pipelines using GCP technologies, Apache Beam, Airflow, Python, and SQL - Lead technical decision-making, set engineering standards, and ensure data quality and reliability across the platform - Guide and mentor junior and mid-level engineers through code reviews, technical support, and knowledge sharing - Collaborate closely with product owners and stakeholders to develop and execute data engineering strategy - Drive continuous improvement and innovation within the Rebate Data Warehouse ecosystem Required Skills and Experience - Hands-on experience with GCP Data Engineering tools: Google Cloud Storage, BigQuery, Looker Studio, Cloud Composer, Gsutil, Dataplex - Deep knowledge of Apache Beam and Apache Airflow - Strong proficiency in Python and SQL for data processing and transformation - Proven track record using GitHub in a collaborative environment - Experience in PBM, healthcare, or financial industry data environments - Flexibility, adaptability, and excellent communication skills Preferred Skills - Java familiarity or experience - Exposure to SnapLogic Benefits - Opportunity to drive strategy and influence technology direction - Leadership and mentorship opportunities to advance your career - Collaborative, supportive team culture - Exposure to cutting-edge cloud and data technologies How to Apply Ready to take the lead in data engineering and make a real impact? Submit your resume today to join our high-performing team!

Indotronix logo

About Indotronix

Sourced by ZipRecruiter

In 1986, Indotronix established itself in the staffing space. 22 years later, Avani entered the scene, offering consulting and technology development. Finally, in 2016, the two joined forces to begin delivering talent across all areas, from Staffing to Consulting to unique platform development.

Industry

Recruiting and staffing services

Company size

1,001 - 5,000 Employees

Headquarters location

Rochester, NY, US