ZipRecruiter

Log In

1

Airflow Developer Jobs in Wisconsin (NOW HIRING)

Reign Mark Consulting Services, LLC

Good understanding of one core programming languages (Java or Python) * RDBMS (Well versed with SQL ... Any of Autosys, Cron Job, Airflow concepts * Messaging technologies - Kafka or IBM MQ

XeteX

Software Engineer - HVAC Systems

West Salem, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Holmen, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Holmen, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

La Crosse, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Trempealeau, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Onalaska, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Bangor, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Ettrick, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

Galesville, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XeteX

Software Engineer - HVAC Systems

La Crosse, WI · On-site

... Developer | Software Engineer - Thermodynamics & Airflow | Software Engineer - Fluid Dynamics Applications | HVAC Modeling Software Engineer | Software Engineer - Psychrometrics | Mechanical ...

XETEX LLC

Software Engineer - HVAC Systems

Holmen, WI · On-site

This role bridges software development and mechanical engineering by translating HVAC concepts such as airflow, heat transfer, psychrometrics, and system performance into accurate, scalable, and user ...

XeteX

Software Engineer - HVAC Systems

Holmen, WI · On-site

This role bridges software development and mechanical engineering by translating HVAC concepts such as airflow, heat transfer, psychrometrics, and system performance into accurate, scalable, and user ...

Bechtle

$120K - $144K/yr

... wie Apache Spark, Airflow, Kubernetes, Python, SQL, C und Unix Shell * Du entwickelst ... Du bringst dich aktiv beim Aufbau und der Weiterentwicklung von CI/CD-Prozessen im Data Engineering ...

Foxconn WI

Cooling System Engineer

Mount Pleasant, WI

$70K - $80K/yr

The Cooling System Engineer will collaborate with cross-functional teams--including mechanical ... Perform thermal analysis and computational fluid dynamics (CFD) modeling to evaluate airflow ...

KOHLS

Senior Data Engineer (Remote)

Menomonee Falls, WI · On-site

$123K - $162K/yr

About the Role As Senior Software Engineer, you will collaborate closely with design, product and ... Develop, automate, and maintain batch and streaming ETL pipelines using Apache Airflow, Apache ...

next page

Showing results 1-20

All JobsAirflow Developer JobsAirflow Developer Jobs in Wisconsin

Airflow Developer information

What are Airflow Developers?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

What are the key skills and qualifications needed to thrive as an Airflow Developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow Developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

Is Airflow in demand?

Airflow developers are in high demand due to the increasing need for data pipeline orchestration in organizations. Skills in Python, cloud platforms, and workflow management tools contribute to strong job prospects in this field.

What jobs in the US pay 300,000 a year?

For an Airflow Developer, earning $300,000 annually typically requires senior-level experience, specialized skills in data pipeline orchestration, and often working in large organizations or consulting roles. High salaries are common in roles involving complex data infrastructure, cloud platforms, and leadership responsibilities. Such compensation is less common for entry-level positions and usually involves additional bonuses or equity components.

What engineer makes $500,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, or cloud architecture can earn $500,000 or more annually, especially with extensive experience, advanced skills, and leadership roles. High compensation often includes bonuses, stock options, or profit sharing, particularly in large tech companies or startups with significant growth potential.

What jobs pay $500,000 a year in the US?

High-paying roles for Airflow Developers or similar data engineering professionals can reach or exceed $500,000 annually, especially with seniority, specialized skills, and experience in cloud platforms like AWS or GCP. Such compensation often includes base salary, bonuses, and stock options, typically found in senior or executive-level positions within large tech companies or financial institutions.
What are popular job titles related to Airflow Developer jobs in Wisconsin? For Airflow Developer jobs in Wisconsin, the most frequently searched job titles are:
What job categories do people searching Airflow Developer jobs in Wisconsin look for? The top searched job categories for Airflow Developer jobs in Wisconsin are:
What cities in Wisconsin are hiring for Airflow Developer jobs? Cities in Wisconsin with the most Airflow Developer job openings:
Airflow Developer jobs near you
Certified Cloud Engineer AWS

Certified Cloud Engineer AWS

NAVA Software Solutions

Madison, WI • On-site

$56.25 - $75/hr

Full-time

This job post has expired today. Applications are no longer accepted.

Job description

NAVA Software solutions is looking for a Certified Cloud Engineer/ AWS Engineer
Details:
Certified Cloud Engineer/ AWS Engineer
Location: Remote project (Need to be based in WI state)
Duration: 12 months
The Enterprise Analytics Platform (EAP) team supports the development and support of the data lake for the UW System Office and member universities. We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and optimizing data pipelines for our AWS Redshift-based data lake house. Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and movement of data from Workday to AWS Redshift for consumer and analytic use.
Key Responsibilities:
  • Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Assist with design and implementation of workflows using Airflow.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.

Required Qualifications and Skills:
  • Advanced hands-on experience designing AWS data lake solutions.
  • Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
  • Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
  • Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
  • Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
  • Experience with Airflow DAG creation.
  • Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
  • Ability to work in a highly complex python object oriented platform.
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
  • Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
  • Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
  • Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
  • Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.

Additional Useful Experience:
  • Docker
  • Airflow Server Administration
  • Parquet file formats
  • AWS Security
  • Jupyter Notebooks
  • API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
  • Git, Git flow best practices
  • Release management and DevOps
  • Shell scripting
  • AWS certifications related to data engineering or databases are a plus.
  • Experience with DevOps technologies and processes.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
  • Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
  • Experience working with large-scale, high-volume data environments.
  • Exposure to higher education, finance, and/or human resources data is a plus.
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media

Facebook

View All NAVA Software Solutions Jobs

Apply