ZipRecruiter

Log In

1

Airflow Developer Jobs in New York (NOW HIRING)

SmartIPlace

Python Developer [Onsite]

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Python Developer Location: Jersey City, NJ Requirement: We're seeking an experienced Python ... Design and implement Airflow DAGs to manage complex interdependent ETL workflows. * Migrate ...

Resource Point LLC

DevOps Engineer

Manhattan, NY · Remote

$54 - $74/hr

... Title: DevOps Engineer Location: Manhattan, NY (Onsite / Offsite) Duration: 12+ Months with ... Experience in AWS Services Airflow EC2 AWS networking concepts VPC Subnets, NAT, S3, IAM , KMS, EMR ...

IMR Soft Llc

Scala Developer

New York, NY · On-site

$58 - $75.25/hr

Scala Developer Location: NYC, NY (Looking for only locals or near by who can do in person ... Experience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent ...

CAYS Inc

Data Engineer

Jersey City, NJ · On-site

$119K - $143K/yr

Must have: -Python -Apache Airflow/DBT -Communication, both written & verbal -Kubernetes -OpenShift -8+ years of experience We are seeking a highly skilled Senior Data Engineer with 8+ years of hands ...

Veracity Software Pvt. Ltd.

SQL Developer

Jersey City, NJ · On-site

$49.50 - $68/hr

The SQL Developer will work closely with technical leads and Product Owners to deliver data ... Airflow, Hadoop, Spark, Hive, Kafka, and Snowflake. • Develop and manage data pipelines for ...

WorkNovas LLC

Sr. Databricks (Pyspark) Developer

New York, NY · On-site

$59.50 - $78.75/hr

Sr. Databricks Developer FTE Only Location: NYC, NY Qualifications & Requirements * Experience 5+ ... Airflow, or dbt. Preferred Skills * Experience with large-scale data modernization programs

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... Airflow; integrate AI/ML models for advanced business insights. - Ensure solutions comply with ...

next page

Showing results 1-20

All JobsAirflow Developer JobsAirflow Developer Jobs in New York

Airflow Developer information

What is an Airflow developer?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What are the key skills and qualifications needed to thrive as an Airflow developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

Does Airflow require coding?

Airflow developers typically need to have programming skills in Python, as workflows are defined using code. Coding knowledge is essential for creating, maintaining, and troubleshooting data pipelines in Airflow.

Is Airflow part of DevOps?

An Airflow Developer works with Apache Airflow, a platform used to programmatically author, schedule, and monitor workflows. While Airflow is often employed within DevOps environments to automate data pipelines and deployment processes, it is not inherently part of DevOps but complements DevOps practices by enabling automation and orchestration. Knowledge of CI/CD tools and infrastructure management is beneficial for such roles.

What are popular job titles related to Airflow Developer jobs in New York?

For Airflow Developer jobs in New York, the most frequently searched job titles are:

What job categories do people searching Airflow Developer jobs in New York look for?

The top searched job categories for Airflow Developer jobs in New York are:

What cities in New York are hiring for Airflow Developer jobs?

Cities in New York with the most Airflow Developer job openings:

Airflow Developer jobs near you
Infographic showing various Airflow Developer job openings in New York as of August 2026, with employment types broken down into 81% Full Time, 6% Part Time, and 13% Contract. Highlights an 83% Physical, 5% Hybrid, and 12% Remote job distribution.

Airflow Orchestration - Solutions Architect

Precision Technologies Corp

Iselin, NJ • On-site

Contractor

Re-posted 15 days ago

Job description

Role: Airflow Orchestration - Solutions Architect

Location: Iselin NJ:  Hybrid (2-3 Days) / week

Type: Long Term Contract

Face to Face interview is must

The role:

The Solutions Architect specializing in Cloud Orchestration, will work with a small group of technologists and become a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform. In this role, he will engineer a wide range of use cases where, Apache Airflow sits at the center of the solution, with the goal of rapidly developing solutions for the use cases.

  • Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
  • Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
  • Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
  • Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
  • Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
  • Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
  • Collaborate to build reusable assets, automation tools, and documented best practices.
  • Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
  • Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys

Skills Required:

  • Experience with Apache Airflow in production environments.
  • Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
  • Proficiency in Python.
  • Knowledge of Azure cloud-native data architecture.
  • Demonstrated technical leadership on team projects.
  • Strong oral and written communication skills.
  • Willingness to learn new technologies and build reference implementations.
  • Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
  • Experience in integrating with Azure Data Factory pipelines.
  • Experience
  • Snowflake and Databricks experience.
  • Experience working with containers.
  • SQL experience.
  • Kubernetes experience, either on-premise or in the cloud.
  • Enterprise data experience in regulated environments.