ZipRecruiter

Log In

1

Airflow Developer Jobs in New York (NOW HIRING)

Empower Professionals

Data Engineer

Jersey City, NJ · On-site

$60/hr

Snowflake | SQL | Python | AWS | Oracle | Airflow | ETL/ELT | Data Warehousing | Data Modeling | Snowpark | AI/GenAI | Data Governance Summary: We are seeking a skilled Data Engineer to design ...

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... Airflow; integrate AI/ML models for advanced business insights. - Ensure solutions comply with ...

CYNET SYSTEMS

Python Developer

Rahway, NJ · On-site

$43 - $48/hr

Familiarity with DevOps practices (Git, Docker, infrastructure as code, observability, continuous ... Proficiency with DataBricks, DBT, and AirFlow. * Good interpersonal and communication skills ...

Man Group plc

Quant Developer

Manhattan, NY · On-site

The Role This is an engineering role sitting at the intersection of Man Group's Discretionary ... Kubernetes, Airflow * AI tooling: Claude Code, LLM agents, vector search, RAG -- we actively build ...

Man Group

Quant Developer

New York, NY · On-site

The Role This is an engineering role sitting at the intersection of Man Group's Discretionary ... Kubernetes, Airflow * AI tooling: Claude Code, LLM agents, vector search, RAG - we actively build ...

Phyton Talent Advisors

Senior Data Engineer

Jersey City, NJ · On-site

$110K - $150K/yr

Build and manage workflow orchestration using TWS/ Apache Airflow. * Ensure data quality ... Bachelor''s degree in Computer Science, Engineering, Information Systems, or a related field. * 5+ ...

New

LiveRamp

Senior DevOps Engineer

Manhattan, NY · On-site

$143K - $183K/yr

The Senior DevOps Engineer will design and optimize big data infrastructure, enhance CI/CD ... Airflow, temporal on kubernetes and cloud. • Implement and harden operational tooling for ...

Jain Global

Front Office Developer

New York, NY · On-site

$200K - $225K/yr

... using airflow; modelling trades in FX rates and futures by incorporating volatility; performing developer operations and deployment in Linux Ubuntu environments using Jenkins or GitHub actions ...

MM International

SQL Developer

Jersey City, NJ · On-site

$47.25 - $64.75/hr

... Airflow, Hadoop, Spark, Hive, Kafka, and Snowflake. * Programming skills in languages like Scala ... Pyspark/SparkSQL. * Experience in deep data analysis, triaging, identifying data gaps, patterns ...

Covetus, LLC

Databricks Python Developer

Manhattan, NY · On-site

$55.50 - $76.25/hr

Must Have Technical/Functional Skills: • 10+ years of experience in Data Engineering, Data ... such as Airflow, ADF, or similar. • Experience with Git, CI/CD, and Agile development ...

Treeswift Inc

Senior Dev Ops Engineer

New York, NY · On-site

$142K - $182K/yr

We run Apache Airflow on Astronomer with DAGs that orchestrate high-volume processing across AWS ... DevOps (ideally in a cloud environment). * Ability to reason about architecture end-to-end and ...

previous pagenext page

Showing results 21-40

All JobsAirflow Developer JobsAirflow Developer Jobs in New York

Airflow Developer information

What is an Airflow developer?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

What are the key skills and qualifications needed to thrive as an Airflow developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.
What are popular job titles related to Airflow Developer jobs in New York? For Airflow Developer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Airflow Developer jobs in New York look for? The top searched job categories for Airflow Developer jobs in New York are:
What cities in New York are hiring for Airflow Developer jobs? Cities in New York with the most Airflow Developer job openings:
Airflow Developer jobs near you
Infographic showing various Airflow Developer job openings in New York as of August 2026, with employment types broken down into 79% Full Time, and 21% Contract. Highlights an 92% In-person, 4% Hybrid, and 4% Remote job distribution.

Sr. Developer - MDV115

Avani Technology Solutions, Inc.

Jersey City, NJ • On-site

Contractor

Re-posted 9 days ago

Job description

Remote
1.Job title COGNIZANT IS LOOKING FOR SR ARCHITECT 2.Job summary 10 to 12 Yrs experience Design Highly scalable Data processing systems with native ML capabilities • Thorough knowledge of DataOps and hands-on experience with one or more DataOps tools like Streamsets or Apache Airflow or Apache Kafka • Design and create end to end Data pipelines covering reporting stages • Design hybrid and multi-cloud data processing solutions • Hands-on data migration experience across on-prem and multi cloud stacks 3.Experience 13to15yrs 4.Required Skills Technical Skills- 3.Experience 12to14yrs 4.Required Skills Technical Skills- ,SQL Scripting,Unix Shell Scripting,Apache Hadoop Domain Skills- 5.Nice to have skills Techincal Skills- ,Core Java Domain Skills- 6.Technology Data Management 7.Shift Day 8.Roles & Responsibilities 10 to 12 Yrs experience Design Highly scalable Data processing systems with native ML capabilities • Thorough knowledge of DataOps and hands-on experience with one or more DataOps tools like Streamsets or Apache Airflow or Apache Kafka • Design and create end to end Data pipelines covering reporting stages • Design hybrid and multi-cloud data processing solutions • Hands-on data migration experience across on-prem and multi cloud stacks 3.Experience 13to15yrs 4.Required Skills Technical Skills- ,Kafka,Apache Airflow,Streamsets Domain Skills- 5.Nice to have skills Techincal Skills- Domain Skills- 6.Technology Data Management 7.Shift Day 9 TO 6 8.Roles & Responsibilities • Through knowledge of streaming data processing and ability to design streaming data pipelines • 1 to 3 years experience in training ML models and building ML pipelines • High-end data modelling experience • GCP certified data engineer or equivalent certification / training 9.Job Location Primary: USNJNEJC01-New Jersey - NJ USA, CLT Alternate: 9.Job Location Primary: USNJNEJC01-New Jersey - NJ USA, CLT Alternate: , 10.Job Type 60CW00 Business Associate 11.Demand Requires Travel? N 12.Certification(s) Required NA
COVID-19 Vaccination Requirement: Please note that, where allowed by local law, Cognizant requires associates of all Cognizant entities, subsidiaries, and joint ventures, including non-integrated business, as well as contractors, to be fully vaccinated against COVID-19 if or when their role requires them to conduct business face-to-face. This includes any role that necessitates presence at a Cognizant or client site, in-person event or meeting, or business travel. In accordance with local law, vaccination will also be required when mandated by a client or the country government, regardless of work location.
New hires will be asked to attest to their vaccination status and upload proof of vaccination as applicable after joining.
Additional Sills: Skills:
Category
Name
Required
Importance
Experience
No items to display.

Apply