ZipRecruiter

Log In

1

Airflow Developer Jobs in California (NOW HIRING)

IDC Technologies

Data Engineer in Sunnyvale CA

Sunnyvale, CA · On-site

$134K - $161K/yr

Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow. Engineers will write data collection scripts, aggregation algorithms, and ...

IDC Technologies

Data Engineer in Sunnyvale CA

Sunnyvale, CA · On-site

$134K - $161K/yr

Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow. Engineers will write data collection scripts, aggregation algorithms, and ...

Info Way Solutions

DevOps Engineer

Fremont, CA · On-site

$58 - $79.25/hr

Info Way Solutions is a company looking for a DevOps Engineer. The role involves managing cloud ... Airflow. • CICD Pipeline • Build & Deployment process • Splunk Log Analysis • Linux & Unix ...

Xforia, Inc.

AWS Devops Engineer

Burbank, CA · On-site

$56.25 - $77/hr

Admin experience with Informatica PowerCenter or Developer. * Experience with Version Control ... Airflow -nice to have not a must.

Info Way Solutions

DevOps Engineer

Sunnyvale, CA · On-site

$61.50 - $84.25/hr

... Airflow. • Skills Required: CICD Pipeline, Build & Deployment process, Splunk Log Analysis, Linux & Unix Commands, Debugging Skills, Any of the one Scripting Language - Python or Ansible.

Info Way Solutions

DevOps Engineer

Fremont, CA · On-site

$58 - $79.25/hr

... Airflow. • Skills Required: CICD Pipeline, Build & Deployment process, Splunk Log Analysis, Linux & Unix Commands, Debugging Skills, Any of the one Scripting Language - Python or Ansible.

Info Way Solutions

Job Role : DevOps Engineer

Fremont, CA · On-site

$58 - $79.25/hr

Info Way Solutions is seeking a DevOps Engineer for a role involving immediate hiring. The position ... Apache Airflow. Qualifications : Required : • Strong in Ansible • Strong in Kubernetes • ...

Sarian, Inc.

Senior DevOps Engineer

Sunnyvale, CA · On-site

$152K - $196K/yr

... Airflow, Spark, Jupyter notebook, Ranger) Proficient in Python coding. Good experience with AWS and Kubernetes. Good experience using GitHub Manikanth Sarian Solutions, Inc. Ph: 732-790-2266 X 105 ...

Sarian, Inc.

Senior DevOps Engineer

Sunnyvale, CA · On-site

$154K - $199K/yr

... DevOps - using AWS, EKS, IAM, S3, Kubernetes, Kustomize, Flux, Crossplane, CRDs, Python, Github ... Superset, Airflow, Spark, Jupyter notebook, Ranger) • Proficient in Python coding. • Good ...

next page

Showing results 1-20

All JobsAirflow Developer JobsAirflow Developer Jobs in California

Airflow Developer information

What is an Airflow developer?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What are the key skills and qualifications needed to thrive as an Airflow developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

Does Airflow require coding?

Airflow developers typically need to have programming skills in Python, as workflows are defined using code. Coding knowledge is essential for creating, maintaining, and troubleshooting data pipelines in Airflow.

Is Airflow part of DevOps?

An Airflow Developer works with Apache Airflow, a platform used to programmatically author, schedule, and monitor workflows. While Airflow is often employed within DevOps environments to automate data pipelines and deployment processes, it is not inherently part of DevOps but complements DevOps practices by enabling automation and orchestration. Knowledge of CI/CD tools and infrastructure management is beneficial for such roles.

What are popular job titles related to Airflow Developer jobs in California?

For Airflow Developer jobs in California, the most frequently searched job titles are:

What job categories do people searching Airflow Developer jobs in California look for?

The top searched job categories for Airflow Developer jobs in California are:

What cities in California are hiring for Airflow Developer jobs?

Cities in California with the most Airflow Developer job openings:

Airflow Developer jobs near you
Infographic showing various Airflow Developer job openings in California as of August 2026, with employment types broken down into 84% Full Time, 6% Part Time, and 10% Contract. Highlights an 80% Physical, 5% Hybrid, and 15% Remote job distribution.

Python/Spark/Airflow Data Engineering Lead

ClifyX

San Jose, CA • On-site

Full-time

Re-posted 19 days ago

Job description

Job Summary:
ClifyX is a company seeking a Python/Spark/Airflow Data Engineering Lead. The role involves leading data engineering projects using Python, Apache Spark, and Apache Airflow, focusing on data processing and workflow orchestration.
Qualifications:
Required:
• Programming – Python and Java
• Data Processing – Apache Spark
• Workflow Orchestration – Apache Airflow
• Container Orchestration – Kubernetes
• Configuration Management – YAML
• Search & Analytics – Elasticsearch, Self install open search on CAE
• Data Ingestion – Logstash
• API Integration – Restful APIs
Company:
ClifyX provides innovative business solutions which satisfy requirements for mission-critical reliability, scalability, interoperations. Founded in 1998, the company is headquartered in South Plainfield, USA, with a team of 501-1000 employees. The company is currently Late Stage.
ClifyX logo

About ClifyX

Sourced by ZipRecruiter

ClifyX is a well-established player in the IT Services sector that specializes in providing result-oriented technological solutions to a wide range of industrial verticals. Based in South Plainfield, New Jersey, ClifyX offers a comprehensive selection of IT services that include project staffing, application development, professional consulting, and other IT-based solutions. While the company's website, clifyx.com, does not divulge the exact founding date, it is clear that ClifyX has grown into a renowned name within their domain, thanks to their unwavering commitment to innovative practices. The company's mission statement revolves around harnessing the power of technology to assist their clientele in steering their respective businesses towards success.

Industry

Recruiting and staffing services

Company size

51 - 200 Employees

Headquarters location

South Plainfield, NJ, US

Year founded

1998

View All ClifyX Jobs

Apply