1

Airflow Developer Jobs in California (NOW HIRING)

Data Engineer in Sunnyvale CA

Sunnyvale, CA · On-site

$134K - $161K/yr

Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow. Engineers will write data collection scripts, aggregation algorithms, and ...

AWS Devops Engineer

Burbank, CA · On-site

$56.25 - $77/hr

Admin experience with Informatica PowerCenter or Developer. * Experience with Version Control ... Airflow -nice to have not a must.

Senior DevOps Engineer

Sunnyvale, CA · On-site

$152K - $196K/yr

... Airflow, Spark, Jupyter notebook, Ranger) Proficient in Python coding. Good experience with AWS and Kubernetes. Good experience using GitHub Manikanth Sarian Solutions, Inc. Ph: 732-790-2266 X 105 ...

Senior DevOps Engineer

Sunnyvale, CA · On-site

$154K - $199K/yr

... DevOps - using AWS, EKS, IAM, S3, Kubernetes, Kustomize, Flux, Crossplane, CRDs, Python, Github ... Superset, Airflow, Spark, Jupyter notebook, Ranger) • Proficient in Python coding. • Good ...

Sr. Data Engineer

Santa Clara, CA · On-site

$150K - $220K/yr

  • Medical

  • Dental

  • Vision

  • PTO

Architect, develop, and deploy batch and streaming pipelines using Airflow and containerized ... Enforce software engineering best practices: CI/CD, code reviews, automated testing, and ...

Sr. Data Engineer

Santa Clara, CA · On-site

$150K - $220K/yr

  • Medical

  • Dental

  • Vision

  • PTO

Architect, develop, and deploy batch and streaming pipelines using Airflow and containerized ... Enforce software engineering best practices: CI/CD, code reviews, automated testing, and ...

Sr. Data Engineer

Santa Clara, CA · On-site

$150K - $220K/yr

  • Medical

  • Dental

  • Vision

  • PTO

Architect, develop, and deploy batch and streaming pipelines using Airflow and containerized ... Enforce software engineering best practices: CI/CD, code reviews, automated testing, and ...

DevOps Engineer:

Sunnyvale, CA · On-site

$61.50 - $84.25/hr

Info Way Solutions is a company seeking a DevOps Engineer. The role involves managing AWS resources ... Managed Airflow , DAG , VPC, subnets, ALB, NLB, etc since we use all of these in our day-to-day ...

Senior Data Engineer

San Jose, CA · On-site

$124K - $168K/yr

San Jose, California, United States Experience: 8 10 Years Job Summary We are seeking a Senior Data Engineer with strong expertise in Databricks , AWS , PySpark , and Apache Airflow to build scalable ...

next page

Showing results 1-20

Airflow Developer information

What is an Airflow developer?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What are the key skills and qualifications needed to thrive as an Airflow developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

What cities in California are hiring for Airflow Developer jobs?

Cities in California with the most Airflow Developer job openings:

Infographic showing various Airflow Developer job openings in California as of August 2026, with employment types broken down into 82% Full Time, and 18% Contract. Highlights an 94% In-person, 3% Hybrid, and 3% Remote job distribution.

Data Engineer (Python/pyspark/GCP/Airflow)

Redolent, Inc.

Sunnyvale, CA • On-site

$136K - $163K/yr

Contractor

Re-posted 8 days ago


Job description

We are actively looking for a Data Engineer In Sunnyvale CA or Remote
TITLE: Data Engineer
LOCATION: Sunnyvale CA or
Remote Duration: 6+ Months
Rate: DOE

Key skills - Apache Spark, Python, GCP, BigQuery, Dataflw, Airflow,
Description:
  • 7+ years of experience in Data engineering build, and maintain robust data pipelines using Apache Spark and Python.
  • Develop and manage workflow orchestration using Apache Airflow.
  • Implement scalable data solutions on Google Cloud Platform (GCP) using services like BigQuery, Cloud Storage, Dataflow, and Vertex AI. collaborate with data scientists to embed machine learning models into production-grade data pipelines. Ensure high performance, reliability, and scalability of data systems.
  • Monitor, troubleshoot, and optimize data workflows and ML model performance.
  • Maintain documentation and follow best practices for version control, testing, and deployment.

Redolent logo

About Redolent

Sourced by ZipRecruiter

Redolent, a dynamic and rapidly expanding company committed to excellence in software solutions, where success is fueled by a combination of technical expertise and efficient management practices. Our solutions create a measurable delta in our clients’ productivity and profitability, contributing to their growth and success.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

San Jose, CA, US

Year founded

2008

Social media