1

Airflow Developer Jobs in Novato, CA (NOW HIRING)

Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

The ideal candidate should have hands-on experience with BigQuery, Apache Airflow, SQL, DBT (Data Build Tool), and Google Cloud Platform services . Required Skills * 5+ years (Developer) / 6-10 years ...

Senior DevOps Engineer

San Francisco, CA · On-site

$153K - $196K/yr

... Airflow, temporal on kubernetes and cloud. * Implement and harden operational tooling for ... About you: * 7+ years of experience in DevOps, Site Reliability Engineering (SRE), or ...

Senior DevOps Engineer

San Francisco, CA · On-site

$153K - $196K/yr

... Airflow, temporal on kubernetes and cloud. * Implement and harden operational tooling for ... About you: * 7+ years of experience in DevOps, Site Reliability Engineering (SRE), or ...

Work directly with Engineering, Operations, Battery Teams, Finance, and Supply Chain teams to ... Utilize dbt and Airflow as your toolkit to clean, transform, and move data into your application ...

We engineer and manufacture ground-breaking battery materials that significantly increase the ... Utilize dbt and Airflow as your toolkit to clean, transform, and move data into your application ...

We engineer and manufacture ground-breaking battery materials that significantly increase the ... Utilize dbt and Airflow as your toolkit to clean, transform, and move data into your application ...

Contribute to the Apache Airflow community by creating technical content and best practices ... Data Engineering Know-How: Familiarity with core data engineering concepts including orchestration ...

They are looking for an experienced Data Developer to design, develop, and maintain their data ... Airflow and Spark. • Have developed scalable, real-time data pipelines using Python/Scala, SQL ...

Snowflake Developer

San Francisco, CA · On-site

$134K - $162K/yr

Tranzeal Incorporated is a company focused on data engineering solutions, and they are seeking a ... Airflow, Matillion, Fivetran, or similar) • Familiarity with Python for data processing and ...

They are seeking a Software Engineer with strong experience in Apache technologies for both batch ... Airflow for workflow orchestration • Working knowledge of Apache Cassandra (NoSQL database) • ...

About The Role We're hiring a Quantitative Developer to help turn research ideas into ... Skill with git, Docker, and modern orchestration tools (Prefect, Airflow, etc.). * Early‑stage ...

Quantitative Developer

San Francisco, CA · On-site

$180K - $280K/yr

About the Role We're hiring a Quantitative Developer to help turn research ideas into production ... Skill with git, Docker, and modern orchestration tools (Prefect, Airflow, etc.). * Early-stage ...

Airflow, Dagster) for reliable, observable pipelines * Build and optimize large-scale data processing systems (batch + streaming where needed) * Partner closely with engineering and product to embed ...

AWS Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

AWS Data Engineer Location: San Francisco and jersey city ( 3 days onsite 2 days remote) look for ... Use Airflow and Step Functions to orchestrate complex data workflows. • Data Modeling: Work with ...

next page

Showing results 1-20

Airflow Developer information

See Novato, CA salary details

$20

$62

$95

How much do airflow developer jobs pay per hour?

As of Aug 25, 2026, the average hourly pay for airflow developer in Novato, CA is $62.04, according to ZipRecruiter salary data. Most workers in this role earn between $47.40 and $75.91 per hour, depending on experience, location, and employer.

What is an Airflow developer?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What are the key skills and qualifications needed to thrive as an Airflow developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

Does Airflow require coding?

Airflow developers typically need to have programming skills in Python, as workflows are defined using code. Coding knowledge is essential for creating, maintaining, and troubleshooting data pipelines in Airflow.

Is Airflow part of DevOps?

An Airflow Developer works with Apache Airflow, a platform used to programmatically author, schedule, and monitor workflows. While Airflow is often employed within DevOps environments to automate data pipelines and deployment processes, it is not inherently part of DevOps but complements DevOps practices by enabling automation and orchestration. Knowledge of CI/CD tools and infrastructure management is beneficial for such roles.

What are popular job titles related to Airflow Developer jobs in Novato, CA?

For Airflow Developer jobs in Novato, CA, the most frequently searched job titles are:

What cities near Novato, CA are hiring for Airflow Developer jobs?

Cities near Novato, CA with the most Airflow Developer job openings:

Infographic showing various Airflow Developer job openings in Novato, CA as of August 2026, with employment types broken down into 77% Full Time, 10% Part Time, and 13% Contract. Highlights an 79% Physical, 6% Hybrid, and 15% Remote job distribution, with an average salary of $129,035 per year, or $62 per hour.

Senior Software Engineer, Developer Platform

San Francisco, CA • On-site

Socket.dev
Network Security • 1 - 10 employees

$120 - $190/hr

Other

Posted 7 days ago


Job description

Company Introduction

At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.

We are seeking a highly skilled and motivated Senior Software Engineer to architect, build, and operate the workflow orchestration platforms that power Bot Auto's engineering and autonomy workloads. From simulation and machine learning training to data pipelines and CI/CD, our teams depend on reliable, scalable workflow systems to move fast. In this role, you will own one or a hybrid of orchestration platforms (such as Argo Workflows and Airflow), operate them at scale, and develop the internal platforms and abstractions built on top of them that make running complex workloads simple, observable, and cost-efficient.

Key Responsibilities
  • Architect, deploy, and operate workflow orchestration platforms (e.g., Argo Workflows, Airflow, or a hybrid) supporting simulation, machine learning and model training, data pipelines, CI/CD, and other general-purpose workloads.
  • Build internal platforms, abstractions, SDKs, and self-service tooling on top of orchestration engines to make authoring, running, and monitoring workflows simple and reliable for engineers.
  • Operate workflow platforms at scale on Kubernetes across cloud (AWS) and on-prem data center environments, handling scheduling, autoscaling, GPU and heterogeneous resources, and cross-cluster orchestration.
  • Ensure reliability, performance, and cost efficiency of workloads through observability, queuing and prioritization, retries, and resource optimization.
  • Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver fit-for-purpose pipelines.
  • Integrate workflow platforms with storage, data streaming and event systems, artifact and model registries, and CI/CD tooling.
  • Establish best practices, templates, and documentation for workflow authoring and operations; mentor engineers across the company.
  • Handle user-impacting issues promptly with clear communication — mitigate in the short term and follow up with durable long-term solutions.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
  • 5+ years of hands-on experience in platform engineering, infrastructure, DevOps, or SRE roles
  • Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems
  • Strong software development skills in one or more languages: Python, Go, Java, or JavaScript/TypeScript
  • Solid understanding of Kubernetes and distributed systems
Preferred Qualifications
  • Expert-level experience operating Argo Workflows, Airflow, and/or other engines (e.g., Prefect, Dagster, Temporal, Kubeflow Pipelines, Flyte)
  • Experience orchestrating ML training, simulation, or large-scale data and batch workloads, including GPU scheduling
  • In-depth Kubernetes experience (EKS, GKE, AKS, RKE2/Rancher) and cross-cluster orchestration
  • IaC tools proficiency, including Terraform, Pulumi, OpenTofu, or Ansible
  • Experience with data streaming and event platforms, including NATS JetStream, Kafka, Pulsar, or RabbitMQ
  • Familiarity with observability stacks: Prometheus, Grafana, Loki, OpenTelemetry, or comparable
  • Demonstrated ability to optimize workload cost and performance without compromising reliability.
#J-18808-Ljbffr