ZipRecruiter

Log In

1

Airflow Developer Jobs in California (NOW HIRING)

IDC Technologies

Data Engineer in Sunnyvale CA

Sunnyvale, CA · On-site

$134K - $161K/yr

Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow. Engineers will write data collection scripts, aggregation algorithms, and ...

IDC Technologies

Data Engineer in Sunnyvale CA

Sunnyvale, CA · On-site

$134K - $161K/yr

Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow. Engineers will write data collection scripts, aggregation algorithms, and ...

Xforia, Inc.

AWS Devops Engineer

Burbank, CA · On-site

$56.25 - $77/hr

Admin experience with Informatica PowerCenter or Developer. * Experience with Version Control ... Airflow -nice to have not a must.

Xforia Inc

AWS Devops Engineer

Burbank, CA · On-site

$56.50 - $77.25/hr

Admin experience with Informatica PowerCenter or Developer. * Experience with Version Control ... Airflow -nice to have not a must.

Sarian, Inc.

Senior DevOps Engineer

Sunnyvale, CA · On-site

$152K - $196K/yr

... Airflow, Spark, Jupyter notebook, Ranger) Proficient in Python coding. Good experience with AWS and Kubernetes. Good experience using GitHub Manikanth Sarian Solutions, Inc. Ph: 732-790-2266 X 105 ...

Sarian, Inc.

Senior DevOps Engineer

Sunnyvale, CA · On-site

$154K - $199K/yr

... DevOps - using AWS, EKS, IAM, S3, Kubernetes, Kustomize, Flux, Crossplane, CRDs, Python, Github ... Superset, Airflow, Spark, Jupyter notebook, Ranger) • Proficient in Python coding. • Good ...

WATI

BI & Big Data Developer

Rancho Cordova, CA · On-site

$57.50 - $74.50/hr

BI & Big Data Developer Location: Rancho Cordova, CA Duration: 9+ months Onsite Role Client is ... Languages: o Python including PySpark o T-SQL / SQL Apache Spark, Apache Airflow, and related ...

Info Way Solutions

Python Developer

Fremont, CA · On-site

$55 - $75.75/hr

Kindly check the JD and share your views Python Developer (with Devops Experience) Sunnyvale, CA ... Professional experience with Splunk, Flink, Jupyter Notebook, Apache Airflow (and related ...

Intuitive

Platform automation Engineer

Sunnyvale, CA · On-site

... Airflow). Bridge data engineering and application development teams while systematically reducing operational overhead. Job Responsibilities • Identify and prioritize automation opportunities by ...

next page

Showing results 1-20

All JobsAirflow Developer JobsAirflow Developer Jobs in California

Airflow Developer information

What are Airflow Developers?

Airflow Developers are professionals who design, build, and maintain data workflows using Apache Airflow, an open-source platform for orchestrating complex computational workflows and data processing pipelines. They are responsible for writing, scheduling, and monitoring tasks (DAGs) that automate data movement and transformation across systems. Airflow Developers work closely with data engineers, analysts, and other stakeholders to ensure reliable and efficient data pipeline automation. Their expertise includes Python programming, Airflow configuration, troubleshooting, and best practices for scalable workflow management.

What is the difference between Airflow Developer vs Data Engineer?

AspectAirflow DeveloperData Engineer
Required CredentialsKnowledge of Apache Airflow, Python, SQLData modeling, SQL, Python, cloud platforms
Work EnvironmentFocus on workflow orchestration, automationData pipeline development, storage, processing
Industry UsageTech, finance, healthcare for workflow automationBroad industries for data infrastructure

While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.

What are the key skills and qualifications needed to thrive as an Airflow Developer, and why are they important?

To thrive as an Airflow Developer, you need strong programming skills in Python, experience with data pipelines, and a solid understanding of workflow orchestration concepts. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and version control systems such as Git are typically required, along with knowledge of containerization tools like Docker. Analytical thinking, attention to detail, and effective communication are key soft skills for collaborating with data teams and troubleshooting complex workflows. These competencies ensure reliable, scalable, and maintainable data pipeline solutions that support organizational data needs.

What are some common challenges Airflow Developers face when managing complex data pipelines, and how can these be addressed?

Airflow Developers often encounter challenges such as managing dependencies between tasks, handling large-scale workflows, and ensuring reliable pipeline execution. To address these, it's essential to design modular DAGs (Directed Acyclic Graphs), implement robust error handling, and use features like sensors and retries strategically. Collaboration with data engineers and stakeholders is also key for troubleshooting and optimizing workflows. Effective monitoring and logging practices further help in quickly identifying and resolving issues.

Is Airflow in demand?

Airflow developers are in high demand due to the increasing need for data pipeline orchestration in organizations. Skills in Python, cloud platforms, and workflow management tools contribute to strong job prospects in this field.

What jobs in the US pay 300,000 a year?

For an Airflow Developer, earning $300,000 annually typically requires senior-level experience, specialized skills in data pipeline orchestration, and often working in large organizations or consulting roles. High salaries are common in roles involving complex data infrastructure, cloud platforms, and leadership responsibilities. Such compensation is less common for entry-level positions and usually involves additional bonuses or equity components.

What engineer makes $500,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, or cloud architecture can earn $500,000 or more annually, especially with extensive experience, advanced skills, and leadership roles. High compensation often includes bonuses, stock options, or profit sharing, particularly in large tech companies or startups with significant growth potential.

What jobs pay $500,000 a year in the US?

High-paying roles for Airflow Developers or similar data engineering professionals can reach or exceed $500,000 annually, especially with seniority, specialized skills, and experience in cloud platforms like AWS or GCP. Such compensation often includes base salary, bonuses, and stock options, typically found in senior or executive-level positions within large tech companies or financial institutions.
What are popular job titles related to Airflow Developer jobs in California? For Airflow Developer jobs in California, the most frequently searched job titles are:
What job categories do people searching Airflow Developer jobs in California look for? The top searched job categories for Airflow Developer jobs in California are:
What cities in California are hiring for Airflow Developer jobs? Cities in California with the most Airflow Developer job openings:
Airflow Developer jobs near you
Data Engineer in Sunnyvale CA

Data Engineer in Sunnyvale CA

IDC Technologies

Sunnyvale, CA • On-site

$134K - $161K/yr

Full-time

Posted 29 days ago

Job description

Company Description
IDC Technologies Inc.
Job Description
Please focus on spark/Pyspark with data experience.
Must Have Skills : Python , Data Engineering
Nice to have : Docker , Kuebernetes
Looking for experienced Python engineers with a background in data engineering. Should be familiar with modern data platforms like Apache Presto or AWS Athena, and workflow tools like Apache Airflow.
Engineers will write data collection scripts, aggregation algorithms, and implement storage technologies that power our internal business intelligence operations.
Candidates are expected to be excellent engineers and will be interviewed by our existing engineering team. Please do not submit candidates who do not have strong knowledge of algorithms and data structures, and a track record of shipping high quality software
Qualifications
Bachelors
Additional Information
All your information will be kept confidential according to EEO guidelines.

Apply