Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets ... Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets ... Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Python Developer/ Westlake, TX( Hybrid), 12+ Months Contract
Roanoke, TX ยท On-site
$48.25 - $66.50/hr
Machine Learning Engineer Dynamic Work schedule: This is 5 days on site a month in the same week ... Airflow, Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise.
Python Developer/ Westlake, TX( Hybrid), 12+ Months Contract
Roanoke, TX ยท On-site
$48.25 - $66.50/hr
Machine Learning Engineer Dynamic Work schedule: This is 5 days on site a month in the same week ... Airflow, Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise.
Software Development Engineering
Austin, TX ยท On-site
... Spark, Airflow, JavaScript, CSS, and AWS technologies for compute and storage, messaging, and data storage โข Develop, test, and deploy software products such as: web pages and applications as ...
Software Development Engineering
Austin, TX ยท On-site
... Spark, Airflow, JavaScript, CSS, and AWS technologies for compute and storage, messaging, and data storage โข Develop, test, and deploy software products such as: web pages and applications as ...
Senior Data Platform Engineer
Austin, TX ยท On-site
$105K - $143K/yr
Design and maintain Airflow DAGs for production data workflows * Develop and optimize Spark ... Strong Python programming skills * Production experience with Apache Spark PySpark * Experience ...
Quick apply
Senior Data Platform Engineer
Austin, TX ยท On-site
$105K - $143K/yr
Design and maintain Airflow DAGs for production data workflows * Develop and optimize Spark ... Strong Python programming skills * Production experience with Apache Spark PySpark * Experience ...
Software Development Engineering
Austin, TX ยท On-site
... developer guides, and onboarding guides; Hands on programming with Java, Dropwizard, JUnit, Salesforce technologies, web services, REST, XML, Oracle, Snowflake, Kafka, AVRO, Spark, Airflow ...
Software Development Engineering
Austin, TX ยท On-site
... developer guides, and onboarding guides; Hands on programming with Java, Dropwizard, JUnit, Salesforce technologies, web services, REST, XML, Oracle, Snowflake, Kafka, AVRO, Spark, Airflow ...
... developer guides, and onboarding guides; Hands on programming with Java, Dropwizard, JUnit, Salesforce technologies, web services, REST, XML, Oracle, Snowflake, Kafka, AVRO, Spark, Airflow ...
... developer guides, and onboarding guides; Hands on programming with Java, Dropwizard, JUnit, Salesforce technologies, web services, REST, XML, Oracle, Snowflake, Kafka, AVRO, Spark, Airflow ...
Senior Python Platform Engineer
Addison, TX ยท On-site
$75 - $87/hr
Develop workflow orchestration solutions using Apache Airflow or similar platforms * Build and ... Strong understanding of distributed systems, resiliency engineering, and platform reliability
Quick apply
Senior Python Platform Engineer
Addison, TX ยท On-site
$75 - $87/hr
Develop workflow orchestration solutions using Apache Airflow or similar platforms * Build and ... Strong understanding of distributed systems, resiliency engineering, and platform reliability
Sr GCP Data Engineer
Austin, TX ยท On-site
$114K - $137K/yr
Design and maintain Airflow DAGs for production data workflows * Develop and optimize Spark ... Strong Python programming skills * Production experience with Apache Spark PySpark * Experience ...
Quick apply
Sr GCP Data Engineer
Austin, TX ยท On-site
$114K - $137K/yr
Design and maintain Airflow DAGs for production data workflows * Develop and optimize Spark ... Strong Python programming skills * Production experience with Apache Spark PySpark * Experience ...
Sr Software Engineer - Python - Irving, TX
Irving, TX ยท On-site
$117K - $155K/yr
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets ... Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Sr Software Engineer - Python - Irving, TX
Irving, TX ยท On-site
$117K - $155K/yr
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets ... Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Senior PySpark Developer / Engineer
Dallas, TX ยท On-site
$51.50 - $68/hr
Role: Senior PySpark Developer / Engineer Location: Dallas, TX (3 Days onsite/ week) Must-Have ... Autosys/ Control-M/ Airflow/ or similar tools used in production environments Nice-to-Have Skills ...
Senior PySpark Developer / Engineer
Dallas, TX ยท On-site
$51.50 - $68/hr
Role: Senior PySpark Developer / Engineer Location: Dallas, TX (3 Days onsite/ week) Must-Have ... Autosys/ Control-M/ Airflow/ or similar tools used in production environments Nice-to-Have Skills ...
Cloud Data Engineer 100% Remote Contract: Goes until 6/30 anticipated to renew each fiscal year ... Knowledge of Airflow DAGs and concepts for managing dependent graphs and complex steps Knowledge of ...
Quick apply
Cloud Data Engineer 100% Remote Contract: Goes until 6/30 anticipated to renew each fiscal year ... Knowledge of Airflow DAGs and concepts for managing dependent graphs and complex steps Knowledge of ...
Senior PySpark Developer / Engineer
Dallas, TX ยท On-site
$55.50 - $73.25/hr
Role: Senior PySpark Developer / Engineer Location: Dallas, TX (3 Days onsite/ week) Must-Have ... Autosys/ Control-M/ Airflow/ or similar tools used in production environments Nice-to-Have Skills ...
Senior PySpark Developer / Engineer
Dallas, TX ยท On-site
$55.50 - $73.25/hr
Role: Senior PySpark Developer / Engineer Location: Dallas, TX (3 Days onsite/ week) Must-Have ... Autosys/ Control-M/ Airflow/ or similar tools used in production environments Nice-to-Have Skills ...
Senior Software Engineer, Workflow Platforms
Houston, TX ยท On-site
$117K - $154K/yr
... DevOps, or SRE roles * Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems * Strong software development skills in one or more ...
Senior Software Engineer, Workflow Platforms
Houston, TX ยท On-site
$117K - $154K/yr
... DevOps, or SRE roles * Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems * Strong software development skills in one or more ...
... Airflow Domain Skills- Travel Intermediaries After Sales(T&H) Nice to have skills Technical Skills ... Developer Bachelors in science engineering or equivalent. Understand requirements build codes ...
... Airflow Domain Skills- Travel Intermediaries After Sales(T&H) Nice to have skills Technical Skills ... Developer Bachelors in science engineering or equivalent. Understand requirements build codes ...
Senior Software Engineer, Workflow Platforms
$117K - $154K/yr
... DevOps, or SRE roles * Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems * Strong software development skills in one or more ...
Senior Software Engineer, Workflow Platforms
$117K - $154K/yr
... DevOps, or SRE roles * Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems * Strong software development skills in one or more ...
Snowflake DBT Developer
Dallas, TX ยท On-site
$113K - $136K/yr
Senior Data Engineer (Snowflake, DBT, Fivetran) Hybrid in Dallas Role Overview We are seeking a ... Work with orchestration tools such as Airflow / Astronomer to schedule, monitor, and manage data ...
Snowflake DBT Developer
Dallas, TX ยท On-site
$113K - $136K/yr
Senior Data Engineer (Snowflake, DBT, Fivetran) Hybrid in Dallas Role Overview We are seeking a ... Work with orchestration tools such as Airflow / Astronomer to schedule, monitor, and manage data ...
Cloud Data Platform Engineer
Irving, TX ยท On-site
$57.50 - $75/hr
... Airflow, Cloud Composer, and Google Cloud Platform. Node.js and React are also now considered required, not just a plus. Candidate does not need to be a senior front end developer, but must be able ...
Cloud Data Platform Engineer
Irving, TX ยท On-site
$57.50 - $75/hr
... Airflow, Cloud Composer, and Google Cloud Platform. Node.js and React are also now considered required, not just a plus. Candidate does not need to be a senior front end developer, but must be able ...
Big Data Developer
Richardson, TX ยท On-site
$48.25 - $62.50/hr
Position-Big Data Developer Duration-Contract Location- Richardson, TX~ Woonsocket, RI JD * Strong ... Airflow, Azure Data Factory) * Experience with real-time and streaming technology (i.e. Azure Event ...
Big Data Developer
Richardson, TX ยท On-site
$48.25 - $62.50/hr
Position-Big Data Developer Duration-Contract Location- Richardson, TX~ Woonsocket, RI JD * Strong ... Airflow, Azure Data Factory) * Experience with real-time and streaming technology (i.e. Azure Event ...
Lead Snowflake Developer
Dallas, TX ยท On-site
$58.50 - $76.75/hr
Job Title: Lead Snowflake Developer Location: Dallas, TX (hybrid in office) Overview: We are ... Experience with orchestration tools such as Apache Airflow, Prefect, or Luigi * Strong SQL skills ...
Lead Snowflake Developer
Dallas, TX ยท On-site
$58.50 - $76.75/hr
Job Title: Lead Snowflake Developer Location: Dallas, TX (hybrid in office) Overview: We are ... Experience with orchestration tools such as Apache Airflow, Prefect, or Luigi * Strong SQL skills ...
Full stack Python lead engineer
Irving, TX ยท On-site
Full Stack Python Lead Engineer Duration: 6-month contract to hire Location: Baltimore based ... DBT, Airflow * Aurora
Full stack Python lead engineer
Irving, TX ยท On-site
Full Stack Python Lead Engineer Duration: 6-month contract to hire Location: Baltimore based ... DBT, Airflow * Aurora
Airflow Developer information
What are Airflow Developers?
What is the difference between Airflow Developer vs Data Engineer?
| Aspect | Airflow Developer | Data Engineer |
|---|---|---|
| Required Credentials | Knowledge of Apache Airflow, Python, SQL | Data modeling, SQL, Python, cloud platforms |
| Work Environment | Focus on workflow orchestration, automation | Data pipeline development, storage, processing |
| Industry Usage | Tech, finance, healthcare for workflow automation | Broad industries for data infrastructure |
While both roles involve working with data and Python, an Airflow Developer specializes in designing and maintaining workflow automation using Apache Airflow. In contrast, a Data Engineer builds and manages data pipelines and infrastructure across various tools and platforms. The roles often overlap but differ mainly in scope and focus.
What are the key skills and qualifications needed to thrive as an Airflow Developer, and why are they important?
What are some common challenges Airflow Developers face when managing complex data pipelines, and how can these be addressed?
Is Airflow in demand?
What jobs in the US pay 300,000 a year?
What engineer makes $500,000 a year?
What jobs pay $500,000 a year in the US?
Full-time, Contractor
Medical, Dental, Vision, Retirement, PTO
Posted 28 days ago
Job description
Key Responsibilities:
Design, develop, and manage complex Airflow DAGs for data workflows, ETL/ELT pipelines, and task automation.
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets.
Optimize and monitor pipeline performance and troubleshoot failures in a timely manner.
Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Implement best practices for code quality, testing, version control, and deployment.
Maintain documentation and provide technical mentorship to junior engineers.
Required Skills:
3+ years of hands-on experience with Apache Airflow in production environments.
Strong programming skills in Python.
Solid understanding of data engineering concepts, including ETL/ELT processes, workflow orchestration, and data validation.
Experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their storage and compute services.
Knowledge of containerization tools like Docker and orchestration with Kubernetes (a plus).
Compensation, Benefits and Duration
Minimum Compensation: USD 36,000
Maximum Compensation: USD 126,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
About Photon
Sourced by ZipRecruiter
Company size
1 - 10 Employees
Headquarters location
Cambridge, MA, US
Year founded
1984