1

Data Engineer Airflow Jobs in Indiana (NOW HIRING)

Senior Python Data Engineer

Indianapolis, IN · On-site

$116K - $156K/yr

Data Engineering Technical Architect Design and implement scalable ETL pipelines using Python and ... Familiarity with Spark, Airflow, or similar orchestration tools. * Exposure to ML workflows or LLM ...

Data Engineer AI

Indianapolis, IN · On-site

$109K - $131K/yr

Manage complex, cross-platform data workflows using Airflow, Step Functions, or Azure Data Factory ... Work as a dedicated engineering partner to MLOps and Data Science teams to rapidly iterate on data ...

Senior Data Engineer

Zionsville, IN · On-site

$102K - $139K/yr

The Senior Data Engineer will lead data pipeline development and drive excellence in data warehouse ... Required : • Advanced in Python, SQL, RDS, Snowflake, ETL/ELT, Coalesce, Airflow/Dagster, Data ...

Data Engineer (in person)

Westfield, IN

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

Data Engineer II

Indianapolis, IN · On-site

$109K - $131K/yr

Data Engineer II Job Location - Indianapolis, IN The Data Engineer is a key technical contributor ... Experience with monitoring tools, such as Apache Airflow, for pipeline performance. Ability to ...

Data Engineer (in person)

Westfield, IN · On-site

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

Data Engineer (in person)

Westfield, IN

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

Sr Databricks Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

... Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD) pipelines, and performance optimization of data engineering pipelines, code, and compute resources Ability ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Airflow and Apache Hadoop for scalable data processing and workflow management - Building and ...

... e.g., Airflow, dbt) and CI/CD pipelines to ensure 99.9% data reliability and 'Data-as-Code ... and compliance. • Engineer data lifecycle policies that strictly adhere to global privacy ...

Senior Data Engineer

Zionsville, IN

$102K - $139K/yr

Why This Role Matters: The Senior Data Engineer at Group 1001 will play a critical role in ... Advanced in Python, SQL, RDS, Snowflake, ETL/ELT, Coalesce, Airflow/Dagster, Data warehousing ...

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Data Engineer II

Indianapolis, IN · On-site

$109K - $131K/yr

Expertise in workflow orchestration and pipeline tools such as Airflow * Experience with biodata ... about data and learning new technologies * Demonstrated experience in software engineering ...

Senior Data Engineer (in person)

Westfield, IN · On-site

$101K - $138K/yr

Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Senior Data Engineer (in person)

Westfield, IN · On-site

$101K - $138K/yr

Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

next page

Showing results 1-20

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a Data Engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a Data Engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a Data Engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.
What are popular job titles related to Data Engineer Airflow jobs in Indiana? For Data Engineer Airflow jobs in Indiana, the most frequently searched job titles are:
What cities in Indiana are hiring for Data Engineer Airflow jobs? Cities in Indiana with the most Data Engineer Airflow job openings:
Senior Python Data Engineer

Senior Python Data Engineer

E-Solutions Inc.

Indianapolis, IN • On-site

$116K - $156K/yr

Other

This job post has expired today. Applications are no longer accepted.


Job description

Data Engineering Technical Architect
Design and implement scalable ETL pipelines using Python and AWS services.
  • Model and manage datasets for analytics and machine learning workflows.
  • Optimize data workflows for performance, reliability, and maintainability.
The resource should possess the following skills and experience:
  • Strong proficiency in Python for data engineering.
  • Hands-on experience with AWS (e.g., S3, Lambda, Glue, RDS).
  • Solid understanding of ETL processes and data pipeline orchestration.
These are nice-to-have skills to complement the required skills:
  • Experience with data modeling for structured and semi-structured data.
  • Familiarity with Spark, Airflow, or similar orchestration tools.
  • Exposure to ML workflows or LLM integration.

Knowledge of containerization (Docker, Kubernetes) and CI/CD practices