ZipRecruiter

Log In

1

Data Engineer Airflow Jobs in Indiana (NOW HIRING)

SEP

Senior Data Engineer (in person)

Westfield, IN · On-site

$101K - $138K/yr

Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

SEP

Senior Data Engineer (in person)

Westfield, IN · On-site

$101K - $138K/yr

Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Fetcherr Ltd

Data Scientist Engineer

Warsaw, IN · On-site

$110 - $160/hr

We are looking for a Data Science Engineer to design and implement the decision-making logic of our ... Familiarity with orchestration frameworks like Dagster or Airflow (from a user/logic perspective)

New

Moser Consulting

Analytics Engineer

Indianapolis, IN · On-site

$115K - $149K/yr

You will work closely with data engineers and business stakeholders to turn raw data into clean ... Familiarity with orchestration tools such as Airflow, Prefect, or Dagster. * Experience developing ...

Moser Consulting

Analytics Engineer

Indianapolis, IN · On-site

$115K - $149K/yr

You will work closely with data engineers and business stakeholders to turn raw data into clean ... Familiarity with orchestration tools such as Airflow, Prefect, or Dagster. * Experience developing ...

Moser Consulting

Analytics Engineer

Indianapolis, IN · On-site

$115K - $149K/yr

You will work closely with data engineers and business stakeholders to turn raw data into clean ... Familiarity with orchestration tools such as Airflow, Prefect, or Dagster. * Experience developing ...

previous pagenext page

Showing results 21-40

All JobsData Engineer Airflow JobsData Engineer Airflow Jobs in Indiana

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.
What are popular job titles related to Data Engineer Airflow jobs in Indiana? For Data Engineer Airflow jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Data Engineer Airflow jobs in Indiana look for? The top searched job categories for Data Engineer Airflow jobs in Indiana are:
What cities in Indiana are hiring for Data Engineer Airflow jobs? Cities in Indiana with the most Data Engineer Airflow job openings:
Data Engineer Airflow jobs near you

Senior Data Engineer (in person)

SEP

Westfield, IN • On-site

$101K - $138K/yr

Full-time

Re-posted 14 days ago

Job description

Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation - and we're looking for a Senior Data Engineer who's ready to lead the way.

We've been partnering with companies to build software that matters since 1988. From Fortune 100 enterprises to fast-moving scale-ups, our clients depend on us to tackle complexity, deliver with craft, and stay engaged through every stage of the work. Now, we're growing our data practice - and we want someone who's as excited about clean, connected, trustworthy data as we are.
What we have to offer
  • Variety on every axis - tools, technologies, market sectors, methodologies 
  • Flexible, reasonable work schedules 
  • Extensive opportunities to learn and develop yourself 
  • A community of friendly, talented, and effective peers 
  • Opportunities to try out different roles with minimal risk 
  • Gorgeous facilities 
What you'll be doing
  • Provide technical direction on data engagements and mentor other engineers 
  • Design and implement data pipelines and transformations (batch and streaming) 
  • Develop data models for analytics use cases 
  • Implement data quality checks and testing strategies for pipelines 
  • Configure and manage orchestration and workflow tooling 
  • Build and maintain infrastructure as code for data platforms 
  • Translate architectural direction into implementation plans 
  • Communicate progress, risks, and technical tradeoffs to stakeholders 
  • Support client meetings in a technical capacity 
Key attributes for applicants
  • A passion for great products, software development, and learning 
  • Expert-level SQL skills with strong proficiency in Python; experience with Spark, Scala, R, or C# is a plus 
  • Deep expertise in data pipeline development, including batch and streaming patterns 
  • Solid understanding of data modeling patterns for analytics (dimensional modeling, data vault, lakehouse architectures) 
  • Experience with cloud data platforms - Azure preferred, AWS experience also valued 
  • Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift 
  • Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows, Temporal, or similar) 
  • Experience with data quality frameworks and testing strategies for pipelines 
  • Familiarity with infrastructure as code tooling (Terraform, ARM/Bicep) and CI/CD pipelines (GitHub Actions or similar) is a plus 
  • Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog, Microsoft Purview) is a plus 
  • Ability to evaluate architectural tradeoffs in data systems (OLAP vs. OLTP, batch vs. streaming, warehouse vs. lakehouse) 
  • Comfortable with ambiguity; can clarify requirements through conversation 
  • Interest in mentoring and developing less experienced engineers 
  • Professional data engineering experience (8+ years desired) 
  • Must be legally authorized to work in the United States 
  • Must not require visa sponsorship or have work authorization based on OPT or CPT 
  • Must be able to work from our office in Westfield, IN without relocation financial assistance 
SEP is a software product design and development company located in Westfield, IN. We provide powerful teams of thoughtful developers and designers to bring ideas to life. Founded in 1988, SEP is one of Indiana's largest software development firms with 180 employees. Our clients span from Fortune 100 to scale-up companies. We are 100% employee-owned through an ESOP and are consistently recognized for our great culture (Top Workplaces, Best Place to Work in Indiana, Techpoint Mira Exceptional Employer).

We are an equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities
apply for this job
SEP logo

About SEP

Sourced by ZipRecruiter

Industry

Software development

Company size

51 - 200 Employees

Headquarters location

Carmel, IN, US

Year founded

1988

View All SEP Jobs

Apply