ZipRecruiter

Log In

1

Data Engineer Airflow Jobs in Indiana (NOW HIRING)

Allied Solutions LLC

Data Engineer

Carmel, IN · On-site

$113K - $136K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The Data Engineer supports the execution of Allied's Data Strategy by focusing on data acquisition ... Orchestration (Apache Airflow, Step Functions, etc.) * Enhance skills and knowledge around database ...

Allied Solutions LLC

Data Engineer

Carmel, IN · On-site

$114K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The Data Engineer supports the execution of Allied's Data Strategy by focusing on data acquisition ... Orchestration (Apache Airflow, Step Functions, etc.) * Enhance skills and knowledge around database ...

Allied Solutions LLC

Data Engineer

Carmel, IN

$114K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The Data Engineer supports the execution of Allied's Data Strategy by focusing on data acquisition ... Orchestration (Apache Airflow, Step Functions, etc.) * Enhance skills and knowledge around database ...

SEP

Data Engineer (in person)

Westfield, IN · On-site

$109K - $131K/yr

... engineer to join their growing data practice. The role involves building and maintaining data ... Airflow, Databricks Workflows, Temporal, or similar) • Experience writing tests and data quality ...

TEKsystems

Data Engineer

Columbia City, IN

$80K - $112K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Description The Data Engineer at Structural and Rail division will own and evolve our modern data ... Airflow/Prefect. • Intermediate Python (data access, transformations, packaging/venv, type-safe ...

TEKsystems

Data Engineer

Columbia City, IN

$80K - $112K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Description The Data Engineer at Structural and will own and evolve our modern data stack, moving ... Airflow/Prefect. • Intermediate Python (data access, transformations, packaging/venv, type-safe ...

TEKsystems

Data Engineer

Columbia City, IN · On-site

$80K - $112K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Description The Data Engineer at Structural and Rail division will own and evolve our modern data ... Airflow/Prefect. • Intermediate Python (data access, transformations, packaging/venv, type-safe ...

TEKsystems

Data Engineer

Columbia City, IN

$80K - $112K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Description The Data Engineer at Structural and Rail division will own and evolve our modern data ... Airflow/Prefect. • Intermediate Python (data access, transformations, packaging/venv, type-safe ...

Masco Corporation

Sr. Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

  • Retirement

... Airflow, Azure Data Factory) Experience with cloud platforms (Azure, AWS, or Google Cloud Platform) Background in analytics engineering or building semantic/curated data layers Why Join Us? At Delta ...

Masco Corporation

Sr. Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

  • Retirement

... Airflow, Azure Data Factory) • Experience with cloud platforms (Azure, AWS, or GCP) • Background in analytics engineering or building semantic/curated data layers Why Join Us? At Delta Faucet ...

SEP

Data Engineer (in person)

Westfield, IN · On-site

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

SEP

Data Engineer (in person)

Westfield, IN · On-site

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

SEP

Data Engineer (in person)

Westfield, IN · On-site

$109K - $131K/yr

SEP is looking for a data engineer to join our growing data practice and deliver data solutions for ... Familiarity with orchestration and workflow management (Apache Airflow, Databricks Workflows ...

Allegion

Lead Platform Data Engineer

Carmel, IN · On-site

... e.g., Airflow, dbt) and CI/CD pipelines to ensure 99.9% data reliability and 'Data-as-Code ... and compliance. • Engineer data lifecycle policies that strictly adhere to global privacy ...

Allegion

Lead Platform Data Engineer

Carmel, IN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Allegion

Lead Platform Data Engineer

Carmel, IN · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Allegion

Lead Platform Data Engineer

Carmel, IN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Replace ad-hoc processes with robust workflow orchestration (e.g., Airflow, dbt) and CI/CD ... Security & Privacy: Engineer data lifecycle policies that strictly adhere to global privacy ...

Salesforce, Inc.

Data Engineer (SMTS / LMTS) - MDM

Indianapolis, IN · On-site

$109K - $131K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

... data integration solutions - while leveraging modern AI technologies to build developer tools ... Build and maintain end-to-end MDM integration systems, including MuleSoft integrations, Airflow ...

SEP

Senior Data Engineer (in person)

Westfield, IN

$101K - $138K/yr

Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

next page

Showing results 1-20

All JobsData Engineer Airflow JobsData Engineer Airflow Jobs in Indiana

Data Engineer Airflow information

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What are popular job titles related to Data Engineer Airflow jobs in Indiana?

For Data Engineer Airflow jobs in Indiana, the most frequently searched job titles are:

What job categories do people searching Data Engineer Airflow jobs in Indiana look for?

The top searched job categories for Data Engineer Airflow jobs in Indiana are:

What cities in Indiana are hiring for Data Engineer Airflow jobs?

Cities in Indiana with the most Data Engineer Airflow job openings:

Data Engineer Airflow jobs near you

Data Engineer

Allied Solutions LLC

Carmel, IN • On-site

$113K - $136K/yr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted 14 days ago

Allied Solutions rating

7.9

Company rating: 7.9 out of 10

Based on 11 frontline employees who took The Breakroom Quiz

185th of 309 rated insurance

Job description

The Data Engineer supports the execution of Allied's Data Strategy by focusing on data acquisition, curation, and transformation. This role involves working with cross-functional teams to implement efficient data models and contribute to the development of modern data architecture aligned with business and data initiatives. The Data Engineer will assist in building end-to-end data pipelines to enable business intelligence, analytics, and data-driven decision making. This position requires a solid understanding of SQL, data design principles, and data processing methods. The Data Engineer will also help implement and maintain data models, schemas, and participate in discussions around the evolution of Allied's Data Management and Strategy.
Job Duties and Responsibilities:
Data Integration Development and Administration (75%)
  • Identifies, troubleshoots, and resolves data and data processing errors in existing solutions.
  • Works closely with the Data Intelligence team to understand data and reporting requirements and assists in implementing backend data solutions to meet business needs.
  • Develops, maintains, and updates data sets while helping standardize data collection and processing practices.
  • Assists in executing technical plans for extracting, integrating, and moving data to and from third-party providers.
  • Supports the delivery of enterprise data solutions, including ETL processes, warehouse updates, and performance tuning.
  • Mentors other ETL Developers and Junior Data Engineers.

Discovery, Design and Documentation (15%)
  • Creates and maintains documentation of data warehouse structures, data stores and end-to-end data flows.
  • Collaborates with technical teams and internal and external users to support the development of technical designs.
  • Supports the refinement and maintenance of BI-focused data architecture under guidance from senior data engineers.
  • Assists in conducting gap analysis on source system databases compared to the enterprise data warehouse to support Business Intelligence initiatives.
  • Participates in technical discussions and provides input on technical decisions that impact cross-functional teams.
  • Attends architecture and planning meetings to contribute to defining project scope, timelines, and resource estimates.
  • Gains a working knowledge of data warehouse and data mart models and associated business information.
  • Helps identify opportunities for process improvements or the adoption of new technologies that improve data delivery and business value.
  • Works collaboratively with developers and subject matter experts to align technical solutions with business needs, focusing on usability and performance.

Enhance Skillsets (10%)
  • Possess and demonstrate good communication skills to be able to run discovery sessions.
  • Continue to develop data architecture skills by working with senior data engineers and architects.
  • Continue to develop data modeling skills by working with senior data engineers.
  • Enhance skills and knowledge around data management platforms and tools:
    • AWS (EC2, S3, Glue, Lambda, etc.)
    • Snowflake
    • Python
    • Orchestration (Apache Airflow, Step Functions, etc.)
  • Enhance skills and knowledge around database platforms:
    • Snowflake
    • SQL Server
    • Postgres
  • Enhance skills and knowledge around Data Governance
    • Data Analysis and Profiling
    • Data Quality
    • Data Governance
    • Data Modeling
  • Enhance skills and knowledge around file formats and communication types:
    • APIs
    • JSON
    • XML
    • CSV (character separated values)
    • Unstructured

Qualifications (Education, Experience, Certifications & KSA):
  • Bachelor's degree or equivalent combination of education and experience required.
  • 3-5 years of experience in data engineering, ETL development, or a related role.
  • Extensive hands-on experience with Informatica and AWS Glue for data integration and transformation.
  • Strong proficiency in Python for data engineering and automation.
  • Deep expertise in AWS Lambda and other cloud-based data services.
  • Strong understanding of data warehousing concepts, data modeling, and SQL.
  • Experience with big data technologies and distributed computing frameworks.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Experience with cloud data platforms such as AWS Redshift, Snowflake, or BigQuery.
  • Advanced knowledge of data governance, security, and compliance best practices.
  • Proficiency in workflow orchestration tools (e.g., Apache Airflow, Step Functions).
  • Familiarity with DevOps practices and CI/CD pipelines for data engineering.
  • Experience with real-time data processing frameworks such as Kafka or Kinesis.

The above statements are intended to describe the general nature and level of work being performed by people assigned to this job. They are not intended to be an exhaustive list of all responsibilities, skills, efforts or working conditions associated with a job.
We offer our employees a robust compensation package! Our comprehensive benefits include: medical, dental and vision insurance coverage; 100% company-paid life and disability coverage, 401k options with company match, three weeks PTO by the end of the first year and much more. Allied proudly promotes from within as part of a strong commitment to providing career growth opportunities for employees of all levels. Our diverse business portfolio allows employees broad career options with the advantage of staying with the same organization.
All qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.
To view our privacy statement click here
To view our terms and conditions click here

What Allied Solutions employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply