1

Data Engineer Airflow Jobs in Kentucky (NOW HIRING)

$124 - $335/hr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Utilizing Apache Airflow and Hadoop for orchestrating complex data workflows and enhancing data ... Demonstrating proficiency in data engineering platforms like Databricks and Snowflake * Utilizing ...

New

Data Platform Engineer I

Louisville, KY

$109K - $131K/yr

  • Medical

  • Life

  • Retirement

Data Platform Engineer I Location: Louisville, KY About El Toro At El Toro, everything we do starts ... You'll write production Python from day one, orchestrate real workflows with tools like Airflow and ...

Data Platform Engineer I

Louisville, KY · On-site

$110K - $132K/yr

  • Medical

  • Life

  • Retirement

  • PTO

Data Platform Engineer I Location: Louisville, KY About El Toro At El Toro, everything we do starts ... You'll write production Python from day one, orchestrate real workflows with tools like Airflow and ...

$140 - $180/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

# Senior Software Engineer - DataApartmentIQ • Madison , Wisconsin • Real Estate • 4h agoSave ... Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar ...

New

$135 - $150/hr

Production experience with data engineering tools such as Apache Spark, Kafka, Flink, Airflow, and Pentaho PDI.* Ability to design data pipelines that integrate streaming, batch, transformation ...

New

... Core, Airflow/Astronomer, Monte Carlo, AWS, and related technologies. * Establish engineering ... Enterprise Data Platform Strategy * Define and execute the long-term vision, roadmap, and operating ...

$196 - $245/hr

To learn more about Discord's Data Platform, read our engineering blog, including how we built our ... Airflow, Dagster, or similar) * Proven track record of delivering complex, multi-phase projects ...

New

$140 - $170/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... data and persistence models such as MongoDB, Snowflake + DevOps toolsets for versioning, containers, such as Git, Docker, Kubernetes, Maven + Job Orchestration tools Control M, Apache Airflow + Event ...

New

$180 - $240/hr

... data ecosystems.**Education and Experience**:Bachelor's degree in Computer Science, Engineering ... Airflow, and using Elastic MapReduce or AWS Glue; and developing storage strategies including ...

New

$120 - $160/hr

  • Life

  • Retirement

  • PTO

You'll work closely with Product, Design, Engineering, and Customer teams to build analytics and ... Experience with modern data tooling such as dbt, Airflow, or equivalent orchestration and ...

New

$120 - $180/hr

  • Medical

  • Dental

  • Vision

  • Life

... Airflow, Prefect, Redis, OAuth). * Bonus experience with distributed systems, ETL/data pipelines, DevOps tooling (Kubernetes, Helm), or mobile development. * Strong communicator who is comfortable ...

New

... platforms (Airflow, Prefect, Temporal) * Design and deploy agentic workflows for automated ... Collaborate with data engineering teams on MLOps and automation pipeline development * Document ...

next page

Showing results 1-20

Data Engineer Airflow information

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What are popular job titles related to Data Engineer Airflow jobs in Kentucky?

For Data Engineer Airflow jobs in Kentucky, the most frequently searched job titles are:

What cities in Kentucky are hiring for Data Engineer Airflow jobs?

Cities in Kentucky with the most Data Engineer Airflow job openings:

Tax Innovation - Data Engineer - Senior Manager

PRICE WATERHOUSE COOPERS

On-site

$124 - $335/hr

Other

Medical, Dental, Vision, Retirement, PTO

This job post has expired today. Applications are no longer accepted.


Job description

The Opportunity

As a Tax Innovation - Data Engineer - Senior Manager, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. Within our Tax practice, you will leverage advanced technologies and techniques to transform raw data into actionable insights, empowering clients to make informed decisions and drive business growth. In this role, you will develop and implement data pipelines, data integration, and data transformation solutions, playing a crucial role in delivering robust data solutions.

As a Senior Manager, you will apply your skills and professional knowledge to deliver quality results. You will motivate and coach teams to solve complex problems, applying sound judgment to recognize when to take action and when to elevate. Your ability to develop and sustain diverse and inclusive teams contributes to the success of our firm. You will craft and convey clear, impactful messages, apply systems thinking to identify underlying problems, and validate outcomes with clients. In this role at PwC, you will drive project success through strategic advising and influence, fostering a culture of continuous improvement and innovation.

Responsibilities
  • Designing and developing data infrastructure and systems to facilitate efficient data processing and analysis
  • Implementing data pipelines, integration, and transformation solutions to convert raw data into actionable insights
  • Leveraging advanced technologies and techniques to drive business growth through data engineering
  • Building and maintaining scalable data architectures using platforms like Amazon Web Services (AWS) and Azure Data Factory
  • Utilizing Apache Airflow and Hadoop for orchestrating complex data workflows and enhancing data processing capabilities
  • Developing and optimizing data models and warehouses, including Snowflake and Databricks, to support strategic decision-making
  • Validating data quality and security within analytics frameworks to maintain data integrity
  • Coaching and motivating teams to solve complex problems and deliver quality results
  • Applying systems thinking to identify underlying problems and opportunities in data engineering projects
  • Crafting and conveying clear, impactful messages that tell a holistic story to clients and stakeholders
What You Must Have
  • At least a Bachelor's degree
  • At least 7 years of experience
What Sets You Apart
  • Preference for at least one of the following fields of study: Analytics/Data Science, Business Administration/Management, Computer Science/Information Systems, Economics, Engineering, Finance, Mathematics/Statistics, Operations/Supply Chain
  • Demonstrating proficiency in data engineering platforms like Databricks and Snowflake
  • Utilizing advanced skills in data architecture development and data modeling
  • Applying strategic questioning and analytical thinking to solve complex problems
  • Leading teams through ambiguity with composure and strategic direction
  • Innovating data integration and transformation processes for client solutions
  • Excelling in coaching and feedback to develop high-performing teams

The salary range for this position is: $124,000 - $335,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link: https://pwc.to/benefits-at-a-glance

As PwC is anequal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.

PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy: https://pwc.to/H-1B-Lottery-Policy.

Learn more about how we work: https://pwc.to/how-we-work

For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.

#J-18808-Ljbffr