1

Data Engineer Airflow Jobs in Tennessee (NOW HIRING)

Sr. Data Engineer

Nashville, TN

$102K - $139K/yr

As a Sr. Data Engineer, you will be a crucial part of the Wellvana technology team responsible for ... Proficiency in data orchestration tools like Apache Airflow or Dagster. * Experience working with ...

Senior Data Engineer

Franklin, TN · Remote

$102K - $138K/yr

The Senior Data Engineer will join the Technology function, solving complex data problems for the ... Airflow. * Deep expertise in Python and SQL is required. * Strong proficiency in C#, with ...

AI/ML Engineer

Franklin, TN · On-site

$113K - $135K/yr

Job Title Senior Software Engineer (Intelligent Data Systems) Location Franklin, TN Candidates must ... g., Airflow, Celery). * Bachelor's or master's degree in computer science or a related technical ...

Showing results 21-40

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.
What are popular job titles related to Data Engineer Airflow jobs in Tennessee? For Data Engineer Airflow jobs in Tennessee, the most frequently searched job titles are:
What cities in Tennessee are hiring for Data Engineer Airflow jobs? Cities in Tennessee with the most Data Engineer Airflow job openings:

$102K - $139K/yr

Full-time

Posted 24 days ago


Job description

Description

The Why Behind Wellvana:

The healthcare system isn't designed for health. We're designed to change that. We're Wellvana, and we help doctors deliver life-changing healthcare.  

Through our elevated value-based care programs, we're revitalizing an antiquated system that's far too long relied on misaligned incentives that reward quantity of care not the quality of it. 

Our enlightened approach-covering everything from care coordination to clinical documentation education to marketing- ties the healthy outcomes of patients directly to shared savings for primary care providers, health systems and payors.  

Providers in our curated network keep their independence, reduce their administrative headaches, and spend more time with patients. Patients, in turn, get an elevated experience with coordinated care between appointments that is nothing short of life-changing.  

Named a 2024 "Best in Business" and 2023 "Best Place to Work" by Nashville Business Journal, we're one of the fastest-growing healthcare companies in America because what we do works. This is the way medicine is meant to be.


Clarity on the Role:

As a Sr. Data Engineer, you will be a crucial part of the Wellvana technology team responsible for the data platform and pipelines used across the organization. You'll work closely with our engineers, business analysts, medical economics team, actuaries, and more to help define and evolve our platform to meet the growing and changing needs of the business. 


What's Expected:

  • Design, build, and maintain scalable data pipelines from scratch.
  • Optimize existing data pipelines for performance, reliability, and efficiency.
  • Architect and manage cloud-based data infrastructure 
  • Utilize data orchestration tools to schedule and monitor workflows.
  • Develop and optimize complex SQL queries and scripts for data processing.
  • Design and implement real-time data streaming solutions.
  • Build and maintain API-based data integrations to facilitate seamless data exchange between systems.
  • Work with data processing frameworks for efficient data transformations.
  • Implement best practices for data modeling, governance, and security.
  • Deploy and manage containerized applications using Kubernetes.
  • Develop and maintain CI/CD pipelines to streamline data deployment and integration processes.
  • Collaborate with cross-functional teams, including analytics, product, and engineering, to ensure data availability and quality.
  • Stay current with industry trends and emerging technologies to continuously improve data engineering practices.


Requirements

What's Required:

  • Integrity: The right way is the only way. 
  • Dependability: You do what you say you're going to do. 
  • Advocacy: You fight for the best possible outcome for providers and their patients. 
  • Clarity: You make it all understandable. 

Education:

  •  Bachelor's degree in Computer Science, Management Information Systems, or a related field, or equivalent experience

Certifications:

  • N/A

Years of Related Experience:

  • 4+ years of data engineering experience
  • 3+ years of cloud engineering experience
  • 2+ years of senior product management experience 
  • 3+ years of Python and SQL experience
  • dbt experience is a plus
  • Health care data experience is a plus

Skills/Competencies/Behaviors:

  • Strong expertise in Python, dbt, and SQL for data transformation and manipulation.
  • Proficiency in data orchestration tools like Apache Airflow or Dagster.
  • Experience working with data warehouses such as Snowflake.
  • Proficiency in big data technologies such as Apache Spark.
  • Experience with real-time data streaming technologies like Kafka is a plus.
  • Strong understanding of API-based data integrations.
  • Knowledge of CI/CD practices for data engineering.
  • Familiarity with containerization tools like Docker and Kubernetes.
  • Strong analytical and problem-solving skills with the ability to work in a fast-paced environment.
  • Excellent communication skills.
  • Experience with workflow automation and data governance best practices.