1

Data Engineer Airflow Jobs in Virginia (NOW HIRING)

Enterprise Data Engineer

Chantilly, VA ยท On-site +1

$117K - $140K/yr

We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python, SQL ... Familiarity with data orchestration tools such as Apache Airflow, Prefect, or similar About Us For ...

Data Engineer

Arlington, VA

$131K - $158K/yr

540 is seeking a Data Engineer to support a mission-critical technology modernization effort for ... Experience with orchestration tools such as Airflow, Dagster, or Argo Workflows * Experience with ...

Data Engineer

Mclean, VA ยท On-site

$115K - $139K/yr

Data Engineering * Demonstrated experience building production data pipelines and ETL/ELT workflows ... Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow

The Data Engineer will leverage their development skills and experience to support the successful ... Experience with RESTful APIs, data pipelining systems like Apache Airflow, and performing ETL tasks ...

Data Engineer

Arlington, VA ยท On-site

$131K - $158K/yr

540 is seeking a Data Engineer to support a mission-critical technology modernization effort for ... Experience with orchestration tools such as Airflow, Dagster, or Argo Workflows * Experience with ...

Data Engineer

Arlington, VA ยท On-site

$131K - $158K/yr

540 is seeking a Data Engineer to support a mission-critical technology modernization effort for ... Experience with orchestration tools such as Airflow, Dagster, or Argo Workflows * Experience with ...

Data Engineer

Mclean, VA ยท On-site

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Data Engineer

Mclean, VA ยท On-site

$110K - $160K/yr

We are looking for seasoned Data Engineer t o work with our team and our clients to develop ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Staff Data Engineer

Arlington, VA ยท Remote

$185K - $220K/yr

Expertise with batch and streaming data pipelines (Apache Airflow, Benthos) and familiarity with ... Redshift). * DevOps Practices: Proficiency with CI/CD, source control, design reviews, and ...

$185K - $220K/yr

Expertise with batch and streaming data pipelines (Apache Airflow, Benthos) and familiarity with ... Redshift). * DevOps Practices: Proficiency with CI/CD, source control, design reviews, and ...

Data Engineer

Mclean, VA ยท On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Data Engineer

Mclean, VA ยท On-site

$115K - $139K/yr

Data Engineering * Demonstrated experience building production data pipelines and ETL/ELT workflows ... Demonstrated experience with workflow orchestration tools such as Step Functions and Airflow

Data Engineer

Mclean, VA ยท On-site

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Data Engineer

Mclean, VA

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Experience with ETL tools, such as dbt and Airflow * Experience with NoSQL and graph databases, and DevOps tools and automation practices * Experience designing and building data warehouses

Data Engineer

Chantilly, VA ยท On-site

$118K - $142K/yr

NS2 Mission is seeking a Data Engineer to support a project in Chantilly, VA . In this role, you'll ... Experience with workflow orchestration tools such as Apache Airflow, Prefect, or similar ...

Data Engineer

Chantilly, VA ยท On-site

$114K - $190K/yr

The Data Engineer will leverage their development skills and experience to support the successful ... Experience with RESTful APIs, data pipelining systems like Apache Airflow, and performing ETL tasks ...

Data Engineer

Mclean, VA ยท On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)

Data Engineer - Mid

Quantico, VA ยท On-site

$135K - $155K/yr

The Data Engineer - Mid designs, develops, and maintains scalable data pipelines, data models, and ... tools (e.g., Airflow). * Experience supporting USMC CD&I or other DoD headquarters/staff ...

Showing results 41-60

Data Engineer Airflow information

What is the difference between Data Engineer Airflow vs Data Engineer?

AspectData Engineer AirflowData Engineer
Primary FocusWorkflow orchestration and pipeline automation using AirflowData collection, storage, transformation, and pipeline development
Required SkillsPython, Airflow, ETL processes, cloud platformsSQL, Python, ETL, data modeling, cloud services
Work EnvironmentData teams, cloud environments, automation pipelinesData warehouses, big data platforms, cloud infrastructure
CertificationsAirflow certifications, Python, cloud certificationsSQL, cloud certifications, data engineering certifications

While both roles involve data pipeline work, Data Engineer Airflow specializes in designing and managing workflows with Airflow, focusing on automation and orchestration. In contrast, Data Engineer has a broader scope, including data storage, transformation, and pipeline development across various tools and platforms.

What does a data engineer specializing in Airflow do?

A Data Engineer specializing in Airflow is responsible for designing, building, and maintaining data pipelines using Apache Airflow, an open-source workflow orchestration tool. Their main job is to automate, schedule, and monitor complex data workflows, ensuring data moves reliably between systems and is processed efficiently. They often collaborate with data scientists, analysts, and other engineers to make sure that data is accessible, accurate, and up to date for business needs. Expertise in Airflow helps streamline data operations, optimize performance, and improve data pipeline reliability.

What are the key skills and qualifications needed to thrive as a data engineer specializing in Airflow, and why are they important?

To thrive as a Data Engineer with an Airflow focus, you need strong programming skills in Python, expertise in data pipeline design, and experience with distributed systems, often supported by a degree in computer science or a related field. Familiarity with Apache Airflow, cloud platforms (like AWS or GCP), and database technologies, as well as certifications in cloud data engineering, are typically required. Outstanding problem-solving, attention to detail, and effective communication help you collaborate on complex data workflows and troubleshoot issues efficiently. These skills ensure robust, scalable, and reliable data infrastructure, enabling organizations to make data-driven decisions with confidence.

How does a data engineer specializing in Airflow typically collaborate with data scientists and analysts?

Data Engineers working with Airflow play a crucial role in enabling data scientists and analysts to access reliable, up-to-date data. They design and maintain ETL pipelines that automate data movement and transformation, ensuring data is clean and available for analysis. Collaboration often involves gathering requirements, troubleshooting pipeline issues, and optimizing data workflows to meet the needs of downstream users. Effective communication and documentation are essential, as data engineers must align technical solutions with the analytical goals of the broader team.

What are popular job titles related to Data Engineer Airflow jobs in Virginia?

For Data Engineer Airflow jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Data Engineer Airflow jobs in Virginia look for?

The top searched job categories for Data Engineer Airflow jobs in Virginia are:

What cities in Virginia are hiring for Data Engineer Airflow jobs?

Cities in Virginia with the most Data Engineer Airflow job openings:

Enterprise Data Engineer

NewGen

Chantilly, VA โ€ข On-site, Remote

$117K - $140K/yr

Full-time

Re-posted 16 days ago


Job description

We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python, SQL, and Palantir (or other ETL platforms) to extract, transform, and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep understanding of ETL processes.
CLEARANCE REQUIRED: TS/SCI Full Scope Polygraph
Responsibilities
  • Write robust and efficient Python and SQL scripts to automate data processing tasks
  • Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems
  • Implement data transformations, enrichment, and modeling workflows to ensure data quality and usability
  • Ensure data structures are optimized for performance and scalability
  • Provide technical guidance and support to ensure effective use of Palantir tools across teams
  • Implement data quality checks, validation, and monitoring mechanisms to ensure the accuracy and reliability of datasets
  • Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems
  • Ensure proper data transformation and curation to meet business and analytics requirements
  • Maintain and improve data quality, consistency, and accuracy through validation and cleansing processes
Requirements
  • TS/SCI FSP Clearance
  • 3+ years of experience in data engineering
  • Strong proficiency in scripting and programming with Python
  • Expertise in working with SQL for data querying, transformation, and optimization
  • Experience with data integration from diverse sources such as APIs, relational databases, and file systems
  • Strong analytical and problem-solving skills with attention to detail
  • Excellent communication and teamwork skills to collaborate with technical and business teams
Desired Skills
  • Bachelor's degree in Computer Science, Data Engineering, or a related field
  • Hands-on experience with Palantir
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Apache Spark, Hadoop)
  • Familiarity with data orchestration tools such as Apache Airflow, Prefect, or similar

About Us
For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ