Irving, TX · Remote
$55 - $60/hr
Strong experience in Apache Airflow (DAG design, schedulers, executors) * Hands-on data ingestion, transformation, routing, and enrichment pipelines * Experience building and integrating Java Spring ...
Quick apply
Irving, TX · Remote
$55 - $60/hr
Strong experience in Apache Airflow (DAG design, schedulers, executors) * Hands-on data ingestion, transformation, routing, and enrichment pipelines * Experience building and integrating Java Spring ...
Chicago, IL · On-site
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Chicago, IL · On-site
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Annapolis, MD · On-site
$113K - $136K/yr
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Annapolis, MD · On-site
$113K - $136K/yr
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Chicago, IL · Hybrid
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Chicago, IL · Hybrid
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Chicago, IL · On-site
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Chicago, IL · On-site
$102K - $137K/yr
Use Alteryx or Airflow DAG and SQL to design and implement ETL pipelines, automate ingestion and transformation workflows, and perform data validation and reconciliation for regulatory and analytics ...
Jersey City, NJ · On-site
$119K - $143K/yr
Design, develop, and maintain complex Airflow DAGs for batch and event-driven data pipelines * Implement best practices for DAG performance, dependency management, retries, SLA monitoring, and ...
Jersey City, NJ · On-site
$119K - $143K/yr
Design, develop, and maintain complex Airflow DAGs for batch and event-driven data pipelines * Implement best practices for DAG performance, dependency management, retries, SLA monitoring, and ...
Alpharetta, GA · On-site
... Apache Airflow(DAG) • Good experience in Kubernetes, Terraform, Orchestration. Qualifications : Required : • 12+ years of experience • Hands on experience in Java/J2EE Programming • ...
Alpharetta, GA · On-site
... Apache Airflow(DAG) • Good experience in Kubernetes, Terraform, Orchestration. Qualifications : Required : • 12+ years of experience • Hands on experience in Java/J2EE Programming • ...
Austin, TX · On-site
$105K - $143K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
Quick apply
Austin, TX · On-site
$105K - $143K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
Phoenix, AZ · On-site
$100K - $135K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
Quick apply
Phoenix, AZ · On-site
$100K - $135K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
$108K - $147K/yr
Understanding of cloud-native solutions and architecture is critical • Strong knowledge and hands-on experience in as Python, SQL ,Terraform, CI/CD , Git flows, Attunity , AutoSys, Airflow Dag ...
$108K - $147K/yr
Understanding of cloud-native solutions and architecture is critical • Strong knowledge and hands-on experience in as Python, SQL ,Terraform, CI/CD , Git flows, Attunity , AutoSys, Airflow Dag ...
Required : • HDFS • MapReduce • Hive • Pig • Sqoop • Spark • Impala • Flume • Qozie • Airflow DAG Company : Georgia IT, Inc. provides IT Consulting for a wide range of IT services ...
Required : • HDFS • MapReduce • Hive • Pig • Sqoop • Spark • Impala • Flume • Qozie • Airflow DAG Company : Georgia IT, Inc. provides IT Consulting for a wide range of IT services ...
Rancho Cordova, CA · On-site
Client is looking for a BI developer who possesses the following skills: data warehouse design and development, Spark ETL/ELT development, Airflow DAG development, and data mapping and analytics.
Rancho Cordova, CA · On-site
Client is looking for a BI developer who possesses the following skills: data warehouse design and development, Spark ETL/ELT development, Airflow DAG development, and data mapping and analytics.
Annapolis Junction, MD · Hybrid
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Annapolis Junction, MD · Hybrid
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Phoenix, AZ · On-site
$105K - $143K/yr
Experience with Airflow DAG development * Hands‑on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling ...
Phoenix, AZ · On-site
$105K - $143K/yr
Experience with Airflow DAG development * Hands‑on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling ...
Austin, TX · On-site
$114K - $137K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
Quick apply
Austin, TX · On-site
$114K - $137K/yr
Experience with Airflow DAG development * Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) * Experience building APIs using FastAPI * Strong SQL and data modeling knowledge
New York, NY · On-site
$134K - $176K/yr
Required Skills: 3+ years Astronomer/Airflow DAG development 5+ years Python coding experience. 5+ years - SQL Server based development of large datasets 5+ years with Experience with developing and ...
Quick apply
New York, NY · On-site
$134K - $176K/yr
Required Skills: 3+ years Astronomer/Airflow DAG development 5+ years Python coding experience. 5+ years - SQL Server based development of large datasets 5+ years with Experience with developing and ...
Las Vegas, NV · On-site
$98K - $129K/yr
Apache Airflow (DAG development, workflow orchestration) * Snowflake * Advanced SQL (complex queries, performance tuning) * Apache Kafka (streaming, event-driven architectures) * API development and ...
Las Vegas, NV · On-site
$98K - $129K/yr
Apache Airflow (DAG development, workflow orchestration) * Snowflake * Advanced SQL (complex queries, performance tuning) * Apache Kafka (streaming, event-driven architectures) * API development and ...
Sunnyvale, CA · On-site
$61.50 - $84.25/hr
Resources such as EKS, Fargate, KMS, SQS, SNS, Lambda, IAM, s3, EFS, Elastic cache, Apache Managed Airflow , DAG , VPC, subnets, ALB, NLB, etc since we use all of these in our day-to-day activities ...
Sunnyvale, CA · On-site
$61.50 - $84.25/hr
Resources such as EKS, Fargate, KMS, SQS, SNS, Lambda, IAM, s3, EFS, Elastic cache, Apache Managed Airflow , DAG , VPC, subnets, ALB, NLB, etc since we use all of these in our day-to-day activities ...
Annapolis, MD · On-site
$113K - $136K/yr
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
Annapolis, MD · On-site
$113K - $136K/yr
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows * Experience using Distributed Big Data processing engines ...
| Aspect | Airflow Dag | Airflow Operator |
|---|---|---|
| Definition | A collection of tasks organized to define a workflow in Apache Airflow. | A single task or unit of work within a DAG, responsible for executing specific actions. |
| Function | Orchestrates and schedules multiple tasks to run in a sequence or parallel. | Performs a specific operation, such as data transfer or transformation. |
| Usage | Used to define entire workflows in Airflow. | Used within DAGs to perform individual steps. |
| Credentials/Certifications | Requires knowledge of Python, Airflow setup, and scheduling concepts. | Requires understanding of task-specific operations and Airflow operators. |
In summary, an Airflow DAG is a blueprint for a workflow, organizing multiple tasks, while an Airflow Operator is a single task that performs a specific function within that workflow. Both are essential for building and managing data pipelines in Airflow.
Irving, TX • Remote
$55 - $60/hr
Contractor
Re-posted 26 days ago
Job Description
Must have hands-on Experience highlight:
Must-Have Skills set (Technical & Functional):
Must have Keywords in resume:
Apache NiFi, Airflow, Java, Spring Boot, Microservices, Kafka, Data Pipelines, ETL, Workflow Orchestration, DAGs, Streaming Architecture, SQL
What exactly Client looking (Job description in short):
Client is seeking a Java Tech Lead with strong Apache NiFi and Airflow expertise to design, build, and optimize enterprise-scale data pipelines. The role focuses on data ingestion, transformation, routing, workflow orchestration, and performance tuning.
Sourced by ZipRecruiter
SMART-iPLACE provides innovative staffing and consulting solutions that help our clients achieve their business objectives. We can understand and support all areas of your IT systems from back-end infrastructure to front-end personal productivity. Our goal is create innovative IT solutions that enable your business to be more agile and competitive.
It services
51 - 200 Employees
Irving, TX, US
2021
