Data Engineer
$117K - $140K/yr
Azkaban, Luigi, Airflow, etc. • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
$117K - $140K/yr
Azkaban, Luigi, Airflow, etc. • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
$117K - $140K/yr
Azkaban, Luigi, Airflow, etc. • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Roanoke, TX · On-site
$48.25 - $66.50/hr
... Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise. • Experience with cloud based services (AWS Preferred). The Role As a Machine Learning Engineer, you will build and ...
Roanoke, TX · On-site
$48.25 - $66.50/hr
... Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise. • Experience with cloud based services (AWS Preferred). The Role As a Machine Learning Engineer, you will build and ...
Jersey City, NJ · On-site
$52.50 - $72.25/hr
... Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise. • Experience with cloud based services (AWS Preferred). The Role As a Machine Learning Engineer, you will build and ...
Jersey City, NJ · On-site
$52.50 - $72.25/hr
... Luigi, Kubeflow, or equivalent). Solid cloud experience. Solid cloud expertise. • Experience with cloud based services (AWS Preferred). The Role As a Machine Learning Engineer, you will build and ...
Cincinnati, OH · On-site
$109K - $132K/yr
... Luigi) -Familiarity with organizing data using Medallion Pattern and understanding centralization vs. decentralization approaches (including Data Mesh principles) -Strong problem-solving ...
Cincinnati, OH · On-site
$109K - $132K/yr
... Luigi) -Familiarity with organizing data using Medallion Pattern and understanding centralization vs. decentralization approaches (including Data Mesh principles) -Strong problem-solving ...
Jersey City, NJ · On-site
$126K - $170K/yr
Experience with CI/CD tools (e.g., Jenkins or equivalent), version control (Git), orchestration/DAGs tools (AWS Step Functions, Airflow, Luigi, Kubeflow, or equivalent). Solid cloud experience.
Jersey City, NJ · On-site
$126K - $170K/yr
Experience with CI/CD tools (e.g., Jenkins or equivalent), version control (Git), orchestration/DAGs tools (AWS Step Functions, Airflow, Luigi, Kubeflow, or equivalent). Solid cloud experience.
Bellmawr, NJ · On-site
$24 - $30.75/hr
Its products include such icons as SUPERPRETZEL, ICEE, and Dippin' Dots along with other key brands like LUIGI'S Real Italian Ice, The Funnel Cake Factory Funnel Cakes, and Hola Churros. J&J also has ...
Bellmawr, NJ · On-site
$24 - $30.75/hr
Its products include such icons as SUPERPRETZEL, ICEE, and Dippin' Dots along with other key brands like LUIGI'S Real Italian Ice, The Funnel Cake Factory Funnel Cakes, and Hola Churros. J&J also has ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
OR · Remote
$63 - $83/hr
Airflow, AWS Managed Airflow, Luigi, NiFi Why phData? We offer: * Remote-First Work Environment * Casual, award-winning small-business work environment * Collaborative culture that prizes autonomy ...
OR · Remote
$63 - $83/hr
Airflow, AWS Managed Airflow, Luigi, NiFi Why phData? We offer: * Remote-First Work Environment * Casual, award-winning small-business work environment * Collaborative culture that prizes autonomy ...
New York, NY · On-site
$150K - $350K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
New York, NY · On-site
$150K - $350K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
Seattle, WA · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Seattle, WA · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Plano, TX · On-site +1
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Plano, TX · On-site +1
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Plano, TX · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Plano, TX · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
MA · On-site +1
$142K - $201K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
MA · On-site +1
$142K - $201K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Portsmouth, NH · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
Portsmouth, NH · On-site +1
$120K - $257K/yr
Work with workflow and modeling tools such as Luigi, Airflow, Celery, MLflow, H2O, scikit-learn, Optuna, and LightGBM, as well as Python development tools such as Pydantic, FastAPI, uv, ruff, and ...
New York, NY · On-site
$200K - $350K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
New York, NY · On-site
$200K - $350K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
$117K - $140K/yr
Proficiency with open source ETL frameworks, such as Apache Airflow, Luigi, or similar * Proficiency with Git * Proficiency with AWS Services including * Glue * EMR * Lambda * RDS * S3 * Athena
$117K - $140K/yr
Proficiency with open source ETL frameworks, such as Apache Airflow, Luigi, or similar * Proficiency with Git * Proficiency with AWS Services including * Glue * EMR * Lambda * RDS * S3 * Athena
New York, NY · On-site
$220K - $300K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
New York, NY · On-site
$220K - $300K/yr
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the ...
$8.17 - $8.98
1% of jobs
$8.98 - $9.79
5% of jobs
$9.79 - $10.60
6% of jobs
$10.60 - $11.41
7% of jobs
$11.83 is the 25th percentile. Wages below this are outliers.
$11.41 - $12.22
9% of jobs
$12.22 - $13.02
14% of jobs
The median wage is $13.43 / hr.
$13.02 - $13.83
14% of jobs
$13.83 - $14.64
16% of jobs
$14.76 is the 75th percentile. Wages above this are outliers.
$14.64 - $15.45
16% of jobs
$15.45 - $16.26
9% of jobs
$16.26 - $17.07
2% of jobs
$8
$13
$17
A Luigi job typically refers to a task or workflow managed using Luigi, an open-source Python framework for building data pipelines. Luigi helps schedule, organize, and track dependencies between tasks in complex data processing workflows. It is commonly used for ETL (Extract, Transform, Load) processes, machine learning pipelines, and batch processing jobs. Each Luigi job consists of tasks that define input, output, and execution logic, ensuring efficient workflow automation.
| Aspect | Luigi | Data Engineer |
|---|---|---|
| Required Credentials | Typically a degree in CS or related field, experience with Python and data pipelines | Often a degree in CS, software engineering, or related, with skills in data architecture and programming |
| Work Environment | Data pipeline orchestration, automation tasks, often in cloud or on-premise environments | Designing, building, and maintaining data systems, working with databases and big data tools |
| Industry Usage | Used in data workflows, ETL processes, and automation | Involved in data infrastructure, analytics, and data-driven product development |
Luigi is primarily a workflow management tool used for orchestrating data pipelines, while a Data Engineer designs and maintains the entire data infrastructure. Both roles require similar technical skills, but Data Engineers have broader responsibilities in data architecture and system design.

$117K - $140K/yr
Full-time
This job post has expired today. Applications are no longer accepted.