Data Airflow

60 Data Airflow Jobs Hiring Near You

... Apache Airflow, keeping critical processes flowing as smoothly as a well‑timed morning coffee ... You'll get to collaborate with data engineers, platform teams, and stakeholders to ensure workflows ...

Data Architect

El Segundo, CA · On-site

$68 - $87.25/hr

BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.). Python Programming ... Experience with SQL and NoSQL modern data stores.

Data Engineer: Data Ops

Cupertino, CA · Hybrid

$141K - $169K/yr

The ideal candidate will have expertise in SQL, Python, Airflow, Spark , and modern data platforms, along with hands-on experience supporting production data pipelines and resolving complex issues.

Data Engineer

Jersey City, NJ · On-site

$119K - $143K/yr

Must have: -Python -Apache Airflow/DBT -Communication, both written & verbal -Kubernetes -OpenShift -8+ years of experience We are seeking a highly skilled Senior Data Engineer with 8+ years of hands ...

$114K - $137K/yr

We are looking for an experienced Snowflake Data Engineer with strong skills in SQL, Airflow, and UNIX to join our dynamic data engineering team. In this role, you will design, implement, and ...

Snowflake | SQL | Python | AWS | Oracle | Airflow | ETL/ELT | Data Warehousing | Data Modeling | Snowpark | AI/GenAI | Data Governance Summary: We are seeking a skilled Data Engineer to design ...

data engineer

Glen Allen, VA · Remote

$106K - $127K/yr

Data Engineer with snowflake, vertica, ETL, MySQL, Airflow Location: Remote Duration: 6 months Responsibilities: * Design and implement robust ETL/ELT pipelines to ingest, transform, and load data ...

Data Engineer

Manhattan, NY · On-site

$125K - $150K/yr

Working with Snowflake, dbt, Airflow, and AWS infrastructure, you will ingest data from diverse sources, transform it to meet business requirements, and ensure data quality and performance at scale.

Data Engineer

Manhattan, NY · On-site

$125K - $150K/yr

Working with Snowflake, dbt, Airflow, and AWS infrastructure, you will ingest data from diverse sources, transform it to meet business requirements, and ensure data quality and performance at scale.

Data Engineer

Rahway, NJ · On-site

$116K - $139K/yr

We are looking for a highly skilled Data Engineer with strong experience in SQL, DBT, Python, Airflow, and Databricks. * Strong proficiency in SQL and relational database concepts. * Hands-on ...

Showing results 41-60

Data Airflow Jobs Information

Infographic showing various job openings at Data Airflow in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% Physical job distribution.

System Administrator (GCP/AWS/Azure, PySpark, BigQuery, and Google Airflow)

Supplier Login

San Jose, CA • On-site

$134K - $161K/yr

Full-time

Re-posted 15 days ago


Job description

Job Overview: This role involves managing and optimizing Big Data environments (PySpark, BigQuery, Airflow) across Google Cloud, AWS, or Azure platforms, ensuring efficient, secure, and cost-effective operations. Key responsibilities include 24x7 support, data pipeline optimization, automation, and troubleshooting, with a strong emphasis on DevOps, CI/CD, and disaster recovery.

Roles and Responsibilities: (Google Cloud/AWS/Azure, PySpark, BigQuery, and Google Airflow)
  • Participate in 24x7x365 rotational shift support and operations for SAP environments.
  • Serve as a team lead responsible for maintaining the upstream Big Data ecosystem, handling millions of financial transactions daily using PySpark, BigQuery, Dataproc, and Google Airflow.
  • Streamline and optimize existing Big Data systems and pipelines while developing new ones, ensuring efficient and cost-effective performance.
  • Manage the operations team during your designated shift and make necessary changes to the underlying infrastructure.
  • Provide day-to-day support, improve platform functionality using DevOps practices, and collaborate with development teams to enhance database operations.
  • Architect and optimize data warehouse solutions using BigQuery to enable efficient data storage and retrieval.
  • Install, build, patch, upgrade, and configure Big Data applications.
  • Administer and configure BigQuery environments, including datasets and tables.
  • Ensure data integrity, availability, and security on the BigQuery platform.
  • Implement partitioning and clustering strategies for optimized query performance.
  • Define and enforce access policies for BigQuery datasets.
  • Set up query usage caps and alerts to control costs and prevent overages.
  • Troubleshoot issues in Linux-based systems with strong command-line proficiency.
  • Create and maintain dashboards and reports to monitor key metrics such as cost and performance.
  • Integrate BigQuery with other GCP services like Dataflow, Pub/Sub, and Cloud Storage.
  • Enable BigQuery usage through tools such as Jupyter Notebook, Visual Studio Code, and CLI utilities.
  • Implement data quality checks and validation processes to maintain data accuracy.
  • Manage and monitor data pipelines using Airflow and CI/CD tools like Jenkins and Screwdriver.
  • Collaborate with data analysts and scientists to gather data requirements and translate them into technical implementations.
  • Provide guidance and support to application development teams for database design, deployment, and monitoring.
  • Demonstrate proficiency in Unix/Linux fundamentals, scripting in Shell/Perl/Python, and using Ansible for automation.
  • Contribute to disaster recovery planning and ensure high availability, including backup and restore operations.
  • Experience with geo-redundant databases and Red Hat clustering is a plus.
  • Ensure timely delivery within defined SLAs and project milestones, adhering to best practices for continuous improvement.
  • Coordinate with support teams including DB, Google, PySpark data engineering, and infrastructure.
  • Participate in Incident, Change, Release, and Problem Management processes.

Must Have Skills, Experience:
  • 4-8 years of relevant experience.
  • Strong experience with Big Data technologies including PySpark, BigQuery, and Google Airflow.
  • Hands-on expertise in cloud platforms (Google Cloud, AWS, or Azure) and Linux system troubleshooting.
  • Proficiency in automation and DevOps tools such as Shell/Python scripting, CI/CD processes, and Ansible.