ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Arizona

Navtech, Inc.

Big Data Engineer with Java

Phoenix, AZ · On-site

$54.25 - $71.75/hr

Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large ... The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze ...

Twice

Data Engineer

Scottsdale, AZ · On-site

$80 - $100/hr

Experience with PySpark, Spark, or Databricks * Familiarity with Delta Lake and lakehouse architectures * Experience with CI/CD pipelines and DevOps practices in Azure * Knowledge of data governance ...

Troon

Data Engineer

Scottsdale, AZ

$114K - $137K/yr

Experience with PySpark, Spark, or Databricks * Familiarity with Delta Lake and lakehouse architectures * Experience with CI/CD pipelines and DevOps practices in Azure * Knowledge of data governance ...

Meraki7 Inc

Databricks Engineer

Phoenix, AZ · On-site

Databricks Engineer Role Overview We are seeking a highly skilled Databricks Engineer to lead the ... Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming ...

Radix Software, Inc

Data Engineer

Scottsdale, AZ · On-site

$120 - $180/hr

Deep expertise with Databricks (or similar modern data platforms), dbt, SQL, Python, and scalable ... engineering productivity while maintaining trust, accuracy, and governance. * Familiar with ...

Honeywell International, Inc.

Data Engineer II

Phoenix, AZ · On-site

$107K - $128K/yr

As a Data Engineer II here at Honeywell Aerospace, you will play an essential role in developing ... Hands-on experience with Dataiku (flows, recipes, scenarios, plugins) and Databricks (Spark, Delta ...

Troon International

Data Engineer

Scottsdale, AZ · On-site

$90 - $120/hr

Experience with PySpark, Spark, or Databricks * Familiarity with Delta Lake and lakehouse architectures * Experience with CI/CD pipelines and DevOps practices in Azure * Knowledge of data governance ...

Troon Golf

Data Engineer

Scottsdale, AZ · On-site

$114K - $137K/yr

Experience with PySpark, Spark, or Databricks * Familiarity with Delta Lake and lakehouse architectures * Experience with CI/CD pipelines and DevOps practices in Azure * Knowledge of data governance ...

Stellar IT Group

Data Engineer

Phoenix, AZ · On-site

$113K - $136K/yr

Data Engineer Location: Phoenix, AZ(Hybrid) Job Type: FTE Key Responsibilities Data Platform ... Design, develop, and maintain cloud-native data pipelines using Databricks, Microsoft Azure Data ...

Forhyre

Data Engineer

Phoenix, AZ

$113K - $136K/yr

Databricks Nice to have: Informatica/ETL. Responsibilities * Design and develop ETL processes based ... Proven working experience as a data engineer * Bachelor degree or equivalent in Computer Science

Conflux Systems

Databricks Engineer

Phoenix, AZ · On-site

Databricks Engineer Role Overview We are seeking a highly skilled Databricks Engineer to lead the ... Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming ...

RIT Solutions, Inc.

AWS data engineer

Chandler, AZ · On-site

$63.50 - $83.50/hr

Responsibilities : • Must have: aws data, datazone, databricks, glue or spark, python, data warehousing, CI/CD • Bachelor's degree in Computer Science, Engineering or related field • 5+ years ...

Globe Telecom, Inc.

Data Engineer Manager

Globe, AZ

$108K - $130K/yr

Implement end-to-end data flows using modern data engineering tools (e.g., Spark, Airflow, dbt, Snowflake, Databricks). 2. Data Engineering Strategy & Governance * Define and champion data ...

Koantek

Databricks Platform Architect

Chandler, AZ · Remote

CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing ... Preferred Certifications Databricks Certified Data Engineer Associate / Professional Databricks ...

previous pagenext page

Showing results 21-40

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Arizona

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Arizona?

The most popular types of Databricks Data Engineer jobs in Arizona are:

What cities in Arizona are hiring for Overnight Databricks Data Engineer jobs?

Cities in Arizona with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Big Data Engineer with Java

Navtech, Inc.

Phoenix, AZ • On-site

$54.25 - $71.75/hr

Contractor

Re-posted 18 days ago

Job description

Big Data Engineer with Java
Location: Remote
Duration: 12 Months Contract
Qualifications:
  • Bachelor's Degree in a Technical Discipline or equivalent work experience
  • Must have experience with Big Data toolsets: Hadoop echo system, Spark, Databricks, and Azure-based services
  • Experience with medium to large scale data structures/data lakes
  • Experience with both Streaming and Batch Data Ingestion (Lambda)
  • Experience with Java
  • Must have experience in Streaming technologies (Kafka, Spark structured streaming, Databricks)
  • Must have a minimum of 5 years of overall Technology experience with at least 2 years of Big Data (Hadoop, Spark, and Azure HDInsights) experience
  • Experience working with data preparation and data quality

Responsibilities:
  • The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze, design, and deliver data products that enable NCR's business
  • You will evaluate business questions, find the right data sets, ensure the cleanliness of the data, and build scalable and clean solutions that can be deployed in a production environment
  • Along the way, you'll partner with our Azure Infrastructure, Visualization, Advanced Analytics, and Engineering teams to consistently deliver quality data products
Navtech logo

About Navtech

Sourced by ZipRecruiter

Industry

Civil engineering construction

Company size

11 - 50 Employees

Headquarters location

New Bloomfield, PA, US

Year founded

1996

View All Navtech Jobs

Apply