1

Overnight Databricks Data Engineer Jobs in Arizona

The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a ... Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.

CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing ... Preferred Certifications Databricks Certified Data Engineer Associate / Professional Databricks ...

Data Engineer - Manager

Phoenix, AZ · On-site

$99K - $232K/yr

... Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable ... Databricks and Snowflake - Guiding team members in data architecture development and database ...

Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and SQL - Experience with Docker and ...

Data Engineer V MDM Location: Tempe Full Time Job: Yes Contact: Ryan Griffin About the Role We are ... Support integration with modern data platforms including Snowflake, Databricks, Fabric, and related ...

RIT Solutions, Inc. is seeking an AWS Data Engineer to join their team in Chandler, AZ. The role ... DataBricks • Glue, Spark, ETL • Python • CI/CD pipelines • Understanding of data warehouse ...

... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...

... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...

... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...

... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Arizona? The most popular types of Databricks Data Engineer jobs in Arizona are:
What cities in Arizona are hiring for Overnight Databricks Data Engineer jobs? Cities in Arizona with the most Overnight Databricks Data Engineer job openings:
Solution Data Engineer - DG Infomatica Engineer

Solution Data Engineer - DG Infomatica Engineer

Circle K

Tempe, AZ • On-site

$111K - $133K/yr

Full-time

Re-posted 4 days ago


Circle K rating

4.9

Company rating: 4.9 out of 10

Based on 1,330 frontline employees who took The Breakroom Quiz

33rd of 48 rated convenience stores


Job description

Job Summary:
Circle K is seeking a hands-on Informatica Developer to support enterprise data initiatives. The role focuses on designing and maintaining data quality and catalog solutions using Informatica IDMC, ensuring trusted data across cloud and on-prem environments.
Responsibilities:
• Design, develop, and maintain data quality rules, scorecards, and dashboards using Informatica CDQ
• Implement and support metadata ingestion, cataloging, and lineage using Informatica Cloud Data Catalog (EDC/CDGC)
• Onboard application and data source metadata in collaboration with application owners and data engineering teams
• Configure and maintain technical and business assets, custom attributes, and custom lineage within the Informatica catalog
• Extract and publish metadata from cloud and on-prem data sources to support enterprise metadata management
• Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
• Configure and manage Informatica Cloud environments, including Secure Agents and connectivity
• Integrate Informatica with cloud platforms and external systems using REST APIs
• Partner with data engineering and analytics teams to ensure high-quality, well-governed datasets are available for reporting and AI/ML use cases
Qualifications:
Required:
• 3–5+ years of hands-on experience as an Informatica Developer or Data Quality Engineer
• Strong experience with Informatica IDMC, including Cloud Data Quality (CDQ) and Cloud Data Catalog (EDC/CDGC)
• Experience implementing data quality validation rules, monitoring, and reporting
• Hands-on experience with Snowflake and Databricks
• Experience working in Azure cloud environments (AWS exposure is a plus)
• Strong SQL skills and understanding of data warehousing and data modeling concepts
• Experience working with on-prem and cloud data sources
• Experience configuring Informatica Secure Agents and cloud connectivity
• Familiarity with REST APIs and system integrations
Preferred:
• Experience with MDM or governance platforms such as TIBCO EBX
• Experience with Boomi or other integration / ESB tools
• Exposure to data governance concepts such as business glossaries and stewardship workflows (implementation-focused, not ownership)
Company:
Our mission at Circle K is to make our customers' lives a little easier every day. Founded in 1951, the company is headquartered in Laval, CAN, with a team of 10001+ employees. The company is currently Late Stage.

What Circle K employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Circle K logo

About Circle K

Sourced by ZipRecruiter

Circle K Stores are owned by Alimentation Couche-Tard, the largest convenience store operator in Canada. We are recognized for our strong food service brands, Simply Great Coffee, and of course our icy cold, flavour abundant Frosters. Our innovative store design and merchandising is second to none.

Industry

Retail

Company size

10,000+ Employees

Headquarters location

Tempe, AZ, US