ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs (NOW HIRING)

NMK Global Inc.

Azure Databricks Data Architect

Trappe, PA · On-site

$63 - $81/hr

Job Title: Azure Databricks Data Architect Location: Collegeville, PA We are looking for an ... Collaborate with Agile and DevOps teams for CI/CD and deployment automation. * Design enterprise ...

NMK Global Inc.

Azure Databricks Data Architect

Trappe, PA · On-site

$63 - $81/hr

Job Title: Azure Databricks Data Architect Location: Collegeville, PA We are looking for an ... Collaborate with Agile and DevOps teams for CI/CD and deployment automation. * Design enterprise ...

Kanak Elite Services Inc

Data Engineer

Bay Point, CA · On-site

$125K - $151K/yr

Databricks Data Engineer Location: [Bay Area, CA] Duration : 12+ Months Need experience with Databricks Job Summary: We are seeking a skilled Data Engineer with hands-on Databricks experience to ...

Slide Insurance

Data Engineer

Tampa, FL · On-site

$108K - $129K/yr

As an Azure Databricks Data Engineer at Slide, you will build and support data pipelines using Azure Data Factory , Databricks , PySpark , and Spark SQL . You'll partner with engineering and business ...

Tata Consultancy Services

Sr. Databricks Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Tata Consultancy Services is seeking a hands-on Sr. Databricks Data Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong experience ...

Deloitte

Databricks Data Engineering Manager

Sacramento, CA · On-site

$122K - $146K/yr

Work you'll do As a Lead Data Engineer II in our AI & Data practice, you will leverage your ... Professional Databricks certifications (e.g., Data Engineer Professional, Machine Learning ...

Deloitte

Databricks Data Engineering Manager

Rosslyn, VA · On-site

$130K - $156K/yr

Work you'll do As a Lead Data Engineer II in our AI & Data practice, you will leverage your ... Professional Databricks certifications (e.g., Data Engineer Professional, Machine Learning ...

Deloitte

Databricks Data Engineering Manager

Arlington, VA · On-site

$131K - $158K/yr

Work you'll do As a Lead Data Engineer II in our AI & Data practice, you will leverage your ... Professional Databricks certifications (e.g., Data Engineer Professional, Machine Learning ...

Tata Consultancy Services

Databricks Lead

Raleigh, NC · On-site

$99K - $131K/yr

Tata Consultancy Services is seeking a Databricks Lead to design, develop, and optimize data ... The ideal candidate will have extensive experience in data engineering, ETL development, and ...

Sono Bello

Data Engineer

Bellevue, WA · Hybrid

$125K - $140K/yr

Use Databricks Workflows or similar orchestration tools to schedule jobs, manage dependencies, and implement data quality checks * Optimize data models for analytics, reporting, and machine-learning ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer Jobs

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities are hiring for Overnight Databricks Data Engineer jobs? Cities with the most Overnight Databricks Data Engineer job openings:
What are the most commonly searched types of Databricks Data Engineer jobs? The most popular types of Databricks Data Engineer jobs are:
What states have the most Overnight Databricks Data Engineer jobs? States with the most job openings for Overnight Databricks Data Engineer jobs include:
Overnight Databricks Data Engineer jobs near you
Azure Databricks Data Architect

Azure Databricks Data Architect

NMK Global Inc.

Trappe, PA • On-site

$63 - $81/hr

Other

Posted 3 days ago

Job description

NMK Global Inc. is a global IT Services & Solutions company specializing in IT Staffing, Technology Consulting, Workforce Solutions, and Application Development Services. We help organizations build high-performing technology teams by connecting them with exceptional talent across a wide range of industries. Our expertise, industry knowledge, and consultative approach enable clients to achieve successful business outcomes while helping professionals advance their careers.

Job Title: Azure Databricks Data Architect
Location: Collegeville, PA

Job Description

We are looking for an experienced Azure Databricks Data Architect with strong expertise in designing enterprise-scale data platforms, modern data architectures, and cloud-based analytics solutions. The ideal candidate should have deep knowledge of Azure services, Databricks, data modeling, ETL/ELT frameworks, and modern data warehousing concepts.

The candidate should possess strong architectural skills, understand emerging digital technologies, and be capable of designing scalable, secure, and high-performing data solutions.

Responsibilities:

  • Design end-to-end enterprise data architecture and lifecycle management.
  • Develop conceptual, logical, and physical data models.
  • Design scalable ETL/ELT pipelines for enterprise data platforms.
  • Build modern batch and streaming data architectures.
  • Architect data solutions using Azure Databricks and Delta Lake.
  • Implement Databricks Workflows for orchestration and automation.
  • Develop solutions using Apache Spark, PySpark, SQL, and Python.
  • Design secure data access strategies using Unity Catalog.
  • Work closely with platform vendors and solution teams to deliver enterprise architecture.
  • Ensure compliance with Information Security and Data Governance standards.
  • Support IoT data collection platforms and enterprise digital transformation initiatives.
  • Collaborate with Agile and DevOps teams for CI/CD and deployment automation.
  • Design enterprise data warehouse solutions and optimize data performance.
  • Stay updated on emerging digital technologies and cloud platforms.

Required Skills:

  • Microsoft Azure
  • Azure Databricks
  • Delta Lake
  • Unity Catalog
  • Databricks Workflows
  • Databricks SQL
  • Apache Spark
  • PySpark
  • SQL
  • Python
  • Data Modeling
  • ETL / ELT Design
  • Batch Data Processing
  • Streaming Data Architectures
  • Data Warehousing
  • Information Security
  • Data Governance
  • Agile Methodology
  • DevOps
  • IoT Platforms

Preferred Skills:

  • Google Cloud Platform (Google Cloud Platform)
  • Amazon Web Services (AWS)
  • Digital Transformation Architecture
  • Manufacturing & Asset Management Solutions
  • Business Automation Platforms

Experience Required:

  • Strong experience in Azure Data Engineering and Data Architecture.
  • Hands-on expertise with Azure Databricks ecosystem.
  • Experience designing enterprise-scale data models.
  • Strong knowledge of ETL/ELT frameworks.
  • Experience with Delta Lake and Unity Catalog.
  • Expertise in batch and streaming architectures.
  • Experience implementing enterprise data warehouse solutions.
  • Familiarity with Agile and DevOps practices.
  • Knowledge of IoT data platforms is a plus.

NMK Global Inc. is an Equal Opportunity Employer. We are committed to creating an inclusive workplace and consider all qualified applicants without regard to age, race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender identity, or any other characteristic protected by applicable law.

Apply