ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Monroe, NC

Pwc

Data Engineer - Senior Manager

Charlotte, NC · On-site

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Pwc

Data Engineer - Manager

Charlotte, NC · On-site

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

The AES Group

Lead Data Engineer

Charlotte, NC · On-site

$100K - $131K/yr

Lead Data Engineer - Azure Databricks Location: Charlotte, North Carolina 28273 Work Arrangement: 5 days onsite Employment Consideration: Contract to Hire Let's create our future together at The AES ...

Programmers.io

Azure Data Engineer

Charlotte, NC · On-site

$111K - $134K/yr

· Cloud & Data Engineer with hands-on experience deploying and administering Azure resources ... in Databricks administration and PySpark development, delivering high-performance ELT pipelines ...

Sunbelt Rentals

Data Engineer

Fort Mill, SC · On-site

$113K - $155K/yr

Develop and maintain data ingestion and transformation pipelines on Databricks using Python and SQL ... Collaborate with senior engineers, analysts, and data scientists to understand requirements and ...

Sunbelt Rentals

Data Engineer

Fort Mill, SC · On-site

$113K - $155K/yr

Develop and maintain data ingestion and transformation pipelines on Databricks using Python and SQL ... Collaborate with senior engineers, analysts, and data scientists to understand requirements and ...

Guidehouse

Data Engineer

Charlotte, NC

$53K - $88K/yr

Guidehouse seeks a Data Engineer I to support the development, maintenance, and enhancement of data ... Exposure to Databricks, Spark, or large-scale data processing technologies. * Familiarity with ...

Guidehouse

Data Engineer

Charlotte, NC · On-site

$53K - $88K/yr

Guidehouse seeks a Data Engineer I to support the development, maintenance, and enhancement of data ... Exposure to Databricks, Spark, or large-scale data processing technologies. * Basic understanding ...

Amicis Global

Data Engineer

Charlotte, NC · On-site

$50 - $70/hr

Well-versed with Azure Databricks * Strong SQL skills with RDMS or NoSQL databases * Experience with developing API's using FastAPI or similar frameworks in Python * Familiarity with the DevOps ...

1 point system

Data Engineer

Rock Hill, SC · Remote

$117K - $140K/yr

Requirement - Data Engineer Location- USA Remote Contract W2 Assessment test required Assessment ... Working knowledge of big data/cloud technologies (Databricks, AWS, Azure, Hadoop, Spark, Snowflake ...

Snowrelic Inc

Lead Data Engineer

Charlotte, NC · On-site

$100K - $131K/yr

Position:  Lead Data Engineer Location: Cincinnati ,OH / Charlotte ,NC ... Design and implement scalable data pipelines and architectures on Azure Databricks.  * Optimize ...

Guidehouse

Data Engineer Lead

Charlotte, NC

Experience with Databricks, Snowflake, or similar distributed data processing platforms. * Experience implementing and managing CI/CD pipelines, infrastructure automation, and DevOps practices.

Sunbelt Rentals

Sr. Data Engineer

Fort Mill, SC · On-site

$130K - $179K/yr

Design, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks using ... Define and enforce data engineering best practices, including pipeline design patterns, data ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Monroe, NC

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

Overnight Databricks Data Engineer jobs near you

Databricks Data Architect

Charlotte, NC • On-site

Unison Group
See more jobs at Unison Groupexternal

$62.25 - $80/hr

Full-time

Posted yesterday

New

Job description

  • We’re seeking a hands-on experience in Databricks with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions.
  • In this role, you’ll design, develop, and operationalize Delta Lakehouse architectures using Databricks, driving real-world outcomes for enterprise customers. You’ll take ownership of implementation tasks, lead technical delivery, and mentor engineering teams in best practices across data engineering, governance, and AI.

Key Responsibilities

  • Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala.
  • Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
  • Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
  • Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
  • Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
  • Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.

Work Location: Singapore

Requirements

Required Skills & Experience

  • Strong hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration.
  • Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
  • Proficiency in Python or Scala for data engineering and ML workflows.
  • Strong understanding of AWS, Azure, or GCP cloud ecosystems.
  • Experience with Terraform automation, DevOps, and MLOps practices.
  • Familiarity with monitoring and governance frameworks for large-scale data platforms.

Good to Have Skills:

  • Machine Learning, Deep Learning, NLP, or Generative AI
  • Designing distributed and scalable systems
  • API-first and microservices architecture
  • Python, ML frameworks (TensorFlow, PyTorch, Scikit-learn)
  • MLOps tools (MLflow, Kubeflow, SageMaker, etc.)
  • Data platforms (Spark, Databricks, Snowflake)