ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Hamilton, NJ

StratG Inc

Data Engineer

Holmdel, NJ · On-site

$127K - $153K/yr

Data Engineer Location : New Jersey who is a self-starter, fueled by collaboration, able to ... Expert in AWS Databricks, Python, Spark * Strong SQL, and UNIX Shell scripting experience

GEI Consultants

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Fusemachines

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Databricks Certified Data Engineer Associate * Microsoft Certified: Azure Fundamentals * Microsoft Certified: Azure Data Engineer Associate * Microsoft Exam: Designing and Implementing Microsoft ...

Fusemachines

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Databricks Certified Data Engineer Associate * Microsoft Certified: Azure Fundamentals * Microsoft Certified: Azure Data Engineer Associate * Microsoft Exam: Designing and Implementing Microsoft ...

Noblesoft Technologies

Data Engineer

Princeton, NJ · On-site

$120K - $144K/yr

Job Title: Data Engineer location : Princeton, NJ Minimum Mandatory Skills: ADF, Data Bricks ... Develop and optimize data processing workflows in Azure Databricks using PySpark . * Integrate data ...

Trinity Technology Solutions

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Create and manage workflows in Databricks and migrate existing Azure Data Factory pipelines. * Load ... Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets.

Pwc

Data Engineer - Senior Associate

Philadelphia, PA · On-site

$77K - $202K/yr

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

Infosys

Databricks Data Operation Engineer

Philadelphia, PA · On-site

$70K - $94K/yr

... Azure Data Factory (ADF) (pipeline monitoring, triggers, activity failures, reruns). o Databricks (job/workflow execution monitoring, logs, cluster behavior at an ops level). o Monitoring ...

Pwc

Data Engineer - Senior Associate

New York, NY · On-site

$77K - $202K/yr

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

Pwc

Data Engineer - Senior Manager

Philadelphia, PA · On-site

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Pwc

Data Engineer - Senior Manager

New York, NY

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Pwc

Data Engineer - Manager

Philadelphia, PA

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Pwc

Data Engineer - Manager

New York, NY

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Databricks

Sr. Product Manager - Technical

New York, NY · On-site

$156K - $215K/yr

... Databricks Data Intelligence Platform and identify opportunities to improve the product experience.You will act as a bridge between technical field teams and product and engineering . Insights from ...

Tech Tammina LLC

Azure Data Engineer

Hamilton, NJ · On-site

$113K - $136K/yr

Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...

Tech Tammina

Azure Data Engineer

Hamilton, NJ · On-site

$113K - $136K/yr

Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Hamilton, NJ

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities near Hamilton, NJ are hiring for Overnight Databricks Data Engineer jobs? Cities near Hamilton, NJ with the most Overnight Databricks Data Engineer job openings:
Overnight Databricks Data Engineer jobs near you

Data Engineer

StratG Inc

Holmdel, NJ • On-site

$127K - $153K/yr

Other

This job post has expired today. Applications are no longer accepted.

Job description

Data Engineer
Location : New Jersey
who is a self-starter, fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. A person should be very good at analytical, problem solving and troubleshooting data pipelines root cause analysis and resolutions. Working with various Development team, Technology partners and business stakeholders to deliver unified and timely support, while upholding quality and resolution standards to fulfil the operational needs of our business stakeholders.
Person should have
 
  • 10+ Years of IT experience, with 7+ years of experience as an ETL/ELT developer/data engineer. 
  • 3+ years of Databricks data engineering experience (Databricks Data Engineer and/or Spark Developer certification preferred)
  • Knowledge in GitHub, Jenkins, Informatica
  • Working knowledge of the Finance or Insurance industry 
  • Expert in AWS Databricks, Python, Spark
  • Strong SQL, and UNIX Shell scripting experience 
  • Performance tuning data pipelines, track record communicating issues & follow-up through issue resolution.
  • Production Support for applications, monitor production jobs, triage issues to appropriate team & resolve any issues in a timely manner.
 

Apply