1

Overnight Databricks Data Engineer Jobs in Edison, NJ

Data Engineer

Princeton, NJ · On-site

$120K - $144K/yr

Job Title: Data Engineer location : Princeton, NJ Minimum Mandatory Skills: ADF, Data Bricks ... Develop and optimize data processing workflows in Azure Databricks using PySpark . * Integrate data ...

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Create and manage workflows in Databricks and migrate existing Azure Data Factory pipelines. * Load ... Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets.

Sr. Product Manager - Technical

Manhattan, NY · On-site

$183K - $212K/yr

Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture. Founded in 2013, the company is headquartered in San Francisco, USA ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Data Engineer

Jersey City, NJ · On-site

$119K - $143K/yr

Data Engineer Must Have Qualifications: * Strong hands-on experience in Data Engineering and ... Hands-on experience with Snowflake, Databricks, Azure, AWS, or GCP. * Strong understanding of data ...

DOE : We are seeking a hands-on Data Engineer with strong experience in building scalable ... Databricks · Modular, reusable SQL-based data workflows · Data testing, documentation, and ...

Azure Data Engineer

Iselin, NJ · On-site

$116K - $139K/yr

Title: Azure Data Engineer Location: Iselin NJ - (3 Days from Office) Experience: 12+ Years ... Design, develop, and deploy Spark program in databricks environment to process and analyze large ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

... Databricks Data Intelligence Platform and identify opportunities to improve the product experience.You will act as a bridge between technical field teams and product and engineering . Insights from ...

Azure Data Engineer

Hamilton, NJ · On-site

$113K - $136K/yr

Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...

Azure Data Engineer

Hamilton, NJ · On-site

$113K - $136K/yr

Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Edison, NJ? The most popular types of Databricks Data Engineer jobs in Edison, NJ are:
What cities near Edison, NJ are hiring for Overnight Databricks Data Engineer jobs? Cities near Edison, NJ with the most Overnight Databricks Data Engineer job openings:
Data Engineer

Data Engineer

Noblesoft Technologies

Princeton, NJ • On-site

$120K - $144K/yr

Contractor

Posted 3 hours ago


Job description

Job Title: Data Engineer
location : Princeton, NJ
 
Minimum Mandatory Skills: ADF, Data Bricks
Desired Skills: Python, PySpark
 
Key Responsibilities:
  • Design and implement ETL/ELT pipelines using Azure Data Factory.
  • Develop and optimize data processing workflows in Azure Databricks using PySpark.
  • Integrate data from multiple sources into a unified data platform.
  • Ensure data quality, security and compliance across all processes.
  • Collaborate with data architects, analysts and business teams to deliver reliable data solutions.
  • Monitor and troubleshoot data pipelines for performance and reliability.
  • Implement best practices for data governancemetadata management and data lineage.
Required Skills & Qualifications:
  • 6–8 years of experience in data engineering and data platform development.
  • Strong hands-on experience with Azure Data FactoryAzure Databricks and PySpark.
  • Proficiency in SQL and working with relational databases.
  • Experience with data modelingdata warehousing and big data processing.
  • Familiarity with Azure ecosystem (Data Lake, Synapse, Key Vault, etc.).
  • Strong problem-solving and debugging skills