ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Edison, NJ

Donato Technologies, Inc

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Sr. Data Engineer New York (35 Miles) Experience: 10+ Years :- Required Skills: * 1.Proficiency in ... or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or ...

Dlapiper

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Data pipeline tooling and cloud data services experience (Azure Data Factory, Azure Databricks ...

Dlapiper

Data Engineer

Short Hills, NJ · On-site

$124K - $149K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Data pipeline tooling and cloud data services experience (Azure Data Factory, Azure Databricks ...

Sigma Computing

Data Engineer

New York, NY · On-site

$140K - $180K/yr

As a Data Platform Engineer, you will be responsible for the underlying data architecture across Snowflake and Databricks, as well as building and optimizing various ETL pipelines to fuel both ...

Spgi

Head of Engineering - Inbound Data

Princeton, NJ · On-site

$185K - $265K/yr

Lead and scale a world-class engineering organization of 100+ data engineers, ML engineers, and ... Deep expertise in Databricks Data Intelligence Platform including Unity Catalog, Delta Lake ...

Amicis Global

Azure Data Engineer

Jersey City, NJ · On-site

$80 - $85/hr

Title: Azure Data Engineer Location: Jersey City, NJ - Hybrid 07311 Duration: 12 months+ Summary ... Azure certifications, experience with Synapse, Data Factory, and Databricks.

Spgi

Head of Engineering - Inbound Data

New York, NY · On-site

$185K - $265K/yr

Lead and scale a world-class engineering organization of 100+ data engineers, ML engineers, and ... Deep expertise in Databricks Data Intelligence Platform including Unity Catalog, Delta Lake ...

Empower Professionals

Data Engineer

Jersey City, NJ · On-site

$60/hr

Data Engineer Location: Jersey City, NJ (Hybrid) Duration: 12+ Months In-person interview needed ... Experience with Spark, Kafka, or Databricks. * SnowPro and/or AWS certifications. * Experience in ...

Databricks

Sr. Product Manager - Technical

New York, NY · Remote

$182K - $211K/yr

... Databricks Data Intelligence Platform and identify opportunities to improve the product experience.You will act as a bridge between technical field teams and product and engineering . Insights from ...

Databricks

Staff Backend Software Engineer

New York, NY · On-site

$190K - $261K/yr

P-1592 At Databricks, we are passionate about enabling data and AI teams to solve the world ... Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical ...

The Cypress Group

Data Engineer

New York, NY · On-site

$200K - $250K/yr

Our client is a hedge fund in NYC looking for a talented Data Engineer to join their team ... any exposure to Databricks would be a plus. Financial services experience is required, and ...

previous page

Showing results 41-60

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Edison, NJ

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities near Edison, NJ are hiring for Overnight Databricks Data Engineer jobs? Cities near Edison, NJ with the most Overnight Databricks Data Engineer job openings:
Overnight Databricks Data Engineer jobs near you

Data Engineer

Donato Technologies, Inc

New York, NY • On-site

$125K - $150K/yr

Other

Re-posted 26 days ago

Job description

Sr. Data Engineer
New York (35 Miles)
Experience: 10+ Years
Job Description :-
Required Skills:
  • 1.Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java)
  • 2. Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)
  • 3. Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or similar) and atleast one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
  • Proficiency in atleast one scheduling/orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
  • 4. Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,)
  • Strong organizational, problem-solving and critical thinking skills; Strong documentation skills
Preferred skills:
  • Experience using AWS Bedrock APIs
  • Knowledge of Generative AI concepts (such as RAG, Vector embeddings, Model fine tuning, Agentic AI)
  • Experience in IaC (preferably Terraform, alternatively AWS cloud formation)