ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Virginia Beach, VA

Sentara Healthcare

Data Engineer - Remote

Virginia Beach, VA · On-site +1

$108K - $130K/yr

Develop and maintain data pipelines using PySpark and Databricks * Work within a metadata-driven ... Data Engineer, Azure, ACP, Azure Cloud Platform, Fivetran, metadata, PySpark, Databricks Benefits:

STIHL

Data Engineer & BI Analyst

Virginia Beach, VA · On-site

$101K - $123K/yr

Design, build, and maintain reliable data pipelines using Databricks, Delta Live Tables, and Azure ... Bachelor's degree in Computer Science, Information Systems, Statistics, Engineering, or related ...

STIHL Inc.

Data Engineer & BI Analyst

Virginia Beach, VA · On-site

$101K - $123K/yr

Design, build, and maintain reliable data pipelines using Databricks, Delta Live Tables, and Azure ... Bachelor's degree in Computer Science, Information Systems, Statistics, Engineering, or related ...

Guidehouse

Data Scientist

Norfolk, VA

Python, R, SQL programming * Data visualization (Qlik, Tableau, Power BI, etc.) * Big data platforms (Databricks, Snowflake, AWS, Azure, Palantir Foundry, etc.) What We Offer: Guidehouse offers a ...

Guidehouse

Data Scientist

Norfolk, VA · On-site

Python, R, SQL programming * Data visualization (Qlik, Tableau, Power BI, etc.) * Big data platforms (Databricks, Snowflake, AWS, Azure, Palantir Foundry, etc.) What We Offer: Guidehouse offers a ...

Guidehouse

Data Scientist

Norfolk, VA

Data analysis and interpretation * ​Python, R, SQL programming * Data visualization (Qlik, Tableau, Power BI, etc.) * Big data platforms (Databricks, Snowflake, AWS, Azure, Palantir Foundry, etc ...

MI Technical Solutions

Data Scientist

Chesapeake, VA · On-site

... engineering and technical support services since 2004! Our team works tirelessly to build a ... Validate outputs from Data Visualization tools (such as Tableau and Advana Databricks) with the raw ...

MDAEdge

ETL Developer | 10+ Years

Norfolk, VA · On-site

$44 - $57.50/hr

MDAEdge is seeking a skilled ETL Developer with 9 to 12 years of experience in SSIS and Databricks to design, develop, and optimize robust data integration solutions. The role involves building ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Virginia Beach, VA

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Virginia Beach, VA?

The most popular types of Databricks Data Engineer jobs in Virginia Beach, VA are:

What cities near Virginia Beach, VA are hiring for Overnight Databricks Data Engineer jobs?

Cities near Virginia Beach, VA with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you
Infographic showing various Overnight Databricks Data Engineer job openings in Virginia Beach, VA as of August 2026, with employment types broken down into 94% Full Time, and 6% Part Time. Highlights an 81% In-person, and 19% Remote job distribution.

Python Data Scientist / Data Engineer

Virginia Beach, VA • Remote

HRC Global Services
See more jobs at HRC Global Servicesexternal

Full-time

Re-posted 14 days ago

Job description

Python Data Scientist / Data Engineer

Python Data Scientist / Data Engineer (PySpark, ETL, Notebooks, Databricks) Summary We're hiring a versatile Python Data Scientist / Data Engineer to design, implement, and productionize scalable data pipelines and analytics workflows.

The role requires deep PySpark experience, strong ETL design, experience with interactive notebooks, and familiarity with Databricks or similar managed Spark platforms.

Key responsibilities

* Design and build robust ETL/ELT pipelines using PySpark for batch and near-real-time workflows.

* Develop, optimize, and schedule Spark jobs on Databricks (or equivalent Spark environment).

* Work with data scientists and product teams to transform business requirements into data models, features, and dashboards.

* Implement data validation, monitoring, and lineage to ensure data quality and reliability.

* Create reproducible notebooks for exploration, prototyping, and handoff to production pipelines.

* Tune performance of Spark jobs (memory, partitioning, shuffle reduction) and optimize cluster usage.

* Collaborate on building CI/CD for data workflows, including tests for data transformations and schema changes.

* Document architecture, ETL processes, and best practices.

Required qualifications

* 3+ years experience in data engineering, data science, or analytics engineering roles.

* Strong Python programming and hands-n PySpark experience developing data transformations at scale.

* Experience with Databricks (jobs, clusters, Delta Lake) or equivalent managed Spark platforms.

* Solid understanding of ETL/ELT patterns, data modeling, and data warehousing concepts.

* Comfortable using Jupyter or Databricks notebooks for exploration and prototyping.

* Experience with SQL and working knowledge of cloud data storage systems (S3, ADLS) and databases.

* Familiarity with orchestration tools (Airflow, Prefect, Dagster) and awareness of CI/CD for data pipelines.