ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Adelphi, MD

Deloitte

Sr Databricks Data Engineer

Mclean, VA

$115K - $139K/yr

As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business ...

Deloitte

Sr Databricks Data Engineer

Rosslyn, VA

$130K - $156K/yr

As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business ...

Deloitte

Databricks Engineering Consultant

Rosslyn, VA · On-site

Work you'll do As a Data Engineer II on the AI & Data team, you will be responsible for: * Designing, developing, testing, and maintaining scalable data pipelines and data products on the Databricks ...

Deloitte

Databricks Data Engineering Manager

Rosslyn, VA

$130K - $156K/yr

Work you'll do As a Lead Data Engineer II in our AI & Data practice, you will leverage your ... Professional Databricks certifications (e.g., Data Engineer Professional, Machine Learning ...

Bizoforce Inc

Data Engineer (Databricks)

Washington, DC · On-site

$129K - $155K/yr

Data Engineer - Databricks Location: Washington, DC Metro Area Duration: Long-Term Full-Time (W2) (Does not require Sponsorship) How the role works * Weeks 1-10: full-time paid Databricks training ...

eSolutionsFirst, LLC

Databricks Solutions Architect

Mclean, VA · On-site

$66.50 - $87.25/hr

Provide hands-on technical leadership for complex Databricks data engineering projects. * Optimize Spark and Databricks workloads for performance, scalability, reliability, and cost. * Design and ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$125K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than just a ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site +1

$125K - $160K/yr

Overview We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than just a ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

Overview We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than ...

CyberMedia Technologies

Data Engineer

Mclean, VA · On-site

$115K - $139K/yr

We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative ... Cloud Data Platform & Databricks Implementation: Build, optimize, and maintain data processing ...

Revature

Data Engineer - Databricks

Washington, DC · On-site

$129K - $155K/yr

Revature is hiring experienced data engineers to join a large-scale Databricks platform build supporting federal government programs in the Washington, DC area. Our client is one of the world ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

Overview We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks. We are looking for more ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site +1

$125K - $160K/yr

Overview We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks. We are looking for more ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Adelphi, MD

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Adelphi, MD?

The most popular types of Databricks Data Engineer jobs in Adelphi, MD are:

What cities near Adelphi, MD are hiring for Overnight Databricks Data Engineer jobs?

Cities near Adelphi, MD with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Databricks Data Engineer

Square Peg Technologies

Washington, DC • On-site

$129K - $156K/yr

Full-time

Medical, Retirement, PTO

Re-posted 22 days ago

Job description

Clearance Required:

Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. 

Location:

Northern Virginia

The Mission:  

Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems. 

Don't know Databricks, no problem! Sign up for our extensive training program to be a part of shaping the future of AI/ML

Basic Qualifications:  

  • Proficient with one or more programming languages (Python, SQL, Java)
  • Prepare big data, implement data models and develop database to support the business solutions
  • Understanding of SQL database structures and mapping data structures between different SQL databases
  • Knowledge of API development techniques
  • Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake. 
  • Demonstrated experience with cloud based database services such as Databricks and AWS

Preferred Qualifications

  • Experience with using Apache Spark and Hadoop to conduct large-scale data processing
  • Extensive experience in Extract-Transform-Load (ETL) processes 
  • Demonstrated extensive experience with cloud services (AWS strongly preferred) 
  • Familiarity with open source data engineering tools and processes

Square Peg Technologies Company Information 

Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage. 

At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI/ML, as well as best practices in advanced analytics. With a firm footprint in the Intelligence Community, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.


Apply