ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Washington

ICF International, Inc.

Data Engineer (Databricks)

Reston, VA · On-site

$119K - $143K/yr

Databricks on Azure for data engineering and ML pipeline support. * SQL, Python, Spark, Tableau. * Git, Jira, CI/CD tools (e.g., Jenkins, CodeBuild). * Jira, Confluence, SharePoint. * Mural, Miro, or ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$115K - $139K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than just a ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

Overview We are looking for seasoned a Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for seasoned a Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more than just a ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

Overview We are looking for seasoned a Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks. We are looking for more ...

CyberMedia Technologies

Data Engineer

Mclean, VA

$115K - $139K/yr

We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative ... Cloud Data Platform & Databricks Implementation: Build, optimize, and maintain data processing ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site +1

$125K - $160K/yr

Contributions We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks. We are looking for ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$125K - $160K/yr

Contributions We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.We are looking for more ...

Medisolv, Inc.

Data Engineer

Columbia, MD · On-site

$111K - $133K/yr

As a Data Engineer/Analyst, you will work closely with Medisolv clients to extract, transform and ... Preferred Qualifications · Experience with Azure and/or AWS platforms using Snowflake, Databricks ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for more than just a "Data Engineer", but a technologist with excellent ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA · On-site

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

Steampunk

Data Engineer - Databricks

Mclean, VA

$110K - $160K/yr

We are looking for seasoned Data Engineer to work with our team and our clients to develop ... Key must have skill sets - Python, SQL, Databricks, AWS Data Services * Support an Agile software ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Washington

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Washington? The most popular types of Databricks Data Engineer jobs in Washington are:
Overnight Databricks Data Engineer jobs near you
Data Engineer (Databricks)

Data Engineer (Databricks)

ICF International, Inc.

Reston, VA • On-site

$119K - $143K/yr

Full-time

Posted 13 days ago

Job description

Our Digital Modernization and Experience (DMX) Group is growing, and we are looking for a motivated, experienced Senior Databricks SME who is passionate about turning complex data into actionable solutions that improve public systems and services. This role supports an enterprise initiative focused on platform infrastructure and analytics modernization for a federal customer.
You'll be joining a cross-functional team of full stack developers, data engineers, and data analysts working within a modular, cloud-native platform supporting the emergency management sector. Your work will help ensure disaster management and mitigation decision-makers have access to accurate, timely, and meaningful data and data products to drive effective service delivery and measurable mission outcomes.
If you thrive in a collaborative environment, enjoy working independently to solve real-world challenges through data, we want to hear from you.
Job Location: This position is fully remote with up to 10% travel to the DC Metropolitan area for client meetings.
This position requires that the job be performed in the United States. If you accept this position, you should note that ICF does monitor employee work locations and blocks access from foreign locations/foreign IP addresses and also prohibits personal VPN connections.
What you'll be doing:
  • Enable secure, scalable, and efficient data exchange between federal client and external data sharing partners using Databricks Delta Sharing.
  • Support the design and development of data pipelines and ETL routines in Azure Cloud environment for many source system types including RDBMS, API, and unstructured data using CDC, incremental, and batch loading techniques.
  • Conduct data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured data.
  • Identify underlying issues and translate them into technical requirements.
  • Assist in building and optimizing data lakes, feature stores, and data warehouse structures to support analytics and machine learning.
  • Prepare, structure, and validate data for data science and MLOps workflows, ensuring it meets the quality and format requirements for modeling.
  • Help monitor and maintain the flow of data across BI dashboards, analytics environments, and machine learning pipelines.
  • Engage directly with clients and stakeholders to understand data needs and translate them into scalable solutions.
  • Collaborate with UX designers, business analysts, developers, and end users to define data and reporting requirements
  • Work with external data partners to determine their data product needs and work within the Databricks platform to enable rapid prototyping and extensible use cases
  • Meet with government employees at executive levels, platform stakeholders, and vendor partners.
  • Work within Agile teams to support iterative development, backlog grooming, and sprint-based delivery.
  • Provide mentorship to junior resources

Technologies you'll use:
  • Databricks on Azure for data engineering and ML pipeline support.
  • SQL, Python, Spark, Tableau.
  • Git, Jira, CI/CD tools (e.g., Jenkins, CodeBuild).
  • Jira, Confluence, SharePoint.
  • Mural, Miro, or other collaboration/whiteboarding tools.

Minimum Requirements:
  • Bachelor's degree
  • 5+ years in data engineering, data security practices, data platforms, and analytics
  • U.S. Citizenship required due to federal contract requirements.
  • Ability to obtain and maintain a federal public trust clearance or equivalent client-required background investigation.
  • Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S.
  • Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years

What we would like you to bring:
  • 3+ years Databricks Platform Expertise - SME Level Proficiency including:
    • Databricks, Delta Lake, and Delta Sharing
    • Deep experience with distributed computing using Apache Spark
    • Knowledge of Spark runtime internals and optimization
    • Ability to design and deploy performant end-to-end data architectures
  • 4+ years of ETL Pipeline Development building robust, scalable data pipelines
  • Databricks certifications - Professional or specialty certifications
  • Hands-on experience with Azure services such as Synapse, Data Factory, or Databricks.
  • Familiarity with data visualization tools such as Tableau, Power BI, or similar.
  • Machine Learning and Analytical Skills including:
  • MLOps - Working knowledge of ML deployment and operations
  • Data Science Methodologies - Statistical analysis, modeling, and interpretation
  • Big Data Technologies - Experience beyond Spark with distributed systems
  • Experience with deployment pipelines, including Git-based version control and CI/CD pipelines and DevOps practices using Terraform for IaC.
  • Emergency management domain knowledge a plus
  • Advanced proficiency in data engineering and analytics using Python, Expert-level SQL skills for data manipulation and analysis and experiencewith Scala, preferred but not required (Python expertise can substitute)
  • Proven experience breaking down complex ideas into manageable components
  • Demonstrable experience developing rapid POCs and Prototypes
  • History of staying current with evolving data technologies and methodologies

Professional Skills
  • Strong analytical thinking, attention to detail, and willingness to learn new tools and technologies.
  • Consulting experience with ability to work directly with clients, executive level stakeholders and manage conflicts.

Working at ICF
ICF is a global advisory and technology services provider, but we're not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.
We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy.
We will consider for employment qualified applicants with arrest and conviction records.
Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email Candidateaccommodation@icf.com and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act.
Candidate AI Usage Policy
At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate or assist with responses during interviews (whether in-person or virtual) is not permitted. This policy is in place to maintain the integrity and authenticity of the interview process.
However, we understand that some candidates may require accommodation that involves the use of AI. If such an accommodation is needed, candidates are instructed to contact us in advance at candidateaccommodation@icf.com. We are dedicated to providing the necessary support to ensure that all candidates have an equal opportunity to succeed.
Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position.
The pay range for this position based on full-time employment is:
$98,614.00 - $202,850.00
Nationwide Remote Office (US99)

Apply