1

Overnight Databricks Data Engineer Jobs in Alabama

Senior Data Engineer

Huntsville, AL · On-site

$77K - $176K/yr

R0239155 Data Engineer, Senior The Opportunity: Ever-expanding technology like IoT, machine ... Databricks, Snowflake, Redshift, or BigQuery * Experience with federal information system policies ...

Lead customer engagements to design, build, and optimize Databricks-based architectures for advanced analytics, data engineering, and machine learning workloads. * Develop scalable ETL/ELT pipelines ...

... Databricks Certified Data Engineer / Data Analyst / ML - Proven leadership in data-driven strategies - Experience in defining data governance frameworks - Understanding of modern cloud data ...

Data Quality Engineer

Montgomery, AL · On-site

$113K - $136K/yr

Cloud data engineering exposure (Azure, Databricks, GCP). (5-8 Years) * Master's degree preferred. * DAMA CDMP (Associate/Practitioner) · EDM Council DCAM · ASQ Data Quality Credential · Collibra ...

Data Governance- Manager

Birmingham, AL · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML Travel Requirements Up to 80% Job Posting End Date The salary range for this position is: $99,000 - $232,000. Actual compensation within the ...

Software Engineer IV

Birmingham, AL · On-site

$114K - $151K/yr

Azure Databricks * MS Azure Lakehouse architecture * Develop scalable solutions within distributed system environments. * Collaborate with data engineering and analytics teams to integrate AI models ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Alabama? The most popular types of Databricks Data Engineer jobs in Alabama are:
What cities in Alabama are hiring for Overnight Databricks Data Engineer jobs? Cities in Alabama with the most Overnight Databricks Data Engineer job openings:
Data Engineer, Senior

$77K - $176K/yr

Full-time

Medical, Life, Retirement, PTO

Re-posted 28 days ago


Booz Allen Hamilton rating

8.8

Company rating: 8.8 out of 10

Based on 48 frontline employees who took The Breakroom Quiz

9th of 58 rated business consultants


Job description

Data Engineer, Senior

The Opportunity:

Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence.

As a Data Engineer at Booz Allen, you'll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful.

Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.

Join us. The world can't wait.

You Have:

  • 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems

  • 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data

  • 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java

  • Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance

  • Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management

  • Top Secret clearance

  • Bachelor's degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree

Nice If You Have:

  • 3+ years of experience architecting and designing large-scale enterprise data and analytics systems

  • 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps

  • Experience with distributed data or computing tools, including Apache Spark, ApacheNiFi,AirFlow, Databricks, Snowflake, Redshift, orBigQuery

  • Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques

  • Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub

  • Experience with NoSQL database such as Elasticsearch,Solr, MongoDB, or Cosmo DB

  • Experience with AI or ML pipelines and processes

  • TS/SCI clearance with a polygraph

  • Master's degree

Clearance:

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Top Secret clearance is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,500.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model
Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.

  • Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.

  • Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.

  • Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

DRE1

What Booz Allen Hamilton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Booz Allen Hamilton logo

About Booz Allen Hamilton

Sourced by ZipRecruiter

Booz Allen Hamilton is a leading provider of management and technology consulting services to the US government in defense, intelligence, and civil markets. Headquartered in McLean, Virginia, the firm also serves major corporations, institutions, and not-for-profit organizations. Founded in 1914 by Edwin G. Booz, the company has a long-standing tradition of helping clients achieve success by delivering a wide range of consulting services that include strategic planning, human capital and learning, communication, systems development, and others. The company's mission is to empower people to change the world, and it has a reputation for maintaining the highest standards of integrity and-excellence.

Industry

It services

Company size

10,000+ Employees

Headquarters location

McLean, VA, US

Year founded

1914