ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Alabama

McLeod

Analyst, Enterprise Data

Birmingham, AL · On-site

$70 - $90/hr

Working knowledge of at least one major programming language (e.g., Python, C#, Java, or Scala ... Familiarity with big data technologies and platforms such as Delta Lake, Spark, and Databricks ...

Pwc

Data Strategy-Manager

Birmingham, AL · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML - Proven leadership in data-driven strategies - Experience in defining data governance frameworks - Understanding of modern cloud data ...

Pwc

Data Governance- Manager

Birmingham, AL · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML Travel Requirements Up to 80% Job Posting End Date The salary range for this position is: $99,000 - $232,000. Actual compensation within the ...

vTech Solution

Data Quality Engineer

Montgomery, AL · On-site

$113K - $136K/yr

Cloud data engineering exposure (Azure, Databricks, GCP). (5-8 Years) * Master's degree preferred. * DAMA CDMP (Associate/Practitioner) · EDM Council DCAM · ASQ Data Quality Credential · Collibra ...

4pconsultinginc

Software Engineer IV

Birmingham, AL · On-site

$114K - $151K/yr

Azure Databricks * MS Azure Lakehouse architecture * Develop scalable solutions within distributed system environments. * Collaborate with data engineering and analytics teams to integrate AI models ...

Pwc

Data Strategy & Governance -Director

Birmingham, AL · On-site

$155K - $410K/yr

... Databricks Certified Data Engineer/Data Analyst/ML - Proven leadership in data-driven strategies - Demonstrating thought leadership in data governance - Collaborating on strategy and transformation ...

previous page

Showing results 41-60

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Alabama

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Alabama?

The most popular types of Databricks Data Engineer jobs in Alabama are:

What cities in Alabama are hiring for Overnight Databricks Data Engineer jobs?

Cities in Alabama with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Data Engineer (only W2 contract no C2C)

4P Consulting Inc.

Birmingham, AL • On-site

$107K - $128K/yr

Full-time

Re-posted 21 days ago

Job description

Job Summary:
4P Consulting Inc. is seeking a Data Engineer to join their AMI Analytics team, focusing on enhancing data-driven decision-making and operational efficiency. The role involves developing data pipelines, managing cloud environments, and creating visualizations using Power BI to support analytical initiatives.
Responsibilities:
• Assist TO in designing, building, and maintaining scalable data pipelines to ingest, transform, and store large volumes of AMI data from various sources.
• Collaborate with data scientists to ensure seamless integration of data pipelines with analytical models and AI processes.
• Develop and implement data models and architectures optimized for AMI data analytics, ensuring efficiency, scalability, and data integrity.
• Implement best practices for data storage, partitioning, and indexing to optimize performance and facilitate analysis.
• Work within cloud environments - Azure to deploy, manage, and optimize data engineering solutions.
• Collaborate with cloud architects and administrators to ensure security, compliance, and cost-effectiveness of cloud infrastructure.
• Develop and maintain Power BI dashboards and reports to visualize AMI data insights and facilitate data-driven decision-making.
• Ensure the accuracy, reliability, and usability of visualizations to meet business requirements.
• Catalog and document AMI data sources, datasets, and metadata to facilitate data discovery, lineage, and governance.
• Implement data cataloging best practices to ensure the availability and accessibility of AMI data assets.
• Collaborate with cross-functional teams to understand data requirements and support analytical initiatives.
• Provide technical support and troubleshooting for data-related issues, ensuring the reliability and availability of data infrastructure.
Qualifications:
Required:
• Bachelor’s degree in Computer Science, Information Technology, or related field.
• 3+ years of experience in data engineering or related roles, preferably in a cloud environment.
• Proficiency in programming languages such as Python, SQL, and Scala.
• Proficiency with Power BI for data visualization and reporting.
• Experience with cloud-based data platforms (e.g., Azure Databricks, AWS EMR).
• Strong understanding of data modeling, ETL processes, and data warehousing concepts.
• Familiarity with big data technologies.
• Innovative and adaptable, with a passion for continuous learning and improvement.
• Strong communication and collaboration skills, with the ability to work effectively across teams.
• Results-oriented and committed to delivering high-quality solutions that meet business needs.
• Ethical conduct and commitment to safety in all aspects of work.
Company:
4P Consulting is a highly specialized Staffing and Recruiting company with significant experience and expertise in the Engineering industry, IT, Admin, Accounting, Advertising . Founded in 2012, the company is headquartered in Kennesaw, Georgia, US, , with a team of 11-50 employees. The company is currently Early Stage.

Apply