1

Overnight Databricks Data Engineer Jobs in Georgia

Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer The Data Foundations team is looking for a Data Engineer ready to own meaningful work ... Architect and implement ELT/ETL pipelines using Databricks and dbt; build robust data workflows on ...

Data Engineer IV

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer IV - Modern Enterprise / Lakehouse / AI-Assisted Location: 241 Ralph McGill Blvd, ... Work with Databricks Lakehouse architecture (primary future-state platform) * Support analytics and ...

Data Engineer

Peachtree Corners, GA · Hybrid

$108.30K - $130K/yr

Data Engineer Hybrid 3 days onsite Charlotte (locals only) 10+ months Responsibilities: * Build ... Direct experience of building data pipelines using Azure Data Factory and Databricks. * Developing ...

Data Engineer III

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Proficiency in Databricks, Azure, Spark, Hive, and Airflow is required. Key Responsibilities Data Engineering & Pipeline Development * Design, build, and maintain scalable and reliable data pipelines

Data Engineer

Fayetteville, GA · On-site +1

$100.60K - $120.80K/yr

In this role, you'll develop scalable ETL/ELT workflows feeding Snowflake and Databricks ... data engineering with strong Python, SQL, and Spark skills * Hands-on experience building and ...

Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer Atlanta, Georgia, United States About the Job Work Arrangement: Hybrid Agency ... Create and manage notebooks (e.g., Fabric Notebooks, Databricks) for data transformation using ...

Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer A professional basketball team and state-of-the-art arena/entertainment venue that ... Implement orchestration frameworks and Databricks-native workflows to manage dependencies and ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer A professional basketball team and state-of-the-art arena/entertainment venue that ... Implement orchestration frameworks and Databricks-native workflows to manage dependencies and ...

Data Engineer

Atlanta, GA

$110.10K - $132.20K/yr

Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing * DevOps for data, GitHub, automated ...

Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing * DevOps for data, GitHub, automated ...

Data Engineer 3

Atlanta, GA · On-site

$110.10K - $132.20K/yr

Data Engineer 3 Location: Atlanta/ Hybrid Client- Southern Co Gas Corp Contract- 1 Year Position ... Support DataBricks and Azure-based testing and quality monitoring workflows Required Qualifications

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Sr. Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

We are seeking a motivated Data Engineer to join our team and support the modernization of our data ... Databricks. • Support migration and maintenance of SSIS packages from legacy systems. • ...

Sr. Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

We are seeking a motivated Data Engineer to join our team and support the modernization of our data ... Databricks. • Support migration and maintenance of SSIS packages from legacy systems. • ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Georgia? The most popular types of Databricks Data Engineer jobs in Georgia are:
Data Engineer

Data Engineer

Merican

Atlanta, GA • On-site

$110.10K - $132.20K/yr

Other

This job post has expired today. Applications are no longer accepted.


Job description

Data Engineer

The Data Foundations team is looking for a Data Engineer ready to own meaningful work end-to-end. You'll design and deliver production-grade data pipelines, ensure the data your team ships is trustworthy and well-defined, and actively use AI tools like Claude to move faster and build smarter. You bring solid engineering fundamentals and an AI-first mindset to everything you build.

Key Responsibilities:

  • Design & Build Production Pipelines: Architect and implement ELT/ETL pipelines using Databricks and dbt; build robust data workflows on Azure (ADLS, ADF) to support batch and near-real-time use cases.
  • Own Data Quality & Reliability: Take end-to-end ownership of data quality in your domain define schemas, freshness SLAs, and ownership boundaries so that downstream consumers, including the Reporting team, can depend on the data you produce. Use AI to Build Better, Faster: Actively use Claude to generate code, automate repetitive engineering tasks, prototype new solutions, and accelerate delivery while maintaining full ownership and accountability for what ships.
  • Write Maintainable, Tested Code: Write clean, testable Python and SQL; contribute to CI/CD pipelines in Azure DevOps; participate in and lead code reviews with a focus on quality and long-term maintainability.
  • Tune for Performance & Cost: Profile and optimize Databricks notebooks, dbt models, and Snowflake queries to meet SLAs without unnecessary cloud spend.
  • Work Closely with the Reporting Team: Partner with the Reporting team and product managers to understand downstream data needs and deliver data products that directly support business decisions for Growth and Emerging Business.
  • Deliver in Agile Sprints: Operate effectively within Scrum own your sprint commitments, participate in planning and retrospectives, and communicate blockers and progress transparently.
  • Operate & Improve Production Systems: Serve as a primary on-call responder for pipelines in your domain; own incident triage and resolution; write post-incident summaries and translate learnings into platform improvements.

Required Qualifications:

  • Bachelor's degree in Computer Science, Engineering, Data Science, or equivalent experience.
  • 2-4 years of experience in data engineering or a closely related software engineering role.
  • Strong SQL and Python skills applied to data transformation and pipeline development.
  • Hands-on experience with Databricks (Spark, Delta Lake) and Snowflake.
  • Experience building pipelines on Azure (ADF, ADLS, or equivalent).
  • Experience with dbt for data transformation and modeling.
  • Solid Git workflow practices and CI/CD experience, ideally with Azure DevOps.
  • Demonstrated use of AI tools (Claude, GitHub Copilot, or similar) to accelerate and improve your engineering work.
  • Experience working in Agile/Scrum teams.

Preferred Qualifications:

  • Familiarity with data quality frameworks such as Great Expectations or dbt tests.
  • Experience with orchestration tools like Airflow or Azure Data Factory pipelines.
  • Track record of building AI-assisted automation for data engineering tasks.
  • Why - Data Foundations: The Data Foundations team is the data backbone of Client's business, purpose-built to support Growth and Emerging Business initiatives. You won't just maintain infrastructure you'll help define how Client's most ambitious new bets are powered by data, from day one of a product's life. Our team operates at the intersection of scale and speed, and you'll have the freedom to experiment with AI-driven engineering while seeing your work's impact on products used by tens of millions of customers.

TekWissen® Group is an equal opportunity employer supporting workforce diversity.


Merican logo

About Merican

Sourced by ZipRecruiter

Merican is a IT Service consulting firm, specialized in Digital adoption and Business automation. With our diverse collection of skilled and committed consultants, technology companies, businesses and digital experts, we provide our subject expertise and our unique client service approach, a best-in-class global model of delivery suited to the business demands of our clients. We ensure that we implement future-oriented solutions for our clients via investments in people, solutions, technologies, competencies and infrastructure.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Columbia , MD, US

Year founded

2020

Social media