ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Minnesota

C4 Technical Services

Senior Databricks

Chanhassen, MN · On-site

$124K - $164K/yr

We are seeking a Senior Databricks Analytics Engineer to help design and build a new Databricks-based analytics platform from the ground up. * This individual will work closely with Data & AI ...

Pwc

Data Engineer - Senior Manager

Minneapolis, MN

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Pwc

Data Engineer - Senior Associate

Minneapolis, MN · On-site

$77K - $202K/yr

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

Pwc

Data Engineer - Manager

Minneapolis, MN · On-site

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Dlapiper

Data Engineer

Minneapolis, MN

$119K - $143K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Data pipeline tooling and cloud data services experience (Azure Data Factory, Azure Databricks ...

Conch Technologies Inc

Senior Data Engineer

Minneapolis, MN · On-site

$110K - $150K/yr

Senior Data Engineer Location: Minneapolis, MN or Madison, WI Duration: 6+ Months Note :Only W2 no ... Databricks * Microsoft Fabric * Strong understanding of data quality, validation, and production ...

Xcel Energy

Senior Data Engineer

Minneapolis, MN · On-site

$110K - $150K/yr

Maintain deep expertise in data engineering and modern data architectures and Databricks ... capabilities. * Operations: Review solution performance, and continually assess health of systems.

Allianz

Data Engineer Principal_3003

Minneapolis, MN · On-site

Hands-on experience with Azure Databricks (Delta Live Tables, Unity Catalog preferred) * Strong ... CI/CD pipelines for data engineering (Azure DevOps / GitHub Actions) * Infrastructure as Code ...

UnitedHealth Group

Senior Data Engineer

Eden Prairie, MN · Remote

$108K - $146K/yr

Support data engineering project execution using Azure Cloud, Databricks, Spark, Scala, and Python to enhance data efficiency, reliability, and value * Evaluate emerging technology trends and ...

HealthPartners

Data Engineer Senior

Bloomington, MN

$115K - $138K/yr

The Data Engineer will help advance and maintain the Leadership Financial Reporting & Analytics ... Expert in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Minnesota

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Minnesota?

The most popular types of Databricks Data Engineer jobs in Minnesota are:

What cities in Minnesota are hiring for Overnight Databricks Data Engineer jobs?

Cities in Minnesota with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Senior Databricks

Chanhassen, MN • On-site

C4 Technical Services
201 - 500 employees
Learn more about C4 Technical Servicesexternal

$124K - $164K/yr

Other

Posted 4 days ago

Job description

Senior Databricks Analytics Engineer
Contract-(3-6 months)
Hybrid - Chanhassen, MN (Local Preferred)
Role Overview:

  • We are seeking a Senior Databricks Analytics Engineer to help design and build a new Databricks-based analytics platform from the ground up.
  • This individual will work closely with Data & AI leadership and serve as a technical partner in establishing the Lakehouse architecture, Medallion data model, semantic layer strategy, and reporting-ready datasets.
  • The ideal candidate has prior experience building Databricks environments from scratch and can operate independently with minimal direction while helping establish foundational best practices.

Top Skills:

  • Databricks
  • Delta Lake
  • PySpark
  • SQL
  • Data Modeling
  • Medallion Architecture
  • Lakehouse Architecture
  • Silver & Gold Layer Development
  • Semantic Modeling
  • Analytics Engineering
  • Data Warehousing
  • PowerBI

Nice to have Skills:

  • Databricks Apps
  • Unity Catalog
  • dbt
  • Microsoft Fabric
  • Power BI Semantic Models
  • Unstructured Data Ingestion
  • AI / GenAI Data Preparation
  • Vector Databases
  • Azure AI Services
  • RAG Framework Exposure
  • Python
  • Azure Data Factory

Job Description:

  • Partner with Data & Analytics leadership to design and build a Databricks Lakehouse environment.
  • Develop and maintain Bronze, Silver, and Gold layers within a Medallion Architecture.
  • Design and implement business-facing data models and semantic layers.
  • Create analytics-ready datasets optimized for reporting and self-service BI.
  • Build and optimize ETL/ELT pipelines using Databricks, PySpark, and SQL.
  • Support ingestion and processing of structured and unstructured data sources.
  • Collaborate with business stakeholders to define metrics, reporting requirements, and data structures.
  • Establish data quality, validation, and governance best practices.
  • Contribute to Databricks Apps and analytics platform capabilities.
  • Help define scalable architecture patterns and development standards.
  • Support AI and GenAI initiatives through data preparation and ingestion pipelines.

Ideal Candidate Profile:

  • Senior Databricks Analytics Engineer
  • Senior Data Engineer
  • Lakehouse Engineer
  • Analytics Engineer
  • Databricks Consultant
  • Databricks Data Architect (hands-on)
  • Data Platform Engineer
  • Azure Databricks Engineer
  • Data Warehouse Engineer with Lakehouse experience
C4 Technical Services logo

About C4 Technical Services

Sourced by ZipRecruiter

C4 Technical Services is a national privately held women and African American owned Staffing and Consulting company based in Minneapolis, Minnesota. We are committed to maintaining our entrepreneurial spirit as we grow and help our clients grow. This gives us the ability to be flexible and responsive as we align with client organizations to help scale their IT, Infrastructure, Digital UX, Application Development, Strategy, and Telecom to increase and support their growing business needs. We have a deliberate commitment to a partner pipeline – always on the hunt for new technology and new solutions to problems, new and old. Our areas of technical focus include D365 Consulting, Microsoft O365, SCCM, SCSM, Cyber Security, Digital UX, UI Development, DevOps, Cloud, PMO, iOS, Android, Power BI, Data Visualization, Kafka, Python, Java, .NET, Chaos Engineering, Call Center, and Ransomware attacks.

Company size

201 - 500 Employees

Headquarters location

Little Canada, MN, US

Year founded

2013

Social media

FacebookTwitter

View All C4 Technical Services Jobs

Apply