ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Minnesota

Solution Design Group

Data Engineer

Minneapolis, MN · On-site

$120K - $140K/yr

We are adding Data Engineers to influence the direction of data modernization for our customers. We ... Experience with Databricks is a bonus * Experience with DBT is a bonus * Prior consulting or ...

Solution Design Group

Data Engineer

Minneapolis, MN · On-site +1

$120K - $140K/yr

We are adding Data Engineers to influence the direction of data modernization for our customers. We ... Experience with Databricks is a bonus * Experience with DBT is a bonus * Prior consulting or ...

Solution Design Group

Data Engineer

Minneapolis, MN · On-site

$119K - $143K/yr

They are seeking Data Engineers to manage, transfer, manipulate, or integrate data to ensure ... Databricks is a bonus • Experience with DBT is a bonus • Prior consulting or professional ...

Saransh Inc

Sr Azure Data Engineer (12+ yrs)

Minneapolis, MN · On-site

$57.50 - $71.25/hr

Title: Azure Data Engineer Location: Minneapolis, MN (Onsite from Day 1) Job Type: Contract ... Azure Databricks Responsibilities: * Design and develop scalable architectures using Azure ...

Healthcare Triangle Inc

Databricks Lead

Minneapolis, MN · On-site

$107K - $140K/yr

Lead the design and development of scalable data engineering solutions using Databricks . * Develop and optimize PySpark, Spark SQL, and Delta Lake pipelines. * Build and manage ETL/ELT workflows and ...

New

Genesis10

Data Engineer - Hybrid

Eagan, MN · On-site

$79.10 - $89.10/hr

Genesis10 is currently seeking a Data Engineer - Hybrid position with a Regional Health Insurance ... Hands-on Databricks experience including notebooks, workflows, and cluster management Experience ...

Centstone

Database Engineer (Azure)

Minneapolis, MN · On-site

The ideal candidate will have strong expertise in Azure SQL, Azure Data Lake, Azure Databricks ... engineering, cloud migration, and enterprise data platform experience are encouraged to apply.

previous pagenext page

Showing results 21-40

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Minnesota

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What are the most commonly searched types of Databricks Data Engineer jobs in Minnesota?

The most popular types of Databricks Data Engineer jobs in Minnesota are:

What cities in Minnesota are hiring for Overnight Databricks Data Engineer jobs?

Cities in Minnesota with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Azure Database Architect - Databricks and Data Lakehouse (9+ Month Contract, Hybrid Twin Cities)

Integration Architects

Saint Paul, MN • On-site

$64.50 - $83/hr

Other

Posted 14 days ago

Job description

Title: Azure Database Architect - Databricks and Data Lakehouse (9+ Month Contract, Remote or Hybrid Twin Cities)

Location: St. Paul, MN - hybrid onsite. Candidates must be local to the Twin Cities metro or already relocating.

Duration: Approximately 9 months starting late September 2026, with client option to extend

Employment Type: Contract, W2 or C2C

Integration Architects is a Minnesota IT consulting firm founded in 2000. We are seeking a senior Azure Database Architect for a large public sector data modernization program. This is a single seat. We submit one candidate, so we are looking for the right one rather than a pile of resumes.

The work

The client is consolidating dozens of separate county level databases into a centralized Azure data lakehouse that will feed a new enterprise case management platform. You will own the architecture and design of that lakehouse and the integrated data reserves underneath it. That means data modeling, access pattern optimization, security and encryption design, backup and disaster recovery strategy, and the documentation that lets the downstream implementation vendor build against it without guessing.

You will also mentor other architects and database engineers on the team. This is a design and leadership seat, not a ticket queue.

What we need to see

  • Ten or more years in data architecture or data management
  • Deep hands on experience designing and implementing data lakes plus relational and non relational databases in Azure
  • Strong Databricks experience, including lakehouse patterns
  • Strong Oracle database experience
  • Azure Data Factory, Azure Monitor, SQL Analytics, Query Performance Insight, Azure Resource Manager, and Azure CLI or PowerShell
  • Data transformation solutions and cloud infrastructure integration
  • CI CD pipelines and scripted data loads using Azure data load utilities
  • Role based access control, encryption, and network security design
  • Backup and recovery strategy using Azure Backup or geo replication
  • Demonstrated experience mentoring other engineers

Helpful but not required

Data warehouse administration, Teradata, Azure SQL managed instances and elastic pools, and prior state or county government data work.

Requirements

  • or . No visa sponsorship and no transfers.
  • Work must be performed inside the United States.
  • Must be available for a Microsoft Teams interview with the client on short notice.

Compensation: See rate discussion below before you post a number.

Skills tags for Dice: Azure, Databricks, Data Lake, Data Lakehouse, Data Architecture, Oracle, Azure Data Factory, Azure SQL, Data Modeling, ETL, PySpark, CI/CD, PowerShell, Azure CLI, Delta Lake, Unity Catalog, RBAC, Disaster Recovery, Teradata, Data Warehouse

Apply