ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Milwaukee, WI

Ontech Talent

Be Seen First

Data & Integration Manager

Brookfield, WI · On-site

$150K - $175K/yr

Hands-on and/or leadership experience with Power BI, Power Apps, Power Automate, Databricks, SQL ... Bachelor's degree in Information Technology, Computer Science, Data Engineering, Information ...

Generac

Senior Platform & Analytics Analyst

Waukesha, WI · On-site

$86K - $108K/yr

... Databricks, ensuring data integrity, scalability, security, and effective ETL processes. * Collaboration with cross-functional teams in manufacturing, Engineering ops, Marketing & sales involves ...

Pwc

AI Engineer

Milwaukee, WI · On-site

$55K - $187K/yr

Certifications aligned to data engineering, machine learning, and cloud platforms, including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials - Utilizing ...

Charter Manufacturing Company, Inc.

Data Architect

Mequon, WI · On-site

$56.50 - $72.75/hr

Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related ... Experience with Azure Data Services, Snowflake, Databricks, PySpark, SQL, Python, Tableau, Power BI ...

Concurrency

Data Architect

Milwaukee, WI

$62.75 - $80.75/hr

You'll work with a high-performance engineering team and report directly to the Practice Manager ... ADLS, Databricks, Fabric, Synapse, and related tooling * Define and document reference ...

Pwc

AI Engineer

Milwaukee, WI · On-site

$50K - $112K/yr

Certifications aligned to data engineering, machine learning, and cloud platforms, including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials - Building ...

Concurrency

Data Architect

Milwaukee, WI · On-site

$62.75 - $80.75/hr

You'll work with a high-performance engineering team and report directly to the Practice Manager ... ADLS, Databricks, Fabric, Synapse, and related tooling * Define and document reference ...

Pwc

AI & GenAI Data Scientist-Director

Milwaukee, WI · On-site

$155K - $410K/yr

Certifications aligned to data engineering, machine learning, and cloud platforms, including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials ...

CYNET SYSTEMS

Data Architect

Racine, WI · On-site

$67/hr

... of experience in Databricks Architecture. * 4+ years of experience in BI platforms ... Guide engineering teams on best practices for data modeling, pipeline design, orchestration, and ...

previous pagenext page

Showing results 21-40

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Milwaukee, WI

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Milwaukee, WI? The most popular types of Databricks Data Engineer jobs in Milwaukee, WI are:
Overnight Databricks Data Engineer jobs near you

Data & Integration Manager

Ontech Talent

Brookfield, WI • On-site

$150K - $175K/yr

Full-time

Medical, Dental, Vision, Life, Retirement

Posted 26 days ago

Be Seen First

After you apply to this job, you can share why you’re interested to jump to the top of the candidate list.

Job description

Job Summary:
The Data & Integration Manager is responsible for leading the enterprise data, integration, automation, and internal development function in a large, multi-system environment. This role owns the strategy, delivery, quality, governance, and support of data platforms and integration services. The position will play a key role in connecting enterprise business systems, including ERP and other lines of business applications, with downstream reporting, analytics, automation, application, and process-improvement needs. The manager will partner with business leaders, IT infrastructure & operation teams, application owners, vendors, and executive stakeholders to deliver trusted data, reliable integrations, scalable automations, and measurable business value.

Job Duties & Responsibilities:

  • Own enterprise data platform strategy, architecture, and delivery for Azure Databases, Dataverse, Data Lakes, Synapse, Fabric, and other platforms in alignment with business priorities.
  • Oversee data ELT, ETL, warehousing, semantic modeling, and orchestration processes across operational, analytical, and reporting environments to support enterprise analytics and reporting teams.
  • Lead ERP and line of business application integrations (Infor Cloud Suite, PJM, Adobe, Autodesk, Command Alkon, HubSpot, Dispatch, and others) via APIs, EDI, event-driven integrations, and automation workflows.
  • Deliver measurable process improvements using automation and integration solutions using Power Platform and other systems (Power Apps, Power Automate, Copilot Studio, etc.).
  • Establish development and data governance, quality, security, and documentation standards.
  • Develop monitoring, audit, retention, exception handling, reconciliation, and issue-resolution processes related to enterprise data and software development.
  • Manage data and development teams, vendors, 3rd party consulting, project backlog, and delivery priorities.
  • Partner with business and IT leaders to deliver analytics, integration, and automation value.


Job-Based Competencies:

  • Spark / Big Data Processing
  • Data Modeling & Warehousing 
  • Pipeline Design & Reliability 
  • Cloud Data Platforms
  • Streaming
  • Data Governance & Security
  • Architecture & Cost Optimization
  • Communication
  • Customer Service
  • Collaboration & Cross-Team Influence 
  • Mentoring & Tech Leadership
  • Change Management & Learning Agility 

Experience & Qualifications:

  • 8+ years of progressive experience in data engineering, integration, analytics, application development, business intelligence, or enterprise systems roles.
  • 3+ years of experience leading teams, managing technical delivery, or overseeing major enterprise data/integration initiatives.
  • Strong experience with Microsoft Azure data services, including Azure SQL, Azure Data Factory, Data Lake/Lakehouse, Synapse, Fabric, and equivalent cloud data platforms.
  • Experience integrating, expanding, and onboarding ERP systems; experience with Infor Cloud Suite Distribution is strongly preferred.
  • Experience with API-based integrations, EDI, ETL/ELT data pipelines, automation workflows, and enterprise integration patterns.
  • Hands-on and/or leadership experience with Power BI, Power Apps, Power Automate, Databricks, SQL, Python, Spark, and modern analytics platforms.
  • Experience establishing standards for development lifecycle, source control, testing, deployment, documentation, monitoring, and production support.
  • Experience supporting multi-location, enterprise-scale operations with distributed business processes and systems.
  • Bachelor’s degree in Information Technology, Computer Science, Data Engineering, Information Systems, Business Analytics, or equivalent.
  • Experience supporting audits, compliance, data disaster recovery, and business continuity planning is a plus.
  • Ability to lead and communicate clearly with technical teams, vendors, and cross-functional initiatives with clear accountability and follow-through.
  • Strong analytical mindset with ability to troubleshoot complex data, integration, automation, and business process issues.
  • Strong documentation, change management, testing, release management, governance, and support habits.

Experience & Qualifications:

  • TOGAF, ITIL, CBIP, PMP, and/or Microsoft Data Engineering / Development / Architecture certifications.
  • Familiarity with Azure API Management, Infor ION API Gateway, MuleSoft, Boomi, Apigee, Kong, Amazon API Gateway, Postman, SAP Integration Suite frameworks and platforms.

Work Environment:

  • Work is typically performed in an indoor office environment.
  • Exposure may include noise, machinery, dust, and public interaction.
  • 10-20% travel is required (up to 50% while onboarding the first 90 days)
  • Typical work performed during business hours

Company Description

Ontech Talent, is where innovation meets expertise in the dynamic realm of IT and Engineering recruiting and staffing. Founded by industry visionary Nicole Whitbeck Dohnal, Ontech Talent has emerged as the premier strategic partner for Fortune mid to large companies seeking unparalleled talent solutions.