ZipRecruiter

Log In

1

Databricks Software Jobs in Minnesota (NOW HIRING)

Deloitte

Databricks Engineer

Minneapolis, MN · On-site +1

Work you'll do As a Databricks Engineer on the AI & Data team, you will be responsible for ... across software, data, AI, network, and hybrid cloud infrastructure. The practice helps clients ...

Deloitte

Databricks Manager

Minneapolis, MN · On-site +1

... software, data, AI, network, and hybrid cloud infrastructure. These solutions are powered by ... Experience with Databricks MLOps or infrastructure setup * Experience coordinating delivery teams ...

Deloitte

Sr Databricks Data Engineer

Minneapolis, MN · On-site

$119.50K - $143.50K/yr

As a Sr Consultant - Databricks Data Engineer, you will design, build, and optimize scalable data engineering solutions using Databricks across various cloud environments. Responsibilities : • Lead ...

3M

Backend Software Engineer

Maplewood, MN · On-site

$145.68K - $178.05K/yr

Integrate backend services with cloud and data platforms, including Databricks and Delta Lake ... software engineering experience delivering production systems * 4+ years of experience designing ...

3M

Backend Software Engineer

Maplewood, MN

$145.68K - $178.05K/yr

Integrate backend services with cloud and data platforms, including Databricks and Delta Lake ... software engineering experience delivering production systems * 4+ years of experience designing ...

U.S. Bank

Senior Software Engineer

Hopkins, MN · On-site

$124.70K - $164.50K/yr

... seeking a Software Engineer to contribute to their technology initiatives in a digital ... Databricks • Hands-on expertise with Azure Data Lake (ADLS) for scalable data storage ...

Tarmac LLC

US Channel Development Manager

Shoreview, MN · On-site

... software development, and its mission is to empower businesses to succeed with outstanding digital products. What You'll Do * Build and execute joint business plans with Databricks & AWS * Drive ...

Tarmac LLC

US Channel Development Manager

Shoreview, MN · On-site

... software development, and its mission is to empower businesses to succeed with outstanding digital products. What You'll Do * Build and execute joint business plans with Databricks & AWS * Drive ...

next page

Showing results 1-20

People also search for

All JobsDatabricks Software JobsDatabricks Software Jobs in Minnesota

Databricks Software information

What are the key skills and qualifications needed to thrive as a Databricks Software Engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks Software Engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is Databricks Software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What are popular job titles related to Databricks Software jobs in Minnesota? For Databricks Software jobs in Minnesota, the most frequently searched job titles are:
What job categories do people searching Databricks Software jobs in Minnesota look for? The top searched job categories for Databricks Software jobs in Minnesota are:
What cities in Minnesota are hiring for Databricks Software jobs? Cities in Minnesota with the most Databricks Software job openings:
Databricks Software jobs near you
Senior Data Engineer (Azure & Databricks)

Senior Data Engineer (Azure & Databricks)

Emergent Software

Bloomington, MN • On-site

$60 - $85/hr

Contractor

Posted 25 days ago

Job description

** This is a 6+ month contract with our client based out of Bloomington, MN. This is a hybrid role, working in office Tuesday/Thursday. Candidates must be able to work in the US without sponsorship.**
We're looking for a Senior Data Engineer with strong Azure experience, especially in Azure Databricks, Delta Lake, and SQL, to build and scale a medallion-based data platform. This role focuses on designing high-performance, governed data pipelines using PySpark, SQL, and Databricks tools to integrate data from Azure systems, SQL Server Managed Instance, and third-party sources, while partnering closely with analytics teams and business stakeholders. Experience or strong interest in supporting AI/ML use cases is highly valued, with financial-services experience considered a plus but not required.
Responsibilities
  • Design, develop, and optimize data pipelines in Azure Databricks using PySpark and SQL, applying Delta Lake and Unity Catalog best practices.
  • Build modular, reusable libraries and utilities within Databricks to accelerate development and standardize workflows.
  • Implement Medallion architecture (Bronze, Silver, Gold layers) for scalable, governed data zones.
  • Integrate external data sources via REST APIs, SFTP file delivery, and SQL Server Managed Instance, implementing validation, logging, and schema enforcement.
  • Utilize parameter-driven jobs and manage compute using Spark clusters and Databricks serverless.
  • Collaborate with data analytics teams and business stakeholders to understand requirements and deliver analytics-ready datasets.
  • Monitor and troubleshoot Azure Data Factory (ADF) pipelines (jobs, triggers, activities, data flows) to identify and resolve job failures and data issues.
  • Automate deployments and manage code using Azure DevOps for CI/CD, version control, and environment management.
  • Contribute to documentation, architectural design, and continuous improvement of data engineering best practices.
  • Support the design and readiness of the data platform for AI and machine learning initiatives.
Requirements
  • Strong expertise with Azure Databricks, including PySpark, Delta Lake, Unity Catalog, and the ability to build reusable libraries, utility notebooks, and parameterized jobs.
  • Advanced SQL skills with experience working in Azure SQL Database and/or SQL Server Managed Instance.
  • Experience designing, troubleshooting, and supporting data pipelines using Azure Data Factory.
  • Proven ability to integrate external data sources, including REST APIs and SFTP.
  • Working knowledge of Azure DevOps for CI/CD, version control, and parameterized deployments.
  • Demonstrated experience partnering closely with data analytics teams and business stakeholders, supported by strong communication, problem-solving, and collaboration skills.
  • Interest or experience in preparing data platforms to support AI and machine learning initiatives.
Nice to Haves
  • Experience implementing Medallion architecture within governed Azure data environments, including data governance and RBAC.
  • Familiarity with data warehousing concepts, dimensional modeling, and preparing datasets for BI tools such as Power BI.
  • Understanding of Spark performance optimization, cluster or serverless compute management, and advanced Delta Lake features.
  • Hands-on experience preparing datasets to support AI/ML use cases.
  • Prior experience in the financial-services industry.
Our Vetting Process
At Emergent Staffing, we work hard to find Data Engineers who are the right fit for our clients. Here are the steps of our vetting process for this position:
  • Application (5 minutes)
  • Online Assessment (40 minutes)
  • Initial Phone Interview (30-45 minutes)
  • Virtual Interview with Hiring team
  • Onsite Interview
  • Job Offer!

#EmergentStaffing
#IND3

Apply