1

Databricks Software Jobs in Florida (NOW HIRING)

Software Engineer

Miami, FL ยท On-site

$120 - $160/hr

Position Summary Base-2 Solutions is seeking a Software Engineer to support USSOUTHCOM J26 ENHANCED ... The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ...

New

Data Engineer - Databricks

Tampa, FL ยท On-site

$100 - $130/hr

We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine ...

New

Data Engineer - Databricks

Tampa, FL ยท Hybrid

$108K - $129K/yr

Databricks workflow development with medallion architecture * Data governance implementation and compliance * Performance tuning for large-scale data processing * Data security and privacy best ...

next page

Showing results 1-20

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What cities in Florida are hiring for Databricks Software jobs?

Cities in Florida with the most Databricks Software job openings:

Azure Databricks Architect

Veracity Software Pvt. Ltd.

Miami, FL โ€ข On-site

$60.75 - $79/hr

Full-time

Re-posted 14 days ago


Job description

Job Summary:
Veracity Software Pvt. Ltd. is seeking an Azure Databricks Architect to define and lead the architecture of scalable, secure, and high-performance data platforms on Microsoft Azure. This hands-on role involves architectural leadership and direct contributions to design, development, optimization, and delivery of data solutions.
Responsibilities:
โ€ข Own the end-to-end architecture for Azure Databricks-based data platforms, including ingestion, transformation, storage, serving, and governance layers.
โ€ข Design reusable frameworks, ELT patterns, and data models that improve delivery speed, consistency, and maintainability.
โ€ข Build and optimize pipelines and Spark jobs directly, with a strong focus on performance, reliability, and cost efficiency.
โ€ข Architect solutions using Azure Databricks, Delta Lake, ADLS, Azure Data Factory, and related Azure platform services.
โ€ข Establish governance, security and code-quality standards for the platform.
โ€ข Partner closely with business analysts, functional teams, and engineering teams to translate requirements into working solutions.
โ€ข Guide troubleshooting, code reviews, and production support for complex data workloads.
โ€ข Drive modernization and cloud-native adoption across data and analytics capabilities.
Qualifications:
Required:
โ€ข 15+ years of experience in data engineering, data architecture, or platform engineering.
โ€ข Strong hands-on experience with Azure Databricks, Spark, Python/Scala, SQL, and Delta Lake.
โ€ข Proven experience designing and implementing cloud data hubs, data lakes, and analytical data stores.
โ€ข Experience with Azure DevOps, CI/CD, and automated deployment practices.
โ€ข Ability to work directly on technical implementation, not only provide oversight.
โ€ข Strong communication and stakeholder collaboration skills.
Preferred:
โ€ข Experience in financial services or insurance.
โ€ข Knowledge of Event Hub, Cosmos DB, Azure Synapse, or other Azure analytics services.
โ€ข Databricks or Microsoft Azure certifications.
โ€ข Experience with reusable frameworks, shell scripting, and production support in large-scale environments.
Company:
At Veracity, if you have an idea you want to validate, a product you need to build, or an existing product that needs optimization, our teams are trained to jump in wherever needed. Founded in 2010, the company is headquartered in Iselin, USA, with a team of 51-200 employees. The company is currently Growth Stage.