1

Databricks Software Jobs in Florida (NOW HIRING)

Azure Developer - Remote

Lakeland, FL · On-site +1

$51 - $63.25/hr

NAVA Software solutions is looking for an Azure Developer Details: Job Title: Azure Developer ... Development of Databricks (Spark), Kafka workloads * Experience with JSON, AVRO, Parquet Delta ...

AI Engineer- Glen-Erik

Miami, FL · On-site

$70 - $80/hr

Experience with Databricks and modern data/AI environments * Strong understanding of software engineering fundamentals, including CI/CD, automated deployment pipelines, Git/source control, testing ...

Showing results 41-60

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What cities in Florida are hiring for Databricks Software jobs?

Cities in Florida with the most Databricks Software job openings:

Information Technology_USA - USA_Developer

Real Soft, Inc.

Jacksonville, FL • On-site

$106K - $127K/yr

Contractor

Re-posted 18 days ago


Job description

: -
MSP Owner: Rob Finton
Location: Atlanta, GA (3 days work from customer location)
Duration: 6 months
skill id: 10787109
Skills: 10+ years experience required
Digital : Google Data Engineering
Responsibilities:
• Defines data requirements, gather, and wrangle large scale of structured and unstructured data, and validate data by running various data tools in the Data Environment.
• Supports the standardization, customization, and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data.
• Creates data policy and develop interfaces and retention models which requires synthesizing or anonymizing data.
• Implements statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists and analytics and insights creation in data sourcing and preparation to visualize data and synthesize insights of commercial value.
• Develops and maintains data engineering best practices and contributes to Insights on data analytics and visualization concepts, methods and techniques.
• Works closely with the data science and business intelligence teams to develop data models and pipelines for research, reporting, and machine learning.
• Design, implement, and support scalable data infrastructure solutions to integrate with multi-heterogeneous data sources, aggregate and retrieve Big Data in a fast and safe mode, curate data that can be used in BI reporting, analysis, machine learning models and ad-hoc data requests.
• Build data pipelines that clean, transform, and aggregate data from disparate sources.
• Engages with business teams to gather requirements and design data solutions.
• Mentors team of more Junior Data Engineers.
• Collaborates across multiple projects to provide data engineering expertise across teams.
• Analyzes most relevant insights and shares with leadership to provide strategic recommendations for the business
• Lead a team of data engineers and act as a key senior contributor to a data engineering project.
Skills and Experience:
• 7+ years of overall IT experience
• 5+ years of experience in a data engineering/ETL role with a track record of manipulating, processing, and extracting value from large datasets
• 3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or Cloud platforms e.g. AWS, GCP, etc.
• 3+ years building, testing, and optimizing data ingestion pipelines, architectures, and data sets with Tibco, IBM or others.
• Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog.
• High-velocity high-volume stream processing with Apache Kafka and Spark Streaming.
• Strong SQL skills with ability to write intermediate complexity queries.
• ETL experience with PySpark, Spark SQL , IBM Data Stage or similar.
• Agile Scrum, Kanban or SAFe experience.
Skills Desired
• Databricks, Python (and/or Scala) and PySpark/Scala-Spark.
• Database solutions like Databricks, Teradata, Mainframe, DB2 or BigQuery.
• BI Solutions like Spotfire, OAC, Tableau or PowerBI
• Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue.
• Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series.
• Strong SQL skills with ability to write intermediate complexity queries
• Experience with GIT code versioning software
Essential Skills: Data Engineer
Experience Required: 10 & Above, Project Code :