1

Databricks Software Jobs in Arizona (NOW HIRING)

Big Data Engineer with Java

Phoenix, AZ · On-site

$54.25 - $71.75/hr

Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large scale data structures/data lakes * Experience with both Streaming and Batch Data Ingestion (Lambda)

... Databricks, MLflow); establish CI/CD pipelines, version control, testing, and monitoring to ensure model quality and reliability * Partner with software engineers, data engineers, product managers ...

... Databricks, MLflow); establish CI/CD pipelines, version control, testing, and monitoring to ensure model quality and reliability * Partner with software engineers, data engineers, product managers ...

Data Engineer

Phoenix, AZ

$113K - $136K/yr

Databricks Nice to have: Informatica/ETL. Responsibilities * Design and develop ETL processes based ... Understand and adopt an Agile (SCRUM like) software development mindset * Follow established ...

Software engineering fundamentals -- version control, code review, CI/CD * ETL and orchestration ... Databricks preferred * Product mindset -- builds for the next user, not just the requester ...

Software engineering fundamentals -- version control, code review, CI/CD * ETL and orchestration ... Databricks preferred * Product mindset -- builds for the next user, not just the requester ...

Data Engineer II

Phoenix, AZ · On-site

$107K - $128K/yr

Develop transformations using SQL and Python within Dataiku (recipes, flows, scenarios) and Databricks (notebooks, Jobs, Delta Lake/Spark) to produce trusted, reusable finance data marts and subject ...

Data Engineer

Scottsdale, AZ · On-site

$150 - $200/hr

Deep expertise with Databricks (or similar modern data platforms), dbt, SQL, Python, and scalable data modeling, including governance, testing, documentation, and semantic layers. * Experience ...

AI Engineer

Phoenix, AZ · On-site

$50K - $112K/yr

Within our Internal Firm Services practice, you will apply data, algorithms, and software ... Microsoft Azure, Databricks, Snowflake, or related data and AI credentials - Building and ...

Showing results 41-60

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What cities in Arizona are hiring for Databricks Software jobs?

Cities in Arizona with the most Databricks Software job openings:

Big Data Engineer with Java

Phoenix, AZ • On-site

Navtech, Inc.
Civil Engineering Construction • 11 - 50 employees

$54.25 - $71.75/hr

Contractor

Re-posted 20 days ago


Job description

Big Data Engineer with Java
Location: Remote
Duration: 12 Months Contract
Qualifications:
  • Bachelor's Degree in a Technical Discipline or equivalent work experience
  • Must have experience with Big Data toolsets: Hadoop echo system, Spark, Databricks, and Azure-based services
  • Experience with medium to large scale data structures/data lakes
  • Experience with both Streaming and Batch Data Ingestion (Lambda)
  • Experience with Java
  • Must have experience in Streaming technologies (Kafka, Spark structured streaming, Databricks)
  • Must have a minimum of 5 years of overall Technology experience with at least 2 years of Big Data (Hadoop, Spark, and Azure HDInsights) experience
  • Experience working with data preparation and data quality

Responsibilities:
  • The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze, design, and deliver data products that enable NCR's business
  • You will evaluate business questions, find the right data sets, ensure the cleanliness of the data, and build scalable and clean solutions that can be deployed in a production environment
  • Along the way, you'll partner with our Azure Infrastructure, Visualization, Advanced Analytics, and Engineering teams to consistently deliver quality data products

Navtech logo

About Navtech

Sourced by ZipRecruiter

Industry

Civil engineering construction

Company size

11 - 50 Employees

Headquarters location

New Bloomfield, PA, US

Year founded

1996