1

Azure Databricks Jobs in Arizona (NOW HIRING)

Data/Information Architect

Tempe, AZ ยท On-site

$61 - $78.50/hr

Azure Databricks, Azure data lake, Ansible, SQL, Terraform, Kafka , Azure CLI, Databricks CLI, PowerShell and/or Bash. What Could Set You Apart * Must have designed the E2E architecture of unified ...

Data/Information Architect

Tempe, AZ ยท On-site

$61 - $78.50/hr

Azure Databricks, Azure data lake, Ansible, SQL, Terraform, Kafka , Azure CLI, Databricks CLI, PowerShell and/or Bash. What Could Set You Apart * Must have designed the E2E architecture of unified ...

Senior Data Engineer (W2)

Phoenix, AZ ยท On-site

$105K - $143K/yr

... Azure Databricks. The candidate will serve as the onshore technical lead with hands on testing, defect fixing, and performance tuning for the migrated workloads. Work closely with stakeholders and ...

New

Data Engineer

Phoenix, AZ ยท On-site

$113K - $136K/yr

Design and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest, process, and deliver data from sources such as APIs ...

Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. * Builds, maintains, and ...

Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. * Builds, maintains, and ...

Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. * Builds, maintains, and ...

Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. * Builds, maintains, and ...

Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. * Builds, maintains, and ...

... for Azure cloud based solution (ADLS, Databricks, monitoring services). - Solicit and translate business needs into requirements for data objects including metrics, attributes, reports, and ...

next page

Showing results 1-20

Azure Databricks information

Is Azure Databricks in demand?

Azure Databricks is a popular platform for data engineering, analytics, and machine learning, and professionals with skills in Spark, Python, and cloud environments are increasingly sought after. As organizations adopt cloud-based data solutions, demand for roles involving Azure Databricks continues to grow across industries.

What does a typical day look like for someone working in an Azure Databricks role?

A typical day for an Azure Databricks professional involves designing, developing, and maintaining data pipelines, collaborating with data scientists and business analysts to transform raw data into actionable insights. You may spend time configuring Spark clusters, optimizing query performance, ensuring data security, and troubleshooting data workflow issues. Regular meetings with stakeholders and team members are common to align on project requirements and report progress. This role often offers a mix of independent technical work and team collaboration, making it both dynamic and engaging.

Is Databricks a high paying job?

Azure Databricks professionals, such as data engineers and data scientists, typically earn above-average salaries due to their specialized skills in cloud platforms, big data processing, and machine learning. Compensation varies based on experience, location, and certifications, but these roles are generally well-paid within the tech industry.

What is a job in Azure Databricks?

A job in Azure Databricks refers to an automated task or set of tasks that run on the platform, such as data processing, machine learning model training, or data pipeline execution. These jobs are scheduled and managed through the Azure Databricks workspace, often requiring knowledge of Spark, Python, Scala, or SQL. They enable users to automate workflows and handle large-scale data analytics efficiently.

What is an Azure Databricks job?

An Azure Databricks job is a way to run a notebook, JAR, Python script, or other workload in an automated or scheduled manner on an Azure Databricks cluster. Jobs allow users to orchestrate data processing, machine learning tasks, or ETL workflows efficiently. They can be triggered manually, on a schedule, or in response to events, enabling streamlined data pipeline management. Jobs also support multi-task workflows, allowing dependencies between different tasks.

What is the salary of Azure Databricks developer?

The salary of an Azure Databricks developer typically ranges from $80,000 to $150,000 annually, depending on experience, location, and certifications. Skilled professionals with expertise in Spark, Python, and cloud environments tend to earn higher salaries.

What are the key skills and qualifications needed to thrive in the Azure Databricks position, and why are they important?

To thrive as an Azure Databricks professional, you need expertise in big data analytics, data engineering, and proficiency with SQL, Python, and Apache Spark, typically supported by a degree in computer science or a related field. Familiarity with the Azure cloud ecosystem, Databricks platform tools, and advantageous certifications like Azure Data Engineer Associate are highly valuable. Strong problem-solving skills, collaboration, and the ability to communicate technical concepts clearly help set you apart in this role. These abilities are crucial for designing and optimizing scalable data solutions and effectively working within cross-functional data teams.

What are the most commonly searched types of Azure Databricks jobs in Arizona? The most popular types of Azure Databricks jobs in Arizona are:
What are popular job titles related to Azure Databricks jobs in Arizona? For Azure Databricks jobs in Arizona, the most frequently searched job titles are:
What cities in Arizona are hiring for Azure Databricks jobs? Cities in Arizona with the most Azure Databricks job openings:

Ab Initio Migration Specialist (Ab Initio to Azure Databricks Migration)

Metalight Solutions Inc

Phoenix, AZ โ€ข On-site

Other

This job post hasย expired today.ย Applications are no longer accepted.


Job description


Job Description

Hi,

Hope you're doing well.

We have an immediate opening for an Ab Initio Migration Specialist with our direct client USPS in Phoenix, AZ. We are looking for a strong Ab Initio SME who has experience migrating legacy ETL applications to Azure Databricks.

The ideal candidate should have deep expertise in Ab Initio, excellent data analysis skills, and hands-on experience with Azure Databricks, Spark, PySpark, and SQL. This role requires working closely with business stakeholders while providing technical leadership to offshore development teams during the migration.


Responsibilities
  • Lead migration of Ab Initio ETL applications to Azure Databricks.
  • Analyze existing Ab Initio graphs, plans, and transformation logic.
  • Convert Ab Initio components into Spark/PySpark/SQL-based Databricks pipelines.
  • Act as the primary Ab Initio Subject Matter Expert (SME) for the migration project.
  • Work directly with business users to gather and clarify requirements.
  • Coordinate with offshore development teams and provide technical guidance.
  • Debug complex ETL jobs and resolve data quality issues.
  • Perform data validation and reconciliation between legacy and target systems.
  • Create reusable migration frameworks, templates, and best practices.
  • Support SIT, UAT, production validation, and performance tuning.
  • Troubleshoot Ab Initio execution issues throughout the migration lifecycle.
  • Collaborate across multiple teams while ensuring timely project delivery.

Required Skills
  • 5 10 years of IT experience.
  • Strong hands-on experience with Ab Initio
    • GDE
    • Co>Operating System
    • EME
    • Conduct>It
    • Continuous Flows
  • Strong understanding of:
    • Graph development
    • DML
    • Transform functions
    • Rollup
    • Join
    • Lookup
    • Normalize/Denormalize
    • Partition/De-partition
  • Hands-on experience with:
    • Azure Databricks
    • Apache Spark
    • PySpark
    • SQL
  • Experience with ETL modernization or cloud migration projects.
  • Strong data validation, reconciliation, and debugging experience.
  • Excellent communication and stakeholder management skills.
  • Experience working with offshore teams.

Preferred Skills
  • Ab Initio to Azure Databricks migration experience.
  • Legacy ETL migration (Informatica or Teradata to Databricks).
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Azure SQL
  • CI/CD for Data Engineering
  • Healthcare, Banking, Insurance, or other regulated industry experience.
  • Experience mentoring technical teams.