1

Databricks Architect Jobs in Arizona (NOW HIRING)

Validate, refine, and own the target architecture on Databricks. Define robust migration strategies and production-ready reference patterns to convert 150+ complex stored procedures into PySpark and ...

Architecture & Strategy: Validate, refine, and own the target architecture on Databricks. Define robust migration strategies and production-ready reference patterns to convert 150+ complex stored ...

Data/Information Architect

Tempe, AZ · On-site

$61 - $78.50/hr

Azure Databricks, Azure data lake, Ansible, SQL, Terraform, Kafka , Azure CLI, Databricks CLI, PowerShell and/or Bash. What Could Set You Apart * Must have designed the E2E architecture of unified ...

Data/Information Architect

Tempe, AZ · On-site

$61 - $78.50/hr

Azure Databricks, Azure data lake, Ansible, SQL, Terraform, Kafka , Azure CLI, Databricks CLI, PowerShell and/or Bash. What Could Set You Apart * Must have designed the E2E architecture of unified ...

Data/Information Architect

Tempe, AZ · On-site

$62 - $79.75/hr

... using Databricks. Experience with Azure, AWS, or other cloud technologies • In depth ... Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching ...

Azure/Databricks Infrastructure Engineer

Tempe, AZ · On-site

$53.50 - $71.25/hr

Participate in architecture reviews, technical workshops, client discussions, and operational ... As an Azure/Databricks Infrastructure Engineer, you will design, implement, and optimize secure ...

12-12-R-Solution Architect - 9150

Phoenix, AZ · On-site

$63.25 - $81.50/hr

Design scalable data lake and data architectures using Databricks and cloud-native services ... Architect AI systems, including RAG workflows and prompt engineering. * Lead cloud migration ...

BI Architect

Phoenix, AZ · On-site

  • Medical

  • Retirement

  • PTO

BI Architect, Phoenix, AZ Responsibilities for the BI Architect: - Design, develop, implement, and ... ADLS, Databricks, monitoring services). - Solicit and translate business needs into requirements ...

Senior Data Platform Architect

Scottsdale, AZ · On-site

$67.25 - $89.75/hr

Lead architecture decisions for Azure services (e.g., Data Factory, Synapse, Data Lake, Databricks) and Fabric components * Ensure interoperability and alignment between Azure-native services and ...

Senior Data Platform Architect

Scottsdale, AZ · On-site

$67.25 - $89.75/hr

Lead architecture decisions for Azure services (e.g., Data Factory, Synapse, Data Lake, Databricks) and Fabric components * Ensure interoperability and alignment between Azure-native services and ...

next page

Showing results 1-20

Databricks Architect information

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are the key skills and qualifications needed to thrive as a Databricks Architect?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.
What are the most commonly searched types of Databricks Architect jobs in Arizona? The most popular types of Databricks Architect jobs in Arizona are:
What cities in Arizona are hiring for Databricks Architect jobs? Cities in Arizona with the most Databricks Architect job openings:
Infographic showing various Databricks Architect job openings in Arizona as of August 2026, with employment types broken down into 90% Full Time, 3% Part Time, and 7% Contract. Highlights an 78% Physical, 8% Hybrid, and 14% Remote job distribution.

Databricks Platform Architect

Koantek

Chandler, AZ • Remote

Contractor

Re-posted 9 hours ago


Job description

Job Title: Lead Data Platform Architect / Data bricks Migration Lead Location: Remote Position Type: Contract Job Overview We are seeking an accomplished, technology-driven Lead Data Platform Architect / Migration Specialist to spearhead the modernization of our core enterprise financial and tax allocation engines. In this role, you will lead the architectural design, definition of migration strategies, and hands-on implementation to transition large-scale legacy relational database systems (SQL Server/T-SQL) into a modern, cloud-native Databricks Lakehouse platform. The ideal candidate will have extensive experience in high-throughput distributed systems, Databricks compute optimization, performance tuning, and complex pipeline orchestration.

Key Responsibilities Architecture & Strategy: Validate, refine, and own the target architecture on Databricks. Define robust migration strategies and production-ready reference patterns to convert 150+ complex stored procedures into PySpark and Structured/Declarative Pipelines (SDP). Pipeline Engineering: Design distributed processing frameworks, control flows, and configuration-driven parameter handling for both full and incremental recalculation modes.

Performance Optimization: Address performance deltas between small and large workloads. Architect and implement acceleration techniques such as caching, partition pruning, cluster sizing, and offline/pre-calculation strategies to maintain sub-30-second user-facing reporting SLAs. Orchestration & Observability: Design and deploy enterprise-level pipeline orchestration using tools like Apache Airflow or Databricks Workflows.

Integrate robust logging, error handling, and observability patterns into existing enterprise monitoring frameworks. Governance & Security: Implement data governance models, data lineage, and schema evolution utilizing tools like Unity Catalog. AI-Assisted Delivery & Code Quality: Establish best practices for AI-assisted code generation (e.g., using Claude or advanced LLMs), providing code-review patterns and refactoring frameworks to ensure maintainable and performant output

Team Enablement: Lead code walkthroughs, design reviews, and pair-programming sessions with the development team to accelerate knowledge transfer and technical excellence. Required Technical Skills & Qualifications Core Big Data Platform: Deep expert-level knowledge of Databricks (Lakehouse architecture, Delta Lake, Unity Catalog) and Apache Spark / PySpark. Legacy Database Expertise: Strong background in relational databases, with advanced proficiency in SQL Server, T-SQL, and Stored Procedures.

Ability to reverse-engineer and refactor legacy database logic into distributed paradigms. Orchestration Tools: Hands-on experience with Apache Airflow or similar modern workflow orchestrators. Performance Tuning: Proven track record in cost optimization (FinOps), cluster tuning, autoscaling configurations, and handling skewed data profiles.

CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing frameworks (PyTest), and automated Git-based workflows. Experience Level: 10+ years of experience in Data Engineering/Architecture, with at least 3+ years specifically leading large-scale cloud data migrations. Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.

Preferred Certifications Databricks Certified Data Engineer Associate / Professional Databricks Certified Solutions Architect AWS Certified Database Specialist or equivalent Cloud Certifications