ZipRecruiter

Log In

1

Databricks Architect Jobs (NOW HIRING)

Zenith services

Databricks Architect

Miami, FL

$62 - $81.25/hr

We are seeking a Databricks Engineer with strong expertise in building scalable data pipelines, data transformation workflows, and analytics solutions using the Databricks platform. The ideal ...

Goli Tech

Azure Databricks Architect / SME

Bellevue, WA · On-site

$71.75 - $93.50/hr

Lead the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric The ideal candidate will have a deep understanding of big data technologies data ...

KaashTech LLC

Azure Databricks Architect

Charlotte, NC · On-site

$62 - $80.75/hr

Azure Databricks - Plus 8 years recent experience ADF 6 years minimum SQL 6 years minimum Comm skills - excellent NOTE: Must needed Azure Databricks certification Job Summary: We are seeking a highly ...

The LaSalle Group

Databricks Senior Architect

Dallas, TX · On-site

$180K - $200K/yr

You'll own the end-to-end Databricks architecture (Unity Catalog, Medallion architecture, Delta Lake), lead a team of internal engineers, and direct external consulting partners to keep the migration ...

LaSalle Network

Databricks Senior Architect

Dallas, TX · On-site

$180K - $200K/yr

You'll own the end-to-end Databricks architecture (Unity Catalog, Medallion architecture, Delta Lake), lead a team of internal engineers, and direct external consulting partners to keep the migration ...

CEDENT

Azure Databricks Engineer

Dallas, TX

$59.25 - $77.25/hr

Architect and implement end-to-end analytics solutions leveraging Databricks and other Azure services (e.g., Azure Data Lake, Azure SQL, Azure Blob Storage). * Lead the design of cloud-based ...

Cloudious

Databrick Architect

Los Angeles, CA · On-site

$69.75 - $91.50/hr

C2C The Databricks Architect is responsible for designing, implementing, and optimizing scalable data analytics and data engineering solutions on the Databricks Lakehouse Platform. This role requires ...

CEDENT

Azure Databricks Engineer (Dallas, TX)

Dallas, TX

$54.50 - $67.50/hr

Architect and implement end-to-end analytics solutions leveraging Databricks and other Azure services (e.g., Azure Data Lake, Azure SQL, Azure Blob Storage). Lead the design of cloud-based ...

next page

Showing results 1-20

All JobsDatabricks Architect Jobs

Databricks Architect information

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are the key skills and qualifications needed to thrive as a Databricks Architect, and why are they important?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.
More about Databricks Architect jobs
What cities are hiring for Databricks Architect jobs? Cities with the most Databricks Architect job openings:
What are the most commonly searched types of Databricks Architect jobs? The most popular types of Databricks Architect jobs are:
What states have the most Databricks Architect jobs? States with the most job openings for Databricks Architect jobs include:
What job categories do people searching Databricks Architect jobs look for? The top searched job categories for Databricks Architect jobs are:
Databricks Architect jobs near you
Databricks Architect (Lead Data Platform Architect)

Databricks Architect (Lead Data Platform Architect)

iLink Digital

Manhattan, NY • On-site

$70.25 - $90.25/hr

Full-time

Posted 16 days ago

Job description


Role Overview
We are looking for a highly skilled Databricks Architect to design, build, and scale enterprise-grade Lakehouse data platforms. This role will drive architecture strategy, platform standardization, and enterprise data modernization initiatives, leveraging Databricks and cloud ecosystems.
The ideal candidate brings deep expertise in Spark, Delta Lake, and cloud-native architecture, along with strong leadership in driving large-scale data transformations.
Key Responsibilities
Data Platform Architecture
  • Define and implement end-to-end Databricks Lakehouse architecture.
  • Design scalable systems for:
    • Batch & real-time data processing
    • Structured & unstructured workloads
  • Establish medallion architecture (Bronze, Silver, Gold layers) as a standard.
Databricks Platform Leadership
  • Lead deployment and optimization of:
    • Azure Databricks / AWS Databricks / GCP Databricks
  • Define standards for:
    • Workspace design & cluster strategy
    • Job orchestration
    • Data storage (Delta Lake)
  • Drive adoption of:
    • Unity Catalog
    • MLflow
    • Databricks SQL & Photon
Solution Design & Engineering
  • Architect robust data ingestion frameworks:
    • Batch (ADF, Airflow)
    • Streaming (Kafka, Event Hub)
  • Define reusable patterns for:
    • ETL/ELT pipelines
    • Data modeling (star schema, data vault, dimensional models)
  • Guide engineering teams on best practices in Spark/PySpark optimization.
Performance & Cost Optimization
  • Optimize workloads for:
    • Query performance
    • Cluster utilization
    • Storage efficiency
  • Implement cost governance strategies (auto-scaling, job clusters, spot instances).
Data Governance & Security
  • Architect enterprise-grade governance frameworks:
    • Data lineage, cataloging, metadata management
    • Fine-grained access control (RBAC/ABAC)
  • Ensure compliance with data privacy and regulatory standards.
Cloud & Ecosystem Integration
  • Integrate Databricks with:
    • Data sources (ERP, CRM, APIs, IoT)
    • BI tools (Power BI, Tableau)
    • ML pipelines and AI platforms
  • Collaborate with cloud architects for:
    • Networking, security, and storage strategies.
Leadership & Mentorship
  • Provide architectural guidance to data engineers, scientists, and TPMs.
  • Conduct design reviews and enforce architecture governance.
  • Mentor teams on emerging patterns:
    • Data Mesh
    • DataOps / MLOps
    • GenAI workloads on Databricks
Skills & Qualifications
Mandatory Skills
  • 12+ years of experience in data engineering, architecture, or platform design.
  • 5+ years of hands-on experience with:
    • Databricks (must-have)
    • Apache Spark / PySpark / SQL
  • Strong expertise in:
    • Delta Lake
    • Distributed data processing
  • Experience with at least one cloud:
    • Azure (preferred), AWS, or GCP

Apply