1

Databricks Architect Jobs in Decatur, GA (NOW HIRING)

Databricks Developer Location: Atlanta, GA / Nashville, TN Duration: Long term contract Note ... Knowledge of Medallion architecture * Ability to work independently and collaborate effectively ...

Professionals in this area work across strategy, architecture, implementation, and deployment to ... Deloitte is seeking a Manager - Databricks to support the design, build, and delivery of modern ...

Azure/Databricks Infrastructure Engineer

Atlanta, GA · On-site

$103.40K - $135.60K/yr

... architecture solutions across development, test, and production environments • Configuring and administering Databricks workspaces, clusters, Unity Catalog, governance capabilities, and platform ...

New

Databricks Developer - Georgia We are seeking a highly skilled Databricks Developer to join our ... Collaborate with data scientists and analysts to define data models and architecture. * Optimize ...

Cloud Architect

Kennesaw, GA

$60 - $76.50/hr

The Cloud Data Architect will be responsible for delivery of BI solutions within Flooring North ... Azure Databricks Unity Catalog * Azure Data Lake Storage * Spark Engine * Power BI/ Microsoft ...

Cloud Architect

Kennesaw, GA · On-site

$60 - $76.50/hr

The Cloud Data Architect will be responsible for delivery of BI solutions within Flooring North ... Azure Databricks Unity Catalog * Azure Data Lake Storage * Spark Engine * Power BI/ Microsoft ...

Work you'll do As a Databricks Manager on the AI & Data team, you will be responsible for ... Lead solution reviews and design update discussions to drive architecture decisions and secure ...

Azure Data Architect

Atlanta, GA · On-site

$61 - $79.50/hr

Key Responsibilities Architect Design Design and implement end-to-end modern data architecture on ... Databricks Proficiency Proven expert-level ability to design and build solutions using Databricks ...

lead or architect

Atlanta, GA · On-site

$61 - $79.50/hr

Key Responsibilities Architect Design Design and implement end-to-end modern data architecture on ... Databricks Proficiency Proven expert-level ability to design and build solutions using Databricks ...

Databricks Data Engineer

Atlanta, GA · On-site

$110.10K - $132.20K/yr

... Apply data architecture, integration, and data modeling practices to improve data quality ... Preferred : • Experience with Delta Lake, Databricks Workflows, and Unity Catalog • Experience ...

New

Databricks Data Engineer

Atlanta, GA

$110.10K - $132.20K/yr

As a Databricks Data Engineer, you will support the design, build, and optimization of cloud-based ... Apply data architecture, integration, and data modeling practices to improve data quality ...

Sr Databricks Data Engineer

Atlanta, GA

$110.10K - $132.20K/yr

Lead, coach, and develop teams of data engineers and architects, fostering technical growth and ... As a Senior Consultant - Databricks Engineer in our AI & Data practice, you will design, build, and ...

Azure Databricks Engineer

Atlanta, GA

$93.80K - $128.40K/yr

... architecture Bronze Silver Gold layers Develop reusable Databricks notebooks and jobs for ... production data workflows Azure Cloud Integration Build and orchestrate pipelines using Azure Data ...

next page

Showing results 1-20

Databricks Architect information

What are the key skills and qualifications needed to thrive as a Databricks Architect, and why are they important?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are popular job titles related to Databricks Architect jobs in Decatur, GA? For Databricks Architect jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Databricks Architect jobs in Decatur, GA look for? The top searched job categories for Databricks Architect jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Databricks Architect jobs? Cities near Decatur, GA with the most Databricks Architect job openings:
Databricks Developer

Databricks Developer

IT America Inc

Atlanta, GA • On-site

Contractor

Posted 24 days ago


Job description

Position: Databricks Developer

Location: Atlanta, GA / Nashville, TN

Duration: Long term contract

Note: Looking for Permanent / Visa independent consultants

We are looking for a skilled Databricks Developer to build and optimize data solutions on the Databricks platform, leveraging Azure cloud services to deliver scalable and high-performance data pipelines.

Key Responsibilities:

  • Develop and optimize data pipelines and workflows using Databricks and PySpark
  • Work with Delta Lake for reliable and performant data storage and processing
  • Manage and govern data assets using Unity Catalog
  • Write and optimize complex SQL queries for data transformation and analytics
  • Collaborate with stakeholders to design and implement scalable data solutions
  • Monitor and tune Databricks workloads for performance and cost efficiency
  • Document solutions and contribute to engineering best practices

Required Skills & Qualifications:

  • 4+ years of experience in data engineering or a similar role
  • Strong hands-on expertise with Databricks, including Delta Lake, Unity Catalog, and PySpark
  • Advanced SQL skills, including query optimization and performance tuning
  • Experience with Azure cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Azure Synapse)
  • Strong understanding of performance optimization techniques within Databricks
  • Knowledge of Medallion architecture
  • Ability to work independently and collaborate effectively with cross-functional teams

Nice to Have:

  • Experience with data migration projects
  • Familiarity with CI/CD pipelines and DevOps practices
  • Knowledge of other orchestration tools like Apache Airflow