ZipRecruiter

Log In

1

Databricks Architect Jobs in Decatur, GA (NOW HIRING)

IT America Inc

Databricks Developer

Atlanta, GA · On-site

Databricks Developer Location: Atlanta, GA / Nashville, TN Duration: Long term contract Note ... Knowledge of Medallion architecture * Ability to work independently and collaborate effectively ...

Tata Consultancy Services

Data Architect

Atlanta, GA · On-site

$61.25 - $78.75/hr

Tata Consultancy Services is a leading IT services and consulting company, and they are seeking a Data Architect to work on cloud modernization and transformation programs involving AWS Databricks.

DS Technologies INC

Databricks developer

Atlanta, GA · On-site

Databricks Developer - Georgia We are seeking a highly skilled Databricks Developer to join our ... Collaborate with data scientists and analysts to define data models and architecture. * Optimize ...

USEReady

Cloud Solutions Architect

Alpharetta, GA · On-site

$62 - $85/hr

The ideal candidate will have deep expertise in Snowflake and/or Databricks, strong scripting and ... Architect, design, and implement scalable, secure, and high-performing cloud data platforms using ...

Programmers.io

lead or architect

Atlanta, GA · On-site

$61 - $79.50/hr

Key Responsibilities Architect Design Design and implement end-to-end modern data architecture on ... Databricks Proficiency Proven expert-level ability to design and build solutions using Databricks ...

next page

Showing results 1-20

All JobsDatabricks Architect JobsDatabricks Architect Jobs in Decatur, GA

Databricks Architect information

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are the key skills and qualifications needed to thrive as a Databricks Architect, and why are they important?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.
What are popular job titles related to Databricks Architect jobs in Decatur, GA? For Databricks Architect jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Databricks Architect jobs in Decatur, GA look for? The top searched job categories for Databricks Architect jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Databricks Architect jobs? Cities near Decatur, GA with the most Databricks Architect job openings:
Databricks Architect jobs near you
Databricks Developer

Databricks Developer

IT America Inc

Atlanta, GA • On-site

Contractor

Re-posted 7 days ago

Job description

Position: Databricks Developer

Location: Atlanta, GA / Nashville, TN

Duration: Long term contract

Note: Looking for Permanent / Visa independent consultants

We are looking for a skilled Databricks Developer to build and optimize data solutions on the Databricks platform, leveraging Azure cloud services to deliver scalable and high-performance data pipelines.

Key Responsibilities:

  • Develop and optimize data pipelines and workflows using Databricks and PySpark
  • Work with Delta Lake for reliable and performant data storage and processing
  • Manage and govern data assets using Unity Catalog
  • Write and optimize complex SQL queries for data transformation and analytics
  • Collaborate with stakeholders to design and implement scalable data solutions
  • Monitor and tune Databricks workloads for performance and cost efficiency
  • Document solutions and contribute to engineering best practices

Required Skills & Qualifications:

  • 4+ years of experience in data engineering or a similar role
  • Strong hands-on expertise with Databricks, including Delta Lake, Unity Catalog, and PySpark
  • Advanced SQL skills, including query optimization and performance tuning
  • Experience with Azure cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Azure Synapse)
  • Strong understanding of performance optimization techniques within Databricks
  • Knowledge of Medallion architecture
  • Ability to work independently and collaborate effectively with cross-functional teams

Nice to Have:

  • Experience with data migration projects
  • Familiarity with CI/CD pipelines and DevOps practices
  • Knowledge of other orchestration tools like Apache Airflow