ZipRecruiter

Log In

1

Databricks Architect Jobs in Decatur, GA (NOW HIRING)

Lorven Technologies

Databricks Architect

Atlanta, GA · On-site

$62.25 - $81.75/hr

Hi Our client is looking for a Databricks Architect in Atlanta, GA below is the detailed requirement. Job positing Title : Databricks Architect Location: Atlanta, GA Required Skills : Strong ...

Sarian, Inc.

Azure Databricks Architect

Atlanta, GA · On-site

$61 - $79.50/hr

Proven experience as a Data Architect or similar role with extensive experience in designing and implementing solutions on Azure Databricks. Technical Skills: * Proficiency with Azure Databricks ...

CGI Inc.

Databricks Subject Matter Expert

Atlanta, GA · On-site

Architect and oversee large-scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks Workflows. . Design real-time and batch ingestion frameworks covering structured, semi ...

Net Orbit

Databricks Administrator

Alpharetta, GA · On-site

Databricks Administrator Location: Alpharetta, GA and Jersey City, NJ Position Code: 305456 Need ... Partnered with Cloud solution architect and development team to fully understand product ...

IT America Inc

Databricks Developer

Atlanta, GA · On-site

Databricks Developer Location: Atlanta, GA / Nashville, TN Duration: Long term contract Note ... Knowledge of Medallion architecture * Ability to work independently and collaborate effectively ...

next page

Showing results 1-20

People also search for

All JobsDatabricks Architect JobsDatabricks Architect Jobs in Decatur, GA

Databricks Architect information

What are the key skills and qualifications needed to thrive as a Databricks Architect, and why are they important?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are popular job titles related to Databricks Architect jobs in Decatur, GA? For Databricks Architect jobs in Decatur, GA, the most frequently searched job titles are:
What job categories do people searching Databricks Architect jobs in Decatur, GA look for? The top searched job categories for Databricks Architect jobs in Decatur, GA are:
What cities near Decatur, GA are hiring for Databricks Architect jobs? Cities near Decatur, GA with the most Databricks Architect job openings:
Databricks Architect jobs near you
Databricks Architect

Databricks Architect

Lorven Technologies

Atlanta, GA • On-site

$62.25 - $81.75/hr

Full-time

Posted yesterday

Job description

Hi
Our client is looking for a Databricks Architect in Atlanta, GA below is the detailed requirement.
Job positing Title : Databricks Architect
Location: Atlanta, GA
Required Skills :Strong expertise in Databricks Lakehouse architecture on AWS.
Job description:
  • Bachelor's degree in computer science, Information Technology, or a related field.
  • ⁠Strong expertise in Databricks Lakehouse architecture on AWS.
  • Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning.
  • Hands on experience with Informatica power center or IDMC
  • Hands on experience with Teradata Vantage and/or Teradata on demand.
  • Experience with Airflow for orchestration and scheduling
  • Strong knowledge of AWS services used in data platforms
  • Familiarity with data reconciliation, observability, and validation frameworks
  • Need to be in person in customer office 4 days a week.
  • Strong communication skills to translate complex technical concepts into business-aligned outcomes
  • Ability to collaborate effectively across onshore and offshore delivery models
Lorven technologies logo

About Lorven technologies

Sourced by ZipRecruiter

Lorven Technologies, headquartered in Plainsboro, New Jersey, United States, is a reputable company in the technology industry, specializing in providing effective IT solutions and consulting services. The company's official website, lorventech.com, offers comprehensive insights into its offerings which include but are not limited to software development, IT consulting, project management, and business analysis. Since its inception, Lorven Technologies has been committed to ensuring efficiency and reliability in delivering IT services to its global clientele, establishing itself as a trusted name in the industry.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

2001

Social media

FacebookTwitter

View All Lorven technologies Jobs

Apply