1

Databricks Architect Jobs in Macon, GA (NOW HIRING)

Databricks Architect information

What is a Databricks Architect?

A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.

What are the key skills and qualifications needed to thrive as a Databricks Architect?

To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.

What are some common challenges Databricks Architects face when designing large-scale data solutions?

Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.

What is the difference between Databricks Architect vs Data Engineer?

AspectDatabricks ArchitectData Engineer
Primary FocusDesigning and implementing data solutions on Databricks platformBuilding, maintaining, and optimizing data pipelines and infrastructure
Skills & CertificationsDatabricks certifications, Spark, cloud platforms (AWS, Azure), SQLSQL, ETL tools, cloud platforms, programming (Python, Scala)
Work EnvironmentData platforms, cloud environments, collaboration with data teamsData pipelines, databases, cloud infrastructure, scripting

While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.

What are popular job titles related to Databricks Architect jobs in Macon, GA?

For Databricks Architect jobs in Macon, GA, the most frequently searched job titles are:

What cities near Macon, GA are hiring for Databricks Architect jobs?

Cities near Macon, GA with the most Databricks Architect job openings:

Information Technology Specialist (DATAMGT)

Macon, GA • On-site


Criminal Investigation & Law Enforcement | IRS Careers
Public Administration • 10K+ employees

7.5

Company rating: 7.5 out of 10

Based on 129 frontline employees who took The Breakroom Quiz

130th of 294 rated public sector bodies

People enjoy working here

Good employer

Recommended by students


$125K/yr

Full-time

Re-posted 4 days ago


Job description

WHAT IS INFORMATION TECHNOLOGY?
A description of the business units can be found at: https://www.jobs.irs.gov/about/who/business-divisions
  • Position(s) are to be filled in following area(s):
    • IT - Data and Platform Engineering - Data and Reporting
  • Consider each location carefully when applying. If you are selected for a location, that location will become your official post of duty.

REVIEW THE ADDITIONAL INFORMATION BELOW FOR FURTHER DETAILSQualifications:

Federal experience is not required. Experience may have been gained in the public sector, private sector or through Volunteer Service. One year of experience refers to full-time work; part-timework is considered on a prorated basis. To ensure full credit for your work experience, please indicate dates of employment by month/day/year, and indicate number of hours worked per week, on your resume.
You must meet the following requirements by the closing date of this announcement.
QUALIFICATION REQUIREMENTS: To qualify for this position, you must meet the qualification requirements outlined below:
Minimum requirements for Grade 12 and UP (GS or Equivalent) Applicants must have Information Technology related experience demonstrating each of the following nine competencies: 1) Attention to Detail, 2) Customer Service, 3) Decision Making, 4) Information Management, 5) Interpersonal Skills, 6) Oral Communication, 7) Problem Solving, 8) Teamwork and 9) Technical Competence.
Specialized Experience GS-14 Level: In addition to meeting basic requirements, to be eligible for this position at this grade level, you must have one (1) year of specialized experience at a level of difficulty and responsibility equivalent to the GS-13 grade level in the Federal service, specialized experience includes:

  • Leading or coordinating IT projects, application-related efforts, operational initiatives, or system-related activities that affect multiple users, teams, programs, or business processes.
  • Applying advanced IT principles, concepts, methods, and practices to evaluate requirements; resolve technical issues; guide system, application, or code testing and configuration decisions; and ensure technical documentation and federal cybersecurity, privacy, or regulatory requirements are addressed.
  • Engaging customers, stakeholders, users, product or business owners, and technical teams to define business or technical requirements, communicate technical impacts, and guide delivery of secure, reliable, scalable IT solutions.
  • Evaluating system, service, or application performance, availability, reliability, security controls, usability, and operational effectiveness; identifying risks, issues, defects, or gaps; and leading corrective actions or improvement efforts.
  • Analyzing competing technical approaches and providing authoritative recommendations to management, stakeholders, or IT specialists on the selection, design, configuration, implementation, or improvement of IT solutions with organizational impact.
  • Experience designing, developing, testing, deploying, and maintaining ETL and ELT pipelines that ingest structured and unstructured data, apply transformation rules, manage processing failures, and publish curated datasets using distributed data processing platforms (e.g., Databricks, Apache Spark).
  • Experience defining and implementing logical and physical data models, schemas, semantic mappings, metadata standards, and tiered data structures to maintain consistent data definitions and relationships across systems and platforms.
  • Experience implementing source control, peer review, automated testing, workflow orchestration, and continuous integration and continuous deployment (CI/CD) processes using source code management and automation tools (e.g., GitHub, GitHub Actions) to promote code and data pipeline changes through development, testing, and production environments.
  • Experience preparing and maintaining system documentation, data dictionaries, architecture and data flow diagrams, interface specifications, deployment procedures, and operational runbooks to support system deployment, maintenance, troubleshooting, and audit reviews.
  • Experience translating organizational objectives into data and artificial intelligence (AI) infrastructure requirements, implementation tasks, acceptance criteria, and operational controls to deliver solutions that support defined mission outcomes and comply with applicable policies.

AND
You must also meet the following requirement(s):

  • PERFORMANCE RATING: Current federal employees must have at least a fully successful or equivalent performance rating to receive consideration.
  • TIME AFTER COMPETITIVE APPOINTMENT (TACA): By the closing date (or if this is an open continuous announcement, by the cut-off date) specified in this job announcement, current civilian employees must have completed at least 90 days of federal civilian service since their latest non-temporary appointment from a competitive referral certificate, known as time after competitive appointment. For this requirement, a competitive appointment is one where you applied to and were appointed from an announcement open to "All US Citizens"
  • TIME IN GRADE (TIG): Federal employees must meet time-in-grade requirements. For positions above the GS-05,applicants must meet applicable time-in-grade requirements to be considered eligible. One year (52 weeks) at the next lower grade level is required to meet the time-in-grade requirements for the grade you are applying for. For positions at the GS-05, you cannot advance to the GS-05 if you have held a GS-02 in the past 52 weeks. There is no TIG restriction for GS-02, 03, or 04 positions.

For more information on qualifications please refer to OPM's Qualifications Standards.

Education:A college or university degree generally must be from an accredited (or pre-accredited) college or university recognized by the U.S. Department of Education. For a list of schools which meet these criteria, please refer to Department of Education Accreditation page.
FOREIGN EDUCATION: Education completed in foreign colleges or universities may be used to meet the requirements. You must show proof the education credentials have been deemed to be at least equivalent to that gained in conventional U.S. education program. It is your responsibility to provide such evidence when applying. Click here (Section 3, Explanation of Terms) or here for Foreign Education Credentialing instructions.
We recommend choosing an evaluator from a member organization of one of the following national associations of credential evaluation services: National Association of Credential Evaluation Services (NACES) or Association of International Credentials Evaluators (AICE).Employment Type: OTHER


What Internal Revenue Service employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom