ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in Austin, TX

CAPPS

GLO - Programmer V (Senior Data Engineer)

Austin, TX · On-site

$10K - $11K/mo

... Databricks, and similar technologies. This role contributes to technical solution design, implements data pipelines and platform enhancements, and collaborates with architects and senior engineers to ...

Databricks

Sr. Forward Deployed Engineer

Austin, TX · On-site

$182K - $250K/yr

CSQ427R94 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the ...

Databricks

Sr. Forward Deployed Engineer

Austin, TX

$103K - $142K/yr

CSQ427R94 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the ...

YETI Coolers LLC

Senior Data Engineer

Austin, TX · On-site

$105K - $142K/yr

About the Role The Senior Data Engineer will be part of a team that designs, builds, and operates ... Databricks * Lead development of analytical data models * Integrate SAP data sources including SAP ...

YETI Coolers LLC

Senior Data Engineer

Austin, TX · On-site

$105K - $142K/yr

About the Role The Senior Data Engineer will be part of a team that designs, builds, and operates ... Databricks * Lead development of analytical data models * Integrate SAP data sources including SAP ...

K&L Gates

Senior Data Engineer

Austin, TX · On-site

$105K - $142K/yr

The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable Microsoft Fabric data platforms. Responsibilities include establishing ...

previous page

Showing results 41-60

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in Austin, TX

Senior Databricks Data Engineer information

See Austin, TX salary details

$59K

$125.4K

$181.9K

How much do senior databricks data engineer jobs pay per year?

As of Sep 2, 2026, the average yearly pay for senior databricks data engineer in Austin, TX is $125,444.00, according to ZipRecruiter salary data. Most workers in this role earn between $103,600.00 and $142,200.00 per year, depending on experience, location, and employer.

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are the most commonly searched types of Databricks Data Engineer jobs in Austin, TX?

The most popular types of Databricks Data Engineer jobs in Austin, TX are:

What are popular job titles related to Senior Databricks Data Engineer jobs in Austin, TX?

For Senior Databricks Data Engineer jobs in Austin, TX, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Austin, TX look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Austin, TX are:

What cities near Austin, TX are hiring for Senior Databricks Data Engineer jobs?

Cities near Austin, TX with the most Senior Databricks Data Engineer job openings:

Senior Databricks Data Engineer jobs near you
Infographic showing various Senior Databricks Data Engineer job openings in Austin, TX as of August 2026, with employment types broken down into 1% As Needed, 84% Full Time, 12% Part Time, and 3% Contract. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution, with an average salary of $125,444 per year, or $60.3 per hour.

Data & AI Automation Engineer (Databricks)

IT America Inc

Austin, TX • On-site

Contractor

Re-posted 25 days ago

Job description

Position: Data & AI Automation Engineer (Databricks)

Location: Austin, TX (Locals preferred - Hybrid 3 Days Onsite Weekly)

Duration: Long-Term Contract

Required Skills: Azure Databricks, Azure Cloud, Generative AI, LLMs

Note: Looking for Permanent / Visa Independent Consultants

Overview:

We are seeking an experienced Data & AI Automation Engineer to lead the development of intelligent automation solutions within an Azure Databricks ecosystem. This role focuses on leveraging Large Language Models (LLMs), AI agents, and advanced automation techniques to enhance data engineering productivity, accelerate software delivery, and improve data quality processes.

The ideal candidate will combine strong data engineering expertise with AI-driven automation capabilities to build scalable solutions that streamline development, testing, governance, and operational activities across the data platform. Working closely with architects, engineers, and platform teams, this individual will help drive innovation through intelligent agent frameworks and automated workflows.

Key Responsibilities:

  • Architect and develop AI-powered agents using LLMs, rule-based logic, or hybrid approaches to automate data engineering operations within Azure Databricks.
  • Create automation solutions that generate, optimize, and refactor PySpark and SQL code to improve development efficiency and maintainability.
  • Design intelligent testing and validation agents to automate data quality assessments, reconciliation processes, and QA activities.
  • Implement automated governance capabilities including metadata management, lineage tracking, compliance monitoring, and policy enforcement.
  • Develop autonomous CI/CD functions such as test creation, deployment verification, release validation, and recovery/rollback procedures.
  • Build monitoring and diagnostic agents capable of detecting anomalies, identifying performance issues, and supporting root-cause investigations.
  • Establish prompt engineering standards, reusable templates, and agent orchestration patterns tailored to enterprise data platforms.
  • Partner with data engineering and architecture teams to identify automation opportunities and prioritize high-value initiatives.
  • Define and enforce best practices for AI agent lifecycle management, including development, testing, deployment, observability, and maintenance.
  • Produce technical documentation, workflow diagrams, operational procedures, and knowledge-transfer materials.
  • Evaluate emerging AI technologies, agent frameworks, and automation tools to support continuous platform improvement.

Required Experience:

  • 10+ years of experience in Data Engineering, Software Engineering, or a related technical discipline.
  • Extensive hands-on experience with modern cloud data platforms such as Azure Databricks, Snowflake, or similar technologies.
  • Proven background building AI-driven automation solutions utilizing LLMs, prompt engineering methodologies, and agent orchestration frameworks.
  • Strong programming expertise in Python and advanced SQL development within production environments.
  • Practical experience working with Azure Databricks, including notebooks, workflows, jobs, Delta Live Tables (DLT), and related services.
  • Experience implementing CI/CD and Continuous Testing (CT) pipelines using tools such as GitHub Actions and Azure DevOps.
  • Demonstrated success creating automated testing frameworks, data validation solutions, or quality assurance processes.
  • Previous experience supporting highly regulated, compliance-driven, or risk-sensitive environments is advantageous.

Technical Skills:

  • Advanced Python development skills with a strong foundation in software engineering principles, testing methodologies, documentation standards, and source control practices.
  • Expertise in SQL and PySpark performance tuning and optimization.
  • Hands-on experience integrating LLM services, AI APIs, prompt engineering techniques, and agent frameworks such as Databricks Agent Framework, LangChain, AutoGen, OpenAI, or Azure OpenAI.
  • Deep understanding of Azure Databricks, including Delta Lake, workflows, asset bundles, and enterprise-scale data processing.
  • Experience building workflow automation solutions using orchestration platforms, serverless technologies, or event-driven architectures.
  • Strong analytical skills with the ability to break down complex business and technical processes into scalable automation components.
  • Excellent communication skills with the ability to explain technical designs, AI agent architectures, and automation strategies to both technical and non-technical stakeholders.

Education:

  • Bachelor’s degree in Computer Science, Software Engineering, Data Science, Information Technology, or a related field.
  • Master’s degree preferred.