Databricks Engineer Jobs in Evansville, IN (NOW HIRING)

We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands-on Databricks Administration experience to lead the administration, governance, security, performance, and cost optimization of an AWS Databricks platform.
This is a platform administration and governance role, not a development position. The ideal candidate will have extensive experience managing enterprise-scale Databricks environments on AWS and will be responsible for ensuring platform stability, security, compliance, performance, and operational excellence.
Key Requirements
• 15+ years of overall IT experience with 5+ years in Databricks Administration.
• Strong hands-on expertise in:
o Databricks Workspace Administration
o Unity Catalog Administration and Governance
o RBAC, SSO, SCIM, and Security Administration
o Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
o Databricks Cost Management, Pricing, and FinOps Optimization
o Platform Monitoring, Auditing, and Compliance
o Multi-workspace Administration
o Hive Metastore and Hive Tables Administration
• Experience managing:
o Catalogs, Schemas, Tables, Views, and Storage Credentials
o Cluster Policies and Compute Governance
o User and Access Management
o Platform Upgrades and Runtime Management
o Workspace Provisioning and Environment Governance
AWS Platform Expertise (Mandatory)
• Hands-on experience administering Databricks on AWS.
• Strong knowledge of:
o AWS IAM
o S3 Storage
o VPC, Security Groups, and Networking
o Secrets Management
o Cloud Governance and Security Best Practices
• Experience working in enterprise-scale AWS-based Data & Analytics environments.
Technical Understanding
Although this is not a development role, the candidate must possess a good understanding of:
• Databricks Lakehouse Architecture
• Apache Spark
• Delta Lake
• Hive Metastore and Hive Tables
• Data Engineering workflows
This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.
Preferred Skills
• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.
Ideal Candidate Profile
• Hands-on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.
Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.