We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands-on Databricks Administration experience to lead the administration, governance, security ...
We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands-on Databricks Administration experience to lead the administration, governance, security ...
Job Family: Database Administration (DBA), Data Engineering & Architecture Consulting, Data ... Databricks to improve reporting and decision-making. * Ensure all solutions adhere to federal ...
Job Family: Database Administration (DBA), Data Engineering & Architecture Consulting, Data ... Databricks to improve reporting and decision-making. * Ensure all solutions adhere to federal ...
Senior Consultant - Cloud Infrastructure
Indianapolis, IN · On-site
$56 - $76.25/hr
Windows Server Hybrid Administrator Associate, Azure Administrator Associate, AWS Certified Cloud ... Knowledge of cloud-based big data and analytics services such as SQL Data Warehouse and Databricks.
Senior Consultant - Cloud Infrastructure
Indianapolis, IN · On-site
$56 - $76.25/hr
Windows Server Hybrid Administrator Associate, Azure Administrator Associate, AWS Certified Cloud ... Knowledge of cloud-based big data and analytics services such as SQL Data Warehouse and Databricks.
... Administrator, Data Cloud Consultant, Platform App Builder, Sales Cloud Consultant, Service Cloud Consultant. * Knowledge of modern cloud data platforms (Snowflake, Databricks, BigQuery, RedShift ...
... Administrator, Data Cloud Consultant, Platform App Builder, Sales Cloud Consultant, Service Cloud Consultant. * Knowledge of modern cloud data platforms (Snowflake, Databricks, BigQuery, RedShift ...
Sr. Data Engineer
Indianapolis, IN · On-site
$109K - $131K/yr
... administrators and data architects to ensure the platform meets business demands. This team member ... and Databricks * 5 years of experience developing batch and/or streaming ETL/ELT processes * 5 ...
Sr. Data Engineer
Indianapolis, IN · On-site
$109K - $131K/yr
... administrators and data architects to ensure the platform meets business demands. This team member ... and Databricks * 5 years of experience developing batch and/or streaming ETL/ELT processes * 5 ...
... 1, Administrator Level 1, and Integration Level 1 * Experience with Talend or other extract, transform, load (ETL) tools, including Google Cloud Dataflow, Azure Data Factory, or Databricks
... 1, Administrator Level 1, and Integration Level 1 * Experience with Talend or other extract, transform, load (ETL) tools, including Google Cloud Dataflow, Azure Data Factory, or Databricks
Databricks Admin information
What are Databricks Admins?
Databricks Admins are IT professionals responsible for managing and configuring the Databricks platform within an organization. They handle user access, workspace setup, cluster management, security policies, and integration with cloud services. Their role is crucial in ensuring that the Databricks environment runs smoothly, securely, and efficiently for data teams. Admins also monitor resource usage, troubleshoot issues, and implement best practices for data processing and analytics workflows.
What are some common challenges a Databricks Admin faces when managing large-scale data pipelines?
As a Databricks Admin, one of the primary challenges is ensuring optimal cluster performance and resource utilization, especially when handling large and complex data pipelines. Admins must monitor job execution, manage user access, and troubleshoot issues related to data connectivity, cluster failures, or slow-running jobs. Additionally, maintaining data security and compliance across collaborative teams can be demanding, as it requires fine-tuning permissions and enforcing organizational policies. Strong communication with data engineers and analysts is essential to proactively address problems and optimize workflows.
What are the key skills and qualifications needed to thrive as a Databricks Admin, and why are they important?
To thrive as a Databricks Admin, you need a solid background in data engineering, cloud computing, and distributed systems, often supported by a degree in computer science or related field. Proficiency in Databricks platform management, Spark, Azure or AWS services, and relevant certifications like Databricks Certified Associate Developer are typically required. Strong problem-solving, communication, and collaboration skills help in effectively managing resources and supporting data teams. These skills ensure optimal platform performance, secure data workflows, and support for analytics initiatives across the organization.
What is the difference between Databricks Admin vs Data Engineer?
| Aspect | Databricks Admin | Data Engineer |
|---|---|---|
| Credentials | Databricks certifications, cloud platform knowledge | Programming skills, cloud certifications, data modeling |
| Work Environment | Cloud-based Databricks platform, administrative tasks | Data pipelines, ETL processes, coding environments |
| Employer & Industry | Tech companies, data-driven organizations using Databricks | Organizations building data infrastructure, analytics teams |
| Search & Comparison Intent | Understanding administrative roles in Databricks | Data pipeline development and data architecture |
While both roles work within data platforms, a Databricks Admin primarily manages and maintains the Databricks environment, focusing on platform configuration and user access. In contrast, a Data Engineer builds and maintains data pipelines, often utilizing Databricks for data processing. Both roles require cloud platform knowledge, but their core responsibilities differ significantly.
What are popular job titles related to Databricks Admin jobs in Indiana? For Databricks Admin jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Databricks Admin jobs in Indiana look for? The top searched job categories for Databricks Admin jobs in Indiana are:
What cities in Indiana are hiring for Databricks Admin jobs? Cities in Indiana with the most Databricks Admin job openings:
Full-time
Posted 3 days ago
New
Job description
We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands-on Databricks Administration experience to lead the administration, governance, security, performance, and cost optimization of an AWS Databricks platform.
This is a platform administration and governance role, not a development position. The ideal candidate will have extensive experience managing enterprise-scale Databricks environments on AWS and will be responsible for ensuring platform stability, security, compliance, performance, and operational excellence.
Key Requirements
• 15+ years of overall IT experience with 5+ years in Databricks Administration.
• Strong hands-on expertise in:
o Databricks Workspace Administration
o Unity Catalog Administration and Governance
o RBAC, SSO, SCIM, and Security Administration
o Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
o Databricks Cost Management, Pricing, and FinOps Optimization
o Platform Monitoring, Auditing, and Compliance
o Multi-workspace Administration
o Hive Metastore and Hive Tables Administration
• Experience managing:
o Catalogs, Schemas, Tables, Views, and Storage Credentials
o Cluster Policies and Compute Governance
o User and Access Management
o Platform Upgrades and Runtime Management
o Workspace Provisioning and Environment Governance
AWS Platform Expertise (Mandatory)
• Hands-on experience administering Databricks on AWS.
• Strong knowledge of:
o AWS IAM
o S3 Storage
o VPC, Security Groups, and Networking
o Secrets Management
o Cloud Governance and Security Best Practices
• Experience working in enterprise-scale AWS-based Data & Analytics environments.
Technical Understanding
Although this is not a development role, the candidate must possess a good understanding of:
• Databricks Lakehouse Architecture
• Apache Spark
• Delta Lake
• Hive Metastore and Hive Tables
• Data Engineering workflows
This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.
Preferred Skills
• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.
Ideal Candidate Profile
• Hands-on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.
Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.
This is a platform administration and governance role, not a development position. The ideal candidate will have extensive experience managing enterprise-scale Databricks environments on AWS and will be responsible for ensuring platform stability, security, compliance, performance, and operational excellence.
Key Requirements
• 15+ years of overall IT experience with 5+ years in Databricks Administration.
• Strong hands-on expertise in:
o Databricks Workspace Administration
o Unity Catalog Administration and Governance
o RBAC, SSO, SCIM, and Security Administration
o Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
o Databricks Cost Management, Pricing, and FinOps Optimization
o Platform Monitoring, Auditing, and Compliance
o Multi-workspace Administration
o Hive Metastore and Hive Tables Administration
• Experience managing:
o Catalogs, Schemas, Tables, Views, and Storage Credentials
o Cluster Policies and Compute Governance
o User and Access Management
o Platform Upgrades and Runtime Management
o Workspace Provisioning and Environment Governance
AWS Platform Expertise (Mandatory)
• Hands-on experience administering Databricks on AWS.
• Strong knowledge of:
o AWS IAM
o S3 Storage
o VPC, Security Groups, and Networking
o Secrets Management
o Cloud Governance and Security Best Practices
• Experience working in enterprise-scale AWS-based Data & Analytics environments.
Technical Understanding
Although this is not a development role, the candidate must possess a good understanding of:
• Databricks Lakehouse Architecture
• Apache Spark
• Delta Lake
• Hive Metastore and Hive Tables
• Data Engineering workflows
This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.
Preferred Skills
• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.
Ideal Candidate Profile
• Hands-on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.
Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.