Databricks Admininstrator

A Society Group, Inc.

Foster City, CA

Vision , Medical , Dental , Paid Time Off , Life Insurance , Retirement
Full-Time

Job Description

We are looking for a Databricks Admininstrator who will be responsible for administering and maintaining different workspaces on databricks having to run databricks on AWS. They’d be responsible for running databricks at a workspace and account level.

Responsibilities:

Hands-on administration experience with setting up the Databricks environment, administering, configuring and installing libraries on the instance.
Advise on architecture and scaling for Databricks environments.
Hands-on experience with workspaces, Unity Catalog, audit logs, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
Experience managing tenants including workspace creation, user management, cloud resources, and account usage monitoring.
Experience managing cluster and jobs, policies, templates, pools configuration options.
Experience as the Databricks account owner, AWS accounts and high-level usage monitoring.
Experience with Databricks security and privacy setup.
Experience managing storage accounts access across a large user base.
Monitor and manage auto-scaling to ensure resources are allocated efficiently.
Experience optimizing usage for performance, monitor cluster health checks and cost preferred.
Collaborate with data scientists, analysts, and other stakeholders to understand and deliver data solutions.
Experience with marketplace plugins and integration with other tools.
Experience troubleshooting end user and platform-level issues.
Document and maintain Databricks best practices and standards.
Experience with Hadoop and EMR administration.

Requirements