ZipRecruiter

Log In

1

Databricks Admin Jobs in Indiana (NOW HIRING)

CSpring

Sr. Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

... administrators and data architects to ensure the platform meets business demands. This team member ... and Databricks * 5 years of experience developing batch and/or streaming ETL/ELT processes * 5 ...

People also search for

All JobsDatabricks Admin JobsDatabricks Admin Jobs in Indiana

Databricks Admin information

What are Databricks Admins?

Databricks Admins are IT professionals responsible for managing and configuring the Databricks platform within an organization. They handle user access, workspace setup, cluster management, security policies, and integration with cloud services. Their role is crucial in ensuring that the Databricks environment runs smoothly, securely, and efficiently for data teams. Admins also monitor resource usage, troubleshoot issues, and implement best practices for data processing and analytics workflows.

What are some common challenges a Databricks Admin faces when managing large-scale data pipelines?

As a Databricks Admin, one of the primary challenges is ensuring optimal cluster performance and resource utilization, especially when handling large and complex data pipelines. Admins must monitor job execution, manage user access, and troubleshoot issues related to data connectivity, cluster failures, or slow-running jobs. Additionally, maintaining data security and compliance across collaborative teams can be demanding, as it requires fine-tuning permissions and enforcing organizational policies. Strong communication with data engineers and analysts is essential to proactively address problems and optimize workflows.

What are the key skills and qualifications needed to thrive as a Databricks Admin, and why are they important?

To thrive as a Databricks Admin, you need a solid background in data engineering, cloud computing, and distributed systems, often supported by a degree in computer science or related field. Proficiency in Databricks platform management, Spark, Azure or AWS services, and relevant certifications like Databricks Certified Associate Developer are typically required. Strong problem-solving, communication, and collaboration skills help in effectively managing resources and supporting data teams. These skills ensure optimal platform performance, secure data workflows, and support for analytics initiatives across the organization.

What is the difference between Databricks Admin vs Data Engineer?

AspectDatabricks AdminData Engineer
CredentialsDatabricks certifications, cloud platform knowledgeProgramming skills, cloud certifications, data modeling
Work EnvironmentCloud-based Databricks platform, administrative tasksData pipelines, ETL processes, coding environments
Employer & IndustryTech companies, data-driven organizations using DatabricksOrganizations building data infrastructure, analytics teams
Search & Comparison IntentUnderstanding administrative roles in DatabricksData pipeline development and data architecture

While both roles work within data platforms, a Databricks Admin primarily manages and maintains the Databricks environment, focusing on platform configuration and user access. In contrast, a Data Engineer builds and maintains data pipelines, often utilizing Databricks for data processing. Both roles require cloud platform knowledge, but their core responsibilities differ significantly.

What are popular job titles related to Databricks Admin jobs in Indiana? For Databricks Admin jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Databricks Admin jobs in Indiana look for? The top searched job categories for Databricks Admin jobs in Indiana are:
What cities in Indiana are hiring for Databricks Admin jobs? Cities in Indiana with the most Databricks Admin job openings:
Databricks Admin jobs near you
Sr. Data Engineer

Sr. Data Engineer

CSpring

Indianapolis, IN • On-site

$109K - $131K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 21 days ago

Job description

This is a great time to join our team at CSpring! Our team has an immediate opening for a full-time, Sr. Data Engineer. If the idea of working on challenging assignments with a team who is passionate about serving others and creating insights sounds exciting, this may just be the role you've been looking for!
Summary
As a CSpring Consultant, you will be a true partner to our clients, dedicated to making each client a raving fan, you will work with a team to develop state of the art solutions to business problems. You will interact with our clients and project teams, leverage your business and technical skills, discuss solutions with team members, and analyze client needs to develop important solutions.
CSpring Data Engineers are responsible for engaging in the design, development and maintenance of data platform and solutions. This includes the platform hosting data sets that support various business operations and enable data-driven decisions as well as the analytical solutions that provide visibility and decision support using data technologies. You will be responsible for administering data tooling, developing ETL/ELT pipelines, developing data integration solutions, resolving technical issues, and working with data scientists, business analysts, system administrators and data architects to ensure the platform meets business demands. This team member also ensures that solutions are scalable, include necessary monitoring, and adhere to best practices and guidelines. Senior Data Engineers also help mentor new team members and continues to grow their knowledge of new technologies.
Responsibilities
  • Develop ETL pipelines from various data repositories to load into various stages of the data platform
  • Develop data lake and warehouse architectures that support business objectives.
  • Integrate platform into the existing enterprise data warehouse and various operational systems
  • Develop administration processes to monitor pipeline performance, resource usage, and failure
  • Address performance and scalability issues in a large-scale data lake environment
  • Provide data platform support and issue resolutions

Required Skills
  • Bachelor's degree in in computer science, software engineering or a closely related field; a Master's degree is preferred
  • 5 years of experience with Azure solutions such as functions, Synapse Data Warehousing, Data Factory, and Databricks
  • 5 years of experience developing batch and/or streaming ETL/ELT processes
  • 5 years of experience with data warehouse or data lake concepts
  • Proficiency in at least one programming language, such as Python or R
  • Experience with a BI reporting platform, such as Tableau
  • Excellent communication, analytical and problem-solving skills
  • At least 2 years of development experience in a project management or agile operation
  • Prior experience working in State, Health and Human Services is a plus

About CSpring:
CSpring is a growing, Indianapolis-based technology consulting firm focused on data-driven solutions. Our team aligns business goals with technology to make information accessible, reliable, and engaging via custom and integrated software, data platforms, and advanced analytics.
If you are committed, collaborative, consultative, and caring - you will fit right in with our team. We pride ourselves in working together and understand that the whole is stronger than any one of us individually. When you join CSpring, you become part of our family - our Ohana. When you're part of our Ohana, we promise to communicate well, provide opportunities for growth, and most importantly. celebrate our successes together. Being part of CSpring's Ohana means you will be informed, recognized, rewarded, and respected. You will also have lots of opportunity to develop strong relationships with our team at quarterly company update events, monthly outings, community service opportunities, learning lunches, and more.
CSpring offers a comprehensive compensation, training, and benefits package; including Paid Time Off, Medical/Dental/Vision/Life/Disability insurance on day one, and 401(k) with company match.

Apply