1

Databricks Software Jobs in Indiana (NOW HIRING)

Senior Data Engineer (in person)

Westfield, IN ยท On-site

$101K - $138K/yr

We've been partnering with companies to build software that matters since 1988. From Fortune 100 ... Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift

AI Engineer

Indianapolis, IN ยท On-site

$50K - $112K/yr

Within our Internal Firm Services practice, you will apply data, algorithms, and software ... Microsoft Azure, Databricks, Snowflake, or related data and AI credentials - Building and ...

Sr. Data Engineer

Indianapolis, IN ยท On-site

$109K - $131K/yr

... software engineering or a closely related field; a Master's degree is preferred * 5 years of experience with Azure solutions such as functions, Synapse Data Warehousing, Data Factory, and Databricks ...

Azure Data Engineer

Indianapolis, IN ยท On-site

$109K - $131K/yr

Work in Azure Synapse, Databricks, Azure SQL, and Azure Data Lake Storage Gen2 to build storage and compute patterns that fit the client's scale and budget. * Implement data quality checks ...

Azure Data Engineer

Indianapolis, IN ยท On-site

$109K - $131K/yr

Work in Azure Synapse, Databricks, Azure SQL, and Azure Data Lake Storage Gen2 to build storage and compute patterns that fit the client's scale and budget. * Implement data quality checks ...

Fabric Data Engineer

Fort Wayne, IN ยท On-site

$104K - $125K/yr

Microsoft Fabric, Azure (Synapse Analytics, Data Factory), or Databricks strongly preferred. * Solid understanding of data lakes, data warehouses, and lakehouse architectures. * Working knowledge of ...

Fabric Data Engineer

Fort Wayne, IN ยท On-site

$104K - $125K/yr

Microsoft Fabric, Azure (Synapse Analytics, Data Factory), or Databricks strongly preferred. * Solid understanding of data lakes, data warehouses, and lakehouse architectures. * Working knowledge of ...

Azure Data Engineer

Indianapolis, IN ยท On-site

$109K - $131K/yr

Work in Azure Synapse, Databricks, Azure SQL, and Azure Data Lake Storage Gen2 to build storage and compute patterns that fit the client's scale and budget. * Implement data quality checks ...

Data Engineer I

Fort Wayne, IN

$113K - $135K/yr

Familiarity with cloud-based platforms like Databricks (AWS, Azure, GCP). Willingness to learn and develop skills in data engineering technologies.

Data Engineer I

Fort Wayne, IN

$113K - $135K/yr

Familiarity with cloud-based platforms like Databricks (AWS, Azure, GCP). Willingness to learn and develop skills in data engineering technologies.

Data Engineer I

Fort Wayne, IN ยท On-site

$113K - $135K/yr

Familiarity with cloud-based platforms like Databricks (AWS, Azure, GCP). Willingness to learn and develop skills in data engineering technologies.

Showing results 21-40

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What cities in Indiana are hiring for Databricks Software jobs?

Cities in Indiana with the most Databricks Software job openings:

Senior Data Engineer (in person)

SEP

Westfield, IN โ€ข On-site

$101K - $138K/yr

Full-time

Re-posted 20 days ago


Job description

Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation - and we're looking for a Senior Data Engineer who's ready to lead the way.
We've been partnering with companies to build software that matters since 1988. From Fortune 100 enterprises to fast-moving scale-ups, our clients depend on us to tackle complexity, deliver with craft, and stay engaged through every stage of the work. Now, we're growing our data practice - and we want someone who's as excited about clean, connected, trustworthy data as we are.
What we have to offer
  • Variety on every axis - tools, technologies, market sectors, methodologies
  • Flexible, reasonable work schedules
  • Extensive opportunities to learn and develop yourself
  • A community of friendly, talented, and effective peers
  • Opportunities to try out different roles with minimal risk
  • Gorgeous facilities

What you'll be doing
  • Provide technical direction on data engagements and mentor other engineers
  • Design and implement data pipelines and transformations (batch and streaming)
  • Develop data models for analytics use cases
  • Implement data quality checks and testing strategies for pipelines
  • Configure and manage orchestration and workflow tooling
  • Build and maintain infrastructure as code for data platforms
  • Translate architectural direction into implementation plans
  • Communicate progress, risks, and technical tradeoffs to stakeholders
  • Support client meetings in a technical capacity

Key attributes for applicants
  • A passion for great products, software development, and learning
  • Expert-level SQL skills with strong proficiency in Python; experience with Spark, Scala, R, or C# is a plus
  • Deep expertise in data pipeline development, including batch and streaming patterns
  • Solid understanding of data modeling patterns for analytics (dimensional modeling, data vault, lakehouse architectures)
  • Experience with cloud data platforms - Azure preferred, AWS experience also valued
  • Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift
  • Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows, Temporal, or similar)
  • Experience with data quality frameworks and testing strategies for pipelines
  • Familiarity with infrastructure as code tooling (Terraform, ARM/Bicep) and CI/CD pipelines (GitHub Actions or similar) is a plus
  • Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog, Microsoft Purview) is a plus
  • Ability to evaluate architectural tradeoffs in data systems (OLAP vs. OLTP, batch vs. streaming, warehouse vs. lakehouse)
  • Comfortable with ambiguity; can clarify requirements through conversation
  • Interest in mentoring and developing less experienced engineers
  • Professional data engineering experience (8+ years desired)
  • Must be legally authorized to work in the United States
  • Must not require visa sponsorship or have work authorization based on OPT or CPT
  • Must be able to work from our office in Westfield, IN without relocation financial assistance

SEP is a software product design and development company located in Westfield, IN. We provide powerful teams of thoughtful developers and designers to bring ideas to life. Founded in 1988, SEP is one of Indiana's largest software development firms with 180 employees. Our clients span from Fortune 100 to scale-up companies. We are 100% employee-owned through an ESOP and are consistently recognized for our great culture (Top Workplaces, Best Place to Work in Indiana, Techpoint Mira Exceptional Employer).
We are an equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities

SEP logo

About SEP

Sourced by ZipRecruiter

Industry

Software development

Company size

51 - 200 Employees

Headquarters location

Carmel, IN, US

Year founded

1988