ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Indiana

SEP

Senior Data Engineer (in person)

Westfield, IN · On-site

$101.70K - $138.10K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

SEP

Senior Data Engineer (in person)

Westfield, IN

$101.70K - $138.10K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Allegion

Lead Platform Data Engineer

Carmel, IN

Role Summary As a Lead Platform Data Engineer, you will own the data architecture that connects ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:

Allegion

Lead Platform Data Engineer

Carmel, IN · On-site

Role Summary As a Lead Platform Data Engineer, you will own the data architecture that connects ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:

AEG

Senior Data Engineer - Analytics

Indianapolis, IN · On-site

$117.10K - $154.30K/yr

SUMMARY The Senior Data Engineer will join our small, high-leverage data team building the data and ... Databricks preferred. * Production experience with dbt for transformation and modeling, and Airflow ...

Deloitte

Databricks Manager

Indianapolis, IN · On-site

Bachelor's degree 6+ years of experience delivering data engineering, analytics, or cloud data platform solutions 3+ years of experience with Databricks and Apache Spark 3+ years of experience with ...

Onebridge

Databricks Practice Lead

Indianapolis, IN

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

AEG

Senior Data Engineer - Privacy & Governance

Indianapolis, IN · On-site

$117.10K - $154.30K/yr

SUMMARY The Senior Data Engineer will join our small, high-leverage data team building the data and ... Databricks preferred. * Production experience with dbt for transformation and modeling, and Airflow ...

Onebridge

Databricks Practice Lead

Indianapolis, IN · On-site

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

Onebridge

Databricks Practice Lead

Indianapolis, IN · On-site +1

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

Pwc

Data Strategy-Manager

Indianapolis, IN

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML - Proven leadership in data-driven strategies - Experience in defining data governance frameworks - Understanding of modern cloud data ...

Guidehouse

Data Architect

Indianapolis, IN

$61 - $78.50/hr

You will work closely with data engineers, AI/ML teams, platform engineers, and government stakeholders to translate mission needs into robust data architectures, leveraging Databricks and Palantir ...

next page

Showing results 1-20

People also search for

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Indiana

Overnight Databricks Data Engineer information

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Indiana? The most popular types of Databricks Data Engineer jobs in Indiana are:
What cities in Indiana are hiring for Overnight Databricks Data Engineer jobs? Cities in Indiana with the most Overnight Databricks Data Engineer job openings:
Overnight Databricks Data Engineer jobs near you

Senior Data Engineer (in person)

SEP

Westfield, IN • On-site

$101.70K - $138.10K/yr

Full-time

Posted 2 days ago

Job description

Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation - and we're looking for a Senior Data Engineer who's ready to lead the way.
We've been partnering with companies to build software that matters since 1988. From Fortune 100 enterprises to fast-moving scale-ups, our clients depend on us to tackle complexity, deliver with craft, and stay engaged through every stage of the work. Now, we're growing our data practice - and we want someone who's as excited about clean, connected, trustworthy data as we are.
What we have to offer
  • Variety on every axis - tools, technologies, market sectors, methodologies
  • Flexible, reasonable work schedules
  • Extensive opportunities to learn and develop yourself
  • A community of friendly, talented, and effective peers
  • Opportunities to try out different roles with minimal risk
  • Gorgeous facilities

What you'll be doing
  • Provide technical direction on data engagements and mentor other engineers
  • Design and implement data pipelines and transformations (batch and streaming)
  • Develop data models for analytics use cases
  • Implement data quality checks and testing strategies for pipelines
  • Configure and manage orchestration and workflow tooling
  • Build and maintain infrastructure as code for data platforms
  • Translate architectural direction into implementation plans
  • Communicate progress, risks, and technical tradeoffs to stakeholders
  • Support client meetings in a technical capacity

Key attributes for applicants
  • A passion for great products, software development, and learning
  • Expert-level SQL skills with strong proficiency in Python; experience with Spark, Scala, R, or C# is a plus
  • Deep expertise in data pipeline development, including batch and streaming patterns
  • Solid understanding of data modeling patterns for analytics (dimensional modeling, data vault, lakehouse architectures)
  • Experience with cloud data platforms - Azure preferred, AWS experience also valued
  • Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift
  • Understanding of orchestration and workflow management (Apache Airflow, Databricks Workflows, Temporal, or similar)
  • Experience with data quality frameworks and testing strategies for pipelines
  • Familiarity with infrastructure as code tooling (Terraform, ARM/Bicep) and CI/CD pipelines (GitHub Actions or similar) is a plus
  • Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog, Microsoft Purview) is a plus
  • Ability to evaluate architectural tradeoffs in data systems (OLAP vs. OLTP, batch vs. streaming, warehouse vs. lakehouse)
  • Comfortable with ambiguity; can clarify requirements through conversation
  • Interest in mentoring and developing less experienced engineers
  • Professional data engineering experience (8+ years desired)
  • Must be legally authorized to work in the United States
  • Must not require visa sponsorship or have work authorization based on OPT or CPT
  • Must be able to work from our office in Westfield, IN without relocation financial assistance

SEP is a software product design and development company located in Westfield, IN. We provide powerful teams of thoughtful developers and designers to bring ideas to life. Founded in 1988, SEP is one of Indiana's largest software development firms with 180 employees. Our clients span from Fortune 100 to scale-up companies. We are 100% employee-owned through an ESOP and are consistently recognized for our great culture (Top Workplaces, Best Place to Work in Indiana, Techpoint Mira Exceptional Employer).
We are an equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities

About SEP

Sourced by ZipRecruiter

Industry

Software development

Company size

51 - 200 Employees

Headquarters location

Carmel, IN, US

Year founded

1988

View All SEP Jobs

Apply