ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Indiana

Vergence

ETL/Data Engineer

Indianapolis, IN · On-site

$107.80K - $129.40K/yr

This role is ideal for an engineer with strong hands-on depth in Azure Data Factory, Azure Synapse Analytics and/or Databricks, and modern Lakehouse patterns, who is comfortable leading migration ...

Vergence

ETL/Data Engineer

Indianapolis, IN

$107.80K - $129.40K/yr

This role is ideal for an engineer with strong hands-on depth in Azure Data Factory, Azure Synapse Analytics and/or Databricks, and modern Lakehouse patterns, who is comfortable leading migration ...

SEP

Data Engineer (in person)

Westfield, IN

$109.80K - $131.90K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

New

SEP

Data Engineer (in person)

Westfield, IN · On-site

$109.80K - $131.90K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

SEP

Data Engineer (in person)

Westfield, IN

$109.80K - $131.90K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

CSpring

Sr. Data Engineer

Indianapolis, IN · On-site

$109.40K - $131.40K/yr

... Databricks * 5 years of experience developing batch and/or streaming ETL/ELT processes * 5 years of experience with data warehouse or data lake concepts * Proficiency in at least one programming ...

Deloitte

Databricks Engineer

Indianapolis, IN · On-site +1

Work you'll do As a Databricks Engineer on the AI & Data team, you will be responsible for... * Build, configure, and support Databricks environments across Microsoft Azure, Amazon Web Services, and ...

SEP

Senior Data Engineer (in person)

Westfield, IN · On-site

$101.70K - $138.10K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

next page

Showing results 1-20

People also search for

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Indiana

Overnight Databricks Data Engineer information

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Indiana? The most popular types of Databricks Data Engineer jobs in Indiana are:
What cities in Indiana are hiring for Overnight Databricks Data Engineer jobs? Cities in Indiana with the most Overnight Databricks Data Engineer job openings:
Overnight Databricks Data Engineer jobs near you

Data Engineer (No Sponsorship Available)

Heritage Construction + Materials

Indianapolis, IN • On-site

$109.40K - $131.40K/yr

Full-time

Posted 22 days ago

Job description

Build Your Career at Heritage Construction + Materials!
We are seeking a highly skilled Data Engineer to support the design, development, and implementation of our cloud data platform. This role is ideal for a Data Engineer who has experience in Databricks, cloud architecture, advanced data pipeline engineering, and building scalable, production-ready systems that support analytics, and enterprise-wide decision intelligence, with a potential to build and support AI/ML in the future.
In this role, you will architect cloud data solutions, optimize data operations, and guide the evolution of our modern data ecosystem. You will work closely with cross-functional partners, including finance and operations, to deliver high-impact, reliable, and efficient data products and strategic data initiatives.
This position requires U.S. work authorization
Essential Functions
  • Design, implement, and maintain scalable data pipelines within a cloud data platform (Azure preferred)
  • Build, optimize, and manage Databricks clusters, ensuring performance, cost efficiency, and reliable job execution
  • Develop and maintain Delta Lake tables, pipelines, and storage patterns to ensure data quality, versioning, and performance
  • Integrate Databricks with Azure services such as Azure Data Factory, ADLS, and Azure DevOps
  • Support the implementation of a new cloud-based data warehouse, defining architecture, governance, and standards
  • Build and automate CI/CD pipelines for data workflows using Azure DevOps
  • Design and implement monitoring solutions using Databricks monitoring tools, Azure Log Analytics, or custom dashboards
  • Collaborate with business and technical stakeholders to identify high-value data engineering and analytics opportunities and contribute to data governance initiatives
  • Apply modern data engineering best practices to support advanced use cases involving NLP, predictive analytics, and automation
  • Additional duties and responsibilities as assigned, including but not limited to continuously growing in alignment with the Company's core values, competencies, and skills.

Education Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field required

Experience Qualifications
  • 3+ years of experience in data engineering or cloud data architecture
  • Expertise in Databricks or Snowflake Cloud Data Platforms
  • Expertise with programming languages such as Python and/or SQL
  • Experience with Python Data Science Libraries (PySpark, Pandas, etc.)
  • Experience with Test Drive Development (TDD)
  • Automated CI/CD Pipelines
  • Linux / Bash / Docker
  • Database Schema Design and Optimization
  • Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
  • Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines)

Skills and Abilities
  • Strong analytical and problem-solving skills
  • Experience with programming languages such as Python, Java, R, or SQL
  • Experience with Databricks or Snowflake Cloud Data Platforms
  • Knowledge of statistical analysis and data visualization tools, such as PowerBI or Tableau
  • Proficient in Microsoft Office

About Heritage Construction + Materials
Heritage Construction + Materials (HC+M) is part of The Heritage Group, a privately held, family-owned business headquartered in Indianapolis. HC+M has core capabilities in infrastructure building. Its collection of companies provides innovative road construction and materials services across the Midwest. HC+M companies, including Asphalt Materials, Inc., Evergreen Roadworks, Milestone Contractors and US Aggregates, proudly employ 3,000 people at 68 locations across seven states. Learn more at www.heritagebuilds.com.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
#HeritageConstruction+Materials

Apply