1

Overnight Databricks Data Engineer Jobs in Indiana

... Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable ... Databricks and Snowflake - Guiding team members in data architecture development and database ...

Sr. Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

... Databricks * 5 years of experience developing batch and/or streaming ETL/ELT processes * 5 years of experience with data warehouse or data lake concepts * Proficiency in at least one programming ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Senior Data Engineer (in person)

Westfield, IN · On-site

$101K - $138K/yr

Familiarity with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, or Redshift ... Experience with analytics engineering tools like dbt and data catalog tools (Unity Catalog ...

Role Summary As a Lead Platform Data Engineer, you will own the data architecture that connects ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:

Role Summary As a Lead Platform Data Engineer, you will own the data architecture that connects ... g., Snowflake, Databricks, or BigQuery). Mastery of SQL is non-negotiable. * Modern Languages:

Bachelor's degree 6+ years of experience delivering data engineering, analytics, or cloud data platform solutions 3+ years of experience with Databricks and Apache Spark 3+ years of experience with ...

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

Databricks Practice Lead | Skills & Experience * 7+ years of experience in data engineering ... solution architecture, or related roles. * Hands-on expertise with Databricks Lakehouse Platform ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Indiana? The most popular types of Databricks Data Engineer jobs in Indiana are:
What cities in Indiana are hiring for Overnight Databricks Data Engineer jobs? Cities in Indiana with the most Overnight Databricks Data Engineer job openings:
Data Engineer - Manager

Data Engineer - Manager

Pwc

Indianapolis, IN

$99K - $232K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 17 days ago


PwC rating

8.4

Company rating: 8.4 out of 10

Based on 74 frontline employees who took The Breakroom Quiz

19th of 57 rated business consultants


Job description

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Manager

Job Description & Summary

The Opportunity
As a Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. Within our Technology Consulting practice, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.
As a Manager, you will lead teams and manage client accounts, focusing on strategic planning and mentoring junior staff. You are accountable for confirming project success and maintaining standards. Enhancing your leadership style, you motivate, develop, and inspire others to deliver quality. You are responsible for coaching, leveraging team members' unique strengths, and managing performance to deliver on client expectations. With your growing knowledge of how business works, you play an important role in identifying opportunities that contribute to the success of our firm. You are expected to lead with integrity and authenticity, articulating our purpose and values in a meaningful way. You embrace technology and innovation to enhance your delivery and encourage others to do the same.
In this role, you will have the opportunity to work with a diverse range of clients, helping them to harness the power of data and analytics to achieve their business objectives.
Responsibilities
- Designing and implementing data infrastructure and systems to facilitate efficient data processing and analysis
- Developing and managing data pipelines, integration, and transformation solutions to support client needs
- Utilizing Amazon Web Services (AWS) and Azure Data Factory to enhance data engineering capabilities
- Leading teams in the strategic planning and execution of data-driven projects
- Overseeing the deployment of scalable data solutions using platforms like Databricks and Snowflake
- Guiding team members in data architecture development and database optimization
- Validating data quality, security, and compliance within analytics frameworks
- Identifying opportunities for data utilization to drive business growth and performance
- Mentoring junior staff to develop their skills and encourage innovation
- Addressing conflicts and engaging in critical conversations with clients and stakeholders
What You Must Have
- At least a Bachelor's degree
- At least 4 years of experience
What Sets You Apart
- Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
- Utilizing Amazon Web Services (AWS) and Azure Data Factory for data engineering
- Developing data architecture and optimization strategies using Snowflake and Databricks
- Implementing data anonymization and security best practices in complex systems
- Excelling in dimensional modeling and data pipeline management
- Leading teams in data warehouse troubleshooting and performance tuning
- Mentoring junior staff in data strategy and validation techniques

Travel Requirements

Up to 60%

Job Posting End Date

The salary range for this position is: $99,000 - $232,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link: https://pwc.to/benefits-at-a-glanceAs PwC is anequal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy: https://pwc.to/H-1B-Lottery-Policy.Learn more about how we work: https://pwc.to/how-we-workFor only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines: https://pwc.to/us-application-deadlines

What PwC employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom