ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Johnston, IA

Pwc

Data Engineer - Senior Manager

Des Moines, IA · On-site

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

RFA Engineering

Data Engineer

Urbandale, IA · On-site

$80K - $120K/yr

RFA Engineering ( www.rfamec.com ) supports industry-leading clients through the full software ... Develop and maintain production-ready Python code and data workflows using SQL, PySpark, Databricks ...

Pwc

Data Engineer - Manager

Des Moines, IA

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Pwc

GenAI Python Systems Engineer-Manager

Des Moines, IA · On-site

$99K - $232K/yr

Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and SQL - Experience with Docker and ...

TEKsystems

Senior Data Engineer

Des Moines, IA

$65 - $68/hr

You'll work with Databricks to develop apps, dashboards, and Genie Spaces that support analytics ... data engineering concepts: Lakehouse architecture, Delta tables, CI/CD, distributed compute ...

TEKsystems

Senior Data Engineer

Des Moines, IA

$65 - $68/hr

You'll work with Databricks to develop apps, dashboards, and Genie Spaces that support analytics ... data engineering concepts: Lakehouse architecture, Delta tables, CI/CD, distributed compute ...

Jobtailor

Director, Data Management

Des Moines, IA · On-site

$170 - $250/hr

Oversee migration from legacy Azure SQL Server systems to an Azure Databricks Lakehouse using medallion architecture * Lead and mentor data engineers and guide the onsite and remote data engineering ...

Pwc

Data Strategy-Manager

Des Moines, IA · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML - Proven leadership in data-driven strategies - Experience in defining data governance frameworks - Understanding of modern cloud data ...

Pwc

Data Governance- Manager

Des Moines, IA · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML Travel Requirements Up to 80% Job Posting End Date The salary range for this position is: $99,000 - $232,000. Actual compensation within the ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Johnston, IA

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Johnston, IA?

The most popular types of Databricks Data Engineer jobs in Johnston, IA are:

What cities near Johnston, IA are hiring for Overnight Databricks Data Engineer jobs?

Cities near Johnston, IA with the most Overnight Databricks Data Engineer job openings:

Overnight Databricks Data Engineer jobs near you

Data Engineer / BI Developer-Databricks

Transcend IT Solutions

Des Moines, IA • On-site

$111K - $134K/yr

Other

Posted 2 days ago

New

Job description

Position Tittle: Data Analytics Engineer / BI Developer
Location: Hybrid – Des Moines, IA metro-live in Iowa or midwest and will fully relocate
Duration: Long Term
 
Job Details:
 
More Data Engineer than Analyst with strong Databricks. Need someone that is more personable
 
We are seeking a Data Analytics Engineer (Databricks) / BI Developer to support a growing enterprise data modernization initiative. This role will sit at the intersection of data analytics and data engineering, helping rebuild and modernize reporting solutions while leveraging newer Databricks-based technologies and cloud data tools.
 
This position is ideal for someone who enjoys both the analytical side of delivering business insights and the technical side of supporting data transformation efforts. The environment is still evolving, so the ideal candidate should be comfortable operating in a collaborative, fast-moving setting where foundational reporting and data capabilities are actively being built out.
 
This position will include exposure to Databricks, transformation logic, and notebook development alongside a stronger focus on dashboarding, reporting modernization, and business insight delivery.
 
Key Responsibilities:
Reporting & Dashboard Modernization
Rebuild and modernize enterprise reporting solutions using newer cloud-based and Databricks-enabled technologies.
Design and develop dashboards, visualizations, and reporting solutions that provide meaningful business insights and operational visibility.
Partner with business stakeholders to understand reporting needs, KPIs, and analytical requirements.
Databricks & Data Transformation Support
Assist with data transformation activities within Databricks environments.
Support development and maintenance of Databricks notebooks and transformation workflows.
Collaborate with data engineering and analytics teams to improve data accessibility and reporting performance.
Help bridge the gap between raw data engineering efforts and business-facing analytics solutions.
Data Analysis & Insights
Analyze datasets to identify trends, anomalies, and actionable insights that support business decision-making.
Support data validation, quality checks, and reporting accuracy initiatives.
Translate complex data into clear and consumable business intelligence outputs.
Cross-Functional Collaboration
Work closely with analytics, engineering, business, and leadership teams to support modernization initiatives.
Assist in defining reporting standards, best practices, and scalable analytics solutions.
Communicate findings and recommendations effectively to both technical and non-technical audiences.
 
Continuous Improvement:
Support ongoing modernization of reporting architecture and analytics capabilities.
Stay current on evolving Databricks, BI, and cloud analytics technologies.
Identify opportunities to improve reporting efficiency, automation, and data usability.
 
Required Qualifications:
3+ years of experience in data analytics, BI development, reporting, or related data-focused roles.
Experience developing dashboards and reporting solutions using Power BI or similar BI platforms.
Strong SQL and data analysis skills.
Exposure to Databricks or modern cloud-based analytics environments.
Understanding of data transformation concepts and analytical workflows.
Strong communication and collaboration skills.
 
Preferred Qualifications:
Experience working with Databricks notebooks and transformation logic.
Exposure to Azure data technologies and cloud-based analytics platforms.
Experience supporting reporting modernization initiatives.
Understanding of data modeling and analytics architecture concepts.
Ability to operate between technical and business-focused teams.
 
Technical Skills:
Power BI
SQL
Databricks
Data Visualization
Dashboard Development
Data Transformation
Analytics & Reporting
Cloud Data Platforms
Databricks Notebooks
Excel
Business Intelligence Tools
Ideal Candidate Profile
 

Apply