1

Overnight Databricks Data Engineer Jobs in Kansas

Sr. DevOps Engineer

Overland Park, KS · On-site

$50 - $68.25/hr

... s Engineer to design, implement, and support modern DevOps practices for an Azure-based data ... Data Factory, Synapse Analytics, or Microsoft Fabric. * Knowledge of Databricks Asset Bundles ...

Analytics Engineer II

Overland Park, KS · On-site

$90K - $115K/yr

The Analytics Engineer II builds and delivers enterprise data products that support analytical and ... Databricks, SQL Server, or Azure. * Experience developing and maintaining data models, pipelines ...

Deep expertise with Databricks, specifically the ability to design enterprise-level strategy and ... Ability to create working environments for data engineers and scientists, and general knowledge of ...

Data Architect

Topeka, KS · On-site

$60 - $77.25/hr

Guide engineers and analysts on best practices in Databricks. * Maintain data architecture roadmaps and priorities. * Balance short-term delivery with long-term scalability, articulating tradeoffs ...

Data Architect

Topeka, KS · Hybrid

$131K - $177K/yr

Guide engineers and analysts on best practices in Databricks. * Maintain data architecture roadmaps and priorities. * Balance short-term delivery with long-term scalability, articulating tradeoffs ...

Engineers features by using business acumen (including healthcare industry knowledge) to find new ... SQL, Databricks * Understanding of machine learning operations * Attention to detail * Ability to ...

Data Architect

Leawood, KS · On-site

$108K - $154K/yr

Implement DataOps/DevOps practices and automation to streamline and operationalize data workflows ... Databricks, Azure Synapse/Fabric, Amazon Redshift). * Strong expertise in data architecture ...

Our Software Engineering team is composed of skilled Technical Architects and Software Engineers ... DataBricks, Azure Data Factory, AWS Glue, Lambda Functions, Azure Synapse, Redshift, Power BI ...

Data Architect

Kansas City, KS · Hybrid

$60 - $77.25/hr

Databricks, Azure Data Lake, BLOB Storage, Synapse database or AWS RDS, Azure SQL Database). * Knowledge of programming languages (e.g., Python, Java, Scala). * Understanding of machine learning ...

Showing results 21-40

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are the most commonly searched types of Databricks Data Engineer jobs in Kansas?

The most popular types of Databricks Data Engineer jobs in Kansas are:

What cities in Kansas are hiring for Overnight Databricks Data Engineer jobs?

Cities in Kansas with the most Overnight Databricks Data Engineer job openings:

Full-time

Re-posted 27 days ago


Key responsibilities

  • Lead and develop a small team responsible for the Data and BI Platforms.

  • Own day-to-day operations of the SQL Server data warehouse, ETL/ELT pipelines, and outbound data feeds to credit unions.

  • Own and mature the BI platform end-to-end, including Power BI environment administration, standards, governance, and expanding its adoption.


Job description

Summary

TruHome Solutions is seeking a hands-on, technically strong Manager of Data Platforms to lead the foundation that powers our data and analytics capabilities. TruHome provides mortgage origination and servicing solutions to credit unions across the country, and data is central to how we serve our clients. Our platforms power outbound data feeds, operational and analytical reporting, and the insights our internal teams and credit union clients rely on every day.

This role manages a small team and is responsible for both the Data Platform (including the data warehouse, integration pipelines, and a future cloud data platform) and the BI Platform built on Power BI. The manager will run and stabilize the existing SQL Server-based environment while playing a lead role in standing up a new cloud data platform on Databricks and Azure, maturing Power BI as the enterprise BI standard, and expanding both platforms to support additional business areas.

The ideal candidate is a player-coach with depth across data engineering and BI platforms, equally effective leading a team, partnering with business stakeholders, and managing day-to-day delivery. They should be a quick business learner who can navigate the nuances of mortgage origination and servicing and communicate clearly with both technical and non-technical audiences.

Duties & Responsibilities
  • Lead and develop a small team responsible for the Data and BI Platforms; foster a culture of technical excellence, accountability, and continuous learning.
  • Own day-to-day operations of the SQL Server data warehouse, ETL/ELT pipelines, and outbound data feeds to member credit unions; ensure reliability, accuracy, and timely delivery.
  • Own and mature the BI platform end-to-end, including Power BI environment administration, semantic model and dataset standards, workspace and capacity governance, report performance, and operational/paginated reporting. Expand its footprint and self-service adoption across TruHome business areas.
  • Help shape and execute on the data and analytics strategy for TruHome, including the design and stand-up of a new cloud data platform on Databricks and Azure.
  • Drive maturity of the enterprise data warehouse by improving data integration, modeling, quality, and documentation, so it can serve as a trusted source for outbound feeds, reporting, and future analytical use cases.
  • Embrace and apply AI capabilities, including AI-assisted development, natural-language analytics (e.g., Databricks Genie), and AI features within the BI platform, to accelerate team productivity and improve data accessibility for business users.
  • Manage the intake, prioritization, and delivery of platform work using Agile/Scrum practices.
  • Serve as a trusted partner to TruHome business leaders and credit union clients. Translate business needs into platform capabilities, communicate progress and tradeoffs clearly, and build credibility through reliable delivery.
  • Support onboarding of new credit union clients by leading the build-out of outbound data pipelines required to integrate with their core and other downstream systems.
  • Support data governance, security, privacy, and regulatory compliance requirements relevant to mortgage servicing and credit union data, partnering with risk, compliance, and information security teams.
  • Manage select vendor relationships and assist with budget planning for tools, licenses, and contractors across the data and BI platforms.
RequirementsEducation and Experience Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related quantitative or technical field required; Master's degree preferred.
  • 8 to 12 years of progressive experience in data engineering, business intelligence, analytics, or data/BI platform roles, with meaningful exposure across both data platform and BI platform domains.
  • 3 to 5 years of experience leading or managing small technical teams, including hiring, performance management, and team development.
  • Demonstrated experience building out or standing up cloud data platforms, ideally on Azure with Databricks. Equivalent experience on other major cloud data platforms (e.g., Snowflake, AWS, GCP) will be considered if paired with strong Spark fundamentals.
  • Exposure to maturing a BI platform (establishing standards, scaling adoption, improving semantic models and report quality, and enabling self-service) is preferred.
  • Experience in mortgage origination, mortgage servicing, banking, lending, or other financial services data environments highly preferred. Candidates without direct domain experience must clearly demonstrate a track record of quickly learning new business domains.
  • Experience working in Agile/Scrum environments and managing team delivery through structured backlogs and sprints.
Required Knowledge, Skills and Abilities
  • Strong hands-on skills with SQL Server, including SSIS for ETL development and maintenance, stored procedure development, query optimization, and performance tuning.
  • Strong hands-on skills with the modern data stack: Python, PySpark, Spark SQL, and cloud data platform services (Databricks, Azure Data Lake Storage, Azure Data Factory or equivalent orchestration).
  • Solid data modeling skills across multiple paradigms (3rd Normal Form / ODS, dimensional/Kimball-style, and modern lakehouse / medallion patterns), with judgment on when each is appropriate.
  • Good working knowledge of the Power BI platform, including semantic/tabular model design, DAX, workspace and capacity management, dataset governance, and report performance tuning. Able to set technical direction and standards for the BI platform.
  • Familiarity with DevOps / DataOps practices including Git-based source control, CI/CD pipelines (Azure DevOps or GitHub Actions), code review, and environment management.
  • Awareness of data governance, security, and privacy practices relevant to regulated financial services environments.
  • Curiosity about and practical experience applying AI tools in data engineering and BI workflows (e.g., GitHub Copilot, Databricks Assistant/Genie, Power BI Copilot); willingness to experiment, evaluate, and bring forward what works.
  • Excellent written and verbal communication skills, with the ability to translate between technical and business audiences and to communicate confidently with senior leaders and external clients.
  • Effective people leader and strong stakeholder manager. Able to coach a small technical team, set expectations, push back constructively, and build long-term trust.
  • Pragmatic and outcome-oriented; able to balance maintaining a running business with iteratively introducing modern platforms and practices, and to manage competing priorities across operational support, project delivery, and platform modernization.
Employment Type: FULL_TIME