1

Overnight Databricks Data Engineer Jobs in Kansas

Data Engineer

Kansas City, KS Β· On-site

$110K - $132K/yr

We are seeking a Data Engineer to design, build, and optimize modern data platforms for our clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. This role is ideal for someone ...

Data Engineer

Topeka, KS Β· On-site

$64K - $173K/yr

... Databricks, Snowflake etc. * 2+ years of experience in on-prem Data Engineering Platforms such as Microsoft SQL Server, Oracle, Teradata etc. * Programming and modifying code in languages like SQL ...

Data Engineer II

Topeka, KS Β· On-site

$107K - $129K/yr

Use Azure technologies and Databricks to develop scalable, reliable, and high-performing data ... Strong programming and scripting skills, including Python. * Experience with REST APIs for data ...

Data Engineer II

Topeka, KS Β· On-site

$107K - $129K/yr

Use Azure technologies and Databricks to develop scalable, reliable, and high-performing data ... Strong programming and scripting skills, including Python. Experience with REST APIs for data ...

Senior Data Engineer

Kansas, KS Β· On-site +1

$93K - $127K/yr

Design and build ETL/ELT pipelines with Databricks, dbt, and AWS that extract, transform, and load ... Solid understanding of data cleaning, preparation, and feature engineering to support downstream ...

Sr. Data Engineer - AI

Kansas City, KS

$110K - $132K/yr

Proficiency with data engineering languages, platforms, and orchestration tools such as Python, SQL, PySpark, Snowflake, Databricks, and Apache Airflow * Experience developing or supporting modern ...

Sr. Data Engineer - AI

Kansas City, KS

$110K - $132K/yr

Proficiency with data engineering languages, platforms, and orchestration tools such as Python, SQL, PySpark, Snowflake, Databricks, and Apache Airflow * Experience developing or supporting modern ...

Senior Data Engineer | Emerging Products

Kansas, KS Β· On-site +1

$93K - $127K/yr

Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics ... data engineering with a strong focus on data platform and distributed systems. * Hands-on ...

Senior Data Engineer | Emerging Products

Kansas, KS Β· On-site +1

$93K - $127K/yr

Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics ... data engineering with a strong focus on data platform and distributed systems. * Hands-on ...

Data Architect

Lenexa, KS Β· On-site

$59.75 - $77/hr

... data engineering capacity * Demonstrated experience architecting a modern cloud analytics platform - Microsoft Fabric strongly preferred; Synapse, Databricks, or equivalent Lakehouse experience ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What cities in Kansas are hiring for Overnight Databricks Data Engineer jobs?

Cities in Kansas with the most Overnight Databricks Data Engineer job openings:

Data Engineer

Kansas City, KS β€’ On-site

Reply
Software DevelopmentΒ β€’Β 11 - 50 employees

$110K - $132K/yr

Full-time

Posted 25 days ago


Job description

Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace by leveraging the power of Microsoft technologies. We provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Our innovative strategies and solutions securely and rapidly transform the way our clients do business.
We are seeking a Data Engineer to design, build, and optimize modern data platforms for our clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. This role is ideal for someone who combines deep technical expertise with strong consulting skills - someone who can engage directly with clients, understand business needs, translate requirements into scalable technical solutions, and communicate clearly with both technical and non-technical stakeholders.
As a member of the team, you will contribute to solution architecture and help deliver high-quality modern data solutions that drive measurable business value. The ideal candidate is equally comfortable discussing lakehouse architecture with engineers, facilitating design sessions with client stakeholders, and presenting recommendations to leadership teams.
Responsibilities
β€’ Work directly with clients to understand business goals, data challenges, and technical requirements
β€’ Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
β€’ Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
β€’ Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
β€’ Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
β€’ Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
Minimum Requirements
β€’ Bachelor's degree in computer science or related field
β€’ 6+ years of experience in data engineering, data platform development, or cloud data solutions
β€’ 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
β€’ Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
β€’ Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
β€’ DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
β€’ Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
β€’ Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
β€’ Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
β€’ Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
β€’ Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.
Reply is an equal opportunity employer. We are committed to provide equal opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you need assistance and reasonable accommodation due to a disability during the application or the recruiting process, email us at [email protected]. Visit our website at www.reply.com to learn more about our open roles.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.