1

Overnight Databricks Data Engineer Jobs in Kansas, KS

Senior Data Engineer | Emerging Products

Kansas, KS · On-site +1

$93K - $127K/yr

Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics ... data engineering with a strong focus on data platform and distributed systems. * Hands-on ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...

Director of Data Engineering We are seeking an experienced Director of Data Engineering responsible ... Integrate and consume data from external platforms, including Databricks-based systems * Support ...

Director of Data Engineering We are seeking an experiencedDirector of Data Engineering responsible ... Integrate and consume data from external platforms, including Databricks-based systems * Support ...

... Databricks Certified Data Engineer / Data Analyst / ML - Proven leadership in data-driven strategies - Experience in defining data governance frameworks - Understanding of modern cloud data ...

Data Governance- Manager

Kansas City, MO · On-site

$99K - $232K/yr

... Databricks Certified Data Engineer / Data Analyst / ML Travel Requirements Up to 80% Job Posting End Date The salary range for this position is: $99,000 - $232,000. Actual compensation within the ...

Deep expertise with Databricks, specifically the ability to design enterprise-level strategy and ... Ability to create working environments for data engineers and scientists, and general knowledge of ...

Showing results 21-40

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities near Kansas, KS are hiring for Overnight Databricks Data Engineer jobs? Cities near Kansas, KS with the most Overnight Databricks Data Engineer job openings:

Senior Data Engineer | Emerging Products

NinjaOne

Kansas, KS • On-site, Remote

$93K - $127K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 9 days ago


Job description

About the Role

At NinjaOne, we're looking for a skilled Senior Data Engineer to join our Emerging Products team and help build the foundation of our modern data platform. You'll play a critical role in designing and scaling lakehouse architectures, building robust streaming and batch pipelines, and ensuring data flows reliably to the analysts and data scientists who depend on it. This is an exciting opportunity to work on greenfield infrastructure using a cutting-edge stack — Kafka, Spark, Iceberg, and Databricks — collaborate with cross-functional teams, and help shape how we harness data to power our next generation of products.

Location — We are flexible on remote working from home, if you are located in the USA and reside in one of the following states: CA, CO, CT, FL, GA, *IL, KS, MA, MD, ME, NJ, NC, NY, OR, TN, TX, VA, and WA. We have physical offices in Austin, TX and Tampa, FL, if you prefer a hybrid option.

We hire the best data engineers, but experience in our stack can't hurt: our data platform is built on Kafka, Spark, Airflow, Iceberg, and Databricks; supporting large-scale distributed workloads across hybrid streaming and batch ecosystems. Knowing lakehouse architecture patterns, distributed query engines, and scalable pipeline design will set you up for success.

What You'll Be Doing

  • Lakehouse Architecture: Design and implement Medallion-layer data architectures (Bronze, Silver, Gold), building structured ingestion pipelines and curated data layers that serve downstream analytics and data science workloads.
  • Pipeline Development: Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow, supporting reliable and low-latency data movement across the platform.
  • Table Format Management: Own and manage open table formats including Iceberg, Delta, and Hudi — selecting the right format for the workload and maintaining performance and reliability at scale.
  • Query Engine Optimization: Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics queries and support platform consumers.
  • Platform Reliability: Monitor pipeline health, troubleshoot data quality and performance issues, and continuously improve the reliability and efficiency of the data platform.
  • Collaboration: Partner closely with data scientists, analysts, and product teams to understand data requirements and deliver platform solutions that enable data-driven decision-making.
  • Other duties as needed.

About You

  • Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent work experience preferred.
  • 10+ years of experience in data engineering with a strong focus on data platform and distributed systems.
  • Hands-on experience building and managing lakehouse architectures, including Medallion (Bronze/Silver/Gold) layering patterns.
  • Deep expertise in Apache Kafka, Apache Spark, and Apache Airflow for both streaming and batch pipeline development.
  • Proficiency in open table formats — Iceberg, Delta Lake, or Hudi — with the ability to evaluate trade-offs and select the right format for the workload.
  • Experience with Databricks for large-scale data processing and analytics workloads.
  • Strong proficiency in Python and SQL.
  • Experience that will make you a standout candidate:
    • Hands-on experience with Trino or Starburst for distributed query execution.
    • Familiarity with hybrid streaming/batch architectures and event-driven data systems.
    • Experience designing Gold-layer datasets optimized for business intelligence and self-serve analytics.

About Us

NinjaOne unifies IT to simplify work for nearly 40,000 customers in 140+ countries. The NinjaOne Unified IT Operations Platform delivers endpoint management, autonomous patching, backup, and remote access in a single console to improve efficiency, increase resilience, and reduce spend. By automating IT and managing all endpoints, organizations give employees a great technology experience at work. NinjaOne is obsessed with customer success and has retained a 98% customer satisfaction score for more than 5 years.

What You'll Love

  • We are a collaborative, kind, and curious community.
  • We honor your flexibility needs with full-time work that is hybrid remote.
  • We have you covered with our comprehensive benefits package, which includes medical, dental, and vision insurance.
  • We help you prepare for your financial future with our 401(k) plan.
  • We prioritize your work-life balance with our unlimited PTO.
  • We reward your work with opportunity for growth and advancement.

Additional Information

This position is NOT eligible for Visa sponsorship. Due to federal government security requirements associated with our FedRAMP-authorized environment, candidates must be U.S. citizens or lawful permanent residents.

*Due to operational policies, NinjaOne is unable to hire for this role within the city limits of Chicago. We will consider all qualified candidates who reside outside of the city proper or are willing to self-relocate.

Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to location, market demands, experience, job-related knowledge, and skills. The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage and PTO. For roles based in California, Colorado, Maryland, New Jersey, or Washington the base salary hiring range for this position is $110,000 to $200,000 per year.

For roles based in New York, the base salary hiring range for this position is $110,000 to $200,000 per year.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, marital status, veteran status, or any other status protected by applicable law. We are committed to providing an inclusive and diverse work environment.