Senior Databricks Data Engineer Jobs in Missouri

Principal Data Engineer

The Principal Data Engineer at Cushman & Wakefield is a senior, high‑impact technical leader responsible for solving complex data engineering challenges and shaping enterprise‑wide data architecture within the TDS Technology and Data Solutions team. Reporting to the Global Head of Data Architecture & Engineering, this role combines deep hands‑on expertise with strategic influence—designing and implementing scalable data solutions on Databricks and the Azure ecosystem, establishing engineering standards, and driving architectural best practices. The role embeds across teams to accelerate delivery, mitigate risks, and ensure high‑quality outcomes, while also mentoring engineers, promoting technical excellence, and acting as a trusted advisor to translate business needs into effective data strategies.

We are seeking a Principal Data Engineer to serve as one of the most senior data engineers on our team and a near‑expert practitioner in the domain. This role combines deep technical execution with broad influence: tackling the most complex data engineering problems, designing and implementing data architectures, and raising the bar for engineering excellence across the Data Organization. Reporting to the Global Head of Data Architecture & Engineering, the Principal Data Engineer is expected to move fluidly across Data Engineering teams – embedding in projects for days or months at a time to unblock, accelerate, and uplift delivery. They will mentor engineers at every level, push standards for technical excellence, and help establish the engineering and architectural principles that guide our work. The primary platform is Databricks and the Azure cloud ecosystem, with the expectation of evaluating and adopting additional data technologies as the platform evolves.

• Engineering delivery: Take on the most technically demanding data engineering work – high‑scale pipelines, performance‑critical workloads, workload optimization, and platform‑level capabilities on Databricks and Azure – where deep expertise is essential to success.
• Engineering excellence: Write, review, and refactor production code that exemplifies the team’s standards for performance, reliability, security, observability, and cost efficiency.
• Standards and principles: Help define and continuously evolve the engineering and architectural principles, patterns, and reference implementations used across the Data Organization.
• Continuous learning: Maintain near‑expert depth in Databricks and Azure data services and proactively build expertise in adjacent and emerging technologies on our roadmap.

• Architecture design: Design end‑to‑end data architectures – covering ingestion, storage, transformation, serving, and governance – using Lakehouse patterns on Databricks and the Azure data ecosystem.
• Implementation ownership: Implement and validate critical components of the architectures you design, ensuring they are demonstrably production ready.
• Architectural alignment: Partner with the Architecture function to ensure designs align with enterprise standards for security, governance, scalability, and total cost of ownership.

• Engineer development: Mentor data engineers across all levels through code reviews, pairing, design reviews, and direct coaching, with a particular focus on accelerating mid‑level engineers toward senior contribution.
• Knowledge sharing: Lead internal tech talks and written deep dives on patterns, pitfalls, and platform capabilities to multiply the team’s expertise.

• Cross‑team embedment: Embed into Data Engineering teams for engagements ranging from days to months to lead, accelerate, or de‑risk critical projects, transferring expertise back to the host team upon exit.
• Risk and quality oversight: Proactively identify technical risks, design flaws, and execution gaps, and drive issues to resolution with clear, well‑reasoned recommendations.

• Trusted technical advisor: Serve as the go‑to technical voice for complex data problems and platform capabilities.
• Translation and influence: Translate business needs into clear technical strategies and translate technical trade‑offs into language that supports informed decisions.
• Cross‑functional partnership: Collaborate with peers in Architecture, Platform, AI, Analytics, Security, and Governance to ensure data engineering work integrates cleanly into the broader data and technology landscape.

• Extensive data engineering experience at increasing levels of seniority, with a clear track record of delivering production‑grade data platforms and pipelines at scale.
• Near‑expert hands‑on proficiency with Databricks (Spark, Lakeflow, Spark Declarative Pipelines (DLT), Delta Lake, Lakebase/Postgres, Unity Catalog, etc.) and the Azure data ecosystem.
• Demonstratable experience designing and implementing end‑to‑end data architectures for complex, enterprise‑scale environments.
• Proven ability to mentor engineers, lead through influence (without direct reports), and raise team‑wide standards for technical excellence.
• Familiarity with modern data architecture patterns (Lakehouse, medallion, data mesh), DataOps practices, and metadata‑driven and configuration‑driven pipeline frameworks and a strong instinct for reusable, scalable engineering patterns.

• Experience embedding across multiple teams, geographies and time zones as a senior technical contributor or technical lead.
• Familiarity with CI/CD and infrastructure‑as‑code tooling for data pipelines using Azure DevOps, Databricks Automation Bundles (DABS), GitHub Actions, or equivalent.
• Good understanding of data governance, metadata management, and cataloguing in enterprise environments.

Cushman & Wakefield is an Equal Opportunity employer to all protected groups, including protected veterans and individuals with disabilities. Discrimination of any type will not be tolerated.

In compliance with the Americans with Disabilities Act Amendments Act (ADAAA), if you have a disability and would like to request an accommodation in order to apply for a position at Cushman & Wakefield, please call the ADA line at 1-888-365-5406 or email Accommodations@cushwake.com. Please refer to the job title and job location when you contact us.

The compensation that will be offered to the successful candidate will depend on factors such as whether the position is covered by a collective bargaining agreement, the geographic area in which the work will be performed, market pay rates in that area, and the candidate’s experience and qualifications. The compensation for the position is: $157,250.00 – $185,000.00. The company will not pay less than minimum wage for this role.

Cushman & Wakefield also provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health, vision, and dental insurance, flexible spending accounts, health savings accounts, retirement savings plans, life, and disability insurance programs, and paid and unpaid time away from work. In addition to a comprehensive benefits package, Cushman and Wakefield provide eligible employees with competitive pay, which may vary depending on eligibility factors such as geographic location, date of hire, total hours worked, job type, business line, and applicability of collective bargaining agreements.