Director Databricks Data Engineer Jobs in Northbrook, IL

Company Description
Job Description
The Enterprise Business Systems team is building Epsilon's next-generation enterprise Corporate Intelligence Platform (CIP) on Databricks. CIP brings together critical data from HR, Finance, Product Development, Revenue Operations, Resource Planning, and other enterprise systems into a governed, enterprise-scale data foundation. The platform enables business leaders to leverage AI, analytics, dashboards, and Databricks Genie to make faster, smarter decisions using trusted corporate data.
As a Senior Data Engineer, you will architect and build the foundational data platform that powers CIP. You will design scalable ingestion frameworks, implement Medallion Architecture patterns, establish data governance controls, build enterprise semantic models, and create certified data products consumed by executive dashboards, AI copilots, and business intelligence solutions.
This role reports to the MIS Engineering Director and partners closely with Product Management, Enterprise Architecture, Business Systems leaders, Data Architects, Data Analysts, AI Engineers, Platform Engineers, Product Owners, and business partners across Finance, HR, Sales, Revenue Operations, and Product Engineering. You will collaborate daily with Databricks platform specialists, source system owners, and cross-functional delivery teams to ensure successful delivery of CIP capabilities.
Responsibilities
Why Would a Top Candidate Want This Opportunity?

• Build Epsilon's Enterprise Data Foundation: Design and implement the strategic platform that centralizes enterprise intelligence across multiple business domains and serves as the long-term system of record for corporate analytics and AI.
• Lead Databricks Architecture at Scale: Drive architecture decisions across Delta Lake, Unity Catalog, Databricks Workflows, Delta Live Tables, semantic modeling, governance, and enterprise AI enablement.
• Solve Highly Visible Business Problems: Support executive initiatives around resource planning, product investment management, engineering cost transparency, sales operations, client profitability analysis, workforce planning, and enterprise reporting.
• Influence Platform Strategy: Play a key role in defining governance standards, certified metrics, enterprise taxonomies, semantic layers, and reusable data products that will be leveraged across the company.

What You'll Achieve

• Build Enterprise Data Architecture: Design and implement scalable Bronze, Silver, and Gold data layers using Databricks and Delta Lake architecture patterns. Develop reusable ingestion frameworks, transformation pipelines, and governed data products that support enterprise reporting and AI initiatives.
• Deliver Enterprise Data Integrations: Build and manage ingestion pipelines from systems including HRIS, Jira, Salesforce, Finance platforms, Resource Forecasting systems, and additional enterprise applications.
• Establish Governance and Data Quality: Implement data quality monitoring, metadata management, lineage tracking, security classifications, masking strategies, governance controls, and certification processes to support trusted analytics and AI outcomes.
• Enable AI and Semantic Layers: Create semantic models, curated datasets, feature layers, and optimized data structures consumed by Databricks Genie, AI applications, executive dashboards, and self-service analytics platforms.

Qualifications
What You'll Bring With You

• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related technical discipline.
• 5+ years of experience building enterprise-scale data platforms and modern cloud-based analytics solutions.
• Deep expertise with Databricks, Delta Lake, Unity Catalog, and Medallion Architecture design patterns.
• Advanced proficiency using Python, SQL, and data engineering frameworks.
• Experience designing Bronze, Silver, and Gold layer architectures.
• Experience building enterprise ETL/ELT pipelines and scalable data ingestion frameworks.
• Strong data modeling skills including dimensional modeling, semantic modeling, canonical data models, and enterprise taxonomy design.
• Experience implementing data governance, metadata management, lineage tracking, and data quality frameworks.
• Working knowledge of cloud platforms, preferably AWS.
• Strong communication and stakeholder management skills with the ability to translate business requirements into scalable technical solutions.
• Ability to independently lead technical initiatives from architecture through production deployment.

Why You Might Stand Out

• Databricks certification and formal training.
• Experience with Databricks Genie, Mosaic AI, AI/ML enablement, or enterprise AI platforms.
• Experience building enterprise data lakes, data meshes, lakehouse architectures, or semantic layers.
• Experience implementing identity resolution, master data management, or enterprise data catalog solutions.
• Strong understanding of data governance, privacy, masking, and regulatory controls.
• Experience supporting executive analytics, operational intelligence, FinOps, workforce planning, or enterprise performance management use cases.
• Experience leading enterprise modernization and business intelligence platform initiatives.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision, 1 Voice.
Additional Information
When You Join Us, We'll Create Something EPIC Together
Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we've provided marketers from the world's leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.
Epsilon's comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.
Our pillars aren't just words. They're how we show up every day.

• People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.
• Collaboration: We work together, support one another, and collectively achieve goals.
• Growth: There are endless opportunities for growth through learning, development and career advancement.
• Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.
• Flexibility: We've created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

• Act with integrity
• Work together to win together
• Innovate with purpose
• Respect all voices
• Empower with accountability

These pillars and values are our foundation-shaping our culture, guiding our decisions, and uniting us in common purpose.
Because You Matter
As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following:

• Time to Recharge: Flexible time off (FTO), 15 paid holidays
• Time to Recover: Paid sick time
• Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance
• Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.
Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants needing accommodations to complete the application process. Please reach out to LeaveofAbsence@epsilon.com to request an accommodation.
For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.
Compensation Range: USD $88,900.00 - USD $165,100.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. Temporary roles may also qualify for participation in our 401(k) plan after eligibility criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 9/3/2026.