1

Senior Databricks Data Engineer Jobs in Illinois

Senior Data Engineer

Chicago, IL · On-site

$109K - $148K/yr

We are looking for a Senior Data Engineer to help build the next generation of our cloud data ... Apply deep expertise in Databricks, AWS, SQL, Python, Linux, and cloud integration patterns to ...

Senior Data Engineer

Chicago, IL · On-site

$109K - $148K/yr

We are looking for a Senior Data Engineer to help build the next generation of our cloud data ... Apply deep expertise in Databricks, AWS, SQL, Python, Linux, and cloud integration patterns to ...

Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

Data Engineer Location: Chicago, IL (3 days office) Employment: Contract Data Engineer with ... Work with Databricks for data processing. * Utilize AWS services like S3, CloudWatch, IAM, SNS, and ...

Senior Data Engineer

Chicago, IL · On-site

$112K - $188K/yr

As the senior technical engineer, design and implement highly efficient, reusable, and scalable ... Support Databricks requests from data engineering and analytics teams, including job orchestration ...

S. are leveraging the Databricks Data Intelligence Platform to securely deliver AI's potential to every audience, at scale. Our Field Engineering team is hiring a dynamic Solutions Architecture ...

Senior Data Engineer

Chicago, IL · On-site

$112K - $188K/yr

As the senior technical engineer, design and implement highly efficient, reusable, and scalable ... Support Databricks requests from data engineering and analytics teams, including job orchestration ...

Senior Data Engineer

Chicago, IL · On-site

$112K - $188K/yr

As the senior technical engineer, design and implement highly efficient, reusable, and scalable ... Support Databricks requests from data engineering and analytics teams, including job orchestration ...

Senior Data Engineer

Chicago, IL · On-site

$112K - $188K/yr

As the senior technical engineer, design and implement highly efficient, reusable, and scalable ... Support Databricks requests from data engineering and analytics teams, including job orchestration ...

Senior Data Engineer

Lake Forest, IL · On-site

$112K - $188K/yr

As the senior technical engineer, design and implement highly efficient, reusable, and scalable ... Support Databricks requests from data engineering and analytics teams, including job orchestration ...

$111K - $121K/yr

Senior Data Engineer, Archer Daniels Midland Company, Decatur, IL. Lead a delivery team to develop ... Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data ...

Senior Data Engineer

Chicago, IL

$109K - $148K/yr

Job Title: Senior Data Engineer Location: Chicago, IL or Minneapolis, Minn. 3-4 days per week ... within the Azure ecosystem, Databricks and ADF * Large-Scale Data Architecture & Design:

Data Engineer

Chicago, IL · On-site

$118K - $141K/yr

W2 Contract We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, Databricks, and AWS Redshift to join our data engineering team. The ideal candidate will have a ...

Senior Data Engineer

Chicago, IL · On-site

$70 - $80/hr

Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Senior Data Engineer to ... Workflow orchestration with Airflow, Databricks Workflows, AWS Step Functions, or equivalent.

Data Engineer

Oak Brook, IL · On-site

$143K/yr

Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Foundry ... Ensure data engineering solutions align with privacy regulations such as GDPR and HIPAA, as well as ...

Showing results 41-60

Senior Databricks Data Engineer information

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are the most commonly searched types of Databricks Data Engineer jobs in Illinois?

The most popular types of Databricks Data Engineer jobs in Illinois are:

What are popular job titles related to Senior Databricks Data Engineer jobs in Illinois?

For Senior Databricks Data Engineer jobs in Illinois, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Illinois look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Illinois are:

Infographic showing various Senior Databricks Data Engineer job openings in Illinois as of September 2026, with employment types broken down into 67% Full Time, and 33% Contract. Highlights an 67% In-person, and 33% Remote job distribution.

Senior Data Engineer

Chicago, IL • On-site

$109K - $148K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 4 days ago


Key responsibilities

  • Design, build, and optimize cloud-native data pipelines using Databricks, Spark, SQL, and Python to support large-scale ingestion, transformation, and delivery of high-value data.

  • Identify and resolve production issues, optimize performance, and address bottlenecks in data processing.

  • Advance the cloud data platform by improving scalability, observability, resilience, and operational efficiency using AWS services.


Job description

Overview
At Epsilon, we do more than collect and store data. We help some of the world's biggest brands discover real opportunities inside the data types, delimiters and decimals.
We are looking for a Senior Data Engineer to help build the next generation of our cloud data platform. This role is ideal for an engineer who thrives on solving complex data challenges at scale and brings deep expertise in Databricks, AWS cloud services, and modern data integration. You will design and operate high-performance, cloud-native data pipelines and analytics systems that power mission-critical workloads across our Ad Stack and external data ecosystems.
If you are energized by distributed systems, platform thinking, automation, and building reliable data products in a fast-moving environment, this is an opportunity to make meaningful technical impact. Join a team where you're empowered to unleash your full potential by working with the most cutting-edge concepts in Ad-Tech.
Responsibilities
  • Troubleshooting: Identify and resolve production issues, optimize performance, and address bottlenecks in data processing.
  • Build Scalable Data Products: Design, build, and optimize cloud-native data pipelines using Databricks, Spark, SQL, and Python to support large-scale ingestion, transformation, and delivery of high-value data across the platform.
  • Own Platform Reliability and Scale: Advance our cloud data platform with AWS services and strong engineering field, improving scalability, observability, resilience, cost efficiency, and operational excellence.
  • Lead with Technical Depth: Apply deep expertise in Databricks, AWS, SQL, Python, Linux, and cloud integration patterns to solve complex engineering problems and influence architecture decisions.
  • Partner Across Functions: Collaborate with cloud architects, integration engineers, analysts, and product partners to deliver data solutions that are scalable, maintainable, and aligned to business outcomes.
  • Drive Continuous Improvement: Continuously improve on data engineering standards, developer productivity, automation, and platform capabilities by bringing forward modern tools, patterns, and guidelines. Influencing technical decisions and contributing to our evolving platform.
  • Communication : Clearly articulate technical concepts and solutions to internal teams and partners, fostering a collaborative environment.
  • Troubleshooting: Identify and resolve production issues, optimize performance, and address bottlenecks in data processing.

Qualifications
What you'll bring with you:
  • BA/BS in Computer Science or related field.
  • 6-8 years of experience in data engineering, cloud data platform engineering, or large-scale data systems.
  • Strong track record of delivering production-grade solutions using Databricks, AWS, SQL, Python, and modern ETL/ELT frameworks.
  • Proficiency in working with Databricks, Spark, SQL, and Python from previous professional positions.
  • Hands-on experience with AWS cloud services, Linux, workflow orchestration, and modern data pipeline development in cloud-native environments.
  • Deep understanding of distributed systems, cloud data architecture, data warehousing, and integration patterns.
  • Experience with Kafka, Airflow, Docker, Kubernetes, relational and NoSQL databases, and enterprise-scale data platforms is highly valued.
  • Strong communication, problem solving, and ownership approach, with the ability to work effectively across teams and contribute in a high-performance engineering environment

Why you might stand out from other talent:
  • Exposure to modern data tools and frameworks such as Kubernetes, Docker, and Airflow (a plus).
  • Familiarity with the internet/digital advertising ecosystem is a plus.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision, 1 Voice.
Additional Information
When you join Epsilon, we'll create something EPIC together. We're a global leader in data and identity, with deep expertise in digital media, clean rooms, customer data platforms, loyalty and marketing services. Positioned at the center of Publicis Groupe, Epsilon helps brands deliver personalized experiences at scale and build lasting customer relationships by unlocking the full potential of data and identity. Epsilon operates in 30+ countries across EMEA, the Americas and APAC, with more than 8,000 employees.
Check out a few of these resources to learn more about what makes Epsilon so EPIC:
Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon
Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog
Epsilon has five values that define our culture and guide us as we create value for our clients, our people and consumers. We seek candidates who align with our company values, demonstrate them and make them meaningful in their day-to-day work:
  • Act with integrity. We are transparent and have the courage to do the right thing.
  • Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.
  • Innovate with purpose. We shape the market with big ideas that drive big outcomes.
  • Respect all voices. We embrace differences and foster a culture of connection and belonging.
  • Empower with accountability. We trust each other to own and deliver on common goals.

Because You Matter
As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to:
  • Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time
  • Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance
  • Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.
Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants who need accommodations to complete the application process. Please reach out to LeaveofAbsence@epsilon.com to request an accommodation.
For San Francisco Bay and Los Angeles Areas: Epsilon will consider qualified applicants with criminal histories for employment in a manner consistent with the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.
#LI-AM1
 
Compensation Range: USD $88,900.00 - USD $165,100.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 9/30/2026.