Databricks Data Engineer Jobs in Cary, NC (NOW HIRING)

Raleigh, NC / Hybrid

About the Team

LexisNexis is a leading global provider of legal, regulatory and business information, and analytics that help customers increase productivity and improve decision-making and outcomes. We help lawyers win cases, manage their work more efficiently, serve their clients better, and grow their practices. We feel privileged to work in a business that has a higher purpose - advancing the rule of law around the world - which is vital for building peace and prosperity in society.

About the Role

We are looking for a Data Engineer III to join our Data Engineering team at LexisNexis. This role is ideal for a highly skilled and experienced data engineer who can independently design and deliver scalable data platforms, optimize cloud-based analytics systems, and support mission-critical production pipelines.

In this role, you will provide technical leadership across Databricks development, Redshift administration, engineering analytics, and behavior analytics ingestion. You will play a key role in shaping data architecture, improving platform reliability, and driving best practices for performance, observability, and operational excellence. You will also partner closely with cross-functional teams to deliver data solutions that support engineering, product, and analytics use cases at scale.

Responsibilities

• Design, develop, optimize, and maintain large-scale data pipelines using Databricks, Spark, and Delta Lake.
• Define and implement scalable ETL/ELT patterns for structured and semi-structured data across multiple sources and domains.
• Improve performance, cost efficiency, reliability, and maintainability of Databricks jobs, workflows, and clusters.
• Contribute to data architecture decisions and establish engineering best practices for cloud-based data processing.
• Perform Redshift administration activities including cluster management, database administration, workload tuning, and operational support.
• Build, optimize, and maintain Redshift schemas, tables, and complex SQL transformations to support analytics and reporting needs.
• Design, develop, and maintain data pipelines powering engineering analytics dashboards, metrics, and reporting solutions.
• Partner with stakeholders to define, compute, and evolve engineering KPIs such as deployment frequency, MTTR, reliability, and quality metrics.
• Own ingestion and processing pipelines for behavior analytics and product telemetry, including: Matomo - event and tracking data ingestion; FullStory - behavioral analytics and session replay data; Pendo - product usage, feature analytics, and event telemetry
• Ensure data quality, completeness, and usability for downstream analytics consumers.
• Provide L2/L3 support for critical data pipelines and platform components, ensuring high availability and timely incident resolution.
• Lead root cause analysis efforts and implement corrective and preventive actions for recurring issues.
• Establish and improve monitoring, alerting, logging, and observability standards across data systems.
• Partner with platform and infrastructure teams to ensure compliance with LexisNexis operational and security standards.

Requirements

• Strong hands-on experience with Databricks, Spark, and Delta Lake.
• Advanced proficiency in SQL, including performance tuning and optimization at scale.
• Strong experience with AWS, especially S3, Lambda, IAM, Redshift, Glue, and Step Functions.
• Strong experience in Redshift administration, including performance tuning, distribution and sort key strategy, workload management, and cluster optimization.
• Solid Python programming skills for ETL/ELT pipelines, automation, and data engineering solutions.
• Experience working with telemetry, clickstream, or behavioral analytics data.
• Familiarity with Matomo, FullStory, and/or Pendo data processing.
• Experience supporting production data environments, including incident management, RCA, and monitoring.
• Strong understanding of data quality, lineage, governance, and cataloging frameworks.
• Ability to independently drive technical solutions and influence design decisions across teams.
• Experience with Kafka, Kinesis, or other event streaming technologies.
• Familiarity with CI/CD pipelines, DevOps practices, and automated testing frameworks.
• Exposure to engineering analytics, including DORA metrics and developer productivity insights.
• Experience with AWS EMR for distributed data processing workloads.
• Experience mentoring engineers and contributing to technical leadership within a team.

Work in a way that works for you

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive

Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits

• Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan

• Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs

• Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity

• Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits

• Health Savings, Health Care, Dependent Care and Commuter Spending Accounts

• Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice

About the Business

LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis and Nexis services.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Formor please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.