Insurance Data Engineer Jobs in Fort Mill, SC (NOW HIRING)

The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one.

If you have a disability and need assistance with the application, you can request a reasonable accommodation. Send an email to Accessibility (accommodation requests only; other inquiries won't receive a response).

Regular or Temporary:

Language Fluency: English (Required)

Work Shift:

Please review the following job description:

Key Responsibilities:

Data Architecture & Strategy

• Design and implement enterprise data architecture leveraging Databricks Lakehouse, Delta Lake, and Azure cloud-native services
• Define data integration, modeling, and governance frameworks tailored for insurance data domains such as agency, carrier, policy, claims, Invoicing & billing, and reinsurance.
• Create scalable and secure data pipelines that handle structured and unstructured data from internal and external sources.
• Author and maintain technological roadmap with mappings to business capabilities
• Experiment and establish adoption blueprint for emerging capabilities within Databrick and in data technology
• Secure the data with appropriate NIST cyber controls

Data Engineering & Analytics Enablement

• Lead the design of ETL/ELT pipelines using PySpark, SQL, Delta Live Tables, Lakeflow connect, Autoloader, Lake flow declarative pipelines, DBT, and Databricks Workflows.
• Partner with actuarial, underwriting, and BI teams to design semantic layers and analytics-ready datasets.
• Optimize performance and cost of Databricks clusters and workflows.
• Enable machine learning and predictive analytics by providing clean, governed, and feature-rich data sets.

Governance & Quality

• Review solution developed by the divisional teams and vendors to ensure the solution uses modern technology, built to scale, has resilience, and is cost effective to operate.
• Implement data quality, lineage, and metadata management frameworks using tools like Unity Catalog, Collibra, or Alation.
• Establish and enforce data security and compliance policies aligned with insurance regulations (e.g., NAIC, Privacy, HIPAA, GDPR, CFIUS).
• Ensure consistency of master data across operational and analytical systems.

Collaboration & Leadership

• Collaborate with business leaders, data engineers, divisional data teams, data visualization experts, and platform head to align architecture with organizational goals.
• Mentor teams on best practices for data modeling, Databricks optimization, and cloud data architecture.
• Evaluate new technologies to continuously improve data strategy and capabilities.

Required Qualifications:

• Bachelor's or master's degree in computer science, Data Engineering, Information Systems, or related field.
• 7+ years of experience in data architecture or data engineering, with at least 4 years in Databricks.
• Strong experience with insurance data models, including policy, claims, premium, fees, agency, underwriting, accounting, and insured domains.
• Expertise in cloud platforms (AWS, Azure, or GCP) and modern data lakehouse architecture.
• Proficiency in SQL, PySpark, Delta Lake, and Databricks SQL.
• Experience integrating with BI tools (Power BI, Tableau, Looker) and data governance tools.
• Excellent communication and stakeholder management skills.

Preferred Skills:

• Experience with streaming data frameworks (Kafka, Delta Live Tables).
• Familiarity with AI/ML pipelines in Databricks.
• Certification(s):
  • Databricks Certified Data Engineer Professional
  • Azure/AWS Certified Data Architect
  • Insurance Data Management Association (IDMA) certifications

General Description of Available Benefits for Eligible Employees of CRC Group: At CRC Group, we're committed to supporting every aspect of teammates' well-being - physical, emotional, financial, social, and professional. Our best-in-class benefits program is designed to care for the whole you, offering a wide range of coverage and support. Eligible full-time teammates enjoy access to medical, dental, vision, life, disability, and AD&D insurance; tax-advantaged savings accounts; and a 401(k) plan with company match. CRC Group also offers generous paid time off programs, including company holidays, vacation and sick days, new parent leave, and more. Eligible positions may also qualify for restricted stock unitsand/or a deferred compensation plan.

CRC Group supports a diverse workforce and is an Equal Opportunity Employer that does not discriminate against individuals on the basis of race, gender, color, religion, citizenship or national origin, age, sexual orientation, gender identity, disability, veteran status or other classification protected by law. CRC Group is a Drug Free Workplace.

EEO is the LawPay Transparency Nondiscrimination Provision E-Verify