Senior Data Pipeline Engineer Jobs in Indiana (NOW HIRING)

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work-but it's work worth doing. If you're driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.

Integrated Risk Management Program Overview

Lilly's Integrated Risk Management (IRM) program is a strategic enterprise initiative that transforms traditional risk management into a competitive advantage by uniting cross-functional expertise with cutting-edge analytics and technology. IRM enables faster, better informed decision-making that protects what matters most: our operations, reputation, and ability to deliver life-saving medicines to patients. This integrated approach creates a coordinated and proactive system that helps Lilly stay resilient and agile as we continue reaching more patients than ever before.

Position Description

The Integrated Risk Data Engineer serves as the technical expert who owns the data foundation powering risk intelligence across the enterprise. This role independently leads data architecture and engineering initiatives from conception through delivery, integrating fragmented systems, designing unified data pipelines, and ensuring risk leaders have access to complete, accurate, and timely risk data. Working within the centralized IRM Analytics team, you will define and implement the Microsoft Fabric architecture and data governance framework that connects disparate risk platforms, including ServiceNow GRC, assurance systems, enterprise applications, and business-specific tools, into cohesive data ecosystems that enable comprehensive risk visibility.

This role requires depth and breadth of expertise in data engineering, with recognized proficiency that positions you as a key technical resource within the IRM function. You will own the design and maintenance of robust data infrastructure using Microsoft Fabric's medallion architecture, lead data pipeline and transformation initiatives, and establish data governance standards that ensure data quality, security, and accessibility across all IRM functions. Balancing hands-on delivery with standards definition and technical leadership, you will transform how risk data flows through the organization-breaking down historical silos and creating analytics and AI-ready datasets that enable advanced analytics, real-time monitoring, and predictive risk intelligence.

Primary Position Responsibilities

Data Architecture & Infrastructure Leadership

• Own the Microsoft Fabric architecture for IRM, defining standards, design patterns, and best practices that ensure scalable, maintainable, and high-performing data infrastructure across the risk ecosystem

• Design, build, and maintain enterprise risk data pipelines using Microsoft Fabric with medallion architecture (bronze, silver, gold layers) that integrate data from multiple risk domains and enterprise systems

• Architect and implement data engineering workflows using Fabric Data Factory, Synapse Data Engineering (Spark notebooks), and Dataflows Gen2 to consolidate fragmented risk data from ServiceNow GRC, SAP, Workday, SuccessFactors, assurance platforms, and other enterprise and function-specific systems

• Design unified data models and Power BI semantic models that enable cross-functional risk analytics, ensuring data consistency, accuracy, and accessibility across all risk functions

• Establish and own the data governance framework for IRM, including data quality standards, validation rules, monitoring processes, security protocols, and access controls that protect sensitive risk information while enabling appropriate data sharing
  

Solution Delivery & Technical Excellence

• Serve as a key technical resource partnering with Analytics Developers, Architects, and Data Scientists to understand data requirements and deliver datasets that power dashboards, reports, predictive models, and risk assessments

• Architect and build scalable, automated data solutions using Fabric pipelines and dataflows that reduce manual data preparation efforts and enable real-time or near-real-time risk monitoring capabilities

• Optimize data pipeline performance using Fabric's compute resources and data storage options (Lakehouse, Data Warehouse) to ensure stakeholders receive timely, accurate risk intelligence when decisions need to be made

• Design and implement data observability and monitoring solutions that proactively identify and resolve data quality issues before they impact business decisions

• Lead migration and integration initiatives as new risk technologies and platforms are adopted across the enterprise, independently owning project planning, solution architecture, and delivery
  

Operational Excellence & Standards Definition

• Independently respond to complex data requests from risk functions, producing clean, well-documented datasets in Fabric Lakehouses and Data Warehouses that support risk assessments, audits, investigations, and strategic initiatives

• Anticipate and resolve complex data quality issues, working with source system owners and business partners to implement sustainable fixes that prevent recurrence

• Define and maintain comprehensive documentation standards for data lineage, transformation logic, data dictionaries, and technical architecture that enable knowledge sharing and maintain institutional knowledge

• Build strategic relationships with Tech@Lilly (IT), risk platform administrators, and business data owners to identify and resolve data integration challenges that impact the broader IRM function
  

Strategic Partnership & Influence

• Build and maintain strategic relationships with risk data owners, assurance function partners, and enterprise data teams to identify internal customer requirements and opportunities to improve data availability, quality, and integration

• Lead standardization of data definitions, taxonomies, and integration patterns across risk functions, influencing technical decisions that enable more effective cross-functional analytics

• Lead the upskilling of IRM team members and business partners in data engineering concepts, serving as a subject matter expert and contributing to data literacy across the organization

• Stay current on emerging data engineering technologies, practices, and tools, evaluating and applying relevant innovations to enhance Lilly's risk data capabilities
  

Basic Qualifications/Requirements

• Bachelor's Degree in Computer Science, Information Systems, Data Engineering, or related field

• 5+ years of relevant professional experience in data engineering, ETL development, or data integration, with demonstrated progression in responsibility and complexity.

Additional Skills/Preferences

• Expert proficiency with Microsoft Fabric (preferred) or similar cloud data platforms (Azure Data Factory, Synapse Analytics, Databricks), with ability to define architecture standards and best practices

• Advanced SQL and Python/PySpark skills, with hands-on experience building data pipelines in Spark notebook environments (Fabric, Databricks, or similar), using Git-based version control

• Experience integrating LLM/API-based workflows (RAG, embeddings, enterprise LLM gateways), with interest or exposure to agentic tool-calling protocols such as MCP

• Demonstrated experience independently leading data engineering projects from planning through delivery, including architecture design and standards definition

• Demonstrated ability to translate complex business requirements into scalable technical data solutions with sound decision-making within functional guidelines

• Strong understanding of Power BI data modeling, semantic model design, and optimizing datasets for analytical performance

• Hands-on experience with Microsoft Fabric components including Data Factory, Synapse Data Engineering, Data Warehouse, Lakehouse, and Dataflows Gen2

• Experience designing and implementing medallion architecture or similar layered data lake design patterns at enterprise scale

• Experience with ServiceNow platform, ServiceNow GRC, or other governance, risk, and compliance systems

• Proficiency in dimensional modeling, star schema design, and data warehouse concepts

• Experience in pharmaceutical, healthcare, or highly regulated industries with complex data governance requirements

• Background in risk management, audit, compliance, or assurance domain data

• Familiarity with Power Platform integration (Power Automate, Power Apps) with Fabric

• Strong problem-solving skills with ability to anticipate, diagnose, and resolve complex data integration challenges

• Proven ability to collaborate effectively with both technical teams and non-technical business stakeholders, translating technical concepts into business language

• Detail-oriented with commitment to data quality and comprehensive documentation

• Self-directed professional who works independently, takes initiative on complex problems, and proactively identifies opportunities for improvement

• Demonstrated strong motivation, rapid learning agility, and growth mindset
  

Travel

Up to 5-10% travel based on business needs

Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.

Lilly is proud to be an EEO Employer and does not discriminate on the basis of age, race, color, religion, gender identity, sex, gender expression, sexual orientation, genetic information, ancestry, national origin, protected veteran status, disability, or any other legally protected status.

Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia (AMECA), Black Employees at Lilly (BE@Lilly), Chinese Culture Network (CCN), EnAble, Evolve, Lilly Indian Network (LIN), Organization of Latinx at Lilly (OLA), Pride (LGBTQ+ Allies), Veterans Leadership Network (VLN) and Women's Initiative for Leading at Lilly (WILL).

Actual compensation will depend on a candidate's education, experience, skills, and geographic location. The anticipated wage for this position is

Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly's compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.

#WeAreLilly