Job Summary:
Eli Lilly and Company is a global healthcare leader headquartered in Indianapolis, Indiana, dedicated to improving the lives of people around the world. They are seeking a Senior Staff Software Engineer to lead the technical direction and delivery of ChatNow's core platform, focusing on the conversation routing engine and integration of AI capabilities.
Responsibilities:
• You'll define the architecture and drive implementation of ChatNow's conversation routing engine — the system that takes a user's intent and connects it to the right AI agent, model, or workflow.
• You'll own the agent integration layer, designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex.
• You'll build streaming chat interfaces in React and TypeScript, backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers.
• You'll own features end to end. Design, build, test, deploy, monitor. No hand-offs.
• You'll operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform — instrumented with LGTM observability so you can see exactly how routing, latency, and agent performance behave in production.
• You'll integrate LLM capabilities through Cortex's model gateway, supporting multi-model routing with fallback and load balancing.
• You'll implement MCP integrations that connect agents to enterprise data sources and tools.
• And you'll use agentic coding tools like Claude Code and GitHub Copilot as a daily force multiplier — not a novelty.
• This is AI-native engineering at staff level. You'll shape how agents are registered, discovered, and invoked on Cortex — defining the framework that the rest of the organization builds on.
• You'll make technical decisions that ripple across teams, mentor engineers, and raise the standard for what production AI software looks like at Lilly.
Qualifications:
Required:
• 10+ years of professional software engineering experience, with demonstrated technical leadership at scale
• 5+ years in TypeScript/JavaScript, Python and Go (with ability to use AI coding tools proficiently), architecting and building production web applications with React or equivalent
• 5+ years experience designing RESTful or GraphQL APIs at scale
• Deep hands-on experience with Kubernetes — not just deploying, but operating, debugging, and tuning
• Strong CI/CD and GitOps practices
• Bachelor's degree in Computer Science, Software Engineering, or a related field
Preferred:
• Experience integrating LLM APIs into production — streaming, function calling, tool use
• Hands-on work with conversational AI systems: routing, intent classification, context management, or multi-agent orchestration
• Experience with real-time systems: WebSockets, SSE, event-driven architectures, or workflow orchestration
• Familiarity with MCP, A2A, or emerging AI interoperability protocols
• Active use of agentic coding tools in your daily workflow
• A track record of shipping user-facing products with high reliability and polish
• Experience setting technical direction across multiple teams or workstreams
Company:
We're a medicine company turning science into healing to make life better for people around the world. Founded in 1876, the company is headquartered in Indianapolis, USA, with a team of 10001+ employees. The company is currently Late Stage.