1

Llm Backend Engineer Jobs in Kentucky (NOW HIRING)

... backend service design Preferred * Understanding of DevOps principles and experience with tools such as GitHub Actions * Experience working with large language model (LLM) APIs or generative AI ...

Senior AI Engineer

Louisville, KY

$100K - $137K/yr

... APIs, backend services, and data pipelines. * Build and optimize LLM-based workflows for ... Strong programming skills in Python and/or TypeScript/JavaScript. * Experience debugging ...

Senior AI Engineer

Louisville, KY · On-site

$100K - $137K/yr

... APIs, backend services, and data pipelines. * Build and optimize LLM-based workflows for ... Strong programming skills in Python and/or TypeScript/JavaScript. * Experience debugging ...

Senior AI Engineer

Louisville, KY · On-site

$100K - $137K/yr

... APIs, backend services, and data pipelines. * Build and optimize LLM-based workflows for ... Strong programming skills in Python and/or TypeScript/JavaScript. * Experience debugging ...

Translate AI capabilities-LLM-generated content, structured summaries, clinical recommendations ... Exposure to Python or backend service development * Experience in a greenfield or early-stage ...

Translate AI capabilities-LLM-generated content, structured summaries, clinical recommendations ... Exposure to Python or backend service development * Experience in a greenfield or early-stage ...

Translate AI capabilities-LLM-generated content, structured summaries, clinical recommendations ... Exposure to Python or backend service development * Experience in a greenfield or early-stage ...

Senior AI Engineer

Louisville, KY · On-site

$100K - $137K/yr

Develop, test, and maintain backend services supporting AI agent execution, orchestration, and tool ... Exposure to AI/ML platforms, LLM-based systems, or agent frameworks * Experience building or ...

next page

Showing results 1-20

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Kentucky?

For Llm Backend Engineer jobs in Kentucky, the most frequently searched job titles are:

What cities in Kentucky are hiring for Llm Backend Engineer jobs?

Cities in Kentucky with the most Llm Backend Engineer job openings:

Infographic showing various Llm Backend Engineer job openings in Kentucky as of August 2026, with employment types broken down into 87% Full Time, 6% Part Time, 6% Contract, and 1% Nights. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution.

Lead Full-Stack Engineer - Backend Focus

Humana

Louisville, KY

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 5 days ago


Humana rating

8.0

Company rating: 8.0 out of 10

Based on 267 frontline employees who took The Breakroom Quiz

171st of 315 rated insurance


Job description

Become a part of our caring community
The Lead Software Engineer codes software applications based on business requirements. The Lead Software Engineer works on problems of diverse scope and complexity ranging from moderate to substantial.

As Centerwell builds its AI engineering function from the ground up, we need a platform foundation strong enough to support everything that comes next. As Lead Full-Stack Engineer focused on platform and API engineering, you will design and build the service layer that connects AI capabilities, data systems, and product frontends-setting the standards for how services are built, secured, and operated across the team.

You will work with meaningful architectural scope, making decisions that span API design, security patterns, and deployment practices. The platform you build will serve care teams and patients across hundreds of Centerwell clinics. If you want to build platforms that others build on-and do it in service of better primary care-this is the role for you.

Key Responsibilities

  • Platform and API Architecture:** Design and lead development of core backend services, REST and GraphQL APIs, and service-to-service integrations that connect all layers of Centerwell's AI product stack.

  • Security and Compliance by Design:** Establish patterns for authentication, authorization, rate limiting, PHI access control, and audit logging. Ensure HIPAA compliance is embedded in platform design from day one-not bolted on after the fact.

  • AI and LLM Integration Patterns:** Define and implement reusable patterns for integrating AI capabilities into product APIs, including LLM routing, streaming responses, tool orchestration, and model output handling.

  • Observability and Reliability:** Build logging, monitoring, and alerting infrastructure so the platform is operable and debuggable at scale.

  • Full-Stack Feature Delivery:** Contribute to product feature development end-to-end using TypeScript and Next.js, from server-side APIs to rendered UI.

  • Architecture Reviews and Standards:** Drive architecture reviews and define backend engineering standards that the full engineering team builds on.


Use your skills to make an impact

Required Qualifications

  • B.S. or M.S. in Computer Science, Engineering, or a related field (or equivalent experience)

  • 8+ years of software engineering experience with deep expertise in backend and platform engineering

  • Strong proficiency in TypeScript and/or Python for API and service development

  • Proven track record building scalable, production-grade REST or GraphQL APIs

  • Solid understanding of authentication (OAuth2, OIDC), API security patterns, and authorization model design

  • Working knowledge of HIPAA requirements, particularly secure transmission, storage, and access control for PHI

  • Experience with Next.js and React sufficient for full-stack feature contribution

  • Demonstrated ownership of complex backend systems end-to-end, from architecture through production operation

  • Hands-on experience with AI-assisted development tools and LLM coding harnesses (Claude Code, Pi Agent, Cursor, Codex, or similar)

Preferred Qualifications

  • Experience in healthcare, financial services, or other highly regulated industries

  • Exposure to event-driven architecture, microservices, or API gateway patterns at scale

  • Familiarity with AI/LLM integration patterns, including streaming APIs and tool-use orchestration

  • Experience in a greenfield or team-founding engineering environment

Additional Information

The candidate must live close to one of our designated IT locations: NYC, NY; Louisville, KY; Tampa, FL; Fort Lauderdale, FL; Dallas/Frisco, TX; Boston, MA; Washington, D.C: Atlanta, GA, Nashville, TN, Chicago, IL, or Charlotte, NC.

Scheduled Weekly Hours

40

Pay Range

The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc.


$129,300 - $177,800 per year


This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance.

Description of Benefits

Humana, Inc. and its affiliated subsidiaries (collectively, "Humana") offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities.
About Us
About Humana: Humana Inc. (NYSE: HUM) is a leading U.S. healthcare company. Through our Humana insurance services and our CenterWell healthcare services, we make it easier for the millions of people we serve to achieve their best health - delivering the care and service they need, when they need it. These efforts are leading to a better quality of life for people with Medicare and Medicaid, families, individuals, military service personnel, and communities at large. Learn more about what we offer atHumana.comand atCenterWell.com.


Equal Opportunity Employer

It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment.


What Humana employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Humana logo

About Humana

Sourced by ZipRecruiter

Humana Inc., headquartered in Louisville, KY., is a leading health care company that offers a wide range of insurance products and health and wellness services that incorporate an integrated approach to lifelong well-being. By leveraging the strengths of its core businesses, Humana believes it can better explore opportunities for existing and emerging adjacencies in health care that can further enhance wellness opportunities for the millions of people across the nation with whom the company has relationships.

Industry

Health care and social assistance

Company size

10,000+ Employees

Headquarters location

Louisville, KY, US

Year founded

1961

Social media