1

Llm Backend Engineer Jobs in Indiana (NOW HIRING)

Backend Engineer (Integrations) Bioscope.AI | Carmel, IN (Hybrid) | Full-Time About Bioscope.AI ... Experience working with LLM APIs and modern AI development tooling. * Direct experience integrating ...

Backend Engineer (Integrations) Bioscope.AI | Carmel, IN (Hybrid) | Full-Time About Bioscope.AI ... Experience working with LLM APIs and modern AI development tooling. * Direct experience integrating ...

Senior AI Engineer

Warsaw, IN · On-site

$130 - $180/hr

... LLM-powered products beyond proof-of-concept or notebook environments * Experience building backend ... Strong understanding of software engineering fundamentals, including modular design, testing ...

Microsoft Fabric Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

Develop partner data ingestion workflows leveraging OCR, LLM-based extraction, confidence scoring ... backend engineering experience delivering production-grade data pipelines, integrations, and ...

You enjoy working across the entire stack, from designing backend services and APIs to crafting ... Build and integrate Generative AI capabilities using LLM platforms such as OpenAI, Azure OpenAI ...

You enjoy working across the entire stack, from designing backend services and APIs to crafting ... Build and integrate Generative AI capabilities using LLM platforms such as OpenAI, Azure OpenAI ...

next page

Showing results 1-20

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Indiana?

For Llm Backend Engineer jobs in Indiana, the most frequently searched job titles are:

What cities in Indiana are hiring for Llm Backend Engineer jobs?

Cities in Indiana with the most Llm Backend Engineer job openings:

Backend Engineer (Integrations)

Bioscope AI

Carmel, IN • On-site

$120 - $170/hr

Other

Medical, Dental, Vision

Posted 24 days ago


Job description

Backend Engineer (Integrations)

Bioscope.AI | Carmel, IN (Hybrid) | Full-Time

About Bioscope.AI

Bioscope.AI is an early-stage precision medicine company redefining how concierge, functional, and longevity practices deliver care. By integrating whole-genome sequencing, multi-omic data, and AI-driven clinical intelligence, our platform gives practitioners unprecedented insight into patient health before disease strikes. We're building the infrastructure for the future of precision health, and we need founding builders ready to shape it.

The Opportunity

This is a role for a builder who wants to own the connective tissue of our platform. As part of the integrations team, you will be responsible for wiring Bioscope into the sprawling ecosystem of systems that concierge and functional medicine practices rely on: electronic health records, diagnostic labs, and third-party clinical data sources. This is the plumbing that makes precision medicine actually work at the point of care.

Integrations are hard. The systems are messy, the standards are inconsistently implemented, and the documentation is often wrong. You will spend your days reverse-engineering APIs, untangling authentication flows, and building resilient pipelines that move sensitive clinical data reliably and securely. When a partner changes their API without warning and something breaks, you're the kind of person who wants to understand exactly why and fix it properly.

This work sits close to the foundation of everything we build. Every integration you ship directly expands what our platform can do and how many practices we can serve.

What You'll Do
  • Own Integrations End-to-End: You will design, build, and maintain integrations with EHR systems, lab partners, and other third-party clinical data sources. From first API call to production monitoring, these are yours.

  • Wrangle Messy Systems: You will reverse-engineer poorly documented APIs, navigate inconsistent standards, and build robust pipelines that handle real-world edge cases gracefully. You treat other people's broken systems as a puzzle to solve, not a reason to give up.

  • Build for Reliability and Security: You will move sensitive clinical data, so you will build with security, auditability, and resilience as first-class concerns. You sweat the details because patients and practitioners depend on them.

  • Be Accountable: You will own your work from commit to production. When something breaks, you dig in and fix it. You follow through, you communicate clearly and you do what you say you'll do.

  • Collaborate Across the Stack: You will work closely with the integrations lead and the broader engineering team to make sure your work fits cleanly into the larger platform.

What We Look For
  • The Right Attitude: This is the most important thing. You are willing to take on hard, detailed work and see it through. You are relentlessly accountable, you take ownership of problems, and you don't need to be chased. You have a "get it done" mentality and the grit to push through the frustrating parts.

  • Self-Directed Execution: You thrive in ambiguity and a fast-paced environment where priorities can shift. Give you a hard problem and a direction, and you will figure out the rest.

  • Strong Engineering Fundamentals: You write clean, maintainable backend code and you understand how to build systems that are reliable, secure, and debuggable.

  • Clear Communication: You can explain technical tradeoffs clearly and keep collaborators informed, especially when things get complicated.

Nice to Haves
  • Backend-oriented experience with Python, FastAPI, and AWS.

  • Experience working with LLM APIs and modern AI development tooling.

  • Direct experience integrating with EHRs (e.g., Elation, Athenahealth, Cerbo, Practice Better) or diagnostic labs.

  • Familiarity with healthcare data standards like FHIR and HL7.

  • Understanding of medical coding and clinical terminology (e.g., LOINC, ICD, SNOMED) is a big plus.

  • A background or strong interest in healthtech, genomics, or precision medicine.

What We Offer
  • Competitive base salary commensurate with experience.

  • Meaningful early-stage equity; you are a true owner.

  • Direct, unfiltered access to leadership and a front-row seat to company building.

  • Health, dental, and vision benefits.

  • A highly flexible, non-traditional work environment with incredible autonomy.

#J-18808-Ljbffr