ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Indiana (NOW HIRING)

Bioscope AI

Backend Engineer (Integrations)

Carmel, IN · On-site

Backend Engineer (Integrations) Bioscope.AI | Carmel, IN (Hybrid) | Full-Time About Bioscope.AI ... Experience working with LLM APIs and modern AI development tooling. * Direct experience integrating ...

New

Cisco

Software Engineer, Backend

Indianapolis, IN

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

The AES Group

Microsoft Fabric Data Engineer

Indianapolis, IN · On-site

$109K - $131K/yr

Develop partner data ingestion workflows leveraging OCR, LLM-based extraction, confidence scoring ... backend engineering experience delivering production-grade data pipelines, integrations, and ...

Relativity

Software Engineer

Indianapolis, IN · On-site

... backend service design Preferred * Understanding of DevOps principles and experience with tools such as GitHub Actions * Experience working with large language model (LLM) APIs or generative AI ...

Cisco

Senior Software Engineer, Backend

Indianapolis, IN · On-site +1

$165K - $241K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

ASCENSUS

Senior Software Engineer

Indianapolis, IN · On-site

$117K - $154K/yr

... backend services, workflow logic, or similar software components. * Familiarity with LLM-powered ... Prompt engineering * AI-enabled application development * Strong software engineering fundamentals ...

Salesforce, Inc.

AI GTM Developer

Indianapolis, IN

$53 - $70.25/hr

Comfortable working across frontend, backend, APIs, databases, and cloud services. * Hands-on ... Familiarity with LLM APIs and AI application development. * Experience deploying and maintaining ...

next page

Showing results 1-20

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Indiana

Llm Backend Engineer information

How much do LLM engineers make?

LLM backend engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in machine learning frameworks and large language models can command higher salaries, often exceeding $200,000.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

Are LLM engineers in demand?

LLM backend engineers are in high demand due to the rapid growth of artificial intelligence and natural language processing applications. Companies seek professionals skilled in machine learning frameworks, programming languages like Python, and large language model deployment to develop and optimize AI systems. This demand is expected to continue as AI technology becomes more integrated into various industries.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What engineer makes 500,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, or machine learning engineering can earn $500,000 or more annually, especially with extensive experience, advanced skills, and working at large tech companies or in high-demand industries. These roles often require expertise in cloud platforms, programming, and system architecture, along with leadership responsibilities or stock options that contribute to total compensation.

What engineers make $300,000 a year?

Senior machine learning engineers, especially those working with large language models (LLMs) and possessing expertise in deep learning, distributed systems, and cloud infrastructure, can earn $300,000 or more annually. High compensation is often associated with experience, specialized skills, and working at top tech companies or in high-demand industries.
What are popular job titles related to Llm Backend Engineer jobs in Indiana? For Llm Backend Engineer jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Llm Backend Engineer jobs in Indiana look for? The top searched job categories for Llm Backend Engineer jobs in Indiana are:
What cities in Indiana are hiring for Llm Backend Engineer jobs? Cities in Indiana with the most Llm Backend Engineer job openings:
Llm Backend Engineer jobs near you

Backend Engineer (Integrations)

Bioscope AI

Carmel, IN • On-site

Full-time

Medical, Dental, Vision

Posted 3 days ago

New

Job description

Backend Engineer (Integrations)
Bioscope.AI | Carmel, IN (Hybrid) | Full-Time
About Bioscope.AI
Bioscope.AI is an early-stage precision medicine company redefining how concierge, functional, and longevity practices deliver care. By integrating whole-genome sequencing, multi-omic data, and AI-driven clinical intelligence, our platform gives practitioners unprecedented insight into patient health before disease strikes. We're building the infrastructure for the future of precision health, and we need founding builders ready to shape it.
The Opportunity
This is a role for a builder who wants to own the connective tissue of our platform. As part of the integrations team, you will be responsible for wiring Bioscope into the sprawling ecosystem of systems that concierge and functional medicine practices rely on: electronic health records, diagnostic labs, and third-party clinical data sources. This is the plumbing that makes precision medicine actually work at the point of care.
Integrations are hard. The systems are messy, the standards are inconsistently implemented, and the documentation is often wrong. You will spend your days reverse-engineering APIs, untangling authentication flows, and building resilient pipelines that move sensitive clinical data reliably and securely. When a partner changes their API without warning and something breaks, you're the kind of person who wants to understand exactly why and fix it properly.
This work sits close to the foundation of everything we build. Every integration you ship directly expands what our platform can do and how many practices we can serve.
What You'll Do
  • Own Integrations End-to-End: You will design, build, and maintain integrations with EHR systems, lab partners, and other third-party clinical data sources. From first API call to production monitoring, these are yours.
  • Wrangle Messy Systems: You will reverse-engineer poorly documented APIs, navigate inconsistent standards, and build robust pipelines that handle real-world edge cases gracefully. You treat other people's broken systems as a puzzle to solve, not a reason to give up.
  • Build for Reliability and Security: You will move sensitive clinical data, so you will build with security, auditability, and resilience as first-class concerns. You sweat the details because patients and practitioners depend on them.
  • Be Accountable: You will own your work from commit to production. When something breaks, you dig in and fix it. You follow through, you communicate clearly, and you do what you say you'll do.
  • Collaborate Across the Stack: You will work closely with the integrations lead and the broader engineering team to make sure your work fits cleanly into the larger platform.

What We Look For
  • The Right Attitude: This is the most important thing. You are willing to take on hard, detailed work and see it through. You are relentlessly accountable, you take ownership of problems, and you don't need to be chased. You have a "get it done" mentality and the grit to push through the frustrating parts.
  • Self-Directed Execution: You thrive in ambiguity and a fast-paced environment where priorities can shift. Give you a hard problem and a direction, and you will figure out the rest.
  • Strong Engineering Fundamentals: You write clean, maintainable backend code and you understand how to build systems that are reliable, secure, and debuggable.
  • Clear Communication: You can explain technical tradeoffs clearly and keep collaborators informed, especially when things get complicated.

Nice to Haves
  • Backend-oriented experience with Python, FastAPI, and AWS.
  • Experience working with LLM APIs and modern AI development tooling.
  • Direct experience integrating with EHRs (e.g., Elation, Athenahealth, Cerbo, Practice Better) or diagnostic labs.
  • Familiarity with healthcare data standards like FHIR and HL7.
  • Understanding of medical coding and clinical terminology (e.g., LOINC, ICD, SNOMED) is a big plus.
  • A background or strong interest in healthtech, genomics, or precision medicine.

What We Offer
  • Competitive base salary commensurate with experience.
  • Meaningful early-stage equity; you are a true owner.
  • Direct, unfiltered access to leadership and a front-row seat to company building.
  • Health, dental, and vision benefits.
  • A highly flexible, non-traditional work environment with incredible autonomy.

Apply