ZipRecruiter

Log In

1

Senior Llm Developer Jobs in Indiana (NOW HIRING)

MARGO

senior c#

Warsaw, IN · On-site

$46 - $60.75/hr

Senior C# Developer Responsibilities * Design, develop, and evolve high‑performance C#/.NET ... LLM's in the software development process with practical experience of agentic AI engineering in an ...

salesforce.com, inc.

Sr. Agentic Developer

Indianapolis, IN · On-site

$120K - $146K/yr

In this role, you will work at the intersection of LLM orchestration, tool-use frameworks, and ... Agentic Systems Engineering: Design, build, and deploy multi-step, tool-using AI agents (planning ...

Salesforce, Inc.

Sr. Agentic Developer

Indianapolis, IN · On-site

$120K - $146K/yr

In this role, you will work at the intersection of LLM orchestration, tool-use frameworks, and ... Agentic Systems Engineering: Design, build, and deploy multi-step, tool-using AI agents (planning ...

Liberty Mutual

Senior Software Engineer

Indianapolis, IN · Hybrid

$117K - $154K/yr

As a senior software engineer at Liberty Mutual, you'll apply your talents in an agile environment ... Exposure to LLM/GenAI application patterns - prompt engineering, retrieval, evaluation and quality ...

Ksmcpa

Senior Software Engineer

Indianapolis, IN · On-site

$117K - $154K/yr

We're looking for a Senior Software Engineer to focus on building the core of our applications ... Demonstrated experience shipping LLM-powered applications to production(retrieval pipelines ...

New

BSA Lifestructures Inc

Senior Mechanical Engineer

Carmel, IN · On-site

$99K - $130K/yr

We are searching for a Senior Mechanical Engineer to join our Indianapolis studio! What You'll Do ... Large Language Models (LLM's), familiarity with Deltek Vantagepoint preferred; Architecture CAD, ...

Liberty Mutual

Senior Software Engineer

Indianapolis, IN · On-site

$117K - $154K/yr

... or Azure DevOps * AWS: CDK, Glue, Lambdas, S3, Step Functions, DynamoDB, ECS, Fargate, SQS, API Gateway, AgentCore * Observability: DataDog, MLflow 3 * GenAI: Experience with LLM orchestration ...

Liberty Mutual

Senior Software Engineer

Indianapolis, IN · On-site

$117K - $154K/yr

... or Azure DevOps * AWS: CDK, Glue, Lambdas, S3, Step Functions, DynamoDB, ECS, Fargate, SQS, API Gateway, AgentCore * Observability: DataDog, MLflow 3 * GenAI: Experience with LLM orchestration ...

next page

Showing results 1-20

All JobsLlm Developer JobsSenior Llm Developer JobsSenior Llm Developer Jobs in Indiana

Senior Llm Developer information

What is a senior LLM developer?

Senior LLM Developers are experienced software engineers who specialize in building, fine-tuning, and deploying large language models (LLMs) such as GPT, BERT, or similar AI models. They work on advanced natural language processing (NLP) tasks, optimize model performance, and often lead teams in developing AI-driven applications. Their responsibilities include data pipeline development, model training, performance evaluation, and integrating LLMs into products. They are proficient in programming languages like Python, familiar with machine learning frameworks, and stay updated with the latest research in AI and NLP.

What are the key skills and qualifications needed to thrive as a senior LLM developer?

To thrive as a Senior LLM Developer, you need deep expertise in natural language processing, machine learning, and advanced programming skills, typically supported by a relevant degree and experience with large language models. Proficiency with frameworks like PyTorch or TensorFlow, cloud platforms (AWS, GCP, Azure), and version control systems, as well as familiarity with model fine-tuning and deployment, are essential. Strong problem-solving, communication, and collaboration skills help in leading teams and translating complex requirements into innovative solutions. These skills are crucial for building, optimizing, and maintaining robust language models that meet organizational objectives and stay ahead in a rapidly evolving field.

What are some common challenges senior LLM developers face when deploying large language models in production environments?

Senior LLM Developers often encounter challenges such as optimizing model performance for latency and scalability while maintaining accuracy. Managing resource-intensive inference and ensuring robust monitoring to detect issues like model drift or biased outputs are also key concerns. Additionally, integrating LLMs with existing systems and coordinating with cross-functional teams, such as MLOps engineers and product managers, is essential for successful deployment. Staying updated with rapidly evolving frameworks and compliance requirements adds to the complexity of the role.

What is the difference between Senior Llm Developer vs Machine Learning Engineer?

AspectSenior Llm DeveloperMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or related fields; experience with ML frameworks
Work EnvironmentResearch labs, AI startups, tech companies focusing on NLPTech companies, startups, industries applying ML solutions
Industry UsagePrimarily in NLP, AI research, and language model developmentBroader across AI applications, including vision, speech, and data analysis

While both roles require strong AI and ML knowledge, Senior Llm Developers specialize in language models and NLP, whereas Machine Learning Engineers work across various AI domains. The roles often overlap but differ in focus and application areas.

What are popular job titles related to Senior Llm Developer jobs in Indiana?

For Senior Llm Developer jobs in Indiana, the most frequently searched job titles are:

What job categories do people searching Senior Llm Developer jobs in Indiana look for?

The top searched job categories for Senior Llm Developer jobs in Indiana are:

What cities in Indiana are hiring for Senior Llm Developer jobs?

Cities in Indiana with the most Senior Llm Developer job openings:

Senior Llm Developer jobs near you
Infographic showing various Senior Llm Developer job openings in Indiana as of August 2026, with employment types broken down into 78% Full Time, 7% Part Time, and 15% Contract. Highlights an 79% Physical, 7% Hybrid, and 14% Remote job distribution.

Principal Coding Annotator / LLM Evaluation Engineer

Alexandria, IN • On-site, Remote

Braintrust
See more jobs at Braintrustexternal

$75 - $90/hr

Full-time

Posted 10 days ago

Job description

Company
Braintrust is a global talent network that connects top independent professionals with leading companies for high-quality, flexible work. We help organizations hire skilled talent faster while giving professionals access to vetted opportunities with innovative teams. Job description

This is a contracting engagement - initially 6 months - with potential for long term engagement.

Location: Paris or London-based preferred; alternatively Europe remote for strong candidates


We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation team. This role sits at the intersection of real-world software engineering, model evaluation, and applied AI, and is critical to improving model reliability, reasoning, and code quality.

You will design challenging coding tasks, evaluate model outputs against rigorous benchmarks, identify failure modes, and contribute to reinforcement learning and model improvement workflows.

This is not a junior annotation role. We are looking for practitioners with deep hands-on coding experience who can think like both an engineer and an evaluator.

What You’ll Do
  • Evaluate coding tasks involving software vulnerabilities, exploit verification, and security patches.
  • Create high-quality coding prompts and reference answers (benchmark-style, e.g. SWE-Bench-like problems).
  • Evaluate LLM outputs for code generation, refactoring, debugging, and implementation tasks.
  • Identify and document model failures, edge cases, and reasoning gaps.
  • Perform head-to-head evaluations between private LLMs (Mistral-based) and leading external models.
  • Build or configure coding environments to support evaluation and reinforcement learning (RL).
  • Follow detailed annotation and evaluation guidelines with high consistency.
What We’re Looking For
  • 5+ years of professional software development experience.
  • Strong Python skills (required).
  • Knowledge of at least one additional programming language (bonus).
  • Experience with professional code review, coding annotation, LLM/code evaluation, or benchmark design is a plus, but not required.
  • Hands-on experience with vulnerability research, exploit reproduction or verification, or implementing, backporting, or validating security patches.
  • Proven ability to apply structured evaluation criteria and write clear technical feedback.
  • Fluent in English (written and spoken).
  • Team lead or mentoring experience is a strong plus.
Why This Role
  • Work hands-on with cutting-edge LLMs.
  • Apply real-world engineering judgment to model evaluation and improvement.
  • High-impact, technical work with a focused, senior team.

Apply