ZipRecruiter

Log In

1

Senior Llm Developer Jobs (NOW HIRING)

Gap International

AI/LLM Engineer

Philadelphia, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

TMS

AI/ LLM Engineer- Next.js

Princeton, NJ · On-site

Role: Senior Full Stack Engineer - AI & Next.js Duration: Long Term Location: United States- Remote Role Summary We are looking for a Senior Full Stack Engineer with strong experience in AI/LLM ...

Gap International

AI/LLM Engineer

Springfield, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

previous pagenext page

Showing results 21-40

All JobsLlm Developer JobsSenior Llm Developer Jobs

Senior Llm Developer information

See salary details

$25K

$80.3K

$163.5K

How much do senior llm developer jobs pay per year?

As of Aug 12, 2026, the average yearly pay for senior llm developer in the United States is $80,287.00, according to ZipRecruiter salary data. Most workers in this role earn between $41,500.00 and $103,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a senior LLM developer?

To thrive as a Senior LLM Developer, you need deep expertise in natural language processing, machine learning, and advanced programming skills, typically supported by a relevant degree and experience with large language models. Proficiency with frameworks like PyTorch or TensorFlow, cloud platforms (AWS, GCP, Azure), and version control systems, as well as familiarity with model fine-tuning and deployment, are essential. Strong problem-solving, communication, and collaboration skills help in leading teams and translating complex requirements into innovative solutions. These skills are crucial for building, optimizing, and maintaining robust language models that meet organizational objectives and stay ahead in a rapidly evolving field.

What is the difference between Senior Llm Developer vs Machine Learning Engineer?

AspectSenior Llm DeveloperMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or related fields; experience with ML frameworks
Work EnvironmentResearch labs, AI startups, tech companies focusing on NLPTech companies, startups, industries applying ML solutions
Industry UsagePrimarily in NLP, AI research, and language model developmentBroader across AI applications, including vision, speech, and data analysis

While both roles require strong AI and ML knowledge, Senior Llm Developers specialize in language models and NLP, whereas Machine Learning Engineers work across various AI domains. The roles often overlap but differ in focus and application areas.

What are some common challenges senior LLM developers face when deploying large language models in production environments?

Senior LLM Developers often encounter challenges such as optimizing model performance for latency and scalability while maintaining accuracy. Managing resource-intensive inference and ensuring robust monitoring to detect issues like model drift or biased outputs are also key concerns. Additionally, integrating LLMs with existing systems and coordinating with cross-functional teams, such as MLOps engineers and product managers, is essential for successful deployment. Staying updated with rapidly evolving frameworks and compliance requirements adds to the complexity of the role.

What is a senior LLM developer?

Senior LLM Developers are experienced software engineers who specialize in building, fine-tuning, and deploying large language models (LLMs) such as GPT, BERT, or similar AI models. They work on advanced natural language processing (NLP) tasks, optimize model performance, and often lead teams in developing AI-driven applications. Their responsibilities include data pipeline development, model training, performance evaluation, and integrating LLMs into products. They are proficient in programming languages like Python, familiar with machine learning frameworks, and stay updated with the latest research in AI and NLP.
More about Senior Llm Developer jobs
What cities are hiring for Senior Llm Developer jobs? Cities with the most Senior Llm Developer job openings:
What are the most commonly searched types of Llm Developer jobs? The most popular types of Llm Developer jobs are:
What states have the most Senior Llm Developer jobs? States with the most job openings for Senior Llm Developer jobs include:
What job categories do people searching Senior Llm Developer jobs look for? The top searched job categories for Senior Llm Developer jobs are:
Senior Llm Developer jobs near you
Infographic showing various Senior Llm Developer job openings in the United States as of August 2026, with employment types broken down into 80% Full Time, 3% Part Time, and 17% Contract. Highlights an 80% Physical, 6% Hybrid, and 14% Remote job distribution, with an average salary of $80,287 per year, or $38.6 per hour.

Senior Software Engineer, AI Agent & LLM

Otter.ai

Mountain View, CA • On-site, Remote

$185K - $230K/yr

Full-time

Posted 20 days ago

Job description

The Opportunity

We are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter's conversational knowledge engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale.

This is a hands-on role for someone who can move from an ambiguous product problem to a working production solution, define how quality should be measured, and drive improvements across services, models, and user experience.

Your Impact
  • Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks.
  • Advance Otter's conversational knowledge engine through better knowledge extraction, annotation, and indexing.
  • Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality.
  • Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
  • Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
  • Improve task completion, correctness, groundedness, reliability, latency, and cost.
  • Turn production traces, customer feedback, and usage signals into measurable product and model improvements.
  • Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities.
We're looking for someone who
  • Has 5+ years of AI Agent engineering, machine learning engineering, or related experience.
  • Brings strong backend or distributed-systems engineering skills.
  • Has hands-on experience building and shipping AI-agent or LLM-powered products.
  • Has a strong focus on AI quality and experience evaluating nondeterministic systems.
  • Can use data, traces, logs, and qualitative examples to identify and resolve complex failures.
  • Works effectively across services, technical domains, and organizational boundaries.
  • Combines strong product judgment with rigorous engineering and evaluation practices.
  • Operates with high agency, strong ownership, and a bias toward action.
  • Can take ambiguous problems from initial exploration through production launch and continuous improvement.
  • Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus.
About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace.  We provide reasonable accommodations for qualified applicants throughout the hiring process. 

Accessibility & Accommodations 

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process.  If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $185,000 to $230,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.
#LI-Hybrid

Apply