ZipRecruiter

Log In

1

Senior Llm Developer Jobs (NOW HIRING)

Simple Solutions

Sr Applied LLM Engineer

San Francisco, CA · On-site

$180K - $200K/yr

Sr. Applied LLM Engineer Qualifications * Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience) * 3+ years of software development ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

next page

Showing results 1-20

All JobsLlm Developer JobsSenior Llm Developer Jobs

Senior Llm Developer information

See salary details

$25K

$80.3K

$163.5K

How much do senior llm developer jobs pay per year?

As of Jun 11, 2026, the average yearly pay for senior llm developer in the United States is $80,287.00, according to ZipRecruiter salary data. Most workers in this role earn between $41,500.00 and $103,000.00 per year, depending on experience, location, and employer.

What is the salary of LLM developer?

The salary of a Senior LLM Developer typically ranges from $120,000 to $180,000 annually, depending on experience, location, and company size. Skilled developers with expertise in machine learning, natural language processing, and deep learning frameworks may earn higher compensation, especially in competitive tech markets.

What engineers make $500,000?

Senior LLM developers and AI engineers with extensive experience, specialized skills in machine learning, deep learning, and natural language processing, and often working in high-demand industries or at leading tech companies can earn $500,000 or more annually. Compensation may include base salary, bonuses, stock options, and other incentives, especially at senior levels or in competitive markets.

What are the key skills and qualifications needed to thrive as a Senior LLM Developer, and why are they important?

To thrive as a Senior LLM Developer, you need deep expertise in natural language processing, machine learning, and advanced programming skills, typically supported by a relevant degree and experience with large language models. Proficiency with frameworks like PyTorch or TensorFlow, cloud platforms (AWS, GCP, Azure), and version control systems, as well as familiarity with model fine-tuning and deployment, are essential. Strong problem-solving, communication, and collaboration skills help in leading teams and translating complex requirements into innovative solutions. These skills are crucial for building, optimizing, and maintaining robust language models that meet organizational objectives and stay ahead in a rapidly evolving field.

What is the difference between Senior Llm Developer vs Machine Learning Engineer?

AspectSenior Llm DeveloperMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or related fields; experience with ML frameworks
Work EnvironmentResearch labs, AI startups, tech companies focusing on NLPTech companies, startups, industries applying ML solutions
Industry UsagePrimarily in NLP, AI research, and language model developmentBroader across AI applications, including vision, speech, and data analysis

While both roles require strong AI and ML knowledge, Senior Llm Developers specialize in language models and NLP, whereas Machine Learning Engineers work across various AI domains. The roles often overlap but differ in focus and application areas.

What is a $900,000 AI job?

A $900,000 AI job typically refers to high-level roles such as Senior Llm Developer or AI research director, which involve developing large language models, advanced machine learning techniques, and require expertise in deep learning frameworks. These positions often demand extensive experience, specialized skills, and may include leadership responsibilities or working in competitive tech environments.

What are some common challenges Senior LLM Developers face when deploying large language models in production environments?

Senior LLM Developers often encounter challenges such as optimizing model performance for latency and scalability while maintaining accuracy. Managing resource-intensive inference and ensuring robust monitoring to detect issues like model drift or biased outputs are also key concerns. Additionally, integrating LLMs with existing systems and coordinating with cross-functional teams, such as MLOps engineers and product managers, is essential for successful deployment. Staying updated with rapidly evolving frameworks and compliance requirements adds to the complexity of the role.

What are Senior LLM Developers?

Senior LLM Developers are experienced software engineers who specialize in building, fine-tuning, and deploying large language models (LLMs) such as GPT, BERT, or similar AI models. They work on advanced natural language processing (NLP) tasks, optimize model performance, and often lead teams in developing AI-driven applications. Their responsibilities include data pipeline development, model training, performance evaluation, and integrating LLMs into products. They are proficient in programming languages like Python, familiar with machine learning frameworks, and stay updated with the latest research in AI and NLP.

Which 3 jobs will survive AI?

For a Senior Llm Developer, roles that require complex problem-solving, creativity, and human judgment are likely to persist, such as AI ethics specialists, AI system auditors, and interdisciplinary researchers. These jobs involve oversight, nuanced understanding, and ethical considerations that AI cannot fully replicate. Skills in critical thinking, domain expertise, and collaboration will remain valuable in the evolving AI landscape.
More about Senior Llm Developer jobs
What cities are hiring for Senior Llm Developer jobs? Cities with the most Senior Llm Developer job openings:
What are the most commonly searched types of Llm Developer jobs? The most popular types of Llm Developer jobs are:
What states have the most Senior Llm Developer jobs? States with the most job openings for Senior Llm Developer jobs include:
What job categories do people searching Senior Llm Developer jobs look for? The top searched job categories for Senior Llm Developer jobs are:
Senior Llm Developer jobs near you
Infographic showing various Senior Llm Developer job openings in the United States as of June 2026, with employment types broken down into 90% Full Time, 8% Part Time, and 2% Contract. Highlights an 77% Physical, 5% Hybrid, and 18% Remote job distribution, with an average salary of $80,287 per year, or $38.6 per hour.
Senior LLM/AI Platform Engineer

Senior LLM/AI Platform Engineer

Peraton

Annapolis Junction, MD • On-site

$112K - $179K/yr

Full-time

Posted 26 days ago

Peraton rating

8.2

Company rating: 8.2 out of 10

Based on 53 frontline employees who took The Breakroom Quiz

46th of 204 rated it services

Job description

Responsibilities
Peraton Labs is seeking a senior engineer to serve as the technical lead for the multi-agent generative AI orchestration layer that powers an advanced analytical platform. This role owns the architecture governing how multiple LLM-based worker agents are spawned, routed, coordinated, and managed across diverse analytical tasks. The Senior LLM/AI Platform Engineer ensures that the platform's generative AI backbone is reliable, performant, and extensible as new worker types and capabilities are introduced.
Key Responsibilities
  • Architect and maintain the multi-agent orchestration framework, including worker spawning, conversation history isolation, context management, and inter-worker coordination
  • Design and implement token optimization strategies, including context window management, conversation summarization, and efficient prompt construction
  • Own the model routing layer that directs tasks to appropriate model tiers based on task complexity and user configuration
  • Develop and refine prompt engineering patterns for worker agents to ensure consistent, high-quality analytical outputs
  • Establish evaluation frameworks to measure generative AI output quality, accuracy, and reliability across worker types
  • Lead the design of new worker types to support program management capabilities (cost analysis workers, risk analysis workers, data fusion workers)
  • Collaborate with PM Domain Analysts to translate program management requirements into generative AI agent behaviors
  • Mentor junior LLM/AI Platform Engineers and establish engineering standards for generative AI development

#px2026
Qualifications
Required Qualifications
  • Minimum of 8+ years of experience with a Bachelor's degree, 6+ years with a Master's degree, or 3+ years with a PhD in Computer Science, AI/ML, or related field
  • Deep experience with large language model architectures, fine-tuning, and inference optimization
  • Proficiency in Python; experience with LLM frameworks (LangChain, LlamaIndex, or equivalent)
  • Strong understanding of prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures
  • Experience with vector databases and embedding models
  • Demonstrated ability to architect complex, multi-component generative AI systems
  • US Citizenship with the ability to obtain/maintain a Secret clearance

Preferred Qualifications
  • Experience with multi-agent systems or autonomous agent frameworks
  • Familiarity with government/defense program management concepts
  • Experience with model evaluation and red-teaming methodologies
  • Knowledge of FedRAMP or DoD cloud security requirements
  • 7+ years of software engineering experience, with 3+ years focused on LLM/NLP systems
  • Graduate degree in Computer Science, AI/ML, or related field is highly desired

Peraton Overview
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can't be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we're keeping people around the world safe and secure.
Target Salary Range
$112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
EEO
EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

What Peraton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Peraton logo

About Peraton

Sourced by ZipRecruiter

At Peraton, we re at the forefront of delivering the next big thing every day. We re the partner of choice to help solve some of the world s most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Herndon, VA, US

Year founded

2017

View All Peraton Jobs

Apply