ZipRecruiter

Log In

1

Senior Llm Developer Jobs (NOW HIRING)

BrightAI

Senior AI Engineer - LLM, RAG

Palo Alto, CA · On-site

$123K - $168K/yr

They are seeking a Senior AI Engineer to lead the development of Retrieval-Augmented Generation ... LLM applications. • Design evaluation strategies to measure performance, accuracy, and user ...

Gametime United

OR · On-site

$104K - $143K/yr

The Role The Senior AI & ML Engineer is responsible for building and scaling the agentic platform ... This person will design, ship, and evaluate LLM-powered features that real customers interact with ...

h2o.ai

Senior AI Engineer

Charlotte, NC · On-site

$102K - $140K/yr

About This Opportunity We are looking for a Senior AI Engineer who builds things that matter. You ... Develop and deploy LLM-powered applications using techniques including RAG, fine-tuning, prompt ...

h2o.ai

Senior AI Engineer

Charlotte, NC · On-site

$102K - $140K/yr

About This Opportunity We are looking for a Senior AI Engineer who builds things that matter. You ... Develop and deploy LLM-powered applications using techniques including RAG, fine-tuning, prompt ...

BrightAI

Senior AI Engineer - LLM, RAG

Palo Alto, CA · On-site

$123K - $168K/yr

They are seeking a Senior AI Engineer to lead the development of Retrieval-Augmented Generation ... LLM applications. • Design evaluation strategies to measure performance, accuracy, and user ...

Cybercoders

Senior AI/ML Engineer

Plantation, FL · Remote

$103K - $142K/yr

Senior AI/ML Engineer Title: Senior AI/ML Engineer Reports to: VP of Engineering, Operations ... Insight synthesis engine - Ship an LLM-powered correlation engine that returns root causes ...

AMSYS Talent

LLM Infrastructure Engineer

Houston, TX · On-site

$97K - $127K/yr

We are looking for a Senior Python / AI API Engineer to build and deploy production-grade services powering Large Language Model (LLM) applications. This role focuses on developing high-performance ...

Upstart

Principal Engineer, LLM

OR · On-site +1

Mentor senior engineers, other principal engineers, and shape the growth of future technical ... Deep expertise in LLM-specific infrastructure such as inference optimization (quantization, ONNX ...

Purple Drive Technologies

Sr Python Developer

Tampa, FL · On-site

$114K - $154K/yr

Overview: We are seeking a highly skilled Senior Python Developer with proven expertise in ... Develop scalable architectures for LLM-powered applications such as chatbots, retrieval-augmented ...

next page

Showing results 1-20

All JobsLlm Developer JobsSenior Llm Developer Jobs

Senior Llm Developer information

See salary details

$25K

$80.3K

$163.5K

How much do senior llm developer jobs pay per year?

As of Jun 11, 2026, the average yearly pay for senior llm developer in the United States is $80,287.00, according to ZipRecruiter salary data. Most workers in this role earn between $41,500.00 and $103,000.00 per year, depending on experience, location, and employer.

What is the salary of LLM developer?

The salary of a Senior LLM Developer typically ranges from $120,000 to $180,000 annually, depending on experience, location, and company size. Skilled developers with expertise in machine learning, natural language processing, and deep learning frameworks may earn higher compensation, especially in competitive tech markets.

What engineers make $500,000?

Senior LLM developers and AI engineers with extensive experience, specialized skills in machine learning, deep learning, and natural language processing, and often working in high-demand industries or at leading tech companies can earn $500,000 or more annually. Compensation may include base salary, bonuses, stock options, and other incentives, especially at senior levels or in competitive markets.

What are the key skills and qualifications needed to thrive as a Senior LLM Developer, and why are they important?

To thrive as a Senior LLM Developer, you need deep expertise in natural language processing, machine learning, and advanced programming skills, typically supported by a relevant degree and experience with large language models. Proficiency with frameworks like PyTorch or TensorFlow, cloud platforms (AWS, GCP, Azure), and version control systems, as well as familiarity with model fine-tuning and deployment, are essential. Strong problem-solving, communication, and collaboration skills help in leading teams and translating complex requirements into innovative solutions. These skills are crucial for building, optimizing, and maintaining robust language models that meet organizational objectives and stay ahead in a rapidly evolving field.

What is the difference between Senior Llm Developer vs Machine Learning Engineer?

AspectSenior Llm DeveloperMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or related fields; experience with ML frameworks
Work EnvironmentResearch labs, AI startups, tech companies focusing on NLPTech companies, startups, industries applying ML solutions
Industry UsagePrimarily in NLP, AI research, and language model developmentBroader across AI applications, including vision, speech, and data analysis

While both roles require strong AI and ML knowledge, Senior Llm Developers specialize in language models and NLP, whereas Machine Learning Engineers work across various AI domains. The roles often overlap but differ in focus and application areas.

What is a $900,000 AI job?

A $900,000 AI job typically refers to high-level roles such as Senior Llm Developer or AI research director, which involve developing large language models, advanced machine learning techniques, and require expertise in deep learning frameworks. These positions often demand extensive experience, specialized skills, and may include leadership responsibilities or working in competitive tech environments.

What are some common challenges Senior LLM Developers face when deploying large language models in production environments?

Senior LLM Developers often encounter challenges such as optimizing model performance for latency and scalability while maintaining accuracy. Managing resource-intensive inference and ensuring robust monitoring to detect issues like model drift or biased outputs are also key concerns. Additionally, integrating LLMs with existing systems and coordinating with cross-functional teams, such as MLOps engineers and product managers, is essential for successful deployment. Staying updated with rapidly evolving frameworks and compliance requirements adds to the complexity of the role.

What are Senior LLM Developers?

Senior LLM Developers are experienced software engineers who specialize in building, fine-tuning, and deploying large language models (LLMs) such as GPT, BERT, or similar AI models. They work on advanced natural language processing (NLP) tasks, optimize model performance, and often lead teams in developing AI-driven applications. Their responsibilities include data pipeline development, model training, performance evaluation, and integrating LLMs into products. They are proficient in programming languages like Python, familiar with machine learning frameworks, and stay updated with the latest research in AI and NLP.

Which 3 jobs will survive AI?

For a Senior Llm Developer, roles that require complex problem-solving, creativity, and human judgment are likely to persist, such as AI ethics specialists, AI system auditors, and interdisciplinary researchers. These jobs involve oversight, nuanced understanding, and ethical considerations that AI cannot fully replicate. Skills in critical thinking, domain expertise, and collaboration will remain valuable in the evolving AI landscape.
More about Senior Llm Developer jobs
What cities are hiring for Senior Llm Developer jobs? Cities with the most Senior Llm Developer job openings:
What are the most commonly searched types of Llm Developer jobs? The most popular types of Llm Developer jobs are:
What states have the most Senior Llm Developer jobs? States with the most job openings for Senior Llm Developer jobs include:
What job categories do people searching Senior Llm Developer jobs look for? The top searched job categories for Senior Llm Developer jobs are:
Senior Llm Developer jobs near you
Infographic showing various Senior Llm Developer job openings in the United States as of June 2026, with employment types broken down into 90% Full Time, 8% Part Time, and 2% Contract. Highlights an 77% Physical, 5% Hybrid, and 18% Remote job distribution, with an average salary of $80,287 per year, or $38.6 per hour.
Senior AI Engineer - LLM, RAG

Senior AI Engineer - LLM, RAG

BrightAI

Palo Alto, CA • On-site

$123K - $168K/yr

Full-time

Posted 4 days ago

Job description

Job Summary:
BrightAI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. They are seeking a Senior AI Engineer to lead the development of Retrieval-Augmented Generation systems that leverage large language models and real-world knowledge sources for industrial applications.
Responsibilities:
• Lead the architecture and development of RAG systems that combine LLMs (e.g., LLAMA, Mistral, Claude, GPT) with structured and unstructured external information sources.
• Develop AI-powered assistants to support technicians in diagnosing and resolving anomalies or failures in factory, plant, or industrial settings.
• Build pipelines to ingest, preprocess, and index large corpora of documents (manuals, logs, notes, procedures) for semantic search and grounding.
• Customize and fine-tune foundational models to incorporate domain-specific language, tone, and logic for industrial troubleshooting scenarios.
• Collaborate with product, data, and cloud teams to design scalable, privacy-compliant, and latency-sensitive LLM applications.
• Design evaluation strategies to measure performance, accuracy, and user experience of RAG-enabled systems in production settings.
• Stay up to date with the latest advances in LLM architectures, retrieval methods, and prompt engineering, and integrate emerging techniques into the product roadmap.
Qualifications:
Required:
• M.S. or Ph.D. in Computer Science, AI, Machine Learning, or a related field, with specialization in NLP or deep learning.
• 5+ years of experience in machine learning or AI with a strong focus on NLP, LLMs, or conversational AI.
• Fluency with modern LLMs and open-source foundational models (e.g., LLAMA, Falcon, Mistral, GPT, Claude).
• Experience building RAG pipelines with tools like LangChain, LlamaIndex, or custom vector database integrations, with at least one production grade system was built.
• Fluency with prompt engineering, instruction tuning, or fine-tuning open-source models.
• Deep understanding of document retrieval (semantic search, embedding generation, similarity metrics) and vector stores (e.g., FAISS, Weaviate, Pinecone).
• Strong foundation in core machine learning techniques, including experience with reinforcement learning (RL) or decision-making models.
• Proficiency with ML development frameworks such as PyTorch, Hugging Face Transformers, or similar. Strong Python programming is a must.
• Experience integrating AI systems into real-world applications with user-facing interfaces and operational constraints.
• Excellent problem-solving and critical thinking skills; ability to design solutions for complex, ambiguous problems.
• Strong written and verbal communication skills, with ability to collaborate cross-functionally with engineers, product managers, and domain experts.
Preferred:
• Strong research or applied background in large language models (LLMs) and retrieval-augmented generation (RAG) systems. Agentic RAG experience is highly desirable.
• Experience applying LLMs in industrial or physical infrastructure settings (e.g., manufacturing, logistics, utilities, energy).
• Knowledge of industrial control systems, maintenance workflows, or technician support processes.
• Exposure to multimodal models or integrating textual data with sensor and/or time-series data.
• Prior experience in a startup or a fast-paced environment building LLM-powered products from the ground up.
Company:
BrightAI provides physical AI solutions for infrastructure and services. Founded in 2020, the company is headquartered in Palo Alto, USA, with a team of 51-200 employees. The company is currently Growth Stage.
BrightAI logo

About BrightAI

Sourced by ZipRecruiter

Industry

Software development

Company size

11 - 50 Employees

Headquarters location

San Francisco, CA, US

Year founded

2019

View All BrightAI Jobs

Apply