ZipRecruiter

Log In

1

Senior Llm Engineer Jobs (NOW HIRING)

Simple Solutions

Sr Applied LLM Engineer

San Francisco, CA · On-site

$180K - $200K/yr

Sr. Applied LLM Engineer Qualifications * Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience) * 3+ years of software development ...

Wise Skulls Corp.

Sr AI/LLM Engineer

Frisco, TX · On-site

$98K - $134K/yr

... Prompt engineering (few-shot, structured output, JSON mode)PydanticOutputParser / structured LLM responsesGuardrails / PII redaction patternsMemory abstractions for agentsLangfuse (trace ...

Gap International

AI/LLM Engineer

Philadelphia, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

TMS

AI/ LLM Engineer- Next.js

Princeton, NJ · On-site

Role: Senior Full Stack Engineer - AI & Next.js Duration: Long Term Location: United States- Remote Role Summary We are looking for a Senior Full Stack Engineer with strong experience in AI/LLM ...

New

Slalom Consulting

General Information

Boston, MA · On-site

Bring senior-level Python and LLM engineering expertise to the team. * Execute both planning and hands-on technical work independently. * Collaborate effectively with Product Owners and other ...

Lorven Technologies

Senior AI/ML Engineer

Calabasas, CA · On-site

$110K - $151K/yr

Senior AI/ML Engineer GenAI & Cloud Solutions Location: Woodland hills, CA (onsite Role ... GenAI & LLM Concepts: Deep understanding of Generative AI, Natural Language Models (NLM), and Large ...

next page

Showing results 1-20

All JobsLlm Engineer JobsSenior Llm Engineer Jobs

Senior Llm Engineer information

See salary details

$59.5K

$126.6K

$183.5K

How much do senior llm engineer jobs pay per year?

As of Jul 20, 2026, the average yearly pay for senior llm engineer in the United States is $126,557.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $143,500.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Senior LLM Engineer, and why are they important?

To thrive as a Senior LLM Engineer, you need deep expertise in machine learning, natural language processing, and advanced programming skills, typically supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as PyTorch, TensorFlow, Hugging Face Transformers, and cloud platforms, along with experience in deploying large-scale language models, is crucial. Strong problem-solving, collaboration, and communication skills set top performers apart in leading cross-functional AI initiatives. These abilities are vital for developing, optimizing, and scaling cutting-edge language models that drive innovation and business value.

What are Senior LLM Engineers?

Senior LLM (Large Language Model) Engineers are experienced professionals who design, build, optimize, and maintain advanced language models like GPT, BERT, or similar AI systems. They work on tasks such as model training, fine-tuning, deployment, and troubleshooting, often collaborating with data scientists and software engineers. Their expertise includes deep learning frameworks, natural language processing, and software engineering best practices. Senior LLM Engineers also play a key role in ensuring the ethical and efficient use of AI models in production systems.

What are some common challenges Senior LLM Engineers face when deploying large language models in production environments?

Senior LLM Engineers often encounter challenges related to scaling models efficiently, managing latency, and ensuring model outputs are safe and reliable. Deploying large language models requires careful optimization to balance performance with computational costs, as well as robust monitoring to detect and mitigate issues like bias or hallucination in outputs. Collaboration with cross-functional teams, including data scientists, product managers, and DevOps, is key to addressing these challenges and ensuring successful model deployment and maintenance.

What is the difference between Senior Llm Engineer vs Machine Learning Engineer?

AspectSenior Llm EngineerMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or AI; strong programming skills
Work EnvironmentFocus on NLP, language models, and large-scale data processingBroader ML tasks, including data modeling, algorithms, and deployment
Industry UsagePrimarily in AI/NLP-focused companies, research labs

Senior Llm Engineers specialize in large language models and NLP-specific tasks, often requiring advanced NLP knowledge and experience with LLMs. Machine Learning Engineers have a broader scope, working on various ML models and applications across industries. While both roles require strong technical skills, Senior Llm Engineers focus more on language-specific AI, whereas Machine Learning Engineers handle diverse ML projects.

More about Senior Llm Engineer jobs
What cities are hiring for Senior Llm Engineer jobs? Cities with the most Senior Llm Engineer job openings:
What are the most commonly searched types of Llm Engineer jobs? The most popular types of Llm Engineer jobs are:
What states have the most Senior Llm Engineer jobs? States with the most job openings for Senior Llm Engineer jobs include:
What job categories do people searching Senior Llm Engineer jobs look for? The top searched job categories for Senior Llm Engineer jobs are:
Senior Llm Engineer jobs near you
Infographic showing various Senior Llm Engineer job openings in the United States as of July 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $126,557 per year, or $60.8 per hour.
Sr Applied LLM Engineer

Sr Applied LLM Engineer

Simple Solutions

San Francisco, CA • On-site

$180K - $200K/yr

Full-time

Re-posted 5 days ago

Job description


Sr. Applied LLM Engineer
Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
  • 3+ years of software development experience, with a focus on building and deploying AI/ML applications
  • Strong backend engineering experience, including:
    • Building APIs from the ground up using Python frameworks such as FastAPI and Django
    • Deploying and scaling containerized applications in cloud environments (e.g., AWS, GCP, Azure)
    • Implementing CI/CD pipelines (e.g., GitHub Actions)
    • Working with Infrastructure-as-Code tools such as Terraform or Pulumi
  • Hands-on experience building LLM-based applications, including:
    • Designing multi-step LLM workflows and task-specific agents
    • Experience working with most frontier models (e.g. OpenAI, Anthropic, Google, etc...)
    • Experience with AI tools as a user, specifically AI code editors
    • Developing advanced prompt engineering strategies, evaluation frameworks, and RAG pipelines
    • Conducting technical R&D to explore and define the boundaries of model functionality
  • Familiarity with secure coding practices, ideally in regulated industries (e.g., life sciences, healthcare, fintech)
  • Experience working in or adjacent to regulated domains (life sciences, clinical R&D) is a plus
  • Frontend development experience (e.g., React) is a plus, but not required
Requirements
  • Ability to design and maintain scalable, production-grade backend systems for AI applications
  • Ability to create, orchestrate, and evaluate LLM-based agents and chained workflows with minimal oversight
  • Ability to debug and improve LLM-driven systems, identifying issues across multiple layers (model output, API behavior, system logic)
  • Ability to conduct rapid experimentation and research on LLM capabilities and translate findings into production functionality
  • Ability to stay current with emerging practices, models, and tooling in the generative AI ecosystem and apply them pragmatically
  • Ability to communicate clearly with technical and non-technical collaborators (e.g., product managers, medical writers, customer teams)
  • Ability to operate effectively in a fast-paced, ambiguity-heavy environment, managing shifting priorities and novel problem spaces
Other Information
  • Very comfortable working in a fast-paced and intense startup environment
  • Willing to work in-person in our office in Mission Bay 4-5 days/week
  • Likes matcha KitKats, believes every LLM prompt is just Schrodinger's cat waiting to be observed, and knows too many random facts about the Mongol postal system

Requirements
Why are you interested in Artos?
Have you successfully brought an LLM-based application to production for external customers?
Are you comfortable with a high-intensity "startup hours" environment (roughly 12-14 hours/day) to hit aggressive growth targets?
Preferred previous employers:
Life Science Tech: Benchling, Viva.
Legal/Compliance AI: Ironclad, Harvey.
Open Source Communities: LangChain, LangGraph, or Maestro contributors.

Apply