ZipRecruiter

Log In

1

Senior Llm Engineer Jobs (NOW HIRING)

Simple Solutions

Sr Applied LLM Engineer

San Francisco, CA · On-site

$180K - $200K/yr

Sr. Applied LLM Engineer Qualifications * Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience) * 3+ years of software development ...

Gap International

AI/LLM Engineer

Springfield, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Philadelphia, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

next page

Showing results 1-20

All JobsLlm Engineer JobsSenior Llm Engineer Jobs

Senior Llm Engineer information

See salary details

$59.5K

$126.6K

$183.5K

How much do senior llm engineer jobs pay per year?

As of Jun 9, 2026, the average yearly pay for senior llm engineer in the United States is $126,557.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $143,500.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Senior LLM Engineer, and why are they important?

To thrive as a Senior LLM Engineer, you need deep expertise in machine learning, natural language processing, and advanced programming skills, typically supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as PyTorch, TensorFlow, Hugging Face Transformers, and cloud platforms, along with experience in deploying large-scale language models, is crucial. Strong problem-solving, collaboration, and communication skills set top performers apart in leading cross-functional AI initiatives. These abilities are vital for developing, optimizing, and scaling cutting-edge language models that drive innovation and business value.

What are Senior LLM Engineers?

Senior LLM (Large Language Model) Engineers are experienced professionals who design, build, optimize, and maintain advanced language models like GPT, BERT, or similar AI systems. They work on tasks such as model training, fine-tuning, deployment, and troubleshooting, often collaborating with data scientists and software engineers. Their expertise includes deep learning frameworks, natural language processing, and software engineering best practices. Senior LLM Engineers also play a key role in ensuring the ethical and efficient use of AI models in production systems.

What are some common challenges Senior LLM Engineers face when deploying large language models in production environments?

Senior LLM Engineers often encounter challenges related to scaling models efficiently, managing latency, and ensuring model outputs are safe and reliable. Deploying large language models requires careful optimization to balance performance with computational costs, as well as robust monitoring to detect and mitigate issues like bias or hallucination in outputs. Collaboration with cross-functional teams, including data scientists, product managers, and DevOps, is key to addressing these challenges and ensuring successful model deployment and maintenance.

What is the difference between Senior Llm Engineer vs Machine Learning Engineer?

AspectSenior Llm EngineerMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or AI; strong programming skills
Work EnvironmentFocus on NLP, language models, and large-scale data processingBroader ML tasks, including data modeling, algorithms, and deployment
Industry UsagePrimarily in AI/NLP-focused companies, research labs

Senior Llm Engineers specialize in large language models and NLP-specific tasks, often requiring advanced NLP knowledge and experience with LLMs. Machine Learning Engineers have a broader scope, working on various ML models and applications across industries. While both roles require strong technical skills, Senior Llm Engineers focus more on language-specific AI, whereas Machine Learning Engineers handle diverse ML projects.

More about Senior Llm Engineer jobs
What cities are hiring for Senior Llm Engineer jobs? Cities with the most Senior Llm Engineer job openings:
What are the most commonly searched types of Llm Engineer jobs? The most popular types of Llm Engineer jobs are:
What states have the most Senior Llm Engineer jobs? States with the most job openings for Senior Llm Engineer jobs include:
What job categories do people searching Senior Llm Engineer jobs look for? The top searched job categories for Senior Llm Engineer jobs are:
Senior Llm Engineer jobs near you
Infographic showing various Senior Llm Engineer job openings in the United States as of May 2026, with employment types broken down into 75% Full Time, and 25% Contract. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $126,557 per year, or $60.8 per hour.
LLM Engineer

LLM Engineer

First Soft Solutions

Dallas, TX • On-site

Full-time

Posted 12 days ago

Job description

Job Title: LLM Engineer
Location: Dallas, TX (Onsite)
Start: Immediate
Role Overview
We are looking for a Senior Full Stack AI Engineer with strong experience in building scalable applications and integrating Large Language Models (LLMs). This role requires hands-on expertise across backend, frontend, and cloud, along with the ability to deliver production-grade AI solutions.
Key Responsibilities
  • Design and develop full-stack applications using Java and React
  • Build and integrate LLM-powered solutions using APIs (OpenAI, Claude, Azure OpenAI, etc.)
  • Develop scalable microservices and REST APIs
  • Deploy and manage applications on AWS or Azure
  • Work with SQL and NoSQL databases for high-performance applications
  • Implement RAG, embeddings, and vector-based search solutions
  • Ensure security, performance, and reliability of applications
  • Mentor junior developers and contribute to code quality and best practices
Required Skills
  • 10+ years of full-stack development experience
  • Strong expertise in Java (Spring Boot, Hibernate)
  • Experience with ReactJS and modern frontend development
  • Hands-on with cloud platforms (AWS or Azure)
  • Experience integrating LLMs (e.g., OpenAI API, Azure OpenAI Service, Amazon Bedrock, Claude)
  • Knowledge of RAG, embeddings, and vector databases
  • Strong database experience (SQL + NoSQL)
  • Proficiency in Python for backend or data processing
  • Experience with REST APIs and microservices architecture
  • Understanding of security (OAuth2, JWT, OpenID Connect)
Nice to Have
  • Experience with Palantir Foundry
  • Exposure to frameworks like LangChain, LlamaIndex, or Hugging Face
  • Experience in enterprise AI/ML solution development
First Soft Solutions logo

About First Soft Solutions

Sourced by ZipRecruiter

First Soft Solutions custom application Development and Maintenance Services are designed to enable you to lower the total cost of ownership and the required quality for your application. While all application Development Outsourcing is Technically custom, The difference is that packaged applications were designed with a general set of features to be used by a broad range of users. Custom application development is capable of producing practically any feature you may desire for your site. Time and money are virtually the only limiting factors. Our goal is to provide Clients with the Solution that fits their specific and unique needs while giving them the knowledge they need to operate and maintain the New Systems and Software. Our allegiance is to the best solution for our Clients. Our experience and knowledgeable consultants are ready to go above and beyond expectations to assist you in obtaining your goals. We can also provides expert project management throughout the entire project life cycle.

Industry

It services

Company size

11 - 50 Employees

Headquarters location

East Brunswick, NJ, US

Year founded

2006

View All First Soft Solutions Jobs

Apply