ZipRecruiter

Log In

1

Senior Llm Engineer Jobs (NOW HIRING)

Koch Industries

Senior LLM Engineer

Austin, TX · On-site

$195K - $255K/yr

Your Job The Senior LLM Engineer will fine-tune and deploy LLMs on Azure OpenAI / Azure AI Foundry to power generative AI capabilities within our engineering design platform, translating natural ...

CINC Systems

Senior LLM Ops Engineer

$107K - $146K/yr

Senior LLMOps Engineer (Remote - Global - Work From Anywhere) About CINC Systems CINC Systems is ... Key Responsibilities · Design and operate LLM orchestration and runtime systems that support ...

Censys

Senior AI/LLM Engineer

$179K - $201K/yr

Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The ... Prior knowledge in prompt engineering improving LLM accuracy, reasoning and consistency

Censys

Senior AI/LLM Engineer

$179K - $201K/yr

Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The ... Prior knowledge in prompt engineering improving LLM accuracy, reasoning and consistency

Gap International

AI/LLM Engineer

Springfield, PA

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Autonomize Inc

ML/LLM Engineer - Applied AI

Austin, TX · On-site

The Opportunity We're looking for a hands-on ML/LLM Engineer who's excited to ship real-world ... This is a mid to senior-level role for someone who's ready to go deep on applied ML problems - from ...

Gap International

AI/LLM Engineer

Philadelphia, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

Gap International

AI/LLM Engineer

Springfield, PA · On-site

As an AI/LLM Engineer, you will lead the design and implementation of advanced systems centered on ... Willing to communicate and contribute thoughts, insights and new ideas to senior leaders both ...

TMS

AI/ LLM Engineer- Next.js

Princeton, NJ · On-site

Role: Senior Full Stack Engineer - AI & Next.js Duration: Long Term Location: United States- Remote Role Summary We are looking for a Senior Full Stack Engineer with strong experience in AI/LLM ...

next page

Showing results 1-20

All JobsLlm Engineer JobsSenior Llm Engineer Jobs

Senior Llm Engineer information

See salary details

$59.5K

$126.6K

$183.5K

How much do senior llm engineer jobs pay per year?

As of Aug 31, 2026, the average yearly pay for senior llm engineer in the United States is $126,557.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $143,500.00 per year, depending on experience, location, and employer.

What is a senior LLM engineer?

Senior LLM (Large Language Model) Engineers are experienced professionals who design, build, optimize, and maintain advanced language models like GPT, BERT, or similar AI systems. They work on tasks such as model training, fine-tuning, deployment, and troubleshooting, often collaborating with data scientists and software engineers. Their expertise includes deep learning frameworks, natural language processing, and software engineering best practices. Senior LLM Engineers also play a key role in ensuring the ethical and efficient use of AI models in production systems.

What are some common challenges senior LLM engineers face when deploying large language models in production environments?

Senior LLM Engineers often encounter challenges related to scaling models efficiently, managing latency, and ensuring model outputs are safe and reliable. Deploying large language models requires careful optimization to balance performance with computational costs, as well as robust monitoring to detect and mitigate issues like bias or hallucination in outputs. Collaboration with cross-functional teams, including data scientists, product managers, and DevOps, is key to addressing these challenges and ensuring successful model deployment and maintenance.

What are the key skills and qualifications needed to thrive as a senior LLM engineer, and why are they important?

To thrive as a Senior LLM Engineer, you need deep expertise in machine learning, natural language processing, and advanced programming skills, typically supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as PyTorch, TensorFlow, Hugging Face Transformers, and cloud platforms, along with experience in deploying large-scale language models, is crucial. Strong problem-solving, collaboration, and communication skills set top performers apart in leading cross-functional AI initiatives. These abilities are vital for developing, optimizing, and scaling cutting-edge language models that drive innovation and business value.

What is the difference between Senior Llm Engineer vs Machine Learning Engineer?

AspectSenior Llm EngineerMachine Learning Engineer
CredentialsAdvanced degrees in CS, NLP, or AI; experience with LLMsDegrees in CS, Data Science, or AI; strong programming skills
Work EnvironmentFocus on NLP, language models, and large-scale data processingBroader ML tasks, including data modeling, algorithms, and deployment
Industry UsagePrimarily in AI/NLP-focused companies, research labs

Senior Llm Engineers specialize in large language models and NLP-specific tasks, often requiring advanced NLP knowledge and experience with LLMs. Machine Learning Engineers have a broader scope, working on various ML models and applications across industries. While both roles require strong technical skills, Senior Llm Engineers focus more on language-specific AI, whereas Machine Learning Engineers handle diverse ML projects.

More about Senior Llm Engineer jobs

What cities are hiring for Senior Llm Engineer jobs?

Cities with the most Senior Llm Engineer job openings:

What are the most commonly searched types of Llm Engineer jobs?

The most popular types of Llm Engineer jobs are:

What states have the most Senior Llm Engineer jobs?

States with the most job openings for Senior Llm Engineer jobs include:

What job categories do people searching Senior Llm Engineer jobs look for?

The top searched job categories for Senior Llm Engineer jobs are:

Senior Llm Engineer jobs near you
Infographic showing various Senior Llm Engineer job openings in the United States as of August 2026, with employment types broken down into 93% Full Time, 3% Part Time, and 4% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution, with an average salary of $126,557 per year, or $60.8 per hour.

Senior LLM Engineer

Austin, TX • On-site

Koch Industries
Oil and Gas Extraction • 10K+ employees

8.0

Company rating: 8.0 out of 10

Based on 53 frontline employees who took The Breakroom Quiz

136th of 545 rated manufacturers

People enjoy working here

Good employer

Paid breaks

Learn more about Koch Industriesexternal

$195K - $255K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 11 days ago

Job description

Your Job
The Senior LLM Engineer will fine-tune and deploy LLMs on Azure OpenAI / Azure AI Foundry to power generative AI capabilities within our engineering design platform, translating natural-language design intent into structured, engineering-valid outputs.
Our Team
Established in 1938, Molex delivers comprehensive electronic solutions for various markets, including data communications, telecommunications, consumer electronics, industrial, automotive, commercial vehicle, aerospace and defense, medical, and lighting. You'll join the platform team behind our Azure AI/ML engineering tools, working alongside ML engineers, data scientists, and MLOps teams to keep training and inference workloads reliable, secure, and cost-efficient.
What You Will Do
  • Fine-tune foundation models (LoRA/QLoRA, RLHF/DPO, instruction tuning) for domain-specific tasks and terminology.
  • Build agentic and tool-use workflows that connect the LLM to internal engineering tools and data sources.
  • Design evaluation harnesses for factuality and accuracy; own hallucination and safety guardrails.
  • Build RAG pipelines (Azure AI Search) and structured tool-use/function-calling systems on top of fine-tuned Azure OpenAI models.
  • Deploy and optimize inference (quantization, KV-cache, vLLM/TensorRT-LLM) on Azure Kubernetes Service for cost-efficient serving.

Who You Are (Basic Qualifications)
  • 8+ years overall ML/AI engineering experience, with deep hands-on LLM/foundation model work - not just calling APIs.
  • Demonstrated experience fine-tuning models (LoRA/QLoRA/PEFT, full fine-tuning, or pretraining at some scale).
  • Practical experience with alignment techniques (RLHF, RLAIF, DPO, or instruction tuning).
  • Strong Python and deep PyTorch proficiency; solid grasp of transformer architecture internals.
  • Hands-on experience building RAG pipelines, embeddings/vector search, and agentic or tool-use LLM systems.
  • Familiarity with Azure OpenAI / Azure AI Foundry or an equivalent cloud LLM platform.

What Will Put You Ahead
  • Direct experience with Azure OpenAI Service and Azure AI Foundry for enterprise-scale deployment.
  • Experience orchestrating LLM-driven code or structured-output generation for technical/engineering domains.
  • Distributed training experience across multi-GPU/multi-node clusters (DeepSpeed, FSDP).
  • Publications, blog posts, or open-source contributions in generative AI.

For this role, we anticipate paying $195,000- $255,000 per year. This role is eligible for variable pay, issued as a monetary bonus or in another form.
At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.
Hiring Philosophy
All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here .
Who We Are
As a Koch company, Molex is a leading supplier of connectors and interconnect components, driving innovation in electronics and supporting industries from automotive to health care and consumer to data communications. The thousands of innovators who work for Molex have made us a global electronics leader. Our experienced people, groundbreaking products and leading-edge technologies help us deliver a wider array of solutions to more markets than ever before.
At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.
Our Benefits
Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.
Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.
Equal Opportunities
Equal Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, some offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please click here for additional information. (For Illinois E-Verify information click here , aquí , or tu ).

What Koch Industries employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply