ZipRecruiter

Log In

1

Machine Learning Engineer Llm Jobs (NOW HIRING)

Nace AI

Machine Learning Engineer

Palo Alto, CA · On-site

As a Machine Learning Engineer, you will play a central role in translating cutting-edge machine ... Experienced in inference time optimization, deep understanding of LLM serving optimizations for ...

Clover Health

Senior Machine Learning Engineer

$125K - $165K/yr

By predicting avoidable adverse events, our ML/NLP/LLM infrastructure is central to working on our ... As a Senior Machine Learning Engineer, you will: * Design, implement and validate high-reliability ...

S&P Global

Senior Machine Learning Engineer

Union City, IN · On-site +1

$95K - $130K/yr

Kensho's solutions and research focus on Generative AI, LLM Agents, speech recognition, entity ... About the Team- We are looking for a Senior ML Engineer to join the group of Machine Learning ...

HealthEdge

Machine Learning Engineer

Overview Machine Learning Engineer, AI Platform As a Machine Learning Engineer, you will design ... Experience with LLM APIs, agentic frameworks (LangChain, Strands, etc.), and prompt engineering ...

HealthEdge

Machine Learning Engineer

Overview Machine Learning Engineer, AI Platform As a Machine Learning Engineer, you will design ... Experience with LLM APIs, agentic frameworks (LangChain, Strands, etc.), and prompt engineering ...

Spgi

Senior Machine Learning Engineer

Union City, IN · On-site +1

$95K - $130K/yr

Kensho's solutions and research focus on Generative AI, LLM Agents, speech recognition, entity ... About the Team- We are looking for a Senior ML Engineer to join the group of Machine Learning ...

Autodesk

Senior Machine Learning Engineer

OR · On-site +1

$104K - $143K/yr

One of the team's major focus areas is the Commerce and Support Assistant (CSA), an LLM-driven ... Position Overview As a Senior Machine Learning Engineer, you will play a key role in designing ...

Advantest

Machine Learning Engineer

San Jose, CA · On-site

Advantest is seeking a motivated Junior Machine Learning Engineer to support the development of ... Experiment with modern analytics techniques, including LLM-based or generative-AI methods, under ...

LRS

Sr. Machine Learning Engineer

Kansas City, MO · On-site

$130K - $145K/yr

LRS Consulting is seeking a Senior Machine Learning Engineer to design, build, and scale production ... This role focuses on developing advanced ML and LLM-powered applications that leverage structured ...

Autodesk

Senior Machine Learning Engineer

New York, NY · On-site +1

$114K - $157K/yr

One of the team's major focus areas is the Commerce and Support Assistant (CSA), an LLM-driven ... Position Overview As a Senior Machine Learning Engineer, you will play a key role in designing ...

Autodesk

$86K - $119K/yr

One of the team's major focus areas is the Commerce and Support Assistant (CSA), an LLM-driven ... Position Overview As a Senior Machine Learning Engineer, you will play a key role in designing ...

Apple

Machine Learning Engineer- GenAI

Cupertino, CA · On-site

... engineer to join our team. You will help design and implement our machine learning strategy to the ... Experience with LLM and LMM development and fine-tuning is a major plus.Proficiency in using ...

Autodesk

Senior Machine Learning Engineer

California, MD · On-site +1

$100K - $137K/yr

One of the team's major focus areas is the Commerce and Support Assistant (CSA), an LLM-driven ... Position Overview As a Senior Machine Learning Engineer, you will play a key role in designing ...

next page

Showing results 1-20

People also search for

All JobsMachine Learning Engineer Llm Jobs

Machine Learning Engineer Llm information

See salary details

$31.5K

$128.8K

$193.5K

How much do machine learning engineer llm jobs pay per year?

As of Jun 6, 2026, the average yearly pay for machine learning engineer llm in the United States is $128,769.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,500.00 and $155,000.00 per year, depending on experience, location, and employer.

What are Machine Learning Engineers (LLM)?

Machine Learning Engineers (LLM) are professionals who design, build, and deploy large language models (LLMs) such as GPT or BERT. They combine software engineering skills with a deep understanding of machine learning algorithms to develop systems that can process and generate human-like text. Their responsibilities often include data preprocessing, model training, fine-tuning, evaluation, and integrating these models into applications. They also work to optimize performance, ensure scalability, and address ethical considerations related to AI language models.

What is the difference between Machine Learning Engineer Llm vs Data Scientist?

AspectMachine Learning Engineer LlmData Scientist
Required CredentialsBachelor's or Master's in CS, AI, or related; experience with ML frameworksBachelor's or Master's in CS, Statistics, or related; strong analytical skills
Work EnvironmentDevelops, tests, and deploys ML models, often in AI-focused teamsAnalyzes data, builds models, and provides insights for decision-making
Industry UsageUsed in AI product development, NLP, LLMs, and automationApplied across finance, healthcare, marketing, and research

While both roles require strong technical skills and knowledge of machine learning, Machine Learning Engineer Llm focuses on developing and deploying large language models, especially in AI applications. Data Scientists analyze data and build models for insights. The roles often overlap but differ mainly in their focus on deployment versus analysis.

What are some common challenges Machine Learning Engineers face when working with large language models (LLMs) in a production environment?

Machine Learning Engineers working with LLMs often encounter challenges such as optimizing model performance while managing resource constraints like memory and compute power. Additionally, ensuring data privacy and compliance can be complex due to the vast amounts of training data involved. Another common challenge is deploying and monitoring LLMs to maintain accuracy and minimize bias, requiring close collaboration with data scientists, DevOps, and product teams. Regularly updating models to reflect new data and user feedback is also crucial for maintaining relevance and performance in real-world applications.

What are the key skills and qualifications needed to thrive as a Machine Learning Engineer LLM, and why are they important?

To thrive as a Machine Learning Engineer specializing in large language models (LLMs), you need a strong background in computer science, mathematics, and deep learning, typically supported by a relevant degree and experience with NLP techniques. Familiarity with frameworks like TensorFlow, PyTorch, Hugging Face Transformers, and experience working with large-scale data sets and distributed systems are essential, along with knowledge of cloud platforms such as AWS or GCP. Strong problem-solving, collaboration, and communication skills help you translate complex research into practical applications and work effectively with cross-functional teams. These combined skills ensure the ability to develop, fine-tune, and deploy LLMs that deliver real-world value while staying at the forefront of AI advancements.
Infographic showing various Machine Learning Engineer Llm job openings in the United States as of May 2026, with employment types broken down into 3% As Needed, 93% Full Time, 1% Part Time, 2% Temporary, and 1% Contract. Highlights an 94% Physical, 1% Hybrid, and 5% Remote job distribution, with an average salary of $128,769 per year, or $61.9 per hour.
Machine Learning Engineer

Machine Learning Engineer

DEKA Research & Development

Manchester, NH • On-site

Full-time

Posted 21 days ago

Job description

We're looking for a Machine Learning Engineer who can operate at the intersection of backend engineering and applied machine learning. If you want to design distributed systems, deploy production ML models, and architect scalable data pipelines that make a measurable difference — this is your opportunity, and it starts with the software you design and deliver at DEKA.
This role is on-site at DEKA in Manchester, NH. Relocation is not available, local candidates only.
How You Will Make an Impact:
  • Design and implement scalable backend services and microservices powering data-intensive, real-world applications
  • Build and deploy production ML models across the full lifecycle from feature engineering and training through evaluation, deployment, and monitoring
  • Develop and maintain event-driven distributed pipelines using Apache Kafka, Apache Spark, and related technologies
  • Architect systems that integrate ML models with rule-based decision engines for automated, real-time decisioning
  • Collaborate across disciplines to translate complex requirements into reliable, elegant engineering solutions
  • Contribute to AI/LLM-driven workflows and orchestration systems that push the boundaries of what software can do
Required Experience/Knowledge:
  • M.S. in Computer Science, AI, or a related field
  • 6+ years in backend software engineering and distributed systems
  • Strong proficiency in Java (Spring Boot, Spring MVC, Hibernate) and Python
  • Hands-on experience building and deploying production ML models (PyTorch or equivalent)
  • Experience with distributed systems and streaming technologies: Apache Kafka, Apache Spark, ZooKeeper
  • Solid understanding of microservices architecture, REST/SOAP APIs, and object-oriented design
  • Experience with relational and NoSQL databases (Oracle, IBM Db2, MSSQL, MongoDB)
  • Familiarity with AWS or equivalent cloud platforms
  • Strong problem-solving skills
  • Intrinsic drive to understand how things work and make them better
  • Excellent communicating and collaboration across engineering, data, and product teams
  • Strong attention to detail

Powered by JazzHR

DBpc6ZRn7W