ZipRecruiter

Log In

1

Llm Engineer Jobs in Boston, MA (NOW HIRING)

Agoda

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

Required : • 5+ years of experience in ML engineering, data science, platform engineering, or a ... with ML Ops and/or LLM Ops concepts (model lifecycle, evaluation, monitoring, versioning ...

next page

Showing results 1-20

All JobsLlm Engineer JobsLlm Engineer Jobs in Boston, MA

Llm Engineer information

See Boston, MA salary details

$27

$58

$83

How much do llm engineer jobs pay per hour?

As of Aug 30, 2026, the average hourly pay for llm engineer in Boston, MA is $58.26, according to ZipRecruiter salary data. Most workers in this role earn between $47.02 and $67.64 per hour, depending on experience, location, and employer.

What does an LLM engineer do?

An LLM Engineer designs, develops, and optimizes applications that leverage large language models (LLMs). They fine-tune models, integrate them into products, and improve performance through prompt engineering and model customization. This role requires expertise in machine learning, natural language processing (NLP), and software development. LLM Engineers work closely with data scientists and developers to create AI-driven solutions for various applications such as chatbots, content generation, and code assistance.

What are the key skills and qualifications needed to thrive as an LLM engineer?

To thrive as an LLM Engineer, you need strong expertise in machine learning, natural language processing, and proficiency with Python, along with a solid understanding of transformer-based models and deep learning frameworks like PyTorch or TensorFlow. Familiarity with cloud platforms, version control systems (e.g., Git), and tools such as Hugging Face Transformers is typically required, and certifications in AI or data science can be advantageous. Excellent problem-solving, collaboration, and communication skills help you work effectively with interdisciplinary teams and present complex findings clearly. These skills enable you to develop, fine-tune, and deploy large language models efficiently in real-world applications.

How much do Llm engineers make?

Llm engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in machine learning and natural language processing can earn higher salaries, often exceeding $200,000 with bonuses and stock options.

What are the most commonly searched types of Llm Engineer jobs in Boston, MA?

The most popular types of Llm Engineer jobs in Boston, MA are:

What are popular job titles related to Llm Engineer jobs in Boston, MA?

For Llm Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Llm Engineer jobs in Boston, MA look for?

The top searched job categories for Llm Engineer jobs in Boston, MA are:

Llm Engineer jobs near you
Infographic showing various Llm Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 90% Full Time, 5% Part Time, and 5% Contract. Highlights an 86% Physical, 6% Hybrid, and 8% Remote job distribution, with an average salary of $121,184 per year, or $58.3 per hour.

Machine Learning Engineer (LLM) (Boston)

Boston, MA • On-site

DeepRec.ai
See more jobs at DeepRec.aiexternal

$170K - $200K/yr

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.

Job description

Machine Learning Engineer (LLM)

Compensation: $170,000 - $200,000+ (DOE)
Location: Boston or Berkeley, flexible 2-3 days per week in office

We’re working a fast‑growing AI company on a mission to automate complex workflows in the financial services sector, starting with insurance. Their technology leverages cutting‑edge AI to simplify high‑value processes, from multi‑turn conversations to full workflow automation.

As an ML Engineer within LLMs, you’ll be building and scaling advanced AI systems that power intelligent, multi‑agent workflows. You’ll take ownership of designing, fine‑tuning, and productionizing large language models, integrating them with backend systems, and optimizing their performance. You’ll collaborate closely with data science, DevOps, and leadership to shape the AI infrastructure that drives the company’s automation solutions.

What You’ll Do
  • Build, fine‑tune, and productionize large language model (LLM) pipelines, including PEFT, RLHF, and DPO workflows.
  • Develop APIs, data pipelines, and orchestration systems for multi‑agent, multi‑turn AI conversations.
  • Integrate models with backend services, including voice orchestration platforms and transcript generation.
  • Optimize model usage and efficiency, transitioning from external APIs to in‑house solutions.
  • Collaborate cross‑functionally with data scientists, DevOps, and leadership to deliver scalable machine learning solutions.
What We’re Looking For Essential Skills & Experience
  • Strong proficiency in Python and ML frameworks (e.g., scikit‑learn, TensorFlow, PyTorch).
  • Hands‑on experience fine‑tuning and training LLMs.
  • Experience with PEFT, DPO, Prefence Optimization, post‑training, supervised fine tuning, RLHF.
  • Familiarity with AWS suite and deploying ML models to production.
  • Ability to reason deeply about ML principles, architectures, and design choices.
  • Knowledge of multi‑agent orchestration and conversational AI systems.
Desirable Skills & Experience
  • Background in voice AI, speech‑to‑text, or text‑to‑speech systems.
  • Exposure to financial services or insurance applications.
  • Familiarity with optimizing models for long‑context scenarios.

For additional information or to apply, please get in touch or apply directly.

Seniority level

Not Applicable

Employment type

Full‑time

Job function

Information Technology

#J-18808-Ljbffr

Apply