1

Llm Developer Jobs in Massachusetts (NOW HIRING)

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

Required : • 5+ years of experience in ML engineering, data science, platform engineering, or a ... with ML Ops and/or LLM Ops concepts (model lifecycle, evaluation, monitoring, versioning ...

next page

Showing results 1-20

Llm Developer information

See Massachusetts salary details

$27

$54

$86

How much do llm developer jobs pay per hour?

As of Aug 23, 2026, the average hourly pay for llm developer in Massachusetts is $54.79, according to ZipRecruiter salary data. Most workers in this role earn between $43.08 and $66.44 per hour, depending on experience, location, and employer.

What does an LLM Developer do?

An LLM Developer designs, fine-tunes, and implements large language models (LLMs) for various applications, such as chatbots, content generation, and AI-driven tools. They work with machine learning frameworks, optimize model performance, and ensure efficient deployment. This role requires expertise in natural language processing (NLP), deep learning, and programming languages like Python.

What are the key skills and qualifications needed to thrive as an LLM Developer?

To excel as an LLM Developer, you need strong expertise in natural language processing (NLP), deep learning frameworks, and programming languages such as Python, typically supported by a degree in computer science or a related field. Familiarity with machine learning libraries (like TensorFlow or PyTorch), cloud computing platforms, and experience with prompt engineering or fine-tuning large language models is crucial. Excellent problem-solving abilities, collaboration, and effective communication skills help you design solutions and work efficiently within multidisciplinary teams. These qualifications are essential for successfully building, deploying, and optimizing large language models that drive impactful AI applications.

What is the role of a large language model developer?

A large language model developer designs, trains, and fine-tunes AI models that understand and generate human language. They work with machine learning frameworks, manage large datasets, and optimize models for accuracy and efficiency, often requiring knowledge of programming, deep learning, and natural language processing techniques.

What are the most commonly searched types of Llm Developer jobs in Massachusetts?

The most popular types of Llm Developer jobs in Massachusetts are:

What job categories do people searching Llm Developer jobs in Massachusetts look for?

The top searched job categories for Llm Developer jobs in Massachusetts are:

What cities in Massachusetts are hiring for Llm Developer jobs?

Cities in Massachusetts with the most Llm Developer job openings:

Infographic showing various Llm Developer job openings in Massachusetts as of August 2026, with employment types broken down into 85% Full Time, 2% Part Time, and 13% Contract. Highlights an 80% Physical, 6% Hybrid, and 14% Remote job distribution, with an average salary of $113,956 per year, or $54.8 per hour.

Technical Product Manager, LLM/ML Domain

Agoda

Boston, MA • On-site

$181K - $209K/yr

Full-time

Re-posted 3 days ago


Job description

Job Summary:
Agoda is a travel technology company that is part of Booking Holdings, aiming to enhance travel experiences through innovation. They are seeking a Technical Product Manager to lead the development of their ML & LLM Ops platforms, facilitating the production and scaling of machine learning applications while ensuring seamless integration with AI-assisted development workflows.
Responsibilities:
• Define and evolve the product vision and roadmap for Agoda’s ML & LLM Ops platforms
• Shape how teams productionize ML models and LLM-powered applications
• Identify platform gaps, scalability constraints, and optimization opportunities
• Drive the evolution of our platform to support AI-native development workflows and coding agents
• Gather requirements from ML engineers, data scientists, backend engineers, and AI application teams
• Translate complex technical needs into clear product requirements and prioritization frameworks
• Proactively identify opportunities to reduce friction, improve reliability, and increase deployment velocity
• Balance experimentation flexibility with governance, safety, and cost efficiency
• Own features end-to-end: concept, specification, prioritization, implementation, and post-launch analysis
• Partner closely with engineering to balance platform scalability, performance, and technical debt
• Ensure platform capabilities support monitoring, evaluation, retraining, versioning, and observability of ML/LLM systems
• Drive adoption through documentation, training, and internal evangelism
• Collaborate with engineering to level up Agoda’s platforms to be more compatible with AI coding assistants and autonomous agents
• Ensure platform APIs, tooling, and abstractions enable meaningful AI-generated code contributions
• Help define guardrails and workflows that allow safe, reliable AI-assisted development
Qualifications:
Required:
• 5+ years of experience in ML engineering, data science, platform engineering, or a related technical domain
• 2+ years of technical product or program management experience in fast-paced, high-scale environments
• Experience working with ML Ops and/or LLM Ops concepts (model lifecycle, evaluation, monitoring, versioning, deployment pipelines)
• Strong understanding of ML systems and model lifecycle management
• Familiarity with LLM application patterns (RAG, fine-tuning, prompt management, evaluation frameworks, etc.)
• Comfortable discussing architecture, APIs, infrastructure trade-offs, and scalability concerns with senior engineers
• Strong analytical mindset with the ability to reason about system design, performance, and cost trade-offs
• Strong cross-functional leadership skills and ability to influence without authority
• Comfortable operating in ambiguity and rapidly evolving technological landscapes
• Excellent communication skills — able to translate between business, platform engineering, and AI application teams
• Proactive, structured thinker with a strong problem-solving mindset
• High ownership and bias for impact
Company:
Agoda is a digital travel platform that provides access to hotels and holiday properties including flights. It is a sub-organization of Booking Holdings. Founded in 2005, the company is headquartered in Singapore, SGP, with a team of 5001-10000 employees. The company is currently Late Stage.