ZipRecruiter

Log In

1

Llm Product Manager Jobs (NOW HIRING)

Validity

Sr. Product Manager, AI

Boston, MA · On-site

Stay current on AI/LLM developments and identify opportunities to leverage new capabilities Required Experience, Skills, and Education * 7+ years of product management experience, with at least one ...

Validity

Sr. Product Manager, AI

Boston, MA · On-site

$175K - $210K/yr

Stay current on AI/LLM developments and identify opportunities to leverage new capabilities Required Experience, Skills, and Education * 7+ years of product management experience, with at least one ...

OpusClip

AI Product Manager

Palo Alto, CA · On-site

... LLM) products, particularly in recommendation systems. • Excellent collaboration skills, with the ability to work effectively with cross-functional teams and comfortable collaborating with ...

Validity

Sr. Product Manager, AI

Boston, MA · On-site

$175K - $210K/yr

Stay current on AI/LLM developments and identify opportunities to leverage new capabilities ... of product management experience, with at least one year of building AI/ML or LLM‑powered ...

Agoda

Technical Product Manager, LLM/ML Domain

Manhattan, NY · On-site

$183K - $212K/yr

They are seeking a Technical Product Manager to lead the development of their ML & LLM Ops platforms, facilitating the production and scaling of machine learning applications while ensuring seamless ...

Agoda

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

They are seeking a Technical Product Manager to lead the development of their ML & LLM Ops platforms, facilitating the production and scaling of machine learning applications while ensuring seamless ...

Agoda

Technical Product Manager, LLM/ML Domain

Seattle, WA · On-site

$190K - $219K/yr

They are seeking a Technical Product Manager to lead the development of their ML & LLM Ops platforms, facilitating the production and scaling of machine learning applications while ensuring seamless ...

Greenlite

Product Manager

New York, NY · Hybrid

What You'll Do We're looking for a Product Manager to own products end-to-end, from 0 to 1 and ... Experience building or shipping AI/LLM features in production (evals, retrieval, going from demo to ...

next page

Showing results 1-20

All JobsLlm Product JobsLlm Product Manager Jobs

Llm Product Manager information

See salary details

$51.5K

$159.4K

$197K

How much do llm product manager jobs pay per year?

As of Sep 10, 2026, the average yearly pay for llm product manager in the United States is $159,405.00, according to ZipRecruiter salary data. Most workers in this role earn between $141,000.00 and $197,000.00 per year, depending on experience, location, and employer.

What is an LLM Product Manager?

LLM Product Managers are professionals responsible for leading the development and management of products that leverage large language models (LLMs), such as those based on artificial intelligence and machine learning. They work at the intersection of technology, business, and user experience, collaborating with engineering, data science, and design teams to define product vision, strategy, and features. Their role includes understanding user needs, prioritizing product features, ensuring responsible AI deployment, and measuring product performance. LLM Product Managers often need a strong understanding of AI technologies and market trends to guide their teams effectively.

How does an LLM Product Manager typically collaborate with engineering and data science teams during the product development lifecycle?

An LLM Product Manager works closely with engineering and data science teams to define product requirements, set priorities, and ensure alignment on technical feasibility. They facilitate regular meetings to clarify objectives, manage timelines, and address challenges related to model training, data quality, or deployment. This role often serves as a bridge between business goals and technical execution, ensuring that the product meets user needs while leveraging the latest advancements in large language models. Effective communication and cross-functional teamwork are essential for delivering high-quality AI-driven solutions.

What are the key skills and qualifications needed to thrive as an LLM Product Manager, and why are they important?

To thrive as an LLM Product Manager, you need a strong background in product management, AI/ML fundamentals, and experience with large language models, typically supported by a relevant degree. Familiarity with machine learning frameworks, cloud platforms, and tools like TensorFlow, PyTorch, and API management systems is essential. Exceptional communication, problem-solving, and cross-functional leadership skills help you collaborate with engineering, data science, and business teams. These skills are crucial for effectively guiding product development, aligning technical capabilities with user needs, and ensuring successful product launches in the evolving AI landscape.

What are popular job titles related to Llm Product Manager jobs?

For Llm Product Manager jobs, the most frequently searched job titles are:

Infographic showing various Llm Product Manager job openings in the United States as of August 2026, with employment types broken down into 88% Full Time, 11% Part Time, and 1% Contract. Highlights an 85% Physical, 2% Hybrid, and 13% Remote job distribution, with an average salary of $159,405 per year, or $76.6 per hour.

AI/LLM Product Manager - Senior Associate

Manhattan, NY • On-site

JP Morgan Chase
Finance and Insurance • 10K+ employees
Learn more about JP Morgan Chaseexternal

$139K - $184K/yr

Full-time

Medical, Retirement

This job post has expired 1 day ago. Applications are no longer accepted.

JPMorgan Chase & Co. rating

7.9

Company rating: 7.9 out of 10

Based on 500 frontline employees who took The Breakroom Quiz

Job description

Join us in building the next generation of AI and autonomous agents to solve missioncritical operational and banking productivity challenges at the scale of the world's largest bank. In this role, you'll own AI use cases endtoend-from discovery and problem framing through requirements, delivery, and longterm reliability. You'll design, build, and extend production-grade agentic systems, partnering closely with data science, engineering, and business stakeholders. Success means more than shipping: you'll be accountable for performance, safety, and daytoday behavior once real bankers rely on these capabilities. 

Key Responsibilities 

  • Define product requirements, features, and roadmap components for AI use cases, translating business problems into agentic solutions and workflows. 
  • Lead end-to-end delivery from pilot through production, owning what the agent does, what it is permitted to do, how it acts under uncertainty, and where autonomy boundaries sit. 
  • Build and extend the agents and the net-new infrastructure they depend on: the services, APIs, and integrations that surround the model and make the system work. 
  • Drive model validation, performance monitoring, drift detection, and iterative improvement, keeping behavior correct as you ship and extend. 
  • Manage backlog prioritization, sprint planning, and delivery tracking. 
  • Partner with stakeholders to identify opportunities for AI-driven efficiency or revenue growth, and run user feedback sessions, folding insights into product enhancements. 
  • Define success metrics and measure business impact, including reliability, adoption, and reuse. 
  • Ensure alignment with data governance, compliance, and risk standards, working across Engineering, Data Science, Controls, and the business. 

Required Skills & Experience 

  • 3-6+ years in product management, data products, or technology delivery, or equivalent expertise. 
  • Have shipped an LLM-powered, autonomous, or agentic system to production 
  • Demonstrated experience designing and running evals for such systems as needed to meet product driven success criteria. You reason about probabilistic behavior and drift, not deterministic pass or fail. 
  • Strong understanding of the AI/ML lifecycle (training, validation, deployment, monitoring) 
  • Understanding of production-grade data judgment: what good data looks like, where it degrades, pipeline stability, and how quality propagates into behavior. 
  • Experience building net-new infrastructure and integrations, with the ability to hold your own on architecture, APIs, and data pipelines. 
  • Experience working with cross-functional teams (Tech, Data Science, Business), with strong communication and stakeholder-management skills. 
  • Comfort operating inside a large, regulated institution where governance and controls are design inputs, not obstacles. 
  • Ability to ship AI-enabled products and lead complex programs in large, matrixed organizations. 
  • Previous experience in commercial and investment banking a plus 

Success Profile 

Ownership mindset. Takes a use case from ambiguous problem to reliable production system and stays accountable for how it behaves. Builds for an institution, not a demo. Treats governance, auditability, and real constraints as the interesting part of the problem, and knows the difference between a weekend prototype and a system bankers depend on. 

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. 

What JPMorgan Chase & Co. employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply