ZipRecruiter

Log In

1

Manager Llm Ai Jobs (NOW HIRING)

Mercor

Project Manager - LLM Specialist

New York, NY · Remote

$50 - $60/hr

About the job Mercor connects elite creative and technical talent with leading AI research labs ... Expert Project Manager Type: Contract Compensation: $50-$60/hour Location: Remote Role ...

Agoda

Technical Product Manager, LLM/ML Domain

Manhattan, NY · On-site

$183K - $212K/yr

... AI-assisted development workflows. Responsibilities : • Define and evolve the product vision and ... management • Familiarity with LLM application patterns (RAG, fine-tuning, prompt management ...

Agoda

Technical Product Manager, LLM/ML Domain

Seattle, WA · On-site

$190K - $219K/yr

... AI-assisted development workflows. Responsibilities : • Define and evolve the product vision and ... management • Familiarity with LLM application patterns (RAG, fine-tuning, prompt management ...

Agoda

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

... AI-assisted development workflows. Responsibilities : • Define and evolve the product vision and ... management • Familiarity with LLM application patterns (RAG, fine-tuning, prompt management ...

Photon

Lead AI Engineer | Onsite - Delaware

Wilmington, DE · On-site

$99K - $131K/yr

Own latency profiling , AI observability , and cost tracking/management for LLM-backed systems ... Run day-to-day delivery of the offshore development team: sprint commitments, code/design review ...

Photon

Lead AI Engineer | Onsite - Delaware

Wilmington, DE

$99K - $131K/yr

Own latency profiling , AI observability , and cost tracking/management for LLM-backed systems ... Run day-to-day delivery of the offshore development team: sprint commitments, code/design review ...

next page

Showing results 1-20

All JobsEducation JobsBusiness Education JobsBusiness Trainer JobsManager Llm Ai Jobs

Manager Llm Ai information

See salary details

$9

$26

$54

How much do manager llm ai jobs pay per hour?

As of Aug 27, 2026, the average hourly pay for manager llm ai in the United States is $26.35, according to ZipRecruiter salary data. Most workers in this role earn between $17.31 and $32.69 per hour, depending on experience, location, and employer.

What is the difference between Manager Llm Ai vs Data Scientist?

AspectManager Llm AiData Scientist
Required CredentialsMaster's or PhD in AI, Machine Learning, or related fields; leadership experienceBachelor's or Master's in Data Science, Computer Science, or related fields
Work EnvironmentLeads AI projects, manages teams, collaborates with stakeholdersAnalyzes data, develops models, reports insights
Employer & Industry UsageTech companies, AI startups, R&D departmentsTech firms, finance, healthcare, research institutions

The main difference is that a Manager Llm Ai oversees AI projects and teams, focusing on strategic implementation, while a Data Scientist primarily analyzes data and develops models. Managers handle leadership and project management, whereas Data Scientists focus on technical analysis and model development.

More about Manager Llm Ai jobs

What cities are hiring for Manager Llm Ai jobs?

Cities with the most Manager Llm Ai job openings:

What are the most commonly searched types of Llm Ai jobs?

The most popular types of Llm Ai jobs are:

What states have the most Manager Llm Ai jobs?

States with the most job openings for Manager Llm Ai jobs include:

What job categories do people searching Manager Llm Ai jobs look for?

The top searched job categories for Manager Llm Ai jobs are:

Manager Llm Ai jobs near you
Infographic showing various Manager Llm Ai job openings in the United States as of August 2026, with employment types broken down into 88% Full Time, 11% Part Time, and 1% Contract. Highlights an 80% Physical, 2% Hybrid, and 18% Remote job distribution, with an average salary of $54,806 per year, or $26.3 per hour.

Engineering Manager, LLM Performance

Santa Clara, CA • On-site

Nvidia Corporation
Computer and Electronic Product Manufacturing • 10K+ employees

9.6

Company rating: 9.6 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

7th of 246 rated software companies

Great coworkers

People enjoy working here

Good employer

Learn more about Nvidia Corporationexternal

Full-time

Re-posted 2 days ago

Job description

At NVIDIA, we aren't just powering the AI revolution-we're accelerating it. We are accelerating LLM inference across the stack and across all open source LLM frameworks like TensorRT LLM, vLLM and SGLang. With demand for AI exploding, particularly in the realm of large language models (LLMs) and vision language models (VLMs, VLAs), we are significantly expanding our team.
We're seeking a highly skilled and driven Engineering Manager to take the lead in accelerating the next generation of LLM/VLM/VLA inference software technologies that will define the future of AI. This is a high-impact, hands-on leadership role at the intersection of deep technical expertise and world-class management. You won't just manage; you'll architect and guide a brilliant team of engineers who are pushing the performance of LLM inference. Your work will be highly collaborative, interfacing directly with NVIDIA Researchers, GPU Architects, and other teams across the company to ensure we ship production-grade, lightning-fast software that sets the global standard for AI performance.
What You'll Be Doing:
  • Lead and grow a team responsible for pushing the performance of LLM inference across multiple LLM frameworks, including TensorRT LLM, vLLM, SGLang and Dynamo on our datacenter products.
  • Drive the design, implementation and optimization of features that are key to performance in LLM inference.
  • Continuously improve the performance of LLM inference on current and upcoming NVIDIA datacenter architectures and GPUs.
  • Continuously improve the performance of LLM inference of important foundation models.
  • Work with inference benchmark teams to help tune performance for key workloads.
  • Integrating cutting-edge technologies developed at NVIDIA and offering an intuitive developer experience for LLM deployment.
  • Lead software development execution, with responsibility for project planning, milestone delivery, and cross-functional coordination.

What We Need to See:
  • MS, PhD, or equivalent experience in Computer Science, Computer Engineering, AI, or a related technical field.
  • 7+ overall years of overall software engineering experience, including 3+ years of technical leadership experience.
  • Proven ability to lead and scale high-performing engineering teams, especially across distributed and cross-functional groups.
  • Strong background in C++ or Python, with expertise in software design and delivering production-quality software libraries.
  • Demonstrated expertise in large language models (LLM) and/or vision language models (VLM) and/or inference in general.

Ways to Stand Out from the Crowd:
  • Deep understanding of GPU architecture, CUDA programming, and system-level performance tuning.
  • Background in LLM inference or working with frameworks such as TensorRT-LLM, vLLM, or SGLang.
  • Passion for building scalable, user-friendly APIs and enabling developers in the AI ecosystem.
  • Have a proven track record of growing and managing a team that encourages idea sharing, empowers team members, and provides opportunities for professional growth.

#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 431,250 USD for Level 4.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until August 9, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

View All Nvidia Jobs

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply