1

Large Language Model Llm Jobs in California (NOW HIRING)

About the Role We're seeking an experienced LLM Inference Engineer to optimize our large language model (LLM) serving infrastructure. The ideal candidate has: * Extensive hands-on experience with ...

next page

Showing results 1-20

Large Language Model Llm information

What are some common challenges faced by Large Language Model (LLM) Engineers in their day-to-day work?

LLM Engineers often encounter challenges related to scaling models efficiently, optimizing performance on large and complex datasets, and ensuring the responsible use of AI technologies. Balancing the trade-offs between model accuracy, speed, and ethical considerations can be demanding, especially as real-world applications often require rapid iterations and rigorous testing. Additionally, staying updated with the latest research advancements and integrating new methods into production systems is an ongoing responsibility. Many engineers tackle these challenges by working closely with data scientists, researchers, and product teams in collaborative, agile environments.

What is a Large Language Model (LLM) job?

A Large Language Model (LLM) job typically involves working with advanced AI models designed to understand and generate human-like text. Roles in this field may include research, data engineering, model fine-tuning, prompt engineering, or application development. Professionals in LLM jobs often work with machine learning algorithms, natural language processing (NLP), and large-scale datasets to enhance AI capabilities. These roles are common in AI-driven industries, including tech companies, research institutions, and startups. Strong programming skills, knowledge of deep learning frameworks, and expertise in NLP are often required.

Which 3 jobs will survive AI?

Large Language Model (LLM) specialists, healthcare professionals, and skilled tradespeople are likely to continue thriving as AI automates routine tasks. These roles require complex decision-making, emotional intelligence, or manual skills that are difficult for AI to replicate fully. Continuous learning and adaptability remain important for job security in these fields.

What jobs can I do with LLM?

Large Language Models (LLMs) are used in roles such as AI research scientist, NLP engineer, data scientist, and machine learning engineer. These jobs involve developing, fine-tuning, and deploying LLMs, often requiring skills in programming, data analysis, and understanding of AI frameworks like TensorFlow or PyTorch.

What are the key skills and qualifications needed to thrive in the Large Language Model Llm position, and why are they important?

Excelling in the role of a Large Language Model (LLM) Engineer requires strong expertise in natural language processing, machine learning, and computer programming, often supported by an advanced degree in computer science or a related field. Familiarity with industry-standard frameworks like PyTorch or TensorFlow, as well as experience with cloud computing platforms and large-scale data management, is highly valued. Communication, creativity, and problem-solving are essential soft skills to effectively collaborate with cross-functional teams and innovate solutions. These skills ensure the development, deployment, and refinement of powerful language models that can address diverse business needs and technical challenges.

What jobs pay 500,000 a year?

High-paying jobs that can reach or exceed $500,000 annually include executive roles such as CEOs, CFOs, and other C-suite positions, as well as specialized professions like top-tier surgeons, investment bankers, and successful entrepreneurs. These roles typically require extensive experience, advanced skills, and often involve leadership, risk management, or highly specialized expertise.

What is a $900000 AI job?

A $900,000 AI job typically refers to high-level positions in artificial intelligence, such as senior machine learning engineers, AI research directors, or chief AI officers, often requiring advanced skills in deep learning, data science, and programming. These roles usually involve leadership, strategic planning, and extensive experience, and they may be found in large tech companies or specialized AI firms. Compensation at this level reflects significant expertise and responsibility in developing and deploying AI systems.
What are the most commonly searched types of Large Language Model Llm jobs in California? The most popular types of Large Language Model Llm jobs in California are:
What are popular job titles related to Large Language Model Llm jobs in California? For Large Language Model Llm jobs in California, the most frequently searched job titles are:
What job categories do people searching Large Language Model Llm jobs in California look for? The top searched job categories for Large Language Model Llm jobs in California are:
What cities in California are hiring for Large Language Model Llm jobs? Cities in California with the most Large Language Model Llm job openings:
Infographic showing various Large Language Model Llm job openings in California as of July 2026, with employment types broken down into 1% As Needed, 71% Full Time, 23% Part Time, 1% Temporary, and 4% Contract. Highlights an 92% Physical, 1% Hybrid, and 7% Remote job distribution.

Manager, Large Language Model Inference

Nvidia Corporation

Santa Clara, CA • On-site

Full-time

Re-posted 26 days ago


Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 17 frontline employees who took The Breakroom Quiz

8th of 246 rated software companies


Job description

At NVIDIA, we aren't just powering the AI revolution-we're accelerating it. The TensorRT inference platform is the backbone of modern AI, delivering the industry's fastest and most efficient deployment of cutting-edge deep learning models on every NVIDIA GPU. With demand for AI exploding, particularly in the realm of large language models (LLMs) and vision language models (VLMs, VLAs), we are significantly expanding our team. We're seeking a highly skilled and driven Engineering Manager to take the lead in developing the next generation of LLM/VLM/VLA inference software technologies that will define the future of AI. This is a high-impact, hands-on leadership role at the intersection of deep technical expertise and world-class management. You won't just manage; you'll architect and guide a brilliant team of engineers who are building the core LLM inference runtime. Your work will be highly collaborative, interfacing directly with NVIDIA Researchers, GPU Architects, and other teams across the company to ensure we ship production-grade, lightning-fast software that sets the global standard for AI performance.
What You'll Be Doing:
  • Lead and grow a team responsible for specialized kernel development, runtime optimizations, and frameworks for LLM inference.
  • Drive the design, development, and delivery of production inference software, targeting NVIDIA's next-generation enterprise and edge hardware platforms.
  • Integrating cutting-edge technologies developed at NVIDIA and offering an intuitive developer experience for LLM deployment.
  • Lead software development execution, with responsibility for project planning, milestone delivery, and cross-functional coordination.

What We Need to See:
  • MS, PhD, or equivalent experience in Computer Science, Computer Engineering, AI, or a related technical field.
  • 7+ overall years of overall software engineering experience, including 3+ years of technical leadership experience.
  • Proven ability to lead and scale high-performing engineering teams, especially across distributed and cross-functional groups.
  • Strong background in C++ or Python, with expertise in software design and delivering production-quality software libraries.
  • Demonstrated expertise in large language models (LLM) and/or vision language models (VLM).

Ways to Stand Out from the Crowd:
  • Deep understanding of GPU architecture, CUDA programming, and system-level performance tuning.
  • Background in LLM inference or working with frameworks such as TensorRT-LLM, vLLM, or SGLang.
  • Passion for building scalable, user-friendly APIs and enabling developers in the AI ecosystem.
  • Have a proven track record of growing and managing a team that encourages idea sharing, empowers team members, and provides opportunities for professional growth.

We are widely considered to be one of the technology world's most desirable employers, and we have some of the most forward-thinking and hardworking people in the world working with us. Due to outstanding growth, our best-in-class teams are rapidly growing. If you're a creative self-starter with a real passion for technology, then come join us.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 2, and 224,000 USD - 356,500 USD for Level 3.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until March 26, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

Year founded

1993