The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
Senior Software Engineer, CUDA Deep Learning Systems
OR · On-site +1
$122K - $161K/yr
Explore, research, and prototype novel systems optimizations for advanced deep learning models at ... the intersection of high-level DL frameworks and low-level CUDA through modeling, simulation, and ...
Senior Software Engineer, CUDA Deep Learning Systems
OR · On-site +1
$122K - $161K/yr
Explore, research, and prototype novel systems optimizations for advanced deep learning models at ... the intersection of high-level DL frameworks and low-level CUDA through modeling, simulation, and ...
Engineering Manager, Deep Learning Inference
OR · On-site +1
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
Engineering Manager, Deep Learning Inference
OR · On-site +1
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
Engineering Manager, Deep Learning Inference
OR · On-site +1
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
Engineering Manager, Deep Learning Inference
OR · On-site +1
The Deep Learning Inference team develops and optimizes open-source frameworks that make AI ... Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized ...
Applied Scientist, AI & Deep Learning
Cambridge, MA · On-site +1
$120K - $200K/yr
The resulting research and development help to continuously advance government programs and ... Ability to accommodate a hybrid schedule (60% onsite 40% remote) Our preferred candidate has: * 5+ ...
Applied Scientist, AI & Deep Learning
Cambridge, MA · On-site +1
$120K - $200K/yr
The resulting research and development help to continuously advance government programs and ... Ability to accommodate a hybrid schedule (60% onsite 40% remote) Our preferred candidate has: * 5+ ...
Senior Deep Learning Compiler Engineer - XLA
OR · On-site +1
$104K - $143K/yr
More recently, GPU deep learning ignited modern AI - the next era of computing - with the GPU ... research experience in performance analysis and compiler optimizations Ability to work ...
Senior Deep Learning Compiler Engineer - XLA
OR · On-site +1
$104K - $143K/yr
More recently, GPU deep learning ignited modern AI - the next era of computing - with the GPU ... research experience in performance analysis and compiler optimizations Ability to work ...
Research and develop machine learning methods exploiting optimization, sampling, and quantum ... An advanced degree (MS/PhD) in a STEM field, or added years of deep industry experience
Research and develop machine learning methods exploiting optimization, sampling, and quantum ... An advanced degree (MS/PhD) in a STEM field, or added years of deep industry experience
Machine Learning Engineer
Louisville, CO · On-site +1
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Quick apply
Machine Learning Engineer
Louisville, CO · On-site +1
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Senior Machine Learning Researcher (Remote - US)
$175K - $300K/yr
Stay current with the latest research in machine learning, deep learning, and AI, ensuring new ... We had remote employees long before the pandemic and our team is now distributed across three ...
Senior Machine Learning Researcher (Remote - US)
$175K - $300K/yr
Stay current with the latest research in machine learning, deep learning, and AI, ensuring new ... We had remote employees long before the pandemic and our team is now distributed across three ...
Machine Learning Engineer
$162K - $170K/yr
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Machine Learning Engineer
$162K - $170K/yr
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Design and execute experiments to validate R&D deep learning approaches. * When experiments have ... Remote or Hybrid: * Full-remote with regular travel to AMP's Louisville CO HQ or * Hybrid or ...
Machine Learning Research Engineer (MLRE) - GPUs
New York, NY · On-site +1
$164K - $259K/yr
... remote candidates of exceptional talent who are willing to travel frequently to our two office ... Deep understanding of GPU programming fundamentals. * Solid track record of observable artifacts (e ...
Machine Learning Research Engineer (MLRE) - GPUs
New York, NY · On-site +1
$164K - $259K/yr
... remote candidates of exceptional talent who are willing to travel frequently to our two office ... Deep understanding of GPU programming fundamentals. * Solid track record of observable artifacts (e ...
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
Senior Deep Learning Performance Architect - LPU
OR · On-site +1
... research, and product teams What we need to see: A MS or PhD in a relevant field (CS, EE, Math) or ... in machine learning and deep learning Expert programming skills in C, C++, and/or Python ...
Senior Deep Learning Performance Architect - LPU
OR · On-site +1
... research, and product teams What we need to see: A MS or PhD in a relevant field (CS, EE, Math) or ... in machine learning and deep learning Expert programming skills in C, C++, and/or Python ...
Senior Deep Learning Software Infrastructure Engineer
OR · On-site +1
$108K - $147K/yr
We are in search of a Deep Learning Software Infrastructure Engineer to propel NVIDIA's Autonomous ... Collaborating with researchers, model engineers, and internal platform teams to enhance efficiency ...
Senior Deep Learning Software Infrastructure Engineer
OR · On-site +1
$108K - $147K/yr
We are in search of a Deep Learning Software Infrastructure Engineer to propel NVIDIA's Autonomous ... Collaborating with researchers, model engineers, and internal platform teams to enhance efficiency ...
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
Quick apply
The Opportunity This is an R&D position in attention-based models. We are currently searching for 1 ... A deep learning researcher , with a track record in Language Models and/or RL (candidates with a ...
Early-stage robot learning research and system development. * Reports to : Co-founder / CTO. * Core ... If you want deep ownership on a hard problem from day one, this is the role. Your First Year
Early-stage robot learning research and system development. * Reports to : Co-founder / CTO. * Core ... If you want deep ownership on a hard problem from day one, this is the role. Your First Year
Remote Deep Learning Research information
What cities are hiring for Remote Deep Learning Research jobs?
Cities with the most Remote Deep Learning Research job openings:
What are the most commonly searched types of Deep Learning Research jobs?
The most popular types of Deep Learning Research jobs are:
What states have the most Remote Deep Learning Research jobs?
States with the most job openings for Remote Deep Learning Research jobs include:
What are popular job titles related to Remote Deep Learning Research jobs?
For Remote Deep Learning Research jobs, the most frequently searched job titles are:
Engineering Manager, Deep Learning Inference
New York, NY • On-site, Remote
Nvidia •
Computer and Electronic Product Manufacturing • 10K+ employees10,000+ employees
Full-time
Re-posted 4 days ago
Key responsibilities
Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
Drive the strategy, roadmap, and execution of NVIDIA's inference frameworks engineering, focusing on Client AI.
Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications.
Nvidia rating
9.6
Based on 18 frontline employees who took The Breakroom Quiz
6th of 247 rated software companies
Job description
NVIDIA is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of AI model deployment. You will shape the software powering today's most sophisticated AI systems - from large language models to multimodal generative AI - all accelerated on NVIDIA GPUs. The Deep Learning Inference team develops and optimizes open-source frameworks that make AI deployment scalable, efficient, and accessible - including vLLM / SGLang, and FlashInfer. Our work enables developers worldwide to harness NVIDIA accelerators for real-time inference at every scale, from datacenter clusters to edge devices.
What you'll be doing:
Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
Drive the strategy, roadmap, and execution of NVIDIA's inference frameworks engineering, focusing on Client AI.
Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized inference pipelines across NVIDIA accelerators.
Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications.
Guide engineers in adopting best practices for CUDA, Triton, CUTLASS, and multi-GPU communications (NIXL, NCCL, NVSHMEM).
Represent the team in roadmap and planning discussions, ensuring alignment with NVIDIA's broader AI and software strategies.
Foster a culture of technical excellence, open collaboration, and continuous innovation.
What we need to see:
MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a related field.
6+ overall years of software development experience, including 3+ years in technical leadership or engineering management.
Strong background in C/C++ software design and development; proficiency in Python is a plus.
Hands-on experience with GPU programming (CUDA, Triton, CUTLASS) and performance optimization.
Proven record of deploying or optimizing deep learning models in production environments.
Experience leading teams using Agile or collaborative software development practices.
Ways to Stand out from The Crowd:
Significant open-source contributions to deep learning or inference frameworks such as PyTorch, vLLM / SGLang, Triton, or TensorRT-LLM.
Deep understanding of multi-GPU communications (NIXL, NCCL, NVSHMEM) and distributed inference architectures.
Expertise in performance modeling, profiling, and system-level optimization across CPU and GPU platforms.
Proven ability to mentor engineers, guide architectural decisions, and deliver complex projects with measurable impact.
Publications, patents, or talks on LLM serving, model optimization, or GPU performance engineering.
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, our rapid growth means endless opportunities for career advancement. If you're a passionate technical leader ready to shape the future of AI inference frameworks - and build the software that powers the world's most advanced models - we'd love to hear from you.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 2, and 224,000 USD - 356,500 USD for Level 3.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
About Nvidia
Sourced by ZipRecruiter
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.
Industry
Computer and electronic product manufacturing
Company size
10,000+ Employees
Headquarters location
Santa Clara, CA, US