ZipRecruiter

Log In

Nvidia
Nvidia

60 Nvidia Senior Software Engineering Manager Jobs Hiring Near You

Nvidia

OR

NVIDIA's software business is scaling quickly, and we're looking for a Senior Software Adoption Manager to help accelerate that growth across key verticals in North America. This is a full-time ...

Nvidia

Senior Software Engineer, NCCL

Santa Clara, CA · On-site

$143.90K - $189.70K/yr

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High ... class engineering teams are growing fast. If you're a creative and autonomous engineer with real ...

Nvidia

Senior Software Engineer - cuEquivariance

Santa Clara, CA · On-site

$143.90K - $189.70K/yr

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than ... The work spans CUDA kernel engineering, Python library development involving both PyTorch and JAX ...

Nvidia

OR

$104.40K - $143.40K/yr

... to NVIDIA's math libraries, compilers, and drivers. This is a true software engineering role. The ... Experience in continuous build and release management for Linux systems * Development of cloud ...

previous page

Showing results 41-60

All JobsNvidia JobsNvidia Senior Software Engineering Manager Jobs

Nvidia Jobs Information

What are the key skills and qualifications needed to thrive as a Senior Software Engineering Manager, and why are they important?

To thrive as a Senior Software Engineering Manager, you need a solid background in software development, strong leadership abilities, and experience managing engineering teams, often supported by a degree in computer science or a related field. Familiarity with project management tools (like Jira), cloud platforms (such as AWS or Azure), and agile methodologies is typically expected, and certifications like PMP or Scrum Master can be advantageous. Outstanding communication, strategic thinking, and mentorship skills help build high-performing teams and foster collaboration. These skills and qualities are crucial for delivering successful projects, supporting team growth, and aligning technical work with business objectives.

How does a Senior Software Engineering Manager typically balance technical leadership with team management responsibilities?

A Senior Software Engineering Manager often splits their time between providing technical guidance and overseeing team development. This means staying involved in high-level architecture decisions while also focusing on mentoring engineers, conducting performance reviews, and facilitating communication across teams. Balancing these aspects requires strong organizational skills, as managers must ensure project delivery timelines are met without sacrificing team morale or individual growth. Regular one-on-ones, sprint planning sessions, and collaboration with product managers are key parts of the weekly routine.

What is a Senior Software Engineering Manager?

A Senior Software Engineering Manager is a leadership role responsible for overseeing multiple software engineering teams or large projects within an organization. They manage engineering managers and senior engineers, define technical strategies, and ensure the successful delivery of complex software solutions. In addition to technical oversight, they are involved in talent development, process improvement, and cross-functional collaboration with other departments. Their role is crucial for aligning engineering goals with business objectives and fostering a culture of innovation and excellence.

What is it like to work at Nvidia?

Nvidia is known for its collaborative and innovative culture, prioritizing teamwork and creativity to drive technological advancements. The company's structure is organized into various teams, including research and development, engineering, and sales, with a focus on fostering open communication and knowledge sharing across departments. Working at Nvidia may appeal to candidates who are passionate about artificial intelligence, graphics, and high-performance computing, as the company offers opportunities to contribute to cutting-edge projects and collaborate with experts in the field.
What other companies are hiring for Senior Software Engineering Manager jobs?
What are the most popular jobs at Nvidia?
What are the most popular categories at Nvidia?
Infographic showing various Senior Software Engineering Manager job openings at Nvidia in the United States as of May 2026, with employment types broken down into 100% Full Time. Highlights an 85% Physical, 13% Hybrid, and 2% Remote job distribution.
Senior Software Engineer, Quantized Inference

Senior Software Engineer, Quantized Inference

Nvidia

Redmond, WA

$137.20K - $180.90K/yr

Full-time

Posted 3 days ago

Job description

We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of efficient inference recipes for LLMs. A recipe defines which operators are transformed into low-precision or sparsified variants - unlocking throughput and latency gains without regressing accuracy or verbosity. Recipes may incorporate techniques such as rotations, block scaling to attenuate outlier impact, or improved calibration data drawn from SFT/RL pipelines.

Each new recipe demands corresponding kernel and model-level implementations in inference engines (vLLM, TRT-LLM, SGLang). The candidate will translate recipe specifications into functionally correct, performant code, e.g., writing Triton kernels, inserting quantize/dequantize nodes into prefill and decode paths, and ensuring per-expert scaling in MoE layers is handled correctly. From there, the candidate will collaborate with partner inference teams to further optimize throughput and interactivity on target workloads. This work is a core component of our productization effort across Megatron-LM, ModelOpt, and vLLM.

What you'll be doing:

  • Implement quantized and sparse recipes in inference engines (vLLM, TRT-LLM, SGLang)

  • Own model export pipelines (ModelOpt, Megatron-LM <-> HuggingFace), ensuring quantized checkpoints serialize correctly for downstream serving

  • Build prototypes and benchmarking harnesses to evaluate recipe throughput/interactivity before full optimization

  • Develop data analysis tooling and visualizations for numerics debugging

  • Improve developer productivity across the team: CI, build systems, training infrastructure, pipeline friction

  • Participate in code reviews and incorporate feedback

What we need to see:

  • Proficient in Python; familiarity with C++

  • Strong software engineering fundamentals: concise, well-tested code; fluent with AI-assisted tooling

  • Experience with ML accelerators with a basic understanding of how certain ML layers affect execution time

  • Familiarity with PyTorch internals (custom ops, autograd, export) or equivalent framework

  • Experience reading, modifying, or contributing to a large open-source codebase

  • MS/PhD in Computer Science or related field, or equivalent experience.

  • 4+ years in a relevant software engineering role

  • Demonstrated ability to move fast with ambiguous requirements, with strong written and verbal communication

Ways to stand out from the crowd:

  • Experience contributing to inference serving frameworks (vLLM, TRT-LLM, SGLang) or Triton kernel development

  • Track record of debugging numerical issues across mixed-precision boundaries

  • Deep experience with model compression techniques: PTQ, QAT, structured/unstructured sparsity

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 1, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

Year founded

1993

View All Nvidia Jobs

Apply