1

Director Software Engineer Gpu Jobs (NOW HIRING)

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Software Engineer, GPU

Mountain View, CA · On-site

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Senior Software Engineer, GPU Performance

Sunnyvale, CA · On-site

$143K - $188K/yr

They are seeking a Senior Software Engineer to optimize GPU performance for critical products, driving innovations in AI and accelerated computing. Responsibilities : • Build optimizations for the ...

OR · On-site

NVIDIA's GPU Architecture Group is looking for a software engineer to further modernize and scale GPU development. As GPU designs become more complex, our hardware models, testbenches, build scripts ...

Baseten is an innovative company powering AI solutions for leading firms like Notion and OpenEvidence, and they are seeking a GPU Kernel Engineer to enhance AI model performance. This role focuses on ...

Software Engineer - GPU Kernels

New York, NY · On-site

$180K - $360K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

As a GPU Kernel Engineer, you'll craft the foundation that powers modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications. You'll work in a fast-paced ...

Software Engineer - GPU Fabric Observability

New York, NY · On-site

$200K - $380K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

We are hiring a Lead Software Engineer to build a first-class observability and root-cause analysis system for GPU fabrics. This is a hard distributed systems problem, not a dashboarding problem. The ...

next page

Showing results 1-20

Director Software Engineer Gpu information

See salary details

$139K

$254K

How much do director software engineer gpu jobs pay per year?

As of Aug 15, 2026, the average yearly pay for director software engineer gpu in the United States is $243,917.00, according to ZipRecruiter salary data. Most workers in this role earn between $253,000.00 and $253,000.00 per year, depending on experience, location, and employer.

What is the difference between Director Software Engineer Gpu vs Software Engineering Manager?

AspectDirector Software Engineer GpuSoftware Engineering Manager
CredentialsBachelor's/Master's in CS or related, specialized GPU knowledgeBachelor's/Master's in CS or related, management experience
Work EnvironmentResearch and development, hardware/software integrationTeam leadership, project management
Industry UsageTech companies, hardware manufacturers, AI/ML firmsSoftware companies, tech firms, enterprise solutions

The main difference is that the Director Software Engineer Gpu focuses on technical leadership in GPU-related development, often with specialized hardware knowledge, while the Software Engineering Manager emphasizes team management and project delivery across various software projects. Both roles require strong technical backgrounds but differ in scope and focus.

More about Director Software Engineer Gpu jobs

What cities are hiring for Director Software Engineer Gpu jobs?

Cities with the most Director Software Engineer Gpu job openings:

What are the most commonly searched types of Software Engineer Gpu jobs?

The most popular types of Software Engineer Gpu jobs are:

What states have the most Director Software Engineer Gpu jobs?

States with the most job openings for Director Software Engineer Gpu jobs include:

Infographic showing various Director Software Engineer Gpu job openings in the United States as of August 2026, with employment types broken down into 1% Internship, 87% Full Time, 8% Part Time, and 4% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $243,917 per year, or $117.3 per hour.

GPU Software Engineer/GPU Architect

Triune Infomatics Inc

San Jose, CA • On-site

$164K - $202K/yr

Other

Re-posted 22 days ago


Job description

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA (Remote/Hybrid)
Duration: Long-term >> ongoing contract
 
Overview: We''re looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You''ll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience