1

Director Software Engineer Gpu Jobs (NOW HIRING)

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Software Engineer, GPU

Mountain View, CA · On-site

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Software Engineer, GPU

Mountain View, CA · On-site +1

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Software Engineer, GPU

Manhattan, NY · On-site +1

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Software Engineer, GPU Performance

Sunnyvale, CA · On-site

$163K/yr

Google is seeking a Software Engineer specializing in GPU Performance to develop next-generation technologies that enhance how users interact with information. The role involves building ...

We are seeking software engineers to work on the architecture of NVIDIA GPU Diagnostic SW. Our charter is to develop the most demanding applications a GPU or high-performance computing server will ...

Software Engineer, GPU Performance

Sunnyvale, CA · On-site

$164K/yr

... software development in one or more programming languages, or 1 year of experience with an advanced degree. * Experience low-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance ...

We are seeking a System Software Engineer to work on next-generation computing and graphics products. Our charter is to build low level GPU testing frameworks to validate GPUs early in the life cycle.

We are seeking a System Software Engineer to work on next-generation computing and graphics products. Our charter is to build low level GPU testing frameworks to validate GPUs early in the life cycle.

... software design and architecture. • Experience with modern GPU architectures (NVIDIA, AMD, or ... Preferred : • Master's degree or PhD in Engineering, Computer Science, or a related technical ...

next page

Showing results 1-20

Director Software Engineer Gpu information

See salary details

$139K

$254K

How much do director software engineer gpu jobs pay per year?

As of Jun 9, 2026, the average yearly pay for director software engineer gpu in the United States is $243,917.00, according to ZipRecruiter salary data. Most workers in this role earn between $253,000.00 and $253,000.00 per year, depending on experience, location, and employer.

What is the difference between Director Software Engineer Gpu vs Software Engineering Manager?

AspectDirector Software Engineer GpuSoftware Engineering Manager
CredentialsBachelor's/Master's in CS or related, specialized GPU knowledgeBachelor's/Master's in CS or related, management experience
Work EnvironmentResearch and development, hardware/software integrationTeam leadership, project management
Industry UsageTech companies, hardware manufacturers, AI/ML firmsSoftware companies, tech firms, enterprise solutions

The main difference is that the Director Software Engineer Gpu focuses on technical leadership in GPU-related development, often with specialized hardware knowledge, while the Software Engineering Manager emphasizes team management and project delivery across various software projects. Both roles require strong technical backgrounds but differ in scope and focus.

More about Director Software Engineer Gpu jobs
What cities are hiring for Director Software Engineer Gpu jobs? Cities with the most Director Software Engineer Gpu job openings:
What are the most commonly searched types of Software Engineer Gpu jobs? The most popular types of Software Engineer Gpu jobs are:
What states have the most Director Software Engineer Gpu jobs? States with the most job openings for Director Software Engineer Gpu jobs include:
GPU Software Engineer/GPU Architect

GPU Software Engineer/GPU Architect

Triune Infomatics Inc

San Jose, CA

$164K - $202K/yr

Other

Posted 14 days ago


Job description

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA
Duration: Long-term >> ongoing contract
 
Overview: We're looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You'll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience