1

Director Software Engineer Gpu Jobs (NOW HIRING)

Expertise in C++ programming for GPU (CUDA or similar framework) * Bachelor degrees in EECS, coupled with a minimum of five years of industry experience * Solid understanding of GPU software stack

Software Engineer, GPU

Mountain View, CA · On-site

$204K - $259K/yr

Enthusiasm for developing the complete GPU software stack, from the hardware level to real-world ... level programming * Familiarity with GPU libraries such as Thrust, CUB, CUTLASS, or Eigen

As a GPU Kernel Engineer, you'll craft the foundation that powers modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications. You'll work in a fast-paced ...

THE ROLE We're seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration, where your code directly impacts the performance of state‑of‑the‑art machine learning ...

Principal Software Engineer, GPU Compute

San Mateo, CA · On-site

$153K - $206K/yr

As a Principal Software Engineer on the Compute team, you will be the technical anchor for Roblox's GPU and AI accelerator capabilities. This is a battle-tested GPU expert role focused on the machine ...

next page

Showing results 1-20

Director Software Engineer Gpu information

See salary details

$139K

$254K

How much do director software engineer gpu jobs pay per year?

As of Sep 5, 2026, the average yearly pay for director software engineer gpu in the United States is $243,917.00, according to ZipRecruiter salary data. Most workers in this role earn between $253,000.00 and $253,000.00 per year, depending on experience, location, and employer.

What is the difference between Director Software Engineer Gpu vs Software Engineering Manager?

AspectDirector Software Engineer GpuSoftware Engineering Manager
CredentialsBachelor's/Master's in CS or related, specialized GPU knowledgeBachelor's/Master's in CS or related, management experience
Work EnvironmentResearch and development, hardware/software integrationTeam leadership, project management
Industry UsageTech companies, hardware manufacturers, AI/ML firmsSoftware companies, tech firms, enterprise solutions

The main difference is that the Director Software Engineer Gpu focuses on technical leadership in GPU-related development, often with specialized hardware knowledge, while the Software Engineering Manager emphasizes team management and project delivery across various software projects. Both roles require strong technical backgrounds but differ in scope and focus.

More about Director Software Engineer Gpu jobs

What cities are hiring for Director Software Engineer Gpu jobs?

Cities with the most Director Software Engineer Gpu job openings:

What are the most commonly searched types of Software Engineer Gpu jobs?

The most popular types of Software Engineer Gpu jobs are:

What states have the most Director Software Engineer Gpu jobs?

States with the most job openings for Director Software Engineer Gpu jobs include:

Infographic showing various Director Software Engineer Gpu job openings in the United States as of August 2026, with employment types broken down into 89% Full Time, 8% Part Time, and 3% Contract. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution, with an average salary of $243,917 per year, or $117.3 per hour.

GPU Software Engineer/GPU Architect

Triune Infomatics Inc

San Jose, CA • On-site

$164K - $202K/yr

Other

Re-posted 12 days ago


Job description

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA (Remote/Hybrid)
Duration: Long-term >> ongoing contract
 
Overview: We''re looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You''ll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience