1

Gpu Software Architect Jobs (NOW HIRING)

$103K - $127K/yr

We are looking for a talented and motivated GPU software architect with broad and deep experience in compute and machine learning software development on GPU. The ideal candidate is a technical ...

As a GPU Software Engineer, you will be equipped to develop GPU IP from the early Architectural planning process until we productize and ship millions of devices to consumers. * You will be ...

As a GPU Software Engineer, you will be equipped to develop GPU IP from the early Architectural planning process until we productize and ship millions of devices to consumers. * You will be ...

GPU Benchmark Analysis Architect

Cupertino, CA · On-site

$206K/yr

At Apple, our Platform Architecture group is responsible for connecting our hardware and software ... Description Analyze GPU workloads performance and bottlenecks various devices. Implement and/or ...

$95K - $129K/yr

As a Senior Software Architect in the GPU Networking Architecture team, you will define Software Defined Networking (SDN) architectural solutions and be part of a team of specialists who span across ...

To achieve our mission, we architect and create high-performance custom silicon; we develop system ... Solid understanding of GPU software stack * Solid understanding of key GPU hardware characteristics ...

next page

Showing results 1-20

Gpu Software Architect information

See salary details

$79K

$174K

$206K

How much do gpu software architect jobs pay per year?

As of Sep 10, 2026, the average yearly pay for gpu software architect in the United States is $174,017.00, according to ZipRecruiter salary data. Most workers in this role earn between $141,500.00 and $205,000.00 per year, depending on experience, location, and employer.

What cities are hiring for Gpu Software Architect jobs?

Cities with the most Gpu Software Architect job openings:

What states have the most Gpu Software Architect jobs?

States with the most job openings for Gpu Software Architect jobs include:

What are popular job titles related to Gpu Software Architect jobs?

For Gpu Software Architect jobs, the most frequently searched job titles are:

Infographic showing various Gpu Software Architect job openings in the United States as of June 2026, with employment types broken down into 13% As Needed, 63% Full Time, 5% Part Time, 18% Temporary, and 1% Contract. Highlights an 86% Physical, 6% Hybrid, and 8% Remote job distribution, with an average salary of $174,017 per year, or $83.7 per hour.

GPU Software Engineer/GPU Architect

San Jose, CA • On-site

Triune Infomatics Inc
IT Services • 51 - 200 employees

$164K - $202K/yr

Other

Re-posted 18 days ago


Job description

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA (Remote/Hybrid)
Duration: Long-term >> ongoing contract
 
Overview: We''re looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You''ll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience