ZipRecruiter

Log In

1

Software Engineer Gpu Jobs (NOW HIRING)

Waymo

Software Engineer, GPU

Mountain View, NY

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Waymo

Software Engineer, GPU

Mountain View, CA · On-site

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Waymo

Software Engineer, GPU

Mountain View, CA · On-site +1

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Waymo

Software Engineer, GPU

Manhattan, NY · On-site +1

$204K - $259K/yr

In this hybrid role, you will report to a Senior Software Engineer. You will: * Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator codebase across ...

Nvidia

System Software Engineer - GPU

Santa Clara, CA

$203.20K - $240.80K/yr

We are seeking software engineers to work on the architecture of NVIDIA GPU Diagnostic SW. Our charter is to develop the most demanding applications a GPU or high-performance computing server will ...

Nvidia

System Software Engineer - GPU

Santa Clara, CA

$203.20K - $240.80K/yr

We are seeking a System Software Engineer to work on next-generation computing and graphics products. Our charter is to build low level GPU testing frameworks to validate GPUs early in the life cycle.

Nvidia

Senior Software Engineer - GPU

Santa Clara, CA

$143.90K - $189.70K/yr

NVIDIA is seeking an exceptional Senior System Software Engineer to join our GPU System Software team. This team is responsible for developing comprehensive system software solutions from concept to ...

Baseten

Software Engineer - GPU Kernels

New York, NY · On-site

$180K - $360K/yr

As a GPU Kernel Engineer, you'll craft the foundation that powers modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications. You'll work in a fast-paced ...

Nvidia

System Software Engineer - GPU

Santa Clara, CA

$203.20K - $240.80K/yr

We are seeking a System Software Engineer to work on next-generation computing and graphics products. Our charter is to build the most stressful set of applications a GPU or high performance ...

next page

Showing results 1-20

People also search for

All JobsSoftware Engineer Gpu Jobs

Software Engineer Gpu information

See salary details

$63.5K

$147.5K

$205.5K

How much do software engineer gpu jobs pay per year?

As of May 29, 2026, the average yearly pay for software engineer gpu in the United States is $147,524.00, according to ZipRecruiter salary data. Most workers in this role earn between $120,000.00 and $173,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Software Engineer GPU, and why are they important?

To thrive as a Software Engineer GPU, you need strong programming skills in C/C++, parallel computing concepts, and a solid background in computer science or related fields. Familiarity with GPU programming frameworks such as CUDA or OpenCL, version control systems, and performance profiling tools is typically required. Analytical thinking, problem-solving abilities, and effective teamwork are essential soft skills for excelling in this role. These competencies ensure the development of optimized, high-performance software that leverages GPU architectures for demanding computational tasks.

How does a Software Engineer specializing in GPU typically collaborate with hardware and other engineering teams?

As a Software Engineer focusing on GPU, you will frequently work closely with hardware engineers, driver developers, and performance analysts. Collaboration often involves optimizing software to leverage GPU capabilities, troubleshooting performance bottlenecks, and ensuring compatibility with evolving hardware architectures. Effective communication and cross-functional teamwork are essential, as solutions often require aligning software design with hardware constraints and roadmaps. This collaborative environment not only broadens your technical understanding but also provides opportunities to learn from diverse engineering disciplines.

What are Software Engineer GPU roles?

A Software Engineer GPU is a specialist who designs, develops, and optimizes software that runs on Graphics Processing Units (GPUs). These engineers focus on maximizing the performance of applications—such as graphics rendering, machine learning, or scientific computation—by leveraging the parallel processing power of GPUs. They often work with languages like CUDA or OpenCL and collaborate with hardware teams to ensure efficient integration of software and GPU hardware. Their work is vital in industries like gaming, AI, automotive, and high-performance computing.

What is the difference between Software Engineer Gpu vs Software Engineer?

AspectSoftware Engineer GpuSoftware Engineer
Required SkillsGPU programming, parallel computing, CUDA/OpenCLGeneral software development, algorithms, coding
Work EnvironmentHigh-performance computing, graphics, AIWeb, mobile, enterprise applications
CertificationsCUDA certifications, relevant degreesVaries widely, often general CS degrees
Industry UsageGraphics, AI, scientific computingSoftware development across industries

Software Engineer Gpu specializes in GPU-based programming for high-performance tasks, while a Software Engineer has a broader focus on general software development. Both roles require strong coding skills, but GPU engineers focus more on parallel processing and graphics technologies. The choice depends on your interest in graphics and high-performance computing versus general software development.

What cities are hiring for Software Engineer Gpu jobs? Cities with the most Software Engineer Gpu job openings:
What are the most commonly searched types of Software Engineer Gpu jobs? The most popular types of Software Engineer Gpu jobs are:
What states have the most Software Engineer Gpu jobs? States with the most job openings for Software Engineer Gpu jobs include:
Software Engineer Gpu jobs near you
Infographic showing various Software Engineer Gpu job openings in the United States as of May 2026, with employment types broken down into 95% Full Time, and 5% Contract. Highlights an 96% Physical, and 4% Hybrid job distribution, with an average salary of $147,524 per year, or $70.9 per hour.
GPU Software Engineer/GPU Architect

GPU Software Engineer/GPU Architect

Triune Infomatics Inc

San Jose, CA

$164.10K - $202.80K/yr

Other

Posted 4 days ago

Job description

Role: GPU Software Engineer/GPU Architect
Location: San Jose, CA
Duration: Long-term >> ongoing contract
 
Overview: We're looking for a strong GPU Software Engineer/GPU Architect to join a highimpact engineering team working on nextgeneration AI, GPU, and semiconductor technologies. This role focuses on GPU kernel development, memory architecture, and integration with modern inference systems such as vLLM and SGLang. You'll work onsite in San Jose, collaborating closely with a team of engineers building highperformance GPUaccelerated systems.
  • Develop and optimize CUDA/ROCm kernels for AI workloads
  • Work with HBM, memory hierarchy, thread scheduling, and P2P communication
  • Integrate GPU kernels with vLLM, SGLang, and other inference servers
  • Build highperformance components in C++ and Python
  • Support AI frameworks such as PyTorch and TensorFlow
  • Optimize multiGPU scaling, KVcache, and attention kernels
  • Profile and debug GPU workloads using Nsight, rocprof, etc.
  • Collaborate with crossfunctional GPU, AI, and semiconductor teams
Required Skills:
  • Strong experience with CUDA, ROCm/HIP, OpenCL, or MPI
  • Deep understanding of GPU architecture, HBM, memory models, and thread hierarchies
  • Handson experience with AMD/NVIDIA GPU software stacks
  • Expertlevel C++ and Python
  • Experience with PyTorch or TensorFlow
  • Experience with vLLM, SGLang, or similar inference systems
Preferred Skills:
  • RDMA, RoCE, InfiniBand, or Infinity Fabric
  • Distributed inference/training or HPC experience
  • Semiconductor or hardwareadjacent experience

Apply