1

Software Engineer Gpu Jobs (NOW HIRING)

Principal Software Engineer, GPU Compute

San Mateo, CA · On-site

$153K - $206K/yr

As a Principal Software Engineer on the Compute team, you will be the technical anchor for Roblox's GPU and AI accelerator capabilities. This is a battle-tested GPU expert role focused on the machine ...

Software Engineer - GPU Fabric Observability

New York, NY · On-site

$200K - $380K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

We are hiring a Lead Software Engineer to build a first-class observability and root-cause analysis system for GPU fabrics. This is a hard distributed systems problem, not a dashboarding problem. The ...

Software Engineer, GPU Infrastructure

San Francisco, CA · On-site

$203K - $241K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... software. Speed and scale are our key differentiators. Come be a part of building civilization ... The Production Engineering Team Examples of key exciting problems the team is working on * Build ...

Senior Software Engineer, GPU Performance

Sunnyvale, CA · On-site

$143K - $189K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Experience with compiler optimization, code generation, and runtime systems for GPU architectures (OpenXLA, MLIR, Triton, etc.). About the job Google's software engineers develop the next-generation ...

Software Engineer, GPU Infrastructure

San Francisco, CA · On-site

$173K - $224K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... software. Speed and scale are our key differentiators. Come be a part of building civilization ... The Production Engineering Team Examples of key exciting problems the team is working on * Build ...

We are looking for a Lead Software Systems Engineer - GPU Performance to play a key role in building our hyperscaler platform, working across its core components while analyzing and optimizing the ...

Showing results 21-40

Software Engineer Gpu information

See salary details

$63.5K

$147.5K

$205.5K

How much do software engineer gpu jobs pay per year?

As of Aug 17, 2026, the average yearly pay for software engineer gpu in the United States is $147,524.00, according to ZipRecruiter salary data. Most workers in this role earn between $120,000.00 and $173,000.00 per year, depending on experience, location, and employer.

What is a software engineer GPU?

A Software Engineer GPU is a specialist who designs, develops, and optimizes software that runs on Graphics Processing Units (GPUs). These engineers focus on maximizing the performance of applications—such as graphics rendering, machine learning, or scientific computation—by leveraging the parallel processing power of GPUs. They often work with languages like CUDA or OpenCL and collaborate with hardware teams to ensure efficient integration of software and GPU hardware. Their work is vital in industries like gaming, AI, automotive, and high-performance computing.

What are the key skills and qualifications needed to thrive as a software engineer GPU?

To thrive as a Software Engineer GPU, you need strong programming skills in C/C++, parallel computing concepts, and a solid background in computer science or related fields. Familiarity with GPU programming frameworks such as CUDA or OpenCL, version control systems, and performance profiling tools is typically required. Analytical thinking, problem-solving abilities, and effective teamwork are essential soft skills for excelling in this role. These competencies ensure the development of optimized, high-performance software that leverages GPU architectures for demanding computational tasks.

How does a software engineer GPU typically collaborate with hardware and other engineering teams?

As a Software Engineer focusing on GPU, you will frequently work closely with hardware engineers, driver developers, and performance analysts. Collaboration often involves optimizing software to leverage GPU capabilities, troubleshooting performance bottlenecks, and ensuring compatibility with evolving hardware architectures. Effective communication and cross-functional teamwork are essential, as solutions often require aligning software design with hardware constraints and roadmaps. This collaborative environment not only broadens your technical understanding but also provides opportunities to learn from diverse engineering disciplines.

What is the difference between Software Engineer Gpu vs Software Engineer?

AspectSoftware Engineer GpuSoftware Engineer
Required SkillsGPU programming, parallel computing, CUDA/OpenCLGeneral software development, algorithms, coding
Work EnvironmentHigh-performance computing, graphics, AIWeb, mobile, enterprise applications
CertificationsCUDA certifications, relevant degreesVaries widely, often general CS degrees
Industry UsageGraphics, AI, scientific computingSoftware development across industries

Software Engineer Gpu specializes in GPU-based programming for high-performance tasks, while a Software Engineer has a broader focus on general software development. Both roles require strong coding skills, but GPU engineers focus more on parallel processing and graphics technologies. The choice depends on your interest in graphics and high-performance computing versus general software development.

What cities are hiring for Software Engineer Gpu jobs?

Cities with the most Software Engineer Gpu job openings:

What are the most commonly searched types of Software Engineer Gpu jobs?

The most popular types of Software Engineer Gpu jobs are:

What states have the most Software Engineer Gpu jobs?

States with the most job openings for Software Engineer Gpu jobs include:

Infographic showing various Software Engineer Gpu job openings in the United States as of August 2026, with employment types broken down into 1% Internship, 87% Full Time, 8% Part Time, and 4% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $147,524 per year, or $70.9 per hour.

Software Engineer- GPU/AI/ML

AMD (Advanced Micro Devices)

Santa Clara, CA • On-site

Other

Posted 3 days ago

New


Advanced Micro Devices rating

8.6

Company rating: 8.6 out of 10

Based on 13 frontline employees who took The Breakroom Quiz

27th of 157 rated electronics manufacturers


Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING
At AMD, our mission is to build great products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges-striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.
WHY AMD
At AMD, we build products that accelerate next-generation computing-from AI and data centers to PCs, gaming, and embedded systems. Progress here comes from bold ideas, strong execution, and people who care about hard problems.
This role sits at the center of that mission: making AMD the platform of choice for the most demanding AI workloads by improving how models train, align, and run on our GPUs.
THE OPPORTUNITY
We're looking for a senior software engineer who combines deep systems performance work with modern AI-someone who can shape software from GPU kernels through distributed training and inference.
You'll join a core team of specialists working on the latest AMD hardware and software. Your work will directly influence the ROCm ecosystem and how foundation models and agentic systems perform on AMD GPUs.
The challenge: Help train and run AI systems that make AI itself more efficient on GPUs-tuning stacks, kernels, and workflows in ways that can materially shift what's possible on our hardware.
This is a high-impact, hands-on role. You'll own hard technical problems, influence direction across teams, and mentor others as we scale AMD's AI software strategy.
WHAT YOU'LL DO
  • Own the AI software stack: Establish best practices and drive performance from low-level GPU kernels to large-scale distributed systems. Use modern LLMs and agent-based tooling where it accelerates development and tuning of the ROCm ecosystem.
  • Accelerate foundation models and agents: Improve training, post-training, and inference for LLMs and autonomous AI workloads so AMD is the default platform for the most demanding use cases.
  • Co-design hardware and software: Partner on the full lifecycle-from GPU architecture input to software for new accelerators-and engage with the broader AI community to keep AMD at the forefront.

WHAT WE'RE LOOKING FOR
We need someone who can go deep in the areas below and collaborate effectively.
SYSTEMS & GPU PERFORMANCE (KERNEL ENGINEERING)
  • Expert-level modern C++ and design of large, performance-critical systems.
  • Strong grasp of GPU architecture, memory hierarchy, and kernel optimization (HIP/CUDA).
  • Hands-on delivery on large-scale C++/HIP/CUDA codebases, such as ROCm (rocBLAS, hipDNN, Composable Kernel, AITemplate), the CUDA ecosystem (cuBLAS, cuDNN, CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as PyTorch, TensorFlow, or JAX (C++/HIP/CUDA paths).
  • Comfort diagnosing bottlenecks with profilers (for example, ROCm Profiler and Nsight) in multi-GPU, distributed settings.

AI POST-TRAINING & LLM SYSTEMS
  • Deep understanding of transformers, attention, and the full model lifecycle.
  • Hands-on work in alignment and post-training-for example, SFT, RLHF, and GRPO.
  • Awareness of current LLM trends, including MoE, quantization, speculative decoding, and agentic systems.
  • Experience optimizing post-training and inference pipelines at scale.

PREFERRED BACKGROUND
  • Substantial professional experience in software development within performance-critical environments.
  • Extensive HIP/CUDA experience optimizing deep learning and OSS LLM inference/training kernels and operators.
  • Strong technical ownership and a track record of shipping complex systems.
  • Clear communication and influence across teams.
  • Plus: Deep familiarity with the AMD ROCm/HIP ecosystem.
  • Plus: Working knowledge of RTL design and Verilog/SystemVerilog for hardware-software co-design.

EDUCATION
  • Bachelor's in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
  • Master's preferred; PhD a plus.
  • Publications in AI/ML, GPU computing, or systems optimization are valued.

#LI-AG2
#LI-HYBRID
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here.
This posting is for an existing vacancy.

What Advanced Micro Devices employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom