1

Gpu Engineer Jobs in Raleigh, NC (NOW HIRING)

Machine Learning & Operations Engineer

Durham, NC · Remote

$71K - $96K/yr

Optimize GPU/compute utilization across cloud and on-prem environments. * Deploy, monitor, and ... More typical DevOps responsibilities for software development as required. Requirements Required ...

Machine Learning & Operations Engineer

Durham, NC · Remote

$67K - $90K/yr

Optimize GPU/compute utilization across cloud and on-prem environments. * Deploy, monitor, and ... More typical DevOps responsibilities for software development as required. Requirements Required ...

Machine Learning & Operations Engineer

Durham, NC · Remote

$67K - $90K/yr

Optimize GPU/compute utilization across cloud and on-prem environments. * Deploy, monitor, and ... More typical DevOps responsibilities for software development as required. Required Qualifications ...

An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can ... We are now looking for a motivated ASIC Timing Engineer to join our dynamic and growing team. If ...

As leading developers and maintainers of the vLLM project, and inventors of state-of-the-art ... Manage and scale multi-cloud GPU infrastructure using Terraform and Ansible, including both bare ...

... Engineering practice, you will design and drive deployment of fully integrated architectures for GPU-accelerated AI factories and high-performance computing infrastructure in close partnership with ...

next page

Showing results 1-20

Gpu Engineer information

See Raleigh, NC salary details

$37.9K

$98.9K

$133.7K

How much do gpu engineer jobs pay per year?

As of Jun 17, 2026, the average yearly pay for gpu engineer in Raleigh, NC is $98,911.00, according to ZipRecruiter salary data. Most workers in this role earn between $81,700.00 and $113,200.00 per year, depending on experience, location, and employer.

What engineers make $500,000?

Senior GPU engineers, especially those with extensive experience, specialized skills in graphics architecture, and leadership roles, can earn $500,000 or more annually. High compensation often includes bonuses, stock options, and other incentives, particularly in large tech companies or specialized industries like gaming, AI, or data centers.

What engineers make $300,000 a year?

Senior GPU engineers, especially those with extensive experience, advanced skills in graphics architecture, and expertise in programming languages like C++ and CUDA, can earn $300,000 or more annually. High-level roles in large tech companies or specialized fields such as AI and machine learning often offer compensation at this level, often including bonuses and stock options.

What jobs pay $400 an hour?

High-paying roles for GPU engineers or related specialized tech positions can reach $400 an hour, typically in consulting, freelance, or contract work for companies needing advanced graphics processing or AI hardware development. Such roles often require extensive experience, advanced skills in hardware design, and a strong portfolio, with some professionals earning this rate through independent consulting or in executive technical positions.

What are the key skills and qualifications needed to thrive in the Gpu Engineer position, and why are they important?

To thrive as a GPU Engineer, you need strong knowledge of computer architecture, proficiency in C/C++, and experience with parallel programming models such as CUDA or OpenCL, along with a degree in computer science, electrical engineering, or a related field. Familiarity with debugging tools, driver development, performance profiling utilities, and hardware simulation platforms is typically required. Excellent problem-solving abilities, attention to detail, and effective teamwork and communication skills help distinguish top candidates. These skills ensure that GPU Engineers can develop high-performance solutions, efficiently troubleshoot hardware and software issues, and collaborate successfully in multidisciplinary environments.

What does a GPU engineer do?

A GPU engineer designs, develops, and optimizes graphics processing units and related hardware or software. They work on improving graphics performance, parallel processing, and computational efficiency, often using programming languages like C++ and tools such as CUDA or OpenCL. Their work supports applications in gaming, scientific computing, and machine learning.

What does a GPU Engineer do?

A GPU Engineer designs, develops, and optimizes graphics processing units (GPUs) for applications like gaming, artificial intelligence, and high-performance computing. They work on hardware architecture, driver development, and parallel computing optimizations to maximize performance. GPU Engineers collaborate with software developers, hardware designers, and researchers to improve graphics rendering, machine learning acceleration, and computational efficiency.

What are some common challenges faced by GPU Engineers, and how are they addressed?

GPU Engineers often face challenges such as optimizing code for maximum parallel efficiency, debugging complex hardware-software interactions, and keeping pace with rapidly evolving GPU architectures. Addressing these issues typically requires a combination of deep architectural understanding, use of specialized profiling and debugging tools, and ongoing collaboration with hardware, software, and QA teams. Many companies provide ongoing training and encourage knowledge sharing within engineering teams to help individuals stay current and effectively tackle new technical hurdles. Overcoming these challenges not only sharpens technical expertise but also opens doors for career growth into architect, team lead, or principal engineer roles.

What are the most commonly searched types of Gpu Engineer jobs in Raleigh, NC? The most popular types of Gpu Engineer jobs in Raleigh, NC are:
What are popular job titles related to Gpu Engineer jobs in Raleigh, NC? For Gpu Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
Senior Software Engineer, Cloud-Native Stack - CSP Engagements

Senior Software Engineer, Cloud-Native Stack - CSP Engagements

NVIDIA

Durham, NC • On-site

Full-time

Posted 2 days ago


Job description

Job Summary:
NVIDIA is a leading technology company known for its groundbreaking developments in Artificial Intelligence and High-Performance Computing. They are seeking a Senior Software Engineer for their CSP Engagements team to focus on the cloud-native stack for advanced AI/ML datacenters, tackling complex scheduling challenges and enhancing Kubernetes and Slurm functionalities.
Responsibilities:
• Perform deep-dive debugging of multi-rack, multi-tenant clusters: scheduler behavior, container runtime issues, device-plugin crashes, RDMA/IB fabric anomalies, etc.
• Gather customer requirements and prototype feature extensions for Kubernetes operators, Slurm plugins, and custom micro-services that expose new GPU capabilities.
• Drive joint architecture reviews and “whiteboard” sessions with CSP and internal platform teams; convert findings into RFCs and upstream pull requests.
• Create reproducible testbeds (Helm/Ansible/Terraform) that mirror customer environments; automate validation and benchmark suites.
• Deliver technical collateral-design docs, how-to guides, demo scripts-and present at customer on-sites, KubeCon, and SlurmUG.
• Collaborate with AE, FAE, and Solution Architect teams to deliver integrated customer solutions and technical documentation.
Qualifications:
Required:
• Strong source-level expertise in Kubernetes internals (scheduler, CRI/CNI/CSI, operators) and Slurm (federation, power-save, plugins).
• Hands-on experience integrating next-gen GPUs (Blackwell/GB200/GB300) or comparable accelerators into containerized clusters.
• Proven track record debugging large-scale, cloud-native stacks across networking (RDMA/RoCE), storage, and control planes.
• Customer-facing engineering or solutions-architect background: requirements gathering, PoC ownership, roadmap influence.
• Familiarity with CI/CD (GitHub Actions, Tekton), observability (Prometheus, OpenTelemetry), and infrastructure-as-code.
• Excellent communication-able to switch between deep technical detail and high-level business impact.
• 10+ years of professional software development experience in distributed systems (Go, Rust, C/C++ or Python for tooling).
• BS or MS (or equivalent experience) in Computer Engineering, Computer Science, or related field.
Preferred:
• Upstream contributions to Kubernetes, Slurm, Volcano, or similar projects.
• Experience with GPU computing (CUDA), deep learning workloads
Company:
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. Founded in 1993, the company is headquartered in Santa Clara, USA, with a team of 10001+ employees. The company is currently Late Stage.

Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

Year founded

1993