1

Rdma Gpu Jobs in Raleigh, NC (NOW HIRING)

Rdma Gpu information

See Raleigh, NC salary details

$41.3K

$120.3K

$170.1K

How much do rdma gpu jobs pay per year?

As of Aug 18, 2026, the average yearly pay for rdma gpu in Raleigh, NC is $120,330.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,100.00 and $138,500.00 per year, depending on experience, location, and employer.

What is an RDMA GPU?

RDMA GPUs are graphics processing units that support Remote Direct Memory Access (RDMA) technology, enabling direct memory transfers between the GPU and remote devices or other GPUs across a network without involving the host CPU. This technology is commonly used in high-performance computing, AI, and data centers to reduce latency and increase data throughput. RDMA GPUs allow faster data exchange for distributed computing tasks, such as large-scale machine learning training, by bypassing traditional network bottlenecks.

How does an RDMA GPU engineer typically collaborate with software and hardware teams to optimize performance?

As an RDMA GPU engineer, you’ll regularly work alongside both software developers and hardware architects to ensure that high-speed data transfers between GPUs and other components are efficient and reliable. This collaboration often involves troubleshooting bottlenecks, tuning drivers, and optimizing memory access patterns. You may also participate in code reviews, joint debugging sessions, and performance benchmarking to align system-level improvements. Effective communication across multidisciplinary teams is essential to deliver best-in-class solutions for demanding workloads like machine learning or scientific computing.

What are the key skills and qualifications needed to thrive as an RDMA GPU engineer, and why are they important?

To thrive as an RDMA GPU Engineer, you need a solid background in computer science or engineering, with expertise in GPU architectures, networking protocols, and RDMA (Remote Direct Memory Access) technologies. Familiarity with CUDA, InfiniBand, RoCE, and relevant profiling or debugging tools is typically required. Strong problem-solving, teamwork, and communication skills help in collaborating effectively on complex, performance-critical systems. These skills are crucial for optimizing high-performance computing applications and ensuring efficient data transfer between GPUs and networked devices.

What is the difference between Rdma Gpu vs Network Engineer?

AspectRdma GpuNetwork Engineer
Required CredentialsComputer science or related degree, certifications in GPU computing or high-performance networkingNetworking certifications (CCNA, CCNP), degree in computer science or related field
Work EnvironmentData centers, high-performance computing labs, research facilitiesCorporate offices, data centers, telecommunication environments
Industry UsageAI, machine learning, scientific computing, data analyticsIT infrastructure, network design, security, and maintenance

Rdma Gpu specialists focus on optimizing GPU performance and high-speed data transfer using RDMA technology, primarily in computing and research environments. Network Engineers design, implement, and maintain network systems. While both roles involve high-tech infrastructure, Rdma Gpu roles are more specialized in GPU and high-performance data transfer, whereas Network Engineers focus on network connectivity and security.

What are popular job titles related to Rdma Gpu jobs in Raleigh, NC?

For Rdma Gpu jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Rdma Gpu jobs in Raleigh, NC look for?

The top searched job categories for Rdma Gpu jobs in Raleigh, NC are:

Senior HPC Support Engineer, InfiniBand - NVLink

Nvidia

Durham, NC

Full-time

Posted 12 days ago


Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 17 frontline employees who took The Breakroom Quiz

7th of 245 rated software companies


Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology-and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent. As an NVIDIAN, you'll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are seeking a highly motivated Senior HPC Support Engineer focussing on InfiniBand and NVLink technology, passionate about data center and networking technologies, to provide comprehensive solutions for sophisticated installations, maintenance, or operations for a broad scope of groundbreaking networking products. As a primary point of contact for our customers; assisting them with technical questions, debugging and resolving their issues. As a member of our NVIDIA Experience (NVEX) Global Technical Support team, you are a conscientious, proficient communicator who is fundamentally interested in taking ownership in resolving issues, while ensuring that a high level of customer satisfaction is maintained and delivered. Significant part of the role is also to collaborate with Engineering, Marketing, and Support teams regularly on technical issues.


What you will be doing:

  • Ability to resolve sophisticated customer concerns and technical issues through meticulous research, reproduction, and solving problems for customers installing our products and supporting systems using Linux Operating Systems (Multi-distro), with the focus on NVIDIA InfiniBand, NVLink and GPU Technology and our End-to-End Solutions

  • Responding to customer product support inquiries via telephone, email, or conference calls

  • Resolving customer issues during installation, operation, maintenance or product application or interoperability with other vendors

  • Participate in multi-functional team meetings and giving feedback to engineering and marketing regarding product requirements, customer experience, support tools, etc.

  • As a technical resource develop, re-define and document standard methodologies to provide to internal teams(Support/R&D) for support process and improvements


What we need to see:

  • 5+ years in providing in-depth Customer Support and debugging experience focussed on large-scale networking and AI Infrastructure environments and products such as InfiniBand, Ethernet and GPU including infrastructure performance, strong interpersonal skills and ability to prioritize/multi-task easily with limited supervision.

  • Shown use of established Agentic AI technologies (Claude, Codex, Cursor) in day-today job responsibilities.

  • Excellent verbal and written English skills.

  • An academic degree from an accredited university or college in Networking, Computer Science/Engineering, or Electrical/IT (or equivalent experience).

  • Intellectual curiosity, positive attitude, flexibility, analytical ability, self-motivation, and team-oriented including professional-level communication skills, interpersonal skills with a passion to solve problems.

Profound knowledge and experience (solving) in the following skills:

  • Networking Technology, protocols and routing including IP, L2 and L3 on a CCNP/CompTIA Networking+ and Cloud+ level

  • Able to debug networking protocols using tools such as TCPDUMP and Wireshark or similar packet generation and analysis tools

  • Configuration and operational expertise with traditional network switch/router and Open platforms

  • Linux OS System Administration, Networking and Performance on a LFCS/RHCSA level

  • Containerized solutions experience on a level of DCA and/or CKA, Virtualization and (KVM/ESXi) and Cloud Infrastructure (AWS/OCI) Technologies


Ways to stand out from the crowd:

Knowledge and working experience with the following:

  • InfiniBand, RDMA/RoCEv2 and GPU Technology.

  • Clustering or HPC Data-Center technologies including Upper Layer Protocols (i.e., NCCL, MPI, Slurm/SchedMD).

  • Shell scripting (Bash/Python).

  • Linux, Networking and NVIDIA AI Infrastructure and Operations Certifications such as CCNP, CCIE, JNCIE-DC/ENT, RHCE, LFCS, NCP-AII/AIO/AIN

Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 108,000 USD - 172,500 USD for Level 3, and 120,000 USD - 207,000 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 9, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

Year founded

1993