ZipRecruiter

Log In

1

Infiniband Jobs (NOW HIRING)

CoreWeave

Systems Engineer, Kernel

New York, NY

$165K - $242K/yr

Intel/AMD/ARM CPUs, Nvidia GPUs, DPUs, Infiniband and Ethernet NICs * Docker, kubernetes (k8s), KubeVirt, containerd, kubelet Focus Areas: * Kernel Debugging - Analyze kernel crashes, oopses, panics ...

Vultr

GPU Fabric Engineer

$125K - $135K/yr

The ideal candidate is deep hands-on experience with InfiniBand and RoCE fabrics in GPU cluster environments, and a strong understanding of how interconnect performance impacts distributed AI ...

M9 Solutions

DevOps Engineer

Herndon, VA · On-site

$54.25 - $74.25/hr

... InfiniBand and OmniPath). • Experience with InfiniBand or Omni-Path high-speed fabrics, including subnet management, IPoIB, and/or IPoOPA mechanisms, fabric topology, and health monitoring and ...

NVIDIA

Solutions Architect, HPC Systems Engineer

$248K/yr

CUDA), NVIDIA Networking technologies (e.g., DPU, RoCE, InfiniBand), and/or ARM CPU solutions. • Familiarity with virtualization technology concepts. Company : NVIDIA is a computing platform ...

Nebius

GPU Cluster Architect

$184K - $318K/yr

Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes. * Performance Modeling : Analyze AI/ML workloads (e.g. LLM ...

CoreWeave

Systems Engineer, Kernel

Livingston, NJ · On-site

$165K - $242K/yr

Intel/AMD/ARM CPUs, Nvidia GPUs, DPUs, Infiniband and Ethernet NICs * Docker, kubernetes (k8s), KubeVirt, containerd, kubelet Focus Areas: * Kernel Debugging - Analyze kernel crashes, oopses, panics ...

Vultr

AI Cluster Architect

$65 - $89/hr

They will evaluate multi-plane, rail-optimized, and tiered fabric designs across technologies like InfiniBand, RoCE, and SpectrumX to ensure the networking architecture supports the intended GPU ...

Crusoe

Staff Hardware Systems Engineer

San Francisco, CA · On-site

$145K - $192K/yr

InfiniBand (fabric debugging, throughput, connectivity issues) * NVMe/storage (performance bottlenecks, firmware interactions, failure analysis) * Conduct rigorous system validation and ...

Astera Labs

Principal Test Engineer

San Jose, CA

$209K - $230K/yr

Working knowledge of high-speed protocols like PCIe, Ethernet, Infiniband, DDR, NVMe, USB, etc. * Professional attitude with ability to execute on multiple tasks with minimal supervision. * Strong ...

NVIDIA

Senior Deep Learning Communication Architect

Austin, TX · On-site

$128K - $174K/yr

Collaborate with hardware and software teams to craft systems that effectively apply high-speed interconnects (e.g., NVLink, InfiniBand, SPC-X) and communication libraries (e.g., MPI, NCCL, UCX, UCC ...

Crusoe

Staff Hardware Systems Engineer

San Francisco, CA · On-site

$145K - $192K/yr

InfiniBand (fabric debugging, throughput, connectivity issues) * NVMe/storage (performance bottlenecks, firmware interactions, failure analysis) * Conduct rigorous system validation and ...

next page

Showing results 1-20

All JobsInfiniband Jobs

Infiniband information

See salary details

$11K

$83.3K

$113K

How much do infiniband jobs pay per year?

As of Jul 18, 2026, the average yearly pay for infiniband in the United States is $83,291.00, according to ZipRecruiter salary data. Most workers in this role earn between $35,500.00 and $108,000.00 per year, depending on experience, location, and employer.

What is Infiniband?

Infiniband is a high-speed, low-latency networking technology commonly used in data centers and high-performance computing environments. It is designed to connect servers, storage systems, and network devices, providing much faster data transfer rates than traditional Ethernet. Infiniband supports scalable bandwidth and efficient communication, which makes it ideal for applications requiring rapid data movement, such as scientific simulations and large-scale database transactions. Its architecture also supports remote direct memory access (RDMA), which further reduces latency and CPU overhead.

What are the key skills and qualifications needed to thrive as an InfiniBand Network Engineer, and why are they important?

To thrive as an InfiniBand Network Engineer, you need a strong background in computer networking, Linux system administration, and high-performance computing (HPC) environments, often supported by a degree in computer science or related field. Familiarity with InfiniBand architecture, experience with tools like OpenFabrics Enterprise Distribution (OFED), and certifications such as CompTIA Network+ are valuable. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for this role. These abilities are essential for ensuring efficient, reliable InfiniBand network performance in complex HPC or data center environments.

What are the typical responsibilities of an InfiniBand network engineer in a data center environment?

InfiniBand network engineers are primarily responsible for designing, deploying, and maintaining high-performance InfiniBand fabrics that connect servers and storage systems in data centers, especially in HPC (High-Performance Computing) environments. Their daily tasks include monitoring network performance, troubleshooting connectivity or latency issues, and performing firmware and driver updates on InfiniBand switches and host adapters. They also collaborate closely with system administrators and application teams to optimize throughput and ensure reliable, low-latency communication. Additionally, InfiniBand engineers often participate in capacity planning and help scale the network infrastructure to meet growing computational demands.

What is the difference between Infiniband vs Ethernet Network Engineer?

AspectInfinibandEthernet Network Engineer
Required CredentialsNetworking certifications, Cisco, Cisco CCNA, CCNPNetworking certifications, Cisco, CCNA, CCNP
Work EnvironmentData centers, high-performance computing environmentsCorporate networks, data centers, enterprise environments
Industry UsageHigh-performance computing, research institutionsBusiness, telecommunications, enterprise IT
Common Search/ComparisonYesYes

Infiniband and Ethernet Network Engineers both work with network infrastructure, but Infiniband specializes in high-speed, low-latency connections used in data centers and HPC environments. Ethernet Network Engineers focus on standard Ethernet networks used across various industries. While their certifications and skills overlap, their work environments and applications differ significantly.

More about Infiniband jobs
What cities are hiring for Infiniband jobs? Cities with the most Infiniband job openings:
What states have the most Infiniband jobs? States with the most job openings for Infiniband jobs include:
What job categories do people searching Infiniband jobs look for? The top searched job categories for Infiniband jobs are:
Infiniband jobs near you
Infographic showing various Infiniband job openings in the United States as of July 2026, with employment types broken down into 98% Full Time, and 2% Contract. Highlights an 90% Physical, 2% Hybrid, and 8% Remote job distribution, with an average salary of $83,291 per year, or $40 per hour.

LLM Pre-training & Distributed Engineer (AI Infrastructure)

Hyphen Connect Limited

San Francisco, CA

$126K - $166K/yr

Other

Posted 24 days ago

Job description

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing  distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.

Responsibilities:

  • Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
  • Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
  • Automate checkpointing and failure recovery during month-long training runs.

Required Skills:

  • Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
  • Experience managing SLURM or Kubernetes-based GPU clusters.
  • Strong systems engineering background (C++, CUDA, Python).

Apply