Job Summary:
Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with their Open-Access AI Cloud. They are seeking a Senior Infrastructure Engineer to help build and scale their GPU Cloud Marketplace, transforming raw GPUs into a programmable pool for AI developers and researchers.
Responsibilities:
• help build and scale Hyperbolic's GPU Cloud Marketplace
• building a multi-tenancy provisioning and virtualization solution
• transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers
• work at the cutting edge of cloud infrastructure
• building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers
Qualifications:
Required:
• Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
• Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
• Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
• Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
• Proficiency with API design and cloud-init for automated provisioning and configuration
• Solid understanding of GPU architecture, CUDA, and GPU compute optimization
• Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
• Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
• Experience building and scaling cloud infrastructure or distributed systems in production environments
Preferred:
• Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)
• Experience with distributed storage systems such as Ceph, Weka, or VAST Data
Company:
Hyperbolic is the open-access AI cloud made for AI developers, providing fast, affordable access to compute, inference, and AI services. Founded in 2022, the company is headquartered in Irvine, USA, with a team of 11-50 employees. The company is currently Early Stage.