Netpreme

14 Netpreme Jobs Hiring Near You

Netpreme Jobs Information

Infographic showing various job openings at Netpreme in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% Physical job distribution.

Member of Technical Staff, ML Systems

Netpreme

Santa Clara, CA • On-site

Full-time

Re-posted 24 days ago


Job description

Job Summary:
Netpreme is seeking a motivated LLM Systems Engineer to explore new and unconventional inference systems based on emerging hardware. The role involves prototyping various algorithms suitable for inference hardware and guiding the hardware team on product definition.
Responsibilities:
• Prototype and optimize emerging ML inference systems.
• Develop novel memory models for expandable vRAM.
• Write efficient GPU kernels for data movement.
• Perform design-space exploration, implementation, and benchmarking of inference engines, both in simulations and on real hardware.
Qualifications:
Required:
• MS or PhD in computer systems, ideally with a focus on LLM inference and/or distributed systems.
• Prior experience contributing to the core LLM inference infrastructures (vLLM, SGLang, TensorRT, etc.).
• Prior experience in accelerator programming (e.g. CUDA, JAX/Pallas, ROCm).
Preferred:
• Advanced computer architectures and performance engineering skills is a big plus.
Company:
Netpreme develops networked memory tiering technology that expands accelerator memory capacity for AI workloads. Founded in 2024, the company is headquartered in Cambridge, USA, with a team of 11-50 employees. The company is currently Early Stage.