Luminal

Job Summary:
Luminal is a company that builds an AI compiler and serving stack to enhance model performance. They are seeking a Cloud Inference Engineer to deploy and tune models for low latency and high throughput on Luminal Cloud.
Responsibilities:
• Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
• Conducting model performance reviews
• Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
• Sometimes write kernels and, yes, occasional tasteful shitposting
Qualifications:
Required:
• CUDA + GPU inference optimization
• vLLM, SGLang, or TensorRT-LLM experience
• KV caching, paged attention, batching, token streaming, etc.
• Distributed compute (with GPUs is a super plus)
• No degree required
Company:
Luminal provides a machine learning compiler and serverless cloud platform that automates PyTorch model optimization and deployment. Founded in 2025, the company is headquartered in San Francisco, USA, with a team of 11-50 employees. The company is currently Early Stage.