About the Role RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads. You'll work on the ...
RadixArk
47 Radixark Jobs Hiring Near You
About the Role RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads. You'll work on the ...
About the Role RadixArk is seeking a Member of Technical Staff - Training to build and scale the systems that train frontier AI models. You will work on large-scale distributed training ...
About the Role RadixArk is seeking a Member of Technical Staff - Training to build and scale the systems that train frontier AI models. You will work on large-scale distributed training ...
Developer Relationship
Palo Alto, CA · On-site
RadixArk is seeking a Developer Advocate to build and engage their technical community around SGLang and Miles. The role involves creating technical content, representing the company at conferences ...
Developer Relationship
Palo Alto, CA · On-site
RadixArk is seeking a Developer Advocate to build and engage their technical community around SGLang and Miles. The role involves creating technical content, representing the company at conferences ...
Solutions Architect
Palo Alto, CA · On-site
$74 - $97.50/hr
About the Role RadixArk is hiring a Solutions Account Executive in Palo Alto, CA - someone who can run a sales cycle and hold their own in a technical conversation. You'll sell SGLang, Miles, and the ...
Solutions Architect
Palo Alto, CA · On-site
$74 - $97.50/hr
About the Role RadixArk is hiring a Solutions Account Executive in Palo Alto, CA - someone who can run a sales cycle and hold their own in a technical conversation. You'll sell SGLang, Miles, and the ...
AI Infra Resident (1-Year Program)
Palo Alto, CA · On-site
$116.40K - $148.70K/yr
About The Role RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster ...
AI Infra Resident (1-Year Program)
Palo Alto, CA · On-site
$116.40K - $148.70K/yr
About The Role RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster ...
Solutions Architect
$74 - $97.50/hr
About the Role RadixArk is hiring a Solutions Account Executive in Palo Alto, CA - someone who can run a sales cycle and hold their own in a technical conversation. You'll sell SGLang, Miles, and the ...
Solutions Architect
$74 - $97.50/hr
About the Role RadixArk is hiring a Solutions Account Executive in Palo Alto, CA - someone who can run a sales cycle and hold their own in a technical conversation. You'll sell SGLang, Miles, and the ...
About the Role RadixArk is seeking a Member of Technical Staff - Diffusion Model to advance the frontier of generative modeling. You will work on cutting-edge diffusion and flow-based models for ...
About the Role RadixArk is seeking a Member of Technical Staff - Diffusion Model to advance the frontier of generative modeling. You will work on cutting-edge diffusion and flow-based models for ...
Performance Engineer
Palo Alto, CA · On-site
About the Role RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads. You'll work on the ...
Performance Engineer
Palo Alto, CA · On-site
About the Role RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads. You'll work on the ...
About the Role RadixArk is looking for a TPU Systems Engineer to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU ...
About the Role RadixArk is looking for a TPU Systems Engineer to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU ...
About the Role RadixArk is hiring a Member of Technical Staff - Supercomputing to help build, deploy, and operate production-grade AI infrastructure for frontier-scale inference and training ...
About the Role RadixArk is hiring a Member of Technical Staff - Supercomputing to help build, deploy, and operate production-grade AI infrastructure for frontier-scale inference and training ...
About the Role RadixArk is hiring a Member of Technical Staff - Supercomputing to help build, deploy, and operate production-grade AI infrastructure for frontier-scale inference and training ...
About the Role RadixArk is hiring a Member of Technical Staff - Supercomputing to help build, deploy, and operate production-grade AI infrastructure for frontier-scale inference and training ...
Full Stack Engineer
Palo Alto, CA · On-site
About The Role RadixArk is building the infrastructure layer for frontier AI systems - unified inference, training, and evaluation stacks powering next-generation LLM applications at scale. Our ...
Full Stack Engineer
Palo Alto, CA · On-site
About The Role RadixArk is building the infrastructure layer for frontier AI systems - unified inference, training, and evaluation stacks powering next-generation LLM applications at scale. Our ...
Controller
Palo Alto, CA · On-site
This is a rare opportunity to define what financial rigor looks like at RadixArk - and to build it yourself. We move fast, operate with a sense of urgency, and expect the same from everyone on the ...
Controller
Palo Alto, CA · On-site
This is a rare opportunity to define what financial rigor looks like at RadixArk - and to build it yourself. We move fast, operate with a sense of urgency, and expect the same from everyone on the ...
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 20K+ GitHub stars and ...
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 20K+ GitHub stars and ...
Developer Relationship
Palo Alto, CA · On-site
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 20K+ GitHub stars and ...
Developer Relationship
Palo Alto, CA · On-site
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 20K+ GitHub stars and ...
About the Role RadixArk is looking for a TPU Systems Engineer to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU ...
About the Role RadixArk is looking for a TPU Systems Engineer to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU ...
About the Role RadixArk is seeking a Member of Technical Staff - Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the ...
About the Role RadixArk is seeking a Member of Technical Staff - Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the ...
About the Role RadixArk is seeking a Member of Technical Staff - Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the ...
About the Role RadixArk is seeking a Member of Technical Staff - Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the ...
About the Role RadixArk is hiring a Member of Technical Staff - CI Engineer to own the infrastructure that keeps SGLang moving. Our CI system runs 300+ GPU tests across NVIDIA, AMD, Intel, and Ascend ...
About the Role RadixArk is hiring a Member of Technical Staff - CI Engineer to own the infrastructure that keeps SGLang moving. Our CI system runs 300+ GPU tests across NVIDIA, AMD, Intel, and Ascend ...
RadixArk is an infrastructure-first company focused on building world-class open systems for AI inference and training. They are seeking a Member of Technical Staff -- Kernel / Compiler ...
RadixArk is an infrastructure-first company focused on building world-class open systems for AI inference and training. They are seeking a Member of Technical Staff -- Kernel / Compiler ...
RadixArk Jobs Information
What are the most popular cities for Radixark jobs?
What are the most popular states for Radixark jobs?
What are the most popular job types at Radixark?
Other
Posted 12 days ago
Job description
About the Role
RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads.
You'll work on the performance-critical path of SGLang, Miles, and the RadixArk infrastructure stack: latency, throughput, GPU utilization, memory efficiency, scheduling, batching, kernel behavior, distributed execution, and cost-per-token. This is not a generic benchmarking role. You'll be working on the systems that determine whether frontier-scale AI workloads are actually usable, affordable, and reliable in production.
Our customers care about real numbers: P99 latency, TTFT, tokens/sec/GPU, throughput under long-context workloads, cost-per-million tokens, RL rollout efficiency, and training-inference consistency. You'll help us measure, debug, and improve these systems across NVIDIA, AMD, Google TPU, and cloud partner environments.
This role is for someone who loves performance debugging, understands that small systems details can create massive product impact, and wants to work at the frontier of AI infrastructure.
What You'll Do- Analyze and improve performance across SGLang, Miles, and RadixArk production deployments
- Benchmark LLM inference and training workloads across GPUs, TPUs, and cloud environments
- Optimize latency, throughput, memory usage, batching, scheduling, routing, and GPU utilization
- Investigate performance regressions in real customer environments
- Work closely with kernel, runtime, distributed systems, and product engineers
- Build internal tooling for profiling, tracing, benchmarking, and regression detection
- Translate customer workload characteristics into concrete performance tuning strategies
- Help define performance metrics that matter commercially, including cost-per-token and serving efficiency
- Partner with customers and cloud partners on deep technical evaluations
- Contribute performance insights back to open-source SGLang and Miles
- Strong systems engineering background, especially in performance-critical software
- Experience with GPU systems, distributed systems, inference serving, ML runtimes, or high-performance computing
- Familiarity with profiling tools, performance debugging, tracing, and benchmark methodology
- Comfort working with Python and C++
- Experience with CUDA, Triton, Pallas, ROCm, XLA, or kernel-level optimization is a strong plus
- Understanding of LLM inference concepts such as batching, KV cache, prefill/decode, speculative decoding, MoE, long context, and P99 latency
- Ability to debug messy real-world performance issues across software, hardware, and infrastructure layers
- Strong communication skills - you should be able to explain performance tradeoffs to both engineers and customers
- Prior experience with production AI infrastructure, cloud GPU environments, or open-source ML systems is a plus
RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang, and developed Miles, our large-scale RL framework.
We're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training.
Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.
We're backed by well-known infrastructure investors and partner with Nvidia, Google, AWS, and frontier AI labs.
Join us in building infrastructure that gives real leverage back to the AI community.
CompensationWe offer competitive compensation with meaningful equity, comprehensive health benefits, and flexible work arrangements. Compensation is determined by location, level, and experience.
Equal OpportunityRadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.