Sr. Inference Optimization Engineer (local / edge runtime)
Hillsboro, OR · On-site
$133K - $175K/yr
Profile and optimize local inference (llama.cpp-vulkan and vLLM) for latency, throughput, and memory on edge hardware * Tune KV cache, continuous batching, and scheduling for interactive agent ...
