Mountain View, CA · On-site
$202K - $240K/yr
Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum ... You are energized by the prospect of building proofs-of-concept in days rather than months. You ...
Mountain View, CA · On-site
$202K - $240K/yr
Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum ... You are energized by the prospect of building proofs-of-concept in days rather than months. You ...
Cardiff By The Sea, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
Cardiff By The Sea, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
$65K - $169K/yr
Where no two days arethe same. Location This role is on-site in Minneapolis, MN About the role you ... Expertise in GPUaccelerated programming, including OpenGL, GLSL shaders, CUDA Kernels, or general ...
$65K - $169K/yr
Where no two days arethe same. Location This role is on-site in Minneapolis, MN About the role you ... Expertise in GPUaccelerated programming, including OpenGL, GLSL shaders, CUDA Kernels, or general ...
Rancho Santa Fe, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
Rancho Santa Fe, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
Chula Vista, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
Chula Vista, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
La Jolla, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
La Jolla, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
El Cajon, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
El Cajon, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
San Diego, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
San Diego, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
National City, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
National City, CA · On-site +1
$87K - $157K/yr
Translate and enhance existing code for GPU/CUDA acceleration and parallel/distributed execution ... days with an anticipated close date of no earlier than 3 days after the original posting date as ...
Mountain View, CA · On-site
$70 - $79/hr
Mountain View, CA (Onsite role, 5 days/week onsite) Duration: 4-month contract Pay Range: $70 - 79 ... Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum ...
Mountain View, CA · On-site
$70 - $79/hr
Mountain View, CA (Onsite role, 5 days/week onsite) Duration: 4-month contract Pay Range: $70 - 79 ... Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum ...
Austin, TX · On-site
$103K - $142K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Austin, TX · On-site
$103K - $142K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Redmond, WA · On-site
$117K - $160K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Redmond, WA · On-site
$117K - $160K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Redmond, WA · On-site
$117K - $160K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Redmond, WA · On-site
$117K - $160K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Plano, TX · On-site
$117K - $154K/yr
Active and existing security clearance required on day 1 At RTX, the world largest aerospace and ... Experience with optimized CUDA programming for Nvidia accelerators. * Prior work in HPC ...
Plano, TX · On-site
$117K - $154K/yr
Active and existing security clearance required on day 1 At RTX, the world largest aerospace and ... Experience with optimized CUDA programming for Nvidia accelerators. * Prior work in HPC ...
Santa Clara, CA · On-site
$122K - $168K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
Santa Clara, CA · On-site
$122K - $168K/yr
... and day to day operation through automation. • Provide technical leadership and strategic ... Preferred : • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking. • ...
$117K - $154K/yr
Active and existing security clearance required on day 1 At RTX, the world largest aerospace and ... Experience with optimized CUDA programming for Nvidia accelerators. * Prior work in HPC ...
$117K - $154K/yr
Active and existing security clearance required on day 1 At RTX, the world largest aerospace and ... Experience with optimized CUDA programming for Nvidia accelerators. * Prior work in HPC ...
... A day in the life In this role, you will: - Optimize transformer blocks using custom CUDA kernels ... programming language experience - 5+ years of leading design or architecture (design patterns ...
... A day in the life In this role, you will: - Optimize transformer blocks using custom CUDA kernels ... programming language experience - 5+ years of leading design or architecture (design patterns ...
Santa Clara, CA · Hybrid
$142K - $188K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
Santa Clara, CA · Hybrid
$142K - $188K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
Santa Clara, CA · Hybrid
$143K - $189K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
Santa Clara, CA · Hybrid
$143K - $189K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
Santa Clara, CA · On-site
$143K - $189K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
Santa Clara, CA · On-site
$143K - $189K/yr
... CUDA programming or exposure to kernel generation / autotuning efforts. * High-velocity prototyping: A track record of rapidly turning state-of-the-art papers into working prototypes in days, not ...
$12.02 - $17.18
4% of jobs
$17.18 - $22.33
9% of jobs
$26.04 is the 25th percentile. Wages below this are outliers.
$22.33 - $27.49
17% of jobs
$27.49 - $32.65
13% of jobs
The median wage is $35.66 / hr.
$32.65 - $37.81
13% of jobs
$37.81 - $42.96
10% of jobs
$42.96 - $48.12
9% of jobs
$49.09 is the 75th percentile. Wages above this are outliers.
$48.12 - $53.28
9% of jobs
$53.28 - $58.44
7% of jobs
$58.44 - $63.59
6% of jobs
$63.59 - $68.75
4% of jobs
$12
$39
$68
$202K - $240K/yr
Other
This job post has expired 1 day ago. Applications are no longer accepted.
Job Category: Technical
Job Title: AI Infrastructure & Experience Engineer
Duties: Key Responsibilities
Inference Optimization: Deploy and tune multiple LLMs and generative multimodal models on local inference hardware. Optimize performance metrics (TTFT, tokens/sec) via model quantization, caching strategies, and architecture-specific adjustments.
Systems Engineering & CUDA: Leverage deep knowledge of the CUDA environment to build custom kernels, ensuring maximum utilization of the low cost GPU compute.
Orchestration & Integration: Seamlessly bridge inference backends with orchestration layers (LiteLLM, Ollama, etc.) and frontends like OpenWebUI.
Rapid Prototyping: Build functional, high-fidelity demos showcasing model memory capabilities, agentic workflows, and context-aware web search.
Peripheral Connectivity: Implement communication protocols to bridge local AI compute with peripheral devices, including smart TVs, household appliances, and XR hardware.
Skills: Technical Qualifications
Recent experience in model optimization required Hardware & Compute: Proven experience with NVIDIA eco-systems and ARM64 architecture.
Systems Programming: Advanced proficiency in C++, Python, and Rust. Deep familiarity with CUDA and the ability to author/debug custom CUDA kernels for compute-intensive tasks.
AI/ML Frameworks: Extensive experience with modern inference engines (llama.cpp, TensorRT-LLM, Ollama) and orchestration frameworks (LiteLLM).
Software Engineering: Robust understanding of asynchronous programming (FastAPI), containerization (Docker/Kubernetes), sandbox environments, and API design for low-latency communication.
Full-Stack Prototyping: Ability to quickly spin up modern frontend UIs (React, Next.js, or similar) to present AI-driven intelligence to end users.
Communication Protocols: Familiarity with WebSockets, gRPC, and REST for device-to-device communication in a local network environment.
Keywords:
Education: Ideal Candidate Profile
The "Builder" Mindset: You are energized by the prospect of building proofs-of-concept in days rather than months. You thrive in environments where speed and creativity are paramount.
Problem Solver: You approach unsolved, messy engineering challenges with enthusiasm rather than trepidation.
Architectural Vision: You see the "big picture" of how AI becomes part of the consumer's daily life, not just how the model generates text.
Agile & Adaptable: You are comfortable working in a fast-paced environment where priorities shift based on the results of rapid experimentation.
Degree in Computer Science, Machine Learning or Artificial Intelligence Specialization preferred, but not required
3 years of relevant industry experience required
Skills and Experience:
Required Skills:
INFERENCE OPTIMIZATION
NVIDIA ECOSYSTEMS
CUSTOM CUDA KERNEL DEVELOPMENT
ARM64 ARCHITECTURE
PYTHON
Additional Skills:
RUST
CUDA
MODERN INFERENCE ENGINES
LLAMA.CPP
TENSORRT-LLM
OLLAMA
ORCHESTRATION FRAMEWORKS
LITELLM
ASYNCHRONOUS PROGRAMMING
FASTAPI
CONTAINERIZATION
DOCKER
KUBERNETES
SANDBOX ENVIRONMENTS
API DESIGN
LOW-LATENCY COMMUNICATION
FRONTEND UI DEVELOPMENT
REACT
NEXT.JS
WEBSOCKETS
GRPC
REST
DEVICE-TO-DEVICE COMMUNICATION
PROBLEM SOLVING
ARCHITECTURAL VISION
AGILITY
ADAPTABILITY
Languages:
English
Read
Write
Speak
Minimum Degree Required: Bachelor's Degree
Patents: No
Publications: No
Veteran Status: No
# of Positions: 1
Sourced by ZipRecruiter
Real estate
201 - 500 Employees
Fremont, CA, US
