ZipRecruiter

Log In

1

Tpu Jobs (NOW HIRING)

Google

TPU SoC Design Engineer, Cloud

Sunnyvale, CA · On-site

You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries ...

Anthropic

TPU Kernel Engineer

San Francisco, CA

About the Role As a TPU Kernel Engineer, you'll be responsible for identifying and addressing performance issues across many different ML systems, including research, training, and inference. A ...

Google Inc.

RTL Design Engineer, TPU and ML

Sunnyvale, CA · On-site

$150 - $200/hr

You will have an opportunity to drive cutting‑edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries ...

Google Inc.

TPU SoC Design Engineer, Cloud

Sunnyvale, CA · On-site

$150 - $200/hr

You will have an opportunity to drive cutting‑edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries ...

Google

RTL Design Engineer, TPU and ML

Sunnyvale, CA · On-site

You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries ...

Google

RTL Design Engineer, TPU

Sunnyvale, CA · On-site

You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You'll be part of a team that pushes boundaries ...

next page

Showing results 1-20

All JobsTpu Jobs

Tpu information

See salary details

$29K

$88.6K

$137K

How much do tpu jobs pay per year?

As of Sep 7, 2026, the average yearly pay for tpu in the United States is $88,611.00, according to ZipRecruiter salary data. Most workers in this role earn between $66,000.00 and $112,000.00 per year, depending on experience, location, and employer.

What is a TPU?

A TPU (Tensor Processing Unit) job typically involves working with specialized hardware accelerators designed to enhance machine learning workloads, particularly deep learning models. These jobs may include roles in AI research, model optimization, and deploying machine learning applications at scale. Professionals in TPU-related roles often have expertise in TensorFlow, neural networks, and high-performance computing.

What are the typical daily responsibilities of a TPU?

As a TPO, your daily tasks usually involve updating the progress of ongoing technical projects, maintaining documentation systems, and ensuring all stakeholders are informed of key developments. You will collaborate closely with engineers, project managers, and other team members to gather data and report on milestones or issues. Additionally, you may be responsible for organizing and participating in status meetings, helping to identify roadblocks, and keeping workflow tools up to date. The role requires excellent multitasking and organizational skills to manage multiple projects simultaneously while delivering accurate information in a fast-paced environment.

What are the key skills and qualifications needed to thrive in the TPU position, and why are they important?

To thrive as a TPO (Technical Project Updater), you need strong project management abilities, technical knowledge relevant to the industry, and keen attention to detail, typically gained through a bachelor's degree in a related field and experience managing technical documentation. Familiarity with project management software like Jira or Asana, and proficiency in updating technical databases and tracking systems, are important. Excellent communication, organization, and time management skills help TPOs manage multiple updates and cross-team collaboration efficiently. These competencies are vital to ensure project statuses are accurately tracked and communicated, leading to better coordination and timely project delivery.

More about Tpu jobs

What cities are hiring for Tpu jobs?

Cities with the most Tpu job openings:

What are the most commonly searched types of Tpu jobs?

The most popular types of Tpu jobs are:

What job categories do people searching Tpu jobs look for?

The top searched job categories for Tpu jobs are:

Tpu jobs near you
Infographic showing various Tpu job openings in the United States as of August 2026, with employment types broken down into 97% Full Time, 2% Part Time, and 1% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $88,611 per year, or $42.6 per hour.

Member of Technical Staff - Inference-TPU

RadixArk

Palo Alto, CA

$200K - $400K/yr

Full-time

Re-posted 20 days ago

Job description

About the Role

RadixArk is looking for a Member of Technical Staff - TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU hardware, working on SGLang-JAX and other critical infrastructure that enables efficient deployment of frontier models on Google's tensor processing units.

Requirements
  • 3+ years experience building production ML systems utilizing JAX/Torch, XLA, or TPU-focused frameworks. 
  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or equivalent industry experience
  • Deep understanding of XLA internals preferred: HLO, MLIR, operator fusion, SPMD partitioning, and sharding strategies.
  • Strong performance tuning instincts across compiler and runtime layers
  • Experience with distributed inference systems (e.g. SGLang, vLLM) or training frameworks (e.g. Miles, Alpa, Pathways)
  • Proficiency in Python with demonstrated ability to write high-performance, production-quality code
  • Experience writing custom GPU/TPU/AI Accelerator kernels. Familiarity with Pallas for kernel development is strongly preferred. 
Responsibilities
  • Build high-performance inference and training systems using JAX/XLA/Pallas, including SGLang-JAX
  • Push large-model workloads to the limits on the newest TPU hardwares
  • Optimize end-to-end latency and throughput for LLM serving on TPU infrastructure
  • Design and implement SPMD strategies for efficient distributed inference and training
  • Design and implement Pallas kernels for operations that require customized low level control for best performance
  • Profile and optimize XLA compilation pipelines and HLO graph transformations
  • Collaborate with kernel engineers and compiler teams to achieve performance wins across the stack
  • Contribute to open-source projects with TPU optimization guides, benchmarks, and architectural insights
About RadixArk

RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.

Compensation

Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

Equal Opportunity

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply