ZipRecruiter

Log In

1

Inference Engineer Jobs (NOW HIRING)

PICTOR LABS INC

$89K - $123K/yr

About the Role We are seeking an experienced Senior ML Inference Engineer to join our team, focusing on optimizing and deploying our production virtual staining models at scale. The ideal candidate ...

Etched

Inference Software Engineer

Cupertino, CA · On-site

They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack and implement high-performance, modular code across the complete Etched ...

Etched

Inference Software Engineer

Cupertino, CA · On-site

They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack, implement high-performance code, and collaborate with various teams to ...

Etched

Inference Software Engineer

Cupertino, CA · On-site

They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack, implement high-performance code, and collaborate with various teams to ...

EnCharge AI

LLM Inference Deployment Engineer

$180K - $240K/yr

About the Role EnCharge AI is seeking an LLM Inference Deployment Engineer to optimize, deploy, and scale large language models (LLMs) for high-performance inference on its energy efficient AI ...

WEKA

OR

You will lead and grow a squad of 3 developers, balancing hands-on technical contribution with ... Take end-to-end ownership of AMG's core inference infrastructure - from the NVMe Token Warehouse ...

next page

Showing results 1-20

All JobsInference Engineer Jobs

Inference Engineer information

See salary details

$44K

$106.4K

$173.5K

How much do inference engineer jobs pay per year?

As of Jul 9, 2026, the average yearly pay for inference engineer in the United States is $106,386.00, according to ZipRecruiter salary data. Most workers in this role earn between $76,000.00 and $132,500.00 per year, depending on experience, location, and employer.
Infographic showing various Inference Engineer job openings in the United States as of July 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $106,386 per year, or $51.1 per hour.
AI Inference Engineer Intern - Model Pruning

AI Inference Engineer Intern - Model Pruning

quadric, Inc

Burlingame, CA • On-site

$45 - $60/hr

Internship

Re-posted 17 days ago

Job description

Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging from battery operated smart-sensor systems to high-performance automotive or autonomous vehicle systems. Unlike other NPUs or neural network accelerators in the industry today that can only accelerate a portion of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.
Note: Our preference is for this internship to be based out of our Burlingame, California office. Candidates should be based in the Bay Area or able to relocate for the internship period and available to work on site.
Responsibilities:
Model pruning: Prune the model to speed up inference with re-training to maintain accuracy.

Requirements

  • MS student in CS or related fields.
  • Proficiency in Python
  • Experience with model pruning and training in PyTorch
  • Experience in quantization, and vision model accuracy metrics.

Benefits

At Quadric, we value Integrity, Humility, and Happiness. What we expect from one another is simple and clear: Initiative, Collaboration, and Completion. We are a collaborative team focused on building something extraordinary in the edge computing space.

The hourly rate for this temporary internship position is $45.00/hour to $60.00/hour. The actual rate offered will depend on a number of factors, including the specific level of the role, years and depth of relevant experience and education, technical skills and competencies, and work location.

Quadric interns receive hands-on experience working alongside industry experts in AI and semiconductor technology, with access to mentorship and meaningful project ownership from day one.

Founded in 2016 and based in downtown Burlingame, California, Quadric is building the world’s first supercomputer designed for the real-time needs of edge devices. Quadric aims to empower developers in every industry with superpowers to create tomorrow’s technology, today. The company was co-founded by technologists from MIT and Carnegie Mellon, who were previously the technical co-founders of the Bitcoin computing company 21.

Quadric is proud to be an equal opportunity employer. We are committed to creating an inclusive environment where people from all backgrounds can do their best work. We consider all qualified applicants without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, veteran status, or any other protected characteristic under applicable law.

If this role resonates with you, we encourage you to apply even if your experience does not perfectly match every qualification. We value potential, curiosity, and a willingness to learn just as much as direct experience. Skills and growth come in many forms, and we would love to hear your story.

By submitting an application, you acknowledge that Quadric will collect and process your personal information as part of the hiring process. Please review our Privacy Policy to understand how we handle your data.

Quadric.io logo

About Quadric.io

Sourced by ZipRecruiter

Industry

Semiconductor and electronic component manufacturing

Company size

11 - 50 Employees

Headquarters location

Burlingame, CA, US

Year founded

2016

Social media

Twitter

View All Quadric.io Jobs