1

Machine Learning Hardware Jobs in Sunnyvale, CA (NOW HIRING)

Machine Learning FEA Engineer

San Francisco, CA ยท On-site

$150.40 - $277.60/hr

San Francisco Bay Area, California, United States Hardware Imagine what you can do here! We are ... The machine learning models will drive rapid design iterations by assessing potential risks and ...

Machine Learning Engineer

Santa Clara, CA ยท On-site +1

$184K - $253K/yr

... and machine learning to accelerate scientific and materials innovation. Our mission is to create ... hardware design. We work closely with scientists, engineers, and product leaders to translate ...

... hardware innovation at the speed of software. We are building an AI-driven simulation software ... Who We're Looking For As a Machine Learning Engineer in Delivery, you are a problem solver who ...

Showing results 21-40

Machine Learning Hardware information

See Sunnyvale, CA salary details

$14

$28

$56

How much do machine learning hardware jobs pay per hour?

As of Aug 8, 2026, the average hourly pay for machine learning hardware in Sunnyvale, CA is $28.86, according to ZipRecruiter salary data. Most workers in this role earn between $20.58 and $32.74 per hour, depending on experience, location, and employer.

What is a machine learning hardware?

A Machine Learning Hardware job involves designing, optimizing, and developing specialized hardware to accelerate machine learning workloads. Professionals in this field work on hardware architectures like GPUs, TPUs, FPGAs, and custom accelerators to improve efficiency, performance, and power consumption. They collaborate with software engineers and data scientists to optimize hardware-software co-design. This role requires expertise in computer architecture, parallel computing, and low-level programming.

What are the typical day-to-day responsibilities for a machine learning hardware engineer?

As a Machine Learning Hardware engineer, your daily tasks often include collaborating with data scientists and software engineers to understand computational requirements, designing and prototyping hardware accelerators, and optimizing existing architectures for improved performance and efficiency. You might work with simulation tools to model new designs, validate hardware functionality, and troubleshoot issues during integration. The role typically involves both independent technical work and teamwork across hardware and AI/ML departments. This position requires keeping up to date with emerging technologies to ensure your solutions remain cutting-edge and competitive in the fast-evolving landscape of artificial intelligence.

What are the key skills and qualifications needed to thrive in the machine learning hardware position, and why are they important?

To thrive in Machine Learning Hardware, you need a solid background in computer engineering, digital design, and machine learning principles, often supported by a degree in electrical engineering, computer engineering, or a related field. Familiarity with hardware description languages (such as VHDL or Verilog), simulation tools, FPGA/ASIC development platforms, and possibly certifications in hardware design or ML accelerators is valuable. Collaboration, problem-solving, and the ability to communicate complex technical ideas effectively are essential soft skills. These skills enable you to design and optimize specialized hardware solutions that accelerate machine learning workloads and foster interdepartmental innovation.

What are popular job titles related to Machine Learning Hardware jobs in Sunnyvale, CA? For Machine Learning Hardware jobs in Sunnyvale, CA, the most frequently searched job titles are:
Infographic showing various Machine Learning Hardware job openings in Sunnyvale, CA as of August 2026, with employment types broken down into 1% As Needed, 73% Full Time, 23% Part Time, 1% Temporary, and 2% Contract. Highlights an 87% Physical, 2% Hybrid, and 11% Remote job distribution, with an average salary of $60,037 per year, or $28.9 per hour.

Mid- level Machine Learning Engineer

InstantServe LLC

San Jose, CA โ€ข On-site

Full-time

This job post hasย expired today.ย Applications are no longer accepted.


Job description

Job Title: Senior Machine Learning Engineer
Client: TetraMem Inc
Location: San Jose, California
Senior Machine Learning Engineer
About the job
Responsibilities
  • Develop, optimize, and deploy lightweight machine learning models for edge AI applications, particularly for audio processing.
  • Implement and optimize ML models on embedded platforms, including FPGA and custom ASIC solutions.
  • Work closely with hardware and software teams to integrate ML models into production systems.
  • Research and implement state-of-the-art ML techniques to enhance model efficiency, latency, and power consumption for embedded AI applications.
  • Improve inference efficiency and model compression techniques, including quantization, pruning, and knowledge distillation.
  • Collaborate with cross-functional teams to drive innovation and contribute to the overall system architecture.
  • Provide technical leadership and mentorship to junior engineers.
  • Publish research findings, present at conferences, and contribute to open-source projects when applicable.
Requirements
  • 5+ years of relevant industry experience (or a PhD) in Computer Science, Electrical Engineering, Machine Learning, or related fields.
  • Must have prior experience managing a team, serving in a Team Lead role, or demonstrating strong technical leadership and cross-functional coordination capabilities.
  • Strong hands-on experience in machine learning, with a focus on edge AI, on-device inference, and deploying lightweight models on resource-constrained devices.
  • Expertise in modern ML frameworks such as PyTorch, TensorFlow (including TensorFlow Lite), and JAX.
  • Proficiency in Python and C/C++, with practical experience in ML model optimization and production deployment.
  • Deep experience with model quantization (PTQ/QAT), pruning, knowledge distillation, sparsity, and other compression techniques for efficient edge inference.
  • Hands-on experience developing for or integrating with AI chip SDKs, neural accelerators (NPUs/DSPs), or hardware-specific toolchains (e.g., NVIDIA TensorRT, Qualcomm Neural Processing SDK, ARM Ethos, or similar).
  • Familiarity with edge inference runtimes (ONNX Runtime, ExecuTorch, TVM) and optimizing models for hardware constraints (latency, memory footprint, power consumption).
Experience in one or more of the following areas considered a strong plus:
  • Understanding of ML compiler and runtime design.
  • Experience working with tools such as Optimum, ONNX, TensorRT, TFLite/LiteRT, ncnn, or CoreML.
  • Familiarity with hardware acceleration techniques.
  • Experience in embedded system development.

InstantServe logo

About InstantServe

Sourced by ZipRecruiter

InstantServe provides a one-stop solution to all Healthcare, IT/Non-IT Staffing needs. Established in 2016, InstantServe is a strong workforce of over 100+ go-getters with a demonstrated background in IT/Non-IT service. We are a nationally certified SBE from the Department of Administration (State of PA). As a proud Minority Woman Owned Small Business Enterprise (M/WBE), InstantServe boasts of a strong team of professionals who have extensive experience catering to several Federal, Public, Commercial, and Healthcare Clients which includes 26 States and 46 government agencies. InstantServe is a client-centric organization that offers cost-effective and reliable solutions. Client satisfaction is sacrosanct! Our team strives to provide the best staffing and IT solutions to take your business to the next level.

Industry

Recruiting and staffing services

Company size

11 - 50 Employees

Headquarters location

Wayne, PA, US

Year founded

2016

Social media