ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in California

NVIDIA

Senior Compiler Engineer - AI

Santa Clara, CA · On-site

$122K - $168K/yr

The role involves driving innovative solutions in compilers and developer tools through applied machine learning and AI, focusing on building AI-driven compiler intelligence for production pipelines.

TetraMem Inc

Compiler Engineer

San Jose, CA · On-site

$160K - $300K/yr

Design, develop, and maintain compiler toolchains that translate machine learning models from ... Collaborate closely with machine learning engineers to support model conversion, validation ...

Nvidia

Senior Compiler Engineer - AI

Santa Clara, CA · On-site

$143K - $189K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... The ideal candidate brings broad experience across machine learning, including reinforcement ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in California

Machine Learning Compiler Engineer information

See California salary details

$31.1K

$127.1K

$191K

How much do machine learning compiler engineer jobs pay per year?

As of Jul 9, 2026, the average yearly pay for machine learning compiler engineer in California is $127,083.00, according to ZipRecruiter salary data. Most workers in this role earn between $100,200.00 and $153,000.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in California? The most popular types of Machine Learning Compiler Engineer jobs in California are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in California? For Machine Learning Compiler Engineer jobs in California, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in California look for? The top searched job categories for Machine Learning Compiler Engineer jobs in California are:
Machine Learning Compiler Engineer jobs near you
Compiler Engineer

Compiler Engineer

TetraMem - Accelerate The World

San Jose, CA • On-site

Full-time

Re-posted 26 days ago

Job description

Job Summary:
TetraMem is a company focused on accelerating the world through innovative technology. They are seeking a Compiler Engineer to develop a compiler toolchain for deep learning models and optimize their performance on new hardware.
Responsibilities:
• Develop compiler toolchain to translate deep learning models to revolutionary new hardware
• Innovative in ways to optimize the speed and efficiency of ML model inference
• Collaborate with machine learning and hardware teams
Qualifications:
Required:
• MS or PhD in Computer Engineering/CS/EE
• 5+ years industry experience as a compiler engineer or developer
• Experience developing compilers for GPU, dataflow compilers, or ML compilers
• Startup mindset/experience
Preferred:
• Experience in RISC-V CPU/VPU kernel development and optimization
• Experience providing technical leadership and/or guidance to other engineers
• Knowledge of popular CPU/GPU compilers such as GCC, Clang
• Knowledge of ML compilers such as MLIR
• Experience with LLVM and other open-source compiler libraries and tools
• Publications on compilation of ML or dataflow programs for HW acceleration
Company:
TetraMem is developing cutting-edge analog computing solutions for AI applications, offering exceptional performance with ultra-low power consumption. Founded in 2018, the company is headquartered in Newark, USA, with a team of 51-200 employees. The company is currently Growth Stage.

Apply