ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in California

TetraMem Inc

Compiler Engineer

San Jose, CA · On-site

$160K - $300K/yr

Design, develop, and maintain compiler toolchains that translate machine learning models from ... Collaborate closely with machine learning engineers to support model conversion, validation ...

Nvidia

Senior Compiler Engineer - AI

Santa Clara, CA

$143K - $189K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... The ideal candidate brings broad experience across machine learning, including reinforcement ...

Qualcomm

GPU AI Compiler Engineer

San Diego, CA · On-site

They are seeking a GPU AI Compiler Engineer to evaluate and improve performance of machine learning frameworks and optimize GPU hardware resource utilization. Responsibilities : • Applies knowledge ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in California

Machine Learning Compiler Engineer information

See California salary details

$31.1K

$127.1K

$191K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 18, 2026, the average yearly pay for machine learning compiler engineer in California is $127,083.00, according to ZipRecruiter salary data. Most workers in this role earn between $100,200.00 and $153,000.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in California? The most popular types of Machine Learning Compiler Engineer jobs in California are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in California? For Machine Learning Compiler Engineer jobs in California, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in California look for? The top searched job categories for Machine Learning Compiler Engineer jobs in California are:
Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in California as of June 2026, with employment types broken down into 95% Full Time, 3% Part Time, and 2% Contract. Highlights an 87% Physical, 5% Hybrid, and 8% Remote job distribution, with an average salary of $127,083 per year, or $61.1 per hour.
Compiler Engineer

Compiler Engineer

TetraMem Inc

San Jose, CA • On-site

$160K - $300K/yr

Full-time

Posted 12 days ago

Job description

Responsibilities:
  • Design, develop, and maintain compiler toolchains that translate machine learning models from industry-standard frameworks into optimized workloads for TetraMem's analog in-memory computing hardware.
  • Develop runtime systems, software libraries, and SDK components that enable efficient deployment, execution, and management of AI applications on TetraMem accelerators.
  • Implement compiler optimizations, including graph transformations, operator fusion, memory optimization, scheduling, and code generation to maximize performance and energy efficiency.
  • Research and develop innovative techniques to improve machine learning inference speed, latency, throughput, and power consumption across a wide range of AI workloads.
  • Collaborate closely with machine learning engineers to support model conversion, validation, optimization, benchmarking, and deployment.
  • Partner with hardware architects and silicon engineering teams to co-design software and hardware features that improve system performance, programmability, and usability.
  • Develop performance analysis, profiling, debugging, and benchmarking tools to evaluate and optimize AI workloads on current and future TetraMem platforms.
  • Integrate and support industry-standard machine learning frameworks and model formats, including PyTorch, TensorFlow, ONNX, and other emerging AI ecosystems.
  • Lead technical design reviews, contribute to software architecture decisions, and establish best practices for scalable, maintainable, and high-quality software development.
  • Mentor junior engineers, contribute to technical documentation, and help define the long-term roadmap for TetraMem's compiler, runtime, and SDK technologies.

Requirements:
  • MS or PhD in Computer Engineering/CS/EE
  • 5+ years industry experience as a compiler engineer or developer
  • Experience developing compilers for GPU, dataflow compilers, or ML compilers
  • Startup mindset/experience

Experience in one or more of the following areas considered a strong plus:
  • Experience in RISC-V CPU/VPU kernel development and optimization
  • Experience providing technical leadership and/or guidance to other engineers
  • Knowledge of popular CPU/GPU compilers such as GCC, Clang
  • Knowledge of ML compilers such as MLIR
  • Experience with LLVM and other open-source compiler libraries and tools
  • Publications on compilation of ML or dataflow programs for HW acceleration

Salary Range: $160,000 - $300,000 / year
TetraMem celebrates diversity and is committed to creating an inclusive environment for all employees. We are proud to be an Equal Opportunity Employer and welcome applicants from all backgrounds. Qualified candidates will receive consideration for employment without regard to race, color, religion, creed, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law.
TetraMem is committed to providing reasonable accommodations to qualified applicants with disabilities throughout the recruitment process. Applicants requiring accommodation may contact Human Resources for assistance.
To ensure a fair, consistent, and efficient hiring process, all candidates must apply through TetraMem's official ClearCompany Applicant Tracking System (ATS). Applications submitted through the ATS allow our hiring team to evaluate candidates using a standardized process and ensure timely communication throughout the recruitment process. To promote equal consideration for all applicants, applications submitted outside of the ClearCompany ATS, including direct emails, LinkedIn messages, or unsolicited submissions to employees, may not be reviewed or considered.
We encourage all interested candidates to apply through the official TetraMem Careers page.

Apply