ZipRecruiter

Log In

1

Ml Compiler Engineer Jobs in California (NOW HIRING)

TetraMem Inc

Compiler Engineer

San Jose, CA · On-site

$160K - $300K/yr

Collaborate closely with machine learning engineers to support model conversion, validation ... Knowledge of ML compilers such as MLIR * Experience with LLVM and other open-source compiler ...

DensityAI

Compiler Engineer -- MLIR

Mountain View, CA · On-site

... ML frameworks to silicon. • Use and develop AI-assisted tool flows to accelerate compiler ... compiler engineering experience, with hands-on MLIR contributions or equivalent IR-design ...

Luminal

Senior Compiler Engineer

San Francisco, CA · On-site

$123K - $169K/yr

They are seeking a Senior Compiler Engineer to design and build core compiler infrastructure ... PTX/SASS, GCN/RDNA assembly, or other GPU ISAs • Familiar with ML compilers: torch.compile (or ...

Nvidia

Senior Compiler Engineer - AI

Santa Clara, CA

$143K - $189K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... Strong mathematical and scientific foundation relevant to AI/ML and compiler technologies. * Hands ...

DensityAI

Compiler Engineer - MLIR

Mountain View, CA

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... compiler engineering experience, with hands-on MLIR contributions or equivalent IR-design ... Strong C++ fluency and experience integrating with ML frameworks (PyTorch, JAX, ONNX, TensorFlow ...

Nvidia

Senior Compiler Engineer Infrastructure

Santa Clara, CA · On-site +1

$127K - $173K/yr

Our compiler organization makes its mark on every GPU NVIDIA produces. By improving how our ... Practical experience applying AI or ML-based tools to improve engineering workflows * Background in ...

Persimmons

Compiler Engineer (Frontend)

San Jose, CA · On-site

  • Retirement

  • PTO

Design and build the compiler that converts AI models from popular ML frameworks into assembly code ... Provide technical leadership across the compiler team, mentoring engineers in advanced compiler ...

Persimmons

Compiler Engineer (Frontend)

San Jose, CA

  • Retirement

  • PTO

Design and build the compiler that converts AI models from popular ML frameworks into assembly code ... Provide technical leadership across the compiler team, mentoring engineers in advanced compiler ...

previous pagenext page

Showing results 21-40

All JobsMl Compiler Engineer JobsMl Compiler Engineer Jobs in California

Ml Compiler Engineer information

What does an ML Compiler Engineer do?

An ML Compiler Engineer designs and develops compilers and software tools that optimize machine learning models for deployment on various hardware platforms. Their work involves translating high-level ML code into optimized, low-level instructions that can run efficiently on CPUs, GPUs, or specialized accelerators. They collaborate closely with hardware engineers and ML researchers to ensure models execute quickly and accurately. Additionally, ML Compiler Engineers may work on improving performance, reducing memory usage, and supporting new ML frameworks or hardware.

What are some typical collaboration points between an ML Compiler Engineer and other teams during a project?

ML Compiler Engineers frequently collaborate with machine learning researchers to understand model requirements, with hardware engineers to optimize for specific accelerators, and with software developers to ensure seamless integration into production systems. This role often involves participating in cross-functional meetings, code reviews, and design discussions to align compiler optimizations with both hardware capabilities and end-user needs. Effective communication and teamwork are essential, as these engineers play a central role in bridging the gap between algorithm design and efficient execution on target platforms.

What is the difference between Ml Compiler Engineer vs Machine Learning Engineer?

AspectMl Compiler EngineerMachine Learning Engineer
Required SkillsProgramming, compiler design, optimization, ML frameworksData analysis, model development, programming, ML frameworks
Work EnvironmentResearch labs, tech companies, AI hardware firmsTech companies, startups, data-driven organizations
CertificationsComputer science, software engineering, specialized compiler coursesMachine learning, data science, AI certifications
Industry UsageAI hardware, software optimization, ML infrastructureModel development, deployment, data analysis

While both roles involve machine learning, Ml Compiler Engineers focus on optimizing ML models through compiler design and software performance, whereas Machine Learning Engineers develop and deploy ML models for applications. The roles often overlap in skills but differ in their primary focus areas.

What are the key skills and qualifications needed to thrive as an ML Compiler Engineer, and why are they important?

To thrive as an ML Compiler Engineer, you need a strong background in computer science, compiler design, machine learning concepts, and typically a degree in computer science or a related field. Familiarity with tools like LLVM, MLIR, TensorFlow XLA, and programming in C++ and Python is often required, along with experience in optimizing machine learning workloads. Strong problem-solving abilities, attention to detail, and effective collaboration skills help set top professionals apart. These skills ensure efficient translation and optimization of ML models for diverse hardware, enhancing performance and scalability.

What are popular job titles related to Ml Compiler Engineer jobs in California?

For Ml Compiler Engineer jobs in California, the most frequently searched job titles are:

What job categories do people searching Ml Compiler Engineer jobs in California look for?

The top searched job categories for Ml Compiler Engineer jobs in California are:

What cities in California are hiring for Ml Compiler Engineer jobs?

Cities in California with the most Ml Compiler Engineer job openings:

Ml Compiler Engineer jobs near you
Infographic showing various Ml Compiler Engineer job openings in California as of August 2026, with employment types broken down into 88% Full Time, 5% Part Time, 2% Temporary, and 5% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution.

Compiler Engineer

TetraMem Inc

San Jose, CA • On-site

$160K - $300K/yr

Full-time

Re-posted 8 days ago

Job description

Responsibilities:
  • Design, develop, and maintain compiler toolchains that translate machine learning models from industry-standard frameworks into optimized workloads for TetraMem's analog in-memory computing hardware.
  • Develop runtime systems, software libraries, and SDK components that enable efficient deployment, execution, and management of AI applications on TetraMem accelerators.
  • Implement compiler optimizations, including graph transformations, operator fusion, memory optimization, scheduling, and code generation to maximize performance and energy efficiency.
  • Research and develop innovative techniques to improve machine learning inference speed, latency, throughput, and power consumption across a wide range of AI workloads.
  • Collaborate closely with machine learning engineers to support model conversion, validation, optimization, benchmarking, and deployment.
  • Partner with hardware architects and silicon engineering teams to co-design software and hardware features that improve system performance, programmability, and usability.
  • Develop performance analysis, profiling, debugging, and benchmarking tools to evaluate and optimize AI workloads on current and future TetraMem platforms.
  • Integrate and support industry-standard machine learning frameworks and model formats, including PyTorch, TensorFlow, ONNX, and other emerging AI ecosystems.
  • Lead technical design reviews, contribute to software architecture decisions, and establish best practices for scalable, maintainable, and high-quality software development.
  • Mentor junior engineers, contribute to technical documentation, and help define the long-term roadmap for TetraMem's compiler, runtime, and SDK technologies.

Requirements:
  • MS or PhD in Computer Engineering/CS/EE
  • 5+ years industry experience as a compiler engineer or developer
  • Experience developing compilers for GPU, dataflow compilers, or ML compilers
  • Startup mindset/experience

Experience in one or more of the following areas considered a strong plus:
  • Experience in RISC-V CPU/VPU kernel development and optimization
  • Experience providing technical leadership and/or guidance to other engineers
  • Knowledge of popular CPU/GPU compilers such as GCC, Clang
  • Knowledge of ML compilers such as MLIR
  • Experience with LLVM and other open-source compiler libraries and tools
  • Publications on compilation of ML or dataflow programs for HW acceleration

Salary Range: $160,000 - $300,000 / year
TetraMem celebrates diversity and is committed to creating an inclusive environment for all employees. We are proud to be an Equal Opportunity Employer and welcome applicants from all backgrounds. Qualified candidates will receive consideration for employment without regard to race, color, religion, creed, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, disability, genetic information, military or veteran status, or any other characteristic protected by applicable federal, state, or local law.
TetraMem is committed to providing reasonable accommodations to qualified applicants with disabilities throughout the recruitment process. Applicants requiring accommodation may contact Human Resources for assistance.
To ensure a fair, consistent, and efficient hiring process, all candidates must apply through TetraMem's official ClearCompany Applicant Tracking System (ATS). Applications submitted through the ATS allow our hiring team to evaluate candidates using a standardized process and ensure timely communication throughout the recruitment process. To promote equal consideration for all applicants, applications submitted outside of the ClearCompany ATS, including direct emails, LinkedIn messages, or unsolicited submissions to employees, may not be reviewed or considered.
We encourage all interested candidates to apply through the official TetraMem Careers page.

Apply