1

Ml Compiler Engineer Jobs (NOW HIRING)

... compiler engineering experience (MLIR, LLVM, TVM, XLA, or equivalent ... Experience lowering ML workloads onto custom or non-standard hardware targets * Ability to read and ...

Compiler Tools Engineer

Austin, TX · On-site

$81K - $109K/yr

Improve ML compiler lowering and optimization pipelines for efficient execution on Qualcomm ... Strong programming skills in modern C/C++ and experience working in large software codebases * 5 ...

AI Compiler Engineer

$195K - $265K/yr

Work closely with ML researchers, hardware engineers, and software developers to design and deploy ... Develop compiler optimizations and passes that convert high-level AI models (e.g., from TensorFlow ...

AI Compiler Engineer

$195K - $265K/yr

Work closely with ML researchers, hardware engineers, and software developers to design and deploy ... Develop compiler optimizations and passes that convert high-level AI models (e.g., from TensorFlow ...

Senior Compiler Engineer - AI

Austin, TX · On-site

$121K - $160K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... Strong mathematical and scientific foundation relevant to AI/ML and compiler technologies. * Hands ...

Senior Compiler Engineer

Austin, TX · On-site

$103K - $142K/yr

Grow with us Senior Compiler Engineer Austin, Texas This is not a remote work opportunity. The ... The compiler takes ML models from StableHLO through orchestration, tiling, memory planning, and ...

Senior Compiler Engineer

Austin, TX · On-site

$103K - $142K/yr

Grow with us Senior Compiler Engineer Austin, Texas This is not a remote work opportunity. The ... The compiler takes ML models from StableHLO through orchestration, tiling, memory planning, and ...

Senior Compiler Engineer

San Francisco, CA · On-site

$123K - $169K/yr

They are seeking a Senior Compiler Engineer to design and build core compiler infrastructure ... PTX/SASS, GCN/RDNA assembly, or other GPU ISAs • Familiar with ML compilers: torch.compile (or ...

Senior Compiler Engineer - AI

Austin, TX

$121K - $160K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... Strong mathematical and scientific foundation relevant to AI/ML and compiler technologies. * Hands ...

Senior Compiler Engineer - AI

Redmond, WA

$137K - $180K/yr

We are seeking an AI Compiler Engineer with deep expertise in compiler technologies to join our ... Strong mathematical and scientific foundation relevant to AI/ML and compiler technologies. * Hands ...

Senior Compiler Engineer - AI

Austin, TX · On-site

$121K - $160K/yr

Collaborate with world-class engineers to shape next-generation compiler capabilities that power ... Strong mathematical and scientific foundation relevant to AI/ML and compiler technologies. * Hands ...

Showing results 41-60

Ml Compiler Engineer information

See salary details

$33K

$89.2K

$142K

How much do ml compiler engineer jobs pay per year?

As of Sep 13, 2026, the average yearly pay for ml compiler engineer in the United States is $89,183.00, according to ZipRecruiter salary data. Most workers in this role earn between $66,500.00 and $109,000.00 per year, depending on experience, location, and employer.

What does an ML Compiler Engineer do?

An ML Compiler Engineer designs and develops compilers and software tools that optimize machine learning models for deployment on various hardware platforms. Their work involves translating high-level ML code into optimized, low-level instructions that can run efficiently on CPUs, GPUs, or specialized accelerators. They collaborate closely with hardware engineers and ML researchers to ensure models execute quickly and accurately. Additionally, ML Compiler Engineers may work on improving performance, reducing memory usage, and supporting new ML frameworks or hardware.

What are some typical collaboration points between an ML Compiler Engineer and other teams during a project?

ML Compiler Engineers frequently collaborate with machine learning researchers to understand model requirements, with hardware engineers to optimize for specific accelerators, and with software developers to ensure seamless integration into production systems. This role often involves participating in cross-functional meetings, code reviews, and design discussions to align compiler optimizations with both hardware capabilities and end-user needs. Effective communication and teamwork are essential, as these engineers play a central role in bridging the gap between algorithm design and efficient execution on target platforms.

What are the key skills and qualifications needed to thrive as an ML Compiler Engineer, and why are they important?

To thrive as an ML Compiler Engineer, you need a strong background in computer science, compiler design, machine learning concepts, and typically a degree in computer science or a related field. Familiarity with tools like LLVM, MLIR, TensorFlow XLA, and programming in C++ and Python is often required, along with experience in optimizing machine learning workloads. Strong problem-solving abilities, attention to detail, and effective collaboration skills help set top professionals apart. These skills ensure efficient translation and optimization of ML models for diverse hardware, enhancing performance and scalability.

What is the difference between Ml Compiler Engineer vs Machine Learning Engineer?

AspectMl Compiler EngineerMachine Learning Engineer
Required SkillsProgramming, compiler design, optimization, ML frameworksData analysis, model development, programming, ML frameworks
Work EnvironmentResearch labs, tech companies, AI hardware firmsTech companies, startups, data-driven organizations
CertificationsComputer science, software engineering, specialized compiler coursesMachine learning, data science, AI certifications
Industry UsageAI hardware, software optimization, ML infrastructureModel development, deployment, data analysis

While both roles involve machine learning, Ml Compiler Engineers focus on optimizing ML models through compiler design and software performance, whereas Machine Learning Engineers develop and deploy ML models for applications. The roles often overlap in skills but differ in their primary focus areas.

More about Ml Compiler Engineer jobs

What cities are hiring for Ml Compiler Engineer jobs?

Cities with the most Ml Compiler Engineer job openings:

What states have the most Ml Compiler Engineer jobs?

States with the most job openings for Ml Compiler Engineer jobs include:

What are popular job titles related to Ml Compiler Engineer jobs?

For Ml Compiler Engineer jobs, the most frequently searched job titles are:

Infographic showing various Ml Compiler Engineer job openings in the United States as of September 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution, with an average salary of $89,183 per year, or $42.9 per hour.

Compiler Engineer

Berkeley, CA • On-site

Other

This job post has expired 3 days ago. Applications are no longer accepted.


Job description

You build the software infrastructure that makes novel hardware actually usable, and you help shape what that hardware looks like in the first place. At Opticore, you will work alongside our Computer Architect to co-design the ISA and execution model, then own the compiler stack that targets it: from high-level ML model representations down to efficient execution on our photonic computing platform. This is a senior, software-focused role, but you will be in the room for hardware decisions from day one. Your job is to make sure the architecture is one a compiler can actually exploit, and then prove it by building that compiler.

Key Responsibilities
  • Partner with the System Architect to co-define the ISA, execution model, and hardware-software interface, ensuring architectural decisions are compiler-friendly from the start
  • Design and implement the compiler stack for Opticore's photonic platform: IR design, lowering passes, code generation, and runtime interfaces
  • Map LLM and AI inference workloads to photonic execution: tiling, scheduling, memory layout, and operator fusion
  • Build performance analysis and profiling infrastructure to identify bottlenecks and guide optimization
  • Maintain close, ongoing collaboration with the hardware team, translating hardware constraints into compiler representations and feeding compiler observations back into hardware design
  • Contribute to the runtime layer: memory management, execution scheduling, and host-device communication
  • 7+ years of hands-on compiler engineering experience (MLIR, LLVM, TVM, XLA, or equivalent)
  • Experience lowering ML workloads onto custom or non-standard hardware targets
  • Ability to read and reason about hardware architecture (memory hierarchies, dataflow models, execution pipelines) and participate meaningfully in ISA and execution model design
  • Track record of working directly with hardware teams to jointly define and refine the hardware-software interface
  • Seniority to drive technical decisions independently and influence architecture choices upstream
  • Comfort building from scratch in an environment where the target architecture is co-evolving with the software
Even Better If You Have
  • Experience targeting novel or non-von-Neumann accelerators (photonic, analog, neuromorphic, custom ASIC)
  • Background in quantization, sparsity, or other model-level optimizations with hardware implications
  • Familiarity with kernel-level optimization (e.g., Triton, CUDA, or custom kernel authoring for accelerators)
  • Prior experience contributing to an ML framework backend (PyTorch, JAX, etc.)

We're reviewing applications on a rolling basis and will reach out to shortlisted candidates.

#J-18808-Ljbffr