2

Full Time Machine Learning Compiler Engineer Jobs

Machine Learning Compiler

Raleigh, NC · On-site

$160K - $240K/yr

Engineering Group, Engineering Group > Machine Learning Engineering General Summary: Lead a team of engineers focused on advancing machine learning compiler technologies for cutting-edge AI ...

Senior AI Compiler Engineer

Austin, TX

$103K - $142K/yr

We are seeking a Machine Learning Compiler Engineer with deep expertise in compiler technologies to join our team. The ideal candidate will bring broad experience across the machine learning ...

SEMRON is redefining what's possible in AI hardware, and they are seeking a Compiler Developer to ... machine learning compiler infrastructure like MLIR/IREE or TVM • experience in polyhedral ...

Senior AI Compiler Engineer

Redmond, WA

$117K - $160K/yr

We are seeking a Machine Learning Compiler Engineer with deep expertise in compiler technologies to join our team. The ideal candidate will bring broad experience across the machine learning ...

Senior AI Compiler Engineer

Austin, TX · On-site

$103K - $142K/yr

We are seeking a Machine Learning Compiler Engineer with deep expertise in compiler technologies to join our team. The ideal candidate will bring broad experience across the machine learning ...

next page

Showing results 1-20

Full Time Machine Learning Compiler Engineer information

See salary details

$31.5K

$128.8K

$193.5K

How much do full time machine learning compiler engineer jobs pay per year?

As of Jun 6, 2026, the average yearly pay for full time machine learning compiler engineer in the United States is $128,769.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,500.00 and $155,000.00 per year, depending on experience, location, and employer.

What is the difference between Full Time Machine Learning Compiler Engineer vs Data Scientist?

AspectFull Time Machine Learning Compiler EngineerData Scientist
Required CredentialsBachelor's or Master's in Computer Science, Electrical Engineering, or related; knowledge of compiler design and ML frameworksBachelor's or Master's in Data Science, Statistics, or related; strong programming and analytical skills
Work EnvironmentSoftware development teams, focusing on compiler optimization and ML infrastructureData analysis teams, focusing on data modeling, visualization, and insights
Industry UsageTech companies, AI startups, hardware firmsFinance, healthcare, marketing, and tech sectors

The Full Time Machine Learning Compiler Engineer primarily develops and optimizes compilers for ML models, requiring deep technical knowledge of compiler architecture. In contrast, Data Scientists analyze data to generate insights and build models without focusing on compiler development. Both roles are essential in AI-driven industries but serve different technical and business functions.

More about Full Time Machine Learning Compiler Engineer jobs
What cities are hiring for Full Time Machine Learning Compiler Engineer jobs? Cities with the most Full Time Machine Learning Compiler Engineer job openings:
What are the most commonly searched types of Machine Learning Compiler Engineer jobs? The most popular types of Machine Learning Compiler Engineer jobs are:
Infographic showing various Full Time Machine Learning Compiler Engineer job openings in the United States as of May 2026, with employment types broken down into 4% As Needed, 88% Full Time, and 8% Contract. Highlights an 94% Physical, 1% Hybrid, and 5% Remote job distribution, with an average salary of $128,769 per year, or $61.9 per hour.
Compiler Engineer - Machine Learning Compiler

Compiler Engineer - Machine Learning Compiler

Mythic

Palo Alto, CA

Full-time

Posted 6 days ago


Job description

About us

Mythic is building the future of AI computing with breakthrough analog technology that delivers 100 the performance of traditional digital systems at the same power and cost. This unlocks bigger, more capable models and faster, more responsive applications-whether in edge devices like drones, robotics, and sensors, or in cloud and data center environments. Our technology powers everything from large language models and CNNs to advanced signal processing, and is engineered to operate from -40 C to +125 C, making it ideal for industrial, automotive, aerospace, and defense.
We've raised over $100M from world-class investors including Softbank, Threshold Ventures, Lux Capital, and DCVC, and secured multi-million-dollar customer contracts across multiple markets.

About the role

Join us in building the next generation of AI compilers. You'll play a key role in developing the compiler for our novel AI accelerator, working side-by-side with hardware engineers and ML researchers. Your work will shape how deep learning workloads run on cutting-edge dataflow hardware-defining the instruction set, execution model, and developer experience. The result: a compiler that delivers breakthrough performance while remaining seamless and intuitive for ML developers.
Here's what you will do
  • Contribute across the full compiler stack, including operator lowering, graph/IR transformations, optimization passes, and backend code generation
  • Optimize for dataflow architectures, developing pipelined schedules, memory orchestration, and resource-constrained execution strategies
  • Collaborate with hardware architects to influence architectural features, ensuring the compiler and hardware evolve together
  • Develop compilation strategies that unify our analog compute with digital subsystems
  • Build and maintain a compiler that produces high-performance binaries with strong debugging support, clear error messages, and predictable performance models
Here's the background we hope you will have
  • 3+ years of experience building compilers or high-performance systems software, especially those involving complex resource management or optimization.
  • Expert in modern C++ (C++14/17/20) and strong Python.
  • Experience with compiler IRs (SSA-based or graph-based), transformations, and code generation
  • Exposure to specialized accelerators (GPU, NPU, FPGA, or custom ASIC) or parallel architectures
The following would be nice to have, but is not required
  • Experience with machine learning compiler stacks (e.g., ONNX, MLIR, TVM, XLA, IREE, PyTorch), with contributions to MLIR or LLVM projects a plus
  • Experience with optimization methods (LP/MIP, CP, SAT/SMT) using solvers like Gurobi or OR-Tools for scheduling and resource allocation
  • Experience compiling for specialized accelerators (GPU, NPU, FPGA, or custom ASIC) on DNN workloads; GPU/DSP experience is valuable if combined with compiler backend work beyond kernel tuning
  • Familiarity with heterogeneous compilation, especially mixing custom accelerators with CPUs/GPUs/NPUs, and exposure to analog or in-memory compute is a plus
  • Experience collaborating in compiler-hardware co-design (architecture + ISA) for better compiler usability and hardware efficiency
What we offer
  • The opportunity to shape how deep learning and LLM workloads are compiled on novel hardware.
  • A role that spans software and hardware co-design, shaping both the compiler and the accelerator architecture
  • A collaborative, innovative team that values engineering rigor, continuous integration, and user-focused design. We foster an environment of shared learning and technical excellence
  • Competitive compensation, equity, and benefits package
At Mythic, we foster a collaborative and respectful environment where people can do their best work. We hire smart, capable individuals, provide the tools and support they need, and trust them to deliver. Our team brings a wide range of experiences and perspectives, which we see as a strength in solving hard problems together. We value professionalism, creativity, and integrity, and strive to make Mythic a place where every employee feels they belong and can contribute meaningfully.
apply for this job