1

Junior Machine Learning Compiler Engineer Jobs (NOW HIRING)

Senior Compiler Engineer

San Francisco, CA · On-site

$123K - $169K/yr

They are seeking a Senior Compiler Engineer to design and build core compiler infrastructure ... Luminal provides a machine learning compiler and serverless cloud platform that automates PyTorch ...

Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a leading ... kernels, compiler tools, or model efficiency tools, etc.) to allow specific hardware features ...

Senior Deep Learning Compiler Engineer

Austin, TX · On-site

$103K - $142K/yr

NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and ... A track record of success in mentoring junior engineers and interns is a bonus. With highly ...

Senior Deep Learning Compiler Engineer

Austin, TX · On-site

$103K - $142K/yr

NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and ... A track record of success in mentoring junior engineers and interns is a bonus. With highly ...

Senior Deep Learning Compiler Engineer

OR · On-site +1

$104K - $143K/yr

NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and ... A track record of success in mentoring junior engineers and interns is a bonus. With highly ...

Senior Deep Learning Compiler Engineer

Redmond, WA · On-site

$117K - $160K/yr

NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and ... A track record of success in mentoring junior engineers and interns is a bonus. With highly ...

Senior Deep Learning Compiler Engineer

Redmond, WA · On-site

$117K - $160K/yr

NVIDIA is hiring software engineers for its Deep Learning Compiler (DLC) team. Academic and ... A track record of success in mentoring junior engineers and interns is a bonus. With highly ...

SEMRON is redefining what's possible in AI hardware, and they are seeking a Compiler Developer to ... machine learning compiler infrastructure like MLIR/IREE or TVM • experience in polyhedral ...

As a Junior Machine Learning Engineer, the candidate will contribute to building and deploying ML models that power intelligent features across the platform. This role offers the opportunity to work ...

... learning community. What you'll be doing: In this role, you will work on CUDA Tile and TensorIR compiler technologies for NVIDIA GPUs. CUDA Tile is a new tile-based programming model that shipped ...

Showing results 21-40

Junior Machine Learning Compiler Engineer information

See salary details

$33.5K

$71.8K

$109.5K

How much do junior machine learning compiler engineer jobs pay per year?

As of Sep 6, 2026, the average yearly pay for junior machine learning compiler engineer in the United States is $71,799.00, according to ZipRecruiter salary data. Most workers in this role earn between $48,500.00 and $80,000.00 per year, depending on experience, location, and employer.

What does a junior machine learning compiler engineer do?

A Junior Machine Learning Compiler Engineer helps design, develop, and optimize compilers for machine learning models. Their work involves translating high-level machine learning code into efficient low-level code that can run on various hardware platforms, such as CPUs, GPUs, or specialized AI chips. They often collaborate with software engineers and data scientists to ensure that machine learning workloads run efficiently and correctly. This role typically involves programming, debugging, and performance tuning, often using languages like C++, Python, and specialized frameworks.

What are typical projects and responsibilities for a junior machine learning compiler engineer in a collaborative team setting?

As a Junior Machine Learning Compiler Engineer, you can expect to work on projects that focus on optimizing machine learning models for performance and deployment across various hardware platforms. Typical responsibilities include assisting in developing and debugging compiler passes, implementing optimizations, and contributing to code reviews. You'll frequently collaborate with senior engineers, data scientists, and hardware specialists to ensure that models are efficiently translated and executed. This role offers valuable learning opportunities through hands-on coding, exposure to state-of-the-art ML frameworks, and regular team meetings for knowledge sharing and mentorship.

What are the key skills and qualifications needed to thrive as a junior machine learning compiler engineer, and why are they important?

To thrive as a Junior Machine Learning Compiler Engineer, you need a solid background in computer science fundamentals, programming (especially C++ and Python), and foundational knowledge of machine learning and compiler theory. Familiarity with frameworks and tools such as LLVM, TensorFlow, MLIR, and version control systems is typically required, along with a relevant bachelor’s or master’s degree. Strong problem-solving abilities, attention to detail, and effective teamwork and communication skills set standout candidates apart. These skills and qualities are crucial for efficiently optimizing machine learning models for various hardware targets and collaborating on innovative compiler solutions.

What is the difference between Junior Machine Learning Compiler Engineer vs Data Scientist?

AspectJunior Machine Learning Compiler EngineerData Scientist
Required CredentialsBachelor's in Computer Science, Software Engineering, or related field; knowledge of compiler design and ML frameworksBachelor's or higher in Data Science, Statistics, Computer Science, or related field; strong analytical skills
Work EnvironmentSoftware development teams, focusing on compiler optimization for ML modelsData analysis teams, focusing on data interpretation and model development
Employer & Industry UsageTech companies, AI startups, hardware firmsTech firms, finance, healthcare, research institutions

The Junior Machine Learning Compiler Engineer primarily focuses on developing and optimizing compilers for machine learning models, requiring programming and compiler knowledge. In contrast, a Data Scientist analyzes data, builds models, and provides insights. Both roles are essential in AI and tech industries but differ in technical focus and daily tasks.

More about Junior Machine Learning Compiler Engineer jobs

What cities are hiring for Junior Machine Learning Compiler Engineer jobs?

Cities with the most Junior Machine Learning Compiler Engineer job openings:

What are the most commonly searched types of Machine Learning Compiler Engineer jobs?

The most popular types of Machine Learning Compiler Engineer jobs are:

What states have the most Junior Machine Learning Compiler Engineer jobs?

States with the most job openings for Junior Machine Learning Compiler Engineer jobs include:

Infographic showing various Junior Machine Learning Compiler Engineer job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 74% Full Time, 24% Part Time, and 1% Contract. Highlights an 87% Physical, 2% Hybrid, and 11% Remote job distribution, with an average salary of $71,799 per year, or $34.5 per hour.

Senior Compiler Engineer

Luminal

San Francisco, CA • On-site

$123K - $169K/yr

Full-time

Re-posted 25 days ago


Job description

Job Summary:
Luminal is focused on optimizing AI models to accelerate and simplify model deployment. They are seeking a Senior Compiler Engineer to design and build core compiler infrastructure, develop backend code generation, and improve model performance across various hardware platforms.
Responsibilities:
• Design and build core compiler infrastructure in Rust
• Build search-based optimization systems for discovering faster kernels
• Develop backend code generation for multiple targets (NVIDIA, Trainium, AMD, TPU, etc.)
• Implement compiler passes for fusion, scheduling, memory planning, and kernel selection
• Profile real models, identify bottlenecks, and improve latency and throughput
• Help shape Luminal’s engineering culture from the ground up
Qualifications:
Required:
• Experience with compiler frameworks: LLVM, MLIR, or other custom compilers
• Hands-on experience with at least one of: PTX/SASS, GCN/RDNA assembly, or other GPU ISAs
• Familiar with ML compilers: torch.compile (or custom PyTorch backend), XLA, TVM, etc.
Preferred:
• Background in distributed systems or multi-device compilation
• Experience with Egg/Egglog is a STRONG plus
• Experience with Rust
• Experience in developing and deploying AI models in production environments
Company:
Luminal provides a machine learning compiler and serverless cloud platform that automates PyTorch model optimization and deployment. Founded in 2025, the company is headquartered in San Francisco, USA, with a team of 11-50 employees. The company is currently Early Stage.