We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is ... Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas ...
We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is ... Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas ...
We are now looking for a Senior Machine Learning Applications and Compiler Engineer. NVIDIA is ... Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas ...
We are now looking for a Senior Machine Learning Applications and Compiler Engineer. NVIDIA is ... Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas ...
Senior Staff Compiler Engineer Toronto/Hybrid We are partnered with a global leader in the ... Analysis of ML/AI algorithms and workloads to drive future features in Qualcomm's ML HW/SW ...
Quick apply
Senior Staff Compiler Engineer Toronto/Hybrid We are partnered with a global leader in the ... Analysis of ML/AI algorithms and workloads to drive future features in Qualcomm's ML HW/SW ...
As part of the broader Neuron Compiler organization, our team works across multiple technology ... ML accelerators. Explore the product and our history. Key job responsibilities Our kernel engineers ...
As part of the broader Neuron Compiler organization, our team works across multiple technology ... ML accelerators. Explore the product and our history. Key job responsibilities Our kernel engineers ...
The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud ... Our team covers multiple disciplines including silicon engineering, hardware design and ...
The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud ... Our team covers multiple disciplines including silicon engineering, hardware design and ...
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Toronto, ON · On-site
As part of the broader Neuron Compiler organization, our team works across multiple technology ... ML accelerators. Explore the product and our history. Key job responsibilities Our kernel engineers ...
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Toronto, ON · On-site
As part of the broader Neuron Compiler organization, our team works across multiple technology ... ML accelerators. Explore the product and our history. Key job responsibilities Our kernel engineers ...
Machine Learning Framework, Compiler & Performance Engineer
Markham, ON · On-site
$100 - $149/hr
Analysis of ML/AI algorithms and workloads to drive future features in Qualcomm's ML HW/SW ... Experience in compiler design and development is an asset * Knowledge of network model formats ...
Machine Learning Framework, Compiler & Performance Engineer
Markham, ON · On-site
$100 - $149/hr
Analysis of ML/AI algorithms and workloads to drive future features in Qualcomm's ML HW/SW ... Experience in compiler design and development is an asset * Knowledge of network model formats ...
As a Software Compiler Intern, you'll work with a dedicated mentor and collaborate across software ... Curious about compilers, ML, parallel systems, or processor architecture. * Problem-solver who ...
As a Software Compiler Intern, you'll work with a dedicated mentor and collaborate across software ... Curious about compilers, ML, parallel systems, or processor architecture. * Problem-solver who ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency)
Markham, ON · On-site
$114.40 - $164.40/hr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... Strong background on compiler stack and ML system optimization for AI accelerators (e.g., graph ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency)
Markham, ON · On-site
$114.40 - $164.40/hr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... Strong background on compiler stack and ML system optimization for AI accelerators (e.g., graph ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency) Markham, Ontario, Canada Machi
Markham, ON · On-site
$114.40 - $164.40/hr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... Strong background on compiler stack and ML system optimization for AI accelerators (e.g., graph ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency) Markham, Ontario, Canada Machi
Markham, ON · On-site
$114.40 - $164.40/hr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... Strong background on compiler stack and ML system optimization for AI accelerators (e.g., graph ...
You'll collaborate across inference, compiler, scheduling, and performance teams to push the ... Conduct and publish original research that pushes the pareto frontier for the field of ML Systems ...
You'll collaborate across inference, compiler, scheduling, and performance teams to push the ... Conduct and publish original research that pushes the pareto frontier for the field of ML Systems ...
You'll collaborate across inference, compiler, scheduling, and performance teams to push the ... Conduct and publish original research that pushes the pareto frontier for the field of ML Systems ...
You'll collaborate across inference, compiler, scheduling, and performance teams to push the ... Conduct and publish original research that pushes the pareto frontier for the field of ML Systems ...
CA$100K - CA$500K/yr
How hardware, compiler, kernel, and ML teams collaborate to maximize performance. * The challenges and tradeoffs of scaling modern AI workloads across custom hardware. Compensation for all engineers ...
CA$100K - CA$500K/yr
How hardware, compiler, kernel, and ML teams collaborate to maximize performance. * The challenges and tradeoffs of scaling modern AI workloads across custom hardware. Compensation for all engineers ...
Conduct and publish original research that advances the Pareto frontier in ML Systems; survey ... Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using ...
Conduct and publish original research that advances the Pareto frontier in ML Systems; survey ... Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using ...
Conduct and publish original research that advances the Pareto frontier in ML Systems; survey ... Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using ...
Conduct and publish original research that advances the Pareto frontier in ML Systems; survey ... Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using ...
... compiler, platform, and product areas. You communicate clearly, take ownership of technical ... Strong understanding of AI/ML concepts, model architectures, and inference workflows. * Experience ...
... compiler, platform, and product areas. You communicate clearly, take ownership of technical ... Strong understanding of AI/ML concepts, model architectures, and inference workflows. * Experience ...
... T-level code. * Direct experience with ROCm, CUDA, or GPU compute software stacks (runtime, compiler, ML frameworks). * Experience integrating LLMs, AI agents, or agentic workflows into software ...
... T-level code. * Direct experience with ROCm, CUDA, or GPU compute software stacks (runtime, compiler, ML frameworks). * Experience integrating LLMs, AI agents, or agentic workflows into software ...
... T-level code. * Direct experience with ROCm, CUDA, or GPU compute software stacks (runtime, compiler, ML frameworks). * Experience integrating LLMs, AI agents, or agentic workflows into software ...
... T-level code. * Direct experience with ROCm, CUDA, or GPU compute software stacks (runtime, compiler, ML frameworks). * Experience integrating LLMs, AI agents, or agentic workflows into software ...
PhD are preferred 6+ years (academic/ industry) experience with ML/DL systems development ... Background in domain specific compiler and library solutions for LLM inference and training (e.g.
New
PhD are preferred 6+ years (academic/ industry) experience with ML/DL systems development ... Background in domain specific compiler and library solutions for LLM inference and training (e.g.
New
... compiler, platform, and product areas. You communicate clearly, take ownership of technical ... Strong understanding of AI/ML concepts, model architectures, and inference workflows. * Experience ...
... compiler, platform, and product areas. You communicate clearly, take ownership of technical ... Strong understanding of AI/ML concepts, model architectures, and inference workflows. * Experience ...
Ml Compiler Engineer information
What does an ML Compiler Engineer do?
An ML Compiler Engineer designs and develops compilers and software tools that optimize machine learning models for deployment on various hardware platforms. Their work involves translating high-level ML code into optimized, low-level instructions that can run efficiently on CPUs, GPUs, or specialized accelerators. They collaborate closely with hardware engineers and ML researchers to ensure models execute quickly and accurately. Additionally, ML Compiler Engineers may work on improving performance, reducing memory usage, and supporting new ML frameworks or hardware.
What are some typical collaboration points between an ML Compiler Engineer and other teams during a project?
ML Compiler Engineers frequently collaborate with machine learning researchers to understand model requirements, with hardware engineers to optimize for specific accelerators, and with software developers to ensure seamless integration into production systems. This role often involves participating in cross-functional meetings, code reviews, and design discussions to align compiler optimizations with both hardware capabilities and end-user needs. Effective communication and teamwork are essential, as these engineers play a central role in bridging the gap between algorithm design and efficient execution on target platforms.
What are the key skills and qualifications needed to thrive as an ML Compiler Engineer, and why are they important?
To thrive as an ML Compiler Engineer, you need a strong background in computer science, compiler design, machine learning concepts, and typically a degree in computer science or a related field. Familiarity with tools like LLVM, MLIR, TensorFlow XLA, and programming in C++ and Python is often required, along with experience in optimizing machine learning workloads. Strong problem-solving abilities, attention to detail, and effective collaboration skills help set top professionals apart. These skills ensure efficient translation and optimization of ML models for diverse hardware, enhancing performance and scalability.
What is the difference between Ml Compiler Engineer vs Machine Learning Engineer?
| Aspect | Ml Compiler Engineer | Machine Learning Engineer |
|---|---|---|
| Required Skills | Programming, compiler design, optimization, ML frameworks | Data analysis, model development, programming, ML frameworks |
| Work Environment | Research labs, tech companies, AI hardware firms | Tech companies, startups, data-driven organizations |
| Certifications | Computer science, software engineering, specialized compiler courses | Machine learning, data science, AI certifications |
| Industry Usage | AI hardware, software optimization, ML infrastructure | Model development, deployment, data analysis |
While both roles involve machine learning, Ml Compiler Engineers focus on optimizing ML models through compiler design and software performance, whereas Machine Learning Engineers develop and deploy ML models for applications. The roles often overlap in skills but differ in their primary focus areas.
What are popular job titles related to Ml Compiler Engineer jobs in Ontario?
For Ml Compiler Engineer jobs in Ontario, the most frequently searched job titles are:
What job categories do people searching Ml Compiler Engineer jobs in Ontario look for?
The top searched job categories for Ml Compiler Engineer jobs in Ontario are:
What cities in Ontario are hiring for Ml Compiler Engineer jobs?
Cities in Ontario with the most Ml Compiler Engineer job openings:
Full-time
Re-posted 28 days ago
Nvidia rating
9.6
Based on 18 frontline employees who took The Breakroom Quiz
6th of 247 rated software companies
Job description
We are now looking for a Senior Machine Learning Applications and Compiler Engineer!
NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms. This is your chance to be part of something outstandingly innovative!
What you'll be doing:
Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
Define and implement mappings of large-scale inference workloads onto NVIDIA's systems.
Extend and integrate with NVIDIA's SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.
What we need to see:
MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.
Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.
Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.
Ways to stand out from the crowd:
Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.
Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.
Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.
Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
About Nvidia
Sourced by ZipRecruiter
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.
Industry
Computer and electronic product manufacturing
Company size
10,000+ Employees
Headquarters location
Santa Clara, CA, US