... engineers to develop groundbreaking technologies in the inference systems software stack. We build ... Background in domain specific compiler and library solutions for LLM inference and training (e.g.
... engineers to develop groundbreaking technologies in the inference systems software stack. We build ... Background in domain specific compiler and library solutions for LLM inference and training (e.g.
Experience designing compiler diagnostics (errors and warnings) that are clear and useful to end users. * Experience across the full software engineering lifecycle: product specification ...
Experience designing compiler diagnostics (errors and warnings) that are clear and useful to end users. * Experience across the full software engineering lifecycle: product specification ...
... Neuron Software Development Kit (SDK), which includes an ML compiler, runtime and natively ... Our team covers multiple disciplines including silicon engineering, hardware design and ...
... Neuron Software Development Kit (SDK), which includes an ML compiler, runtime and natively ... Our team covers multiple disciplines including silicon engineering, hardware design and ...
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Toronto, ON · On-site
Working at the hardware-software boundary, our engineers craft high-performance kernels for ML ... As part of the broader Neuron Compiler organization, our team works across multiple technology ...
Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs
Toronto, ON · On-site
Working at the hardware-software boundary, our engineers craft high-performance kernels for ML ... As part of the broader Neuron Compiler organization, our team works across multiple technology ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
Toronto, ON · On-site
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
Toronto, ON · On-site
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Machine Learning Framework, Compiler & Performance Engineer
Markham, ON · On-site
CA$99K - CA$149K/yr
Company Qualcomm Canada ULC Job Area Engineering Group, Engineering Group > Machine Learning ... Knowledge of software development processes (revision control, CD/CI, etc.) · Familiarity with ...
Machine Learning Framework, Compiler & Performance Engineer
Markham, ON · On-site
CA$99K - CA$149K/yr
Company Qualcomm Canada ULC Job Area Engineering Group, Engineering Group > Machine Learning ... Knowledge of software development processes (revision control, CD/CI, etc.) · Familiarity with ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
Toronto, ON · On-site
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
Toronto, ON · On-site
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
Quick apply
Compiler Tech Lead
$170K - $190K/yr
We are seeking an experienced Compiler Engineer to join our exceptional team. Responsibilities: * Design and implement software that maps neural nets onto our spatial architecture * Stay abreast of ...
QNX Principal Systems Software Developer
CA$131K - CA$181K/yr
This is engineering at the foundation of the software stack, where every optimization ... Knowledge of compiler technologies and optimization techniques. * Strong understanding of software ...
QNX Principal Systems Software Developer
CA$131K - CA$181K/yr
This is engineering at the foundation of the software stack, where every optimization ... Knowledge of compiler technologies and optimization techniques. * Strong understanding of software ...
FPGA Development Tools Engineer - Synthesis
CA$129K - CA$187K/yr
Influence compiler architecture and performance at scale * Collaborate with world-class engineers across silicon, architecture, and software Job Type: Regular Shift: Shift 1 (Canada) Primary Location:
FPGA Development Tools Engineer - Synthesis
CA$129K - CA$187K/yr
Influence compiler architecture and performance at scale * Collaborate with world-class engineers across silicon, architecture, and software Job Type: Regular Shift: Shift 1 (Canada) Primary Location:
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency)
Markham, ON · On-site
CA$114K - CA$164K/yr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... PEFT, compiler stack optimization etc. * Prototype and develop system solutions with software ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency)
Markham, ON · On-site
CA$114K - CA$164K/yr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... PEFT, compiler stack optimization etc. * Prototype and develop system solutions with software ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency) Markham, Ontario, Canada Machi
Markham, ON · On-site
CA$114K - CA$164K/yr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... PEFT, compiler stack optimization etc. * Prototype and develop system solutions with software ...
AI/Machine Learning Engineer (Embedded Systems, Inference Efficiency) Markham, Ontario, Canada Machi
Markham, ON · On-site
CA$114K - CA$164K/yr
Engineering Group, Engineering Group > Machine Learning Engineering General Summary: As a member of ... PEFT, compiler stack optimization etc. * Prototype and develop system solutions with software ...
Embedded Software Developer (New Grad)
CA$68K - CA$109K/yr
Contributions help improve software quality, reliability, and engineering productivity. How you ... Tool chains (assembler, compiler, linker, etc.). Pay Range: The annual pay range for this position ...
Embedded Software Developer (New Grad)
CA$68K - CA$109K/yr
Contributions help improve software quality, reliability, and engineering productivity. How you ... Tool chains (assembler, compiler, linker, etc.). Pay Range: The annual pay range for this position ...
Embedded Simulation Developer - SIL and Virtualization
Markham, ON · On-site
CA$90K - CA$136K/yr
... of Virtualization and Software-in-the-Loop (SIL) Integration Engineer to support our Test ... compiler, gdb debugger, Eclipse, Jenkins and ETAS INCA tools * Adept experience with MATLAB and ...
Embedded Simulation Developer - SIL and Virtualization
Markham, ON · On-site
CA$90K - CA$136K/yr
... of Virtualization and Software-in-the-Loop (SIL) Integration Engineer to support our Test ... compiler, gdb debugger, Eclipse, Jenkins and ETAS INCA tools * Adept experience with MATLAB and ...
QNX Principal Systems Software Developer
Ottawa, ON · On-site
CA$131K - CA$181K/yr
This is engineering at the foundation of the software stack, where every optimization ... Knowledge of compiler technologies and optimization techniques. * Strong understanding of software ...
QNX Principal Systems Software Developer
Ottawa, ON · On-site
CA$131K - CA$181K/yr
This is engineering at the foundation of the software stack, where every optimization ... Knowledge of compiler technologies and optimization techniques. * Strong understanding of software ...
Compiler Software Engineer information
See Ontario salary details
$37K - $51K
2% of jobs
$51K - $65K
4% of jobs
$65K - $79K
7% of jobs
$92.7K is the 25th percentile. Wages below this are outliers.
$79K - $93K
12% of jobs
$93K - $107K
14% of jobs
The median wage is $117.5K / yr.
$107K - $121K
15% of jobs
$121K - $135K
15% of jobs
$143K is the 75th percentile. Wages above this are outliers.
$135K - $149K
12% of jobs
$149K - $163K
9% of jobs
$163K - $177K
6% of jobs
$177K - $191K
4% of jobs
$37K
$121.3K
$191K
How much do compiler software engineer jobs pay per year?
What is a compiler software engineer?
What are the key skills and qualifications needed to thrive as a compiler software engineer?
What are some common challenges faced by compiler software engineers when optimizing code for different hardware architectures?
What is the difference between Compiler Software Engineer vs Software Developer?
| Aspect | Compiler Software Engineer | Software Developer |
|---|---|---|
| Required Credentials | Bachelor's or higher in Computer Science, specialized knowledge in compilers | Bachelor's or higher in Computer Science or related field |
| Work Environment | Research labs, tech companies, compiler development teams | Varied environments including startups, corporations, freelance projects |
| Industry Usage | Primarily in compiler design, programming language development, systems software | Web, mobile, enterprise applications, software solutions |
Compiler Software Engineers focus on designing and optimizing compilers and language tools, often working in specialized teams. Software Developers create a wide range of applications across industries. While both roles require programming skills, Compiler Software Engineers have a niche expertise in language translation and optimization, making their work more specialized.
What are popular job titles related to Compiler Software Engineer jobs in Ontario?
For Compiler Software Engineer jobs in Ontario, the most frequently searched job titles are:
What job categories do people searching Compiler Software Engineer jobs in Ontario look for?
The top searched job categories for Compiler Software Engineer jobs in Ontario are:

Senior Software Engineer, Matrix Multiplication
Toronto, ON
Full-time
Posted 12 days ago
Nvidia rating
9.6
Based on 18 frontline employees who took The Breakroom Quiz
Job description
We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack. We build innovative AI systems software to accelerate for AI inference. As a member of the team, you'll develop libraries, code generators, and GPU kernel technologies for NVIDIA's hardware architecture.
This means designing and building things like new abstractions, efficient attention kernel implementations, new LLM inference runtimes components, and kernel code generators to accelerate large language models, agents, and other high-impact AI workloads. What you'll be doing: Innovating and developing new AI systems technologies for efficient inference Designing, implementing, and optimizing kernels for high impact AI workloads Designing and implementing extensible abstractions for LLM serving engines Building efficient just-in-time domain specific compilers and runtimes Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams Contributing to open source communities like FlashInfer, vLLM, and SGLang What we need to see: Masters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); PhD are preferred 6+ years (academic/ industry) experience with ML/DL systems development preferable Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX, etc) and ideally inference engines and runtimes such as vLLM, SGLang, and MLC
Strong Python and C/C++ programming skills Strong experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, cuTile, Triton, or similar) with hands-on experience with Matrix Multiplication Ways to stand out from the crowd: Background in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention) Expertise in inference engines like vLLM and SGLang Expertise in machine learning compilers (e.g. Apache TVM, MLIR) Open source project ownership or contributions Your base salary will be determined based on your location, experience, and the pay of employees in similar positions
The base salary range is 184,000 USD - 287,500 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until August 14, 2026.
This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.
As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
About Nvidia
Sourced by ZipRecruiter
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.
Industry
Computer and electronic product manufacturing
Company size
10,000+ Employees
Headquarters location
Santa Clara, CA, US