ZipRecruiter

Log In

1

Junior Compiler Software Engineer Jobs in Toronto, ON

1Valet

Junior QA Engineer

Toronto, ON · On-site

We develop smart building software and integrated hardware solutions that connect property managers ... About the Role We are looking for an enthusiastic Junior Quality Assurance Engineer to join our ...

Capital One

Staff Software Engineer

Toronto, ON · Hybrid

CA$173K - CA$197K/yr

Provide mentorship to junior and intermediate associates through engineering best practises and ... Bachelor's, Master's or Diploma in Computer Science, Software Engineering, Information Technology ...

Capital One

Staff Software Engineer

Toronto, ON · Hybrid

CA$173K - CA$197K/yr

Provide mentorship to junior and intermediate associates through engineering best practises and ... Bachelor's, Master's or Diploma in Computer Science, Software Engineering, Information Technology ...

Capital One

Staff Software Engineer

Toronto, ON · Hybrid

CA$172K - CA$197K/yr

Provide mentorship to junior and intermediate associates through engineering best practises and ... Bachelor's, Master's or Diploma in Computer Science, Software Engineering, Information Technology ...

Capital One

Staff Software Engineer

Toronto, ON · Hybrid

CA$172K - CA$197K/yr

Provide mentorship to junior and intermediate associates through engineering best practises and ... Bachelor's, Master's or Diploma in Computer Science, Software Engineering, Information Technology ...

Scotiabank

Software Engineer

Toronto, ON · On-site

Apply software engineering best practices including SOLID principles, design patterns, and clean ... Experience mentoring junior developers or leading technical initiatives. * Strong communication ...

Curinos Inc

Senior Software Engineer

Toronto, ON · On-site

CA$130K - CA$140K/yr

Are you a passionate Senior Software Engineer looking to make a significant impact in the fintech ... Provide guidance and coaching to junior engineers, helping them grow their skills and contributing ...

previous pagenext page

Showing results 21-40

All JobsCompiler Software Engineer JobsJunior Compiler Software Engineer JobsJunior Compiler Software Engineer Jobs in Toronto, ON

Junior Compiler Software Engineer information

What does a junior compiler software engineer do?

A Junior Compiler Software Engineer assists in the development, optimization, and maintenance of compiler software. They typically work under the guidance of more senior engineers to write code that translates programming languages into machine code, debug issues, and ensure programs run efficiently on various hardware. Their responsibilities may include implementing new features, fixing bugs, writing tests, and collaborating with other team members. This role usually requires a solid understanding of programming languages, data structures, algorithms, and computer architecture.

What are the key skills and qualifications needed to thrive as a junior compiler software engineer?

To thrive as a Junior Compiler Software Engineer, you need a solid understanding of programming languages, computer architecture, and compiler theory, usually supported by a degree in computer science or a related field. Familiarity with C/C++, LLVM, GCC, debugging tools, and version control systems like Git is typically expected. Strong problem-solving skills, attention to detail, and effective communication help you collaborate and tackle complex technical challenges. These skills and tools are essential for developing efficient, reliable compilers and contributing to high-quality software projects.

What are some typical challenges faced by junior compiler software engineers when working on large codebases?

Junior Compiler Software Engineers often encounter challenges such as understanding legacy code, navigating complex codebases, and adapting to different compiler architectures. Collaborating with senior engineers to debug intricate issues and ensuring that new features or optimizations maintain backward compatibility are common tasks. Over time, juniors develop strong problem-solving skills and a deeper understanding of compiler theory and systems programming, which are essential for career growth in this field.

What are the most commonly searched types of Compiler Software Engineer jobs in Toronto, ON?

The most popular types of Compiler Software Engineer jobs in Toronto, ON are:

What are popular job titles related to Junior Compiler Software Engineer jobs in Toronto, ON?

For Junior Compiler Software Engineer jobs in Toronto, ON, the most frequently searched job titles are:

What job categories do people searching Junior Compiler Software Engineer jobs in Toronto, ON look for?

The top searched job categories for Junior Compiler Software Engineer jobs in Toronto, ON are:

Junior Compiler Software Engineer jobs near you
Infographic showing various Junior Compiler Software Engineer job openings in Toronto, ON as of August 2026, with employment types broken down into 89% Full Time, 8% Part Time, and 3% Contract. Highlights an 87% Physical, 5% Hybrid, and 8% Remote job distribution.

DL Performance Software Engineer - LLM Inference

Nvidia

Toronto, ON • Hybrid

Full-time

Re-posted 4 hours ago

Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

6th of 247 rated software companies

Job description

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You'll architect and implement high-performance inference software, optimize GPU kernels, drive industry benchmarks, and work with state-of-the-art research techniques to improve serving efficiency. You'll collaborate across inference performance, kernels, training, large-scale serving, and research teams to push the frontier of accelerated computing for AI.

What you'll be doing:

  • Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features and serving runtime algorithms.

  • Profile and optimize the inference framework (vLLM) with methods like speculative decoding, 5D Parallelism, and prefill-decode disaggregation.

  • Architect novel frameworks and runtime optimizations for inference infrastructure, benchmarking, and kernels.

  • Conduct and publish original research that advances the Pareto frontier in ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into production-grade, open-source software.

  • Develop, optimize, and benchmark GPU kernels (both hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization.

What we need to see:

  • Bachelor's, Master's, or PhD degree in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE).

  • 5+ years of industry experience in software engineering or equivalent research experience.

  • Strong programming skills in Python and one of C/C++, Go, or Rust. Solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, software engineering, distributed systems, deep learning theories.

  • Knowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and inference engines (e.g., vLLM and SGLang).

  • Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute).

  • Excellent debugging, problem-solving, and communication skills; ability to excel in a fast-paced, multi-functional setting.

Ways to Stand out from the Crowd

  • Experience developing major features and optimizations for LLM inference engines (e.g., vLLM, SGLang).

  • Hands-on work with LLM inference and training runtimes (deploying LLMs to production, large-scale LLM pre-training and RL), ML compilers and DSLs (e.g., Triton, CuTe, MLIR/LLVM, XLA), GPU libraries (e.g., CUTLASS) and features (e.g., CUDA Graph, Tensor Cores).

  • Experience with speculative decoding training and runtime features: tree-structured drafting, parallel drafting, diffusion LLMs, DFlash, EAGLE.

  • Contributions to open-source projects and/or publications; please include links to GitHub pull requests, published papers and artifacts.

  • At NVIDIA, we believe artificial intelligence (AI) will fundamentally transform how people live and work. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential.

Our team consists of experts in AI, systems and performance optimization. Our leadership includes world-renowned experts in AI systems who have received multiple academic and industry research awards. If you're excited to build systems, kernels, and tools that make large-scale AI faster, more efficient, and easier to deploy, we'd love to hear from you.


#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 10, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

View All Nvidia Jobs

Apply