Job Summary:
NVIDIA is a leader in high-performance computing platforms, driving the AI revolution across various industries. They are seeking a Senior Software Engineer for the CUTLASS platform to develop core components, contribute to the MLIR-based backend compiler, and collaborate with multiple teams to enhance GPU performance.
Responsibilities:
• Develop core components of the CUTLASS platform including Tensor Core MMAs, copies, synchronization barriers, schedulers, and other GPU hardware features in CUDA C++ and CUTLASS Python DSL.
• Contribute to the advancement of the MLIR-based backend compiler stack for the CUTLASS Python DSL by designing dialects and associated compiler passes.
• Author example kernels utilizing CUTLASS abstractions to showcase the use of novel GPU hardware features that are crucial for achieving high performance.
• Collaborate with GPU architecture, CUDA, and NVVM/PTX compiler teams to provide feedback on programming models and to assess the performance of future GPU hardware features.
Qualifications:
Required:
• Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 3+ years of relevant industry experience.
• Strong proficiency in C++ programming and software design, including debugging, performance evaluation, and testing.
• Experience working with high-performance code generation and knowledge of compiler transformations and optimizations.
• A deep understanding of computer architecture and parallel computing programming models.
Preferred:
• Experience writing high-performance kernels at low levels of abstractions like NVVM/ PTX for GPUs or other similar parallel processing architectures.
• Hands-on compiler design experience, particularly in MLIR.
• Understanding of deep learning models, algorithms, and frameworks.
Company:
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. Founded in 1993, the company is headquartered in Santa Clara, USA, with a team of 10001+ employees. The company is currently Late Stage.