Job Summary:
Tencent is a leading technology company seeking a Sr. Cloud AI Infrastructure Engineer. This role involves conducting architecture research, optimizing performance for large-scale cloud computing, defining interconnect architecture, and analyzing technology trends in semiconductors and accelerators.
Responsibilities:
• Conduct in-depth research into the underlying hardware logic of various AI accelerators; evaluate the power-efficiency ratio and suitability of different heterogeneous architectures in the context of Large Language Model (LLM) inference and training.
• Design and optimize high-performance operator libraries for large-scale cloud computing environments; resolve long-tail latency issues in hardware scheduling, memory management, and distributed communication.
• Define the interconnect architecture; drive the virtualization, standardized access, and efficient pooling of heterogeneous computing resources in the cloud.
• Monitor global trends in semiconductors and accelerators; perform feasibility studies and experimental validation for the implementation of emerging technologies within cloud infrastructure.
Qualifications:
Required:
• Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering, Microelectronics, or a related field.
• Expertise in GPGPU architectures or other mainstream AI accelerator architectures.
• Proficient in parallel computing frameworks; deep understanding of low-level operator development languages (e.g., CUDA, Triton).
• Solid understanding of large-scale distributed systems, cluster topologies (e.g., Fat-tree, Torus), and high-performance network protocols.
• Familiar with the architectural evolution of global leading computing enterprises; ability to objectively analyze the technical pros/cons and engineering challenges of different architectural paths.
Preferred:
• Experience in the application, optimization, or architectural design of ultra-large-scale accelerator clusters.
• Experience in the low-level adaptation and performance tuning of mainstream deep learning frameworks (e.g., PyTorch, TensorFlow).
Company:
Tencent develops internet, gaming, fintech, and AI solutions, offering social content, enterprise services, and cloud technologies. Founded in 1998, the company is headquartered in Shenzhen, CHN, with a team of 10001+ employees. The company is currently Late Stage.