Job Summary:
NVIDIA is a leader in AI and deep learning technologies, and they are seeking a Senior Perception Engineer to develop and productize their autonomous driving solutions. The role involves building 3D obstacle perception solutions using multi-sensor fusion and deep learning, focusing on improving accuracy and efficiency for autonomous driving applications.
Responsibilities:
• Perception experts with application focus will be on multi-sensor fusion based deep learning model development for obstacle perception/fusion in complex driving environments.
• Applied research and development of innovative deep learning and multi-sensor fusion algorithms to improve output accuracy of 3D obstacle perception solutions under challenging and diverse scenarios.
• Identify and analyze the strength and weakness of the developed 3D obstacle perception solutions using large scale benchmark data (both real and synthetic) and improve them iteratively through KPI building and optimization. This includes careful data verification, model architecture design, understanding details of loss function engineering, and being capable of finding detailed ML bugs and iterating toward perfection.
• Productize the developed 3D obstacle perception solutions by meeting product requirements for safety, latency, and SW robustness, with a strong emphasis on production deep learning model development.
• Drive and prioritize data-driven development by working with large data collection and labeling teams to bring in high value data to improve perception system accuracy. Efforts will include data collection prioritization and planning, labeling prioritization, so that value of data is maximized.
Qualifications:
Required:
• 10+ years of hands-on work experience in developing deep learning and algorithms to solve sophisticated real world problems, and proficiency in using deep learning frameworks (e.g., PyTorch).
• Experience in multi-sensor fusion (cameras, ultrasonic sensors, radar) for perception tasks, particularly in high-resolution world reconstruction.
• Proven experience in production deep learning model development, including careful data verification, model architecture design, loss function engineering, and debugging ML models.
• Experience in data-driven development and collaboration with data and ground truth teams.
• Strong programming skills in python and/or C++.
• Outstanding communication and teamwork skills as we work as a tightly-knit team, always discussing and learning from each other.
• BS/MS/PhD in CS, EE, sciences or related fields (or equivalent experience)
Preferred:
• Experience on end-to-end deep learning model development is a plus.
• Proven expertise in developing perception solutions for autonomous driving or robotics using deep learning with multi-sensor input.
• Hands-on experience in developing and deploying DNN-based solutions to embedded platforms for real time applications.
• Good understanding of fundamentals of 3D computer vision, camera calibrations including intrinsic and extrinsic, and sensor fusion principles.
• Experience with development in CUDA language. The ability to implement CUDA kernels as part of training or inference pipelines.
Company:
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. Founded in 1993, the company is headquartered in Santa Clara, USA, with a team of 10001+ employees. The company is currently Late Stage.