Job Summary:
Bot Auto is revolutionizing the transportation of goods with autonomous trucks, and they are seeking a Senior ML/RL Engineer to develop their unified behavioral architecture. This role involves bridging the gap between simulation and real-world applications by creating scalable policy frameworks and ensuring safety in autonomous navigation.
Responsibilities:
• Behavioral Modeling: Develop and train diverse, conditioned policies that simulate realistic driving behaviors to stress-test and validate our autonomous driving stack.
• Safety-Constrained Learning: Lead the research and implementation of advanced RL algorithms to ensure safety metrics are treated as primary constraints in the learning process.
• Reward & Objective Design: Collaborate with cross-functional teams to design robust reward functions and evaluation metrics that balance safety, progress, and comfort.
• Scalable Training Pipelines: Contribute to the optimization of our large-scale, high-throughput training environments to enable rapid iteration on complex multi-agent scenarios.
• Model Architecture: Advance our state-of-the-art neural architectures to improve spatial reasoning, long-horizon planning, and interaction modeling.
• Cross-Team Collaboration: Work closely with Simulation and Planning teams to integrate research-grade models into production-quality, safety-critical software.
Qualifications:
Required:
• Proven track record of training and deploying deep RL algorithms (e.g., PPO, SAC) for complex, real-world robotic or autonomous systems.
• Expertise in Python and PyTorch; strong understanding of modern deep learning architectures and optimization techniques.
• MS or PhD in Computer Science, Robotics, or a related quantitative field.
• Ability to diagnose and solve fundamental challenges in RL training, such as variance management and distribution shift.
Preferred:
• Experience with constrained optimization or safety-critical learning frameworks.
• Background in MARL training stability, including self-play and decentralized execution strategies.
• Familiarity with vehicle dynamics and behavior planning, particularly for long-haul highway environments.
Company:
Transforming American Transportation with Autonomous Trucks Founded in 2023, the company is headquartered in Houston, USA, with a team of 51-200 employees. The company is currently Growth Stage.