Perception Algorithm Engineer Jobs in Mesquite, TX

Technology, Digital and Data

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

At Caterpillar, technology always has a purpose, which is to solve our customers' toughest challenges. Through Cat Technology, we are solving problems by building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world-on real jobsites, at global scale.

Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible-intelligent machines operating in dynamic jobsites-into reality.

The Sensor Rendering Engineer is responsible for developing, validating, and optimizing high-fidelity sensor simulation and rendering capabilities within the NVIDIA Omniverse ecosystem. This role focuses on creating physically accurate virtual sensing environments that support robotics, autonomy, digital twin, and machine intelligence applications. The engineer collaborates closely with autonomy, perception, simulation, and visualization teams to ensure synthetic sensor data accurately represents real-world operating conditions and enables robust algorithm development, testing, and validation.

Key areas of ownership include sensor modeling, rendering pipeline support, synthetic data generation, environmental realism, performance optimization, and the integration of camera, LiDAR, radar, and other virtual sensors into large-scale simulation environments. The role requires expertise in real-time rendering technologies, RTX-based ray tracing, Omniverse Isaac Sim, USD workflows, and sensor fidelity validation against real-world data.

The ideal candidate combines strong software engineering skills with deep knowledge of computer graphics, physically based rendering, sensor physics, and simulation technologies to deliver scalable, accurate, and production-ready virtual sensing solutions.

• Develop and maintain high-fidelity sensor rendering solutions for camera, LiDAR, radar, depth, and other perception systems within NVIDIA Omniverse and Isaac Sim.
• Design, implement, and validate physically based sensor models that accurately represent real-world sensor behavior and environmental interactions.
• Create synthetic data generation pipelines to support machine learning, computer vision, perception, and autonomous system development.
• Optimize RTX-based rendering workflows to balance sensor accuracy, scalability, and simulation performance.
• Develop tools and automation frameworks for sensor configuration, calibration, testing, and data collection.
• Collaborate with autonomy, perception, controls, and digital twin teams to define sensor requirements and validation criteria.
• Build and maintain USD-based simulation assets, environments, and workflows that support enterprise-scale digital twin initiatives.
• Model environmental effects such as lighting, weather, dust, fog, material properties, occlusions, and surface reflectance to improve simulation realism.
• Correlate simulated sensor outputs with real-world datasets and field measurements to assess fidelity and drive continuous model improvements.
• Integrate sensor simulation capabilities into virtual machine validation and autonomy testing frameworks.
• Partner with software, graphics, and infrastructure engineers to deploy scalable simulation solutions across workstations, cloud, and high-performance computing environments.
• Investigate emerging rendering technologies, AI-driven simulation techniques, and Omniverse platform capabilities to enhance sensor realism and productivity.
• Establish best practices, standards, and documentation for sensor rendering, synthetic data generation, and simulation validation.
• Provide technical leadership and mentorship in rendering technologies, sensor physics, computer graphics, and Omniverse development.
• Support cross-functional teams in troubleshooting sensor-related simulation issues and improving virtual testing effectiveness.

• Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Robotics, Graphics Engineering, or a related technical discipline.
• 5+ years of experience in software development, simulation, computer graphics, rendering, robotics, or autonomous systems development.
• Strong proficiency in Python and C++ for developing simulation, rendering, and automation applications.
• Hands-on experience with NVIDIA Omniverse, Isaac Sim, USD (Universal Scene Description), and RTX-based rendering technologies.
• Deep understanding of physically based rendering (PBR), ray tracing, path tracing, and real-time graphics pipelines.
• Experience modeling and simulating perception sensors, including cameras, LiDAR, radar, depth sensors, and inertial measurement systems.
• Knowledge of sensor physics, sensor calibration, noise modeling, and environmental effects impacting perception systems.
• Experience developing synthetic data generation solutions for machine learning, computer vision, or autonomous systems applications.
• Strong understanding of 3D geometry, optics, image formation, photogrammetry, and computer vision fundamentals.
• Experience working with large-scale simulation environments and digital twin technologies.
• Familiarity with GPU programming concepts, rendering optimization, and performance analysis techniques.
• Experience integrating simulation platforms with robotics, autonomy, perception, or machine learning workflows.
• Proficiency with source control systems, CI/CD pipelines, and modern software engineering practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Demonstrated ability to work effectively in cross-functional teams involving software, autonomy, controls, perception, and simulation engineers.
• Excellent verbal and written communication skills, including the ability to communicate complex technical concepts to diverse audiences.

• Master's or Ph.D. in Computer Graphics, Robotics, Computer Vision, Artificial Intelligence, or a related field.
• Experience developing digital twins for industrial, construction, mining, agricultural, or autonomous vehicle applications.
• Familiarity with ROS/ROS2, NVIDIA Cosmos, Isaac Lab, OpenUSD, and synthetic data frameworks.
• Experience validating virtual sensor models against real-world sensor datasets and field measurements.
• Knowledge of machine perception, sensor fusion, localization, mapping, and autonomous navigation systems.
• Experience with cloud-based simulation infrastructure and scalable compute environments.
• Demonstrated technical leadership and mentoring experience.
• Experience supporting end-to-end virtual validation programs for autonomous or intelligent machines.

• This position requires the candidate to work full-time at the Irving, TX office (Dallas)
• Domestic relocation assistance is available for this position.
• Visa sponsorship is available with this position.

$112,710.00 - $183,140.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

• Medical, dental, and vision benefits*
• Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
• 401(k) savings plans*
• Health Savings Account (HSA)*
• Flexible Spending Accounts (FSAs)*
• Health Lifestyle Programs*
• Employee Assistance Program*
• Voluntary Benefits and Employee Discounts*
• Career Development*
• Incentive bonus*
• Disability benefits
• Life Insurance
• Parental leave
• Adoption benefits
• Tuition Reimbursement

* These benefits also apply to part-time employees

This position requires working onsite five days a week.

Relocation is available for this position.

Visa sponsorship is available for eligible applicants.

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.