SEARCH
3D Range Sensing   |   Image Processing   |   Modeling & Simulation   |   Motion Planning & Execution   |   Machine Learning   |   Manipulation





Multi-Vehicle Coordination   |   Operator Interfaces   |   Electromechanical Design   |   System Integration & Testing   |   Operational Safety





Safety Engineering & Certification   |   Projects vs. Capabilities
© Carnegie Mellon University
Capabilities





Training system for hand-held mine detectors


A head-mounted, monocular OCU screen and hand-held controller for a one-ton UGV



SACR (Situational Awareness through Colorized Ranging) generates a real-time, photo-realistic, three-dimensional model of a vehicle’s surroundings. Using SACR for teleoperation improves operator situational awareness and performance.
Operator Interfaces

Our user-interfaces allow a remote operator to monitor and assume control of a robotic agent. They support effective, non-line-of-sight teleoperation of robots and their payloads.  Better situational awareness leads to better safety, lowers the workload of robot operators, and allows operators to perform tasks more efficiently.

We developed head-mounted displays and lightweight operator control units for unmanned ground vehicles.  Our driver assistance systems help military drivers to spot potentially hazardous changes along their vehicle’s route, such as roadside explosives.  Our advanced teleoperation system uses input from range sensors and video cameras to generate real-time, three-dimensional, photo-realistic models of a vehicle’s surroundings.  Operators can view their vehicle from any perspective, giving them better awareness of their vehicle’s environment.  We also developed a teleoperation booth that provides video, audio, and movement feedback to operators. 

  Operator control units

  Operator assistance

  Situational awareness

  Operator training

  Work cell monitoring and control

  Payload and implement control