Manually controlling driverless vehicles - that sounds like a contradiction at first. This is because AGVs are actually designed to move goods without human intervention, for example from the warehouse to production or from one assembly workstation to the next. The vehicles usually move along fixed routes through the factory and perform the same tasks fully automatically. However, as with any technical system, AGVs also occasionally malfunction. For example, if an obstacle blocks the path and the vehicle cannot drive around this obstacle without leaving its predefined route. Most AGVs then stop until the obstacle is removed - or until they are manually steered around the obstacle.

Scientists at IPH have developed an intuitive and mobile system for human-machine interaction in the MobiMMI research project in order to be able to control vehicles at any time - without special training, without IT knowledge and without interfering with the control system. From the outside, the demonstrator's only striking feature is a pair of standard AR glasses; what makes it special is the software, which is the result of two years of research and development work. It allows AGVs to be controlled intuitively and on the move. Mobile means that the employee can stand anywhere in the factory within sight of the vehicle instead of sitting far away at a computer. Intuitive means that the employee communicates with the vehicles in the same way that humans do: via eye contact, speech and gestures.

The logistics employee simply puts on the AR glasses and can then have a three-dimensional joystick displayed. This allows them to steer the vehicle with a few hand movements, for example around obstacles or to stations that are not programmed, such as chaotically parked deliveries in the incoming goods area. Manual control can also be useful for non-routine transport orders.

As an alternative to gesture control, the employee can also activate voice control, select individual AGVs and specify a destination, for example: "AGV 3, go to station 5." Voice control is suitable for unscheduled transport orders. Normally, AGVs work through one programmed job after another. If something urgent needs to be done, a qualified employee has to intervene via the control system and bring the order forward. Thanks to the software in the smart glasses, the MobiMMI system can do this on demand.