Virtual vision enhancement and intuitive interaction through Augmented Reality on industrial trucks

Theme Industry 4.0, Automated guided vehicles
Project title Virtual vision enhancement and intuitive interaction through Augmented Reality on industrial trucks (ViSIER)
Project duration 01.10.2019 – 30.11.2021
Download
Press release

One of the biggest challenges when operating a forklift truck is the driver's limited view of his surroundings, especially when storing and retrieving load carriers or transporting bulky loads. Different camera and assistance systems are used on the vehicles to support the driver and his environment and increase the operational safety of the vehicle. Controls and screens for displaying order data, vehicle parameters or the playback of rear view or fork arms cameras, as used today in most vehicles, also represent an additional visual restriction.

The aim of this research project is to implement an AR-based operator assistance system for forklift trucks, with the support of which visual restrictions of the driver, caused by vehicle components and load, are compensated and vehicle and order data are networked with the driver depending on the situation. The interaction with the assistance system is to take place via gestures and virtual elements.

  • Sorry, no events available.
  • 11.11.2020, 10:00 h - 12:00 h
  • IPH Hannover gGmbH | Hollerithallee 6 | 30419 Hannover
  • Online meeting via MS Teams
  • 23.04.2020, 10:30 h - 12:30 h
  • IPH Hannover gGmbH | Hollerithallee 6 | 30419 Hannover
  • Online meeting via MS Teams
  • 27.08.2019, 10:30 h - 14:45 h
  • IPH - Institut für Integrierte Produktion Hannover gGmbH, Hollerithallee 6, 30419 Hannover

Publications about the project

How to compensate the restricted vision in forklifts with the help of strategically placed cameras and augmented reality glasses? Scientists from ITA and IPH are jointly tackling this question.

Augmented reality, AR, industrial trucks, vision enhancement, assistance system

In this article, a method for automatic visual obstruction detection and mask-type congruent visual obstruction compensation, based on the principal of augmented reality, is presented. The method is based on the superposition of a simulated operator's field of view with information from a scene reconstructed by two RGB-Cameras. These cameras are arranged in a way that they can record the scene information behind the view restriction. Besides the presentation of the test rig, a detailed presentation of the image processing software is given. With a view to the later use of the system in a forklift truck, the real-time capability of the system will be tested and optimization possibilities will be discussed.

augmented reality, visual obstruction correction, forklift truck, image processing software

Due to their design, the lift mast and attachments on industrial trucks, among other things, can restrict the operator's field of vision. In the project "Virtual visibility improvement and intuitive interaction through augmented reality on industrial trucks (Visier)", this situation is to be counteracted with the development of a new driver assistance system. With the aid of augmented reality (AR) goggles, the aim is to create the conditions for the driver to be able to block out visual restrictions and thus take a look behind the cargo and the mast in order to detect hazards and obstacles at an early stage.

Augmented Reality, assistance system, industrial trucks

Sponsor

The IGF project 20158 N/2 of the Research Foundation Intralogistics / Material Handling and Logistics (IFL) is funded via the German Federation of Industrial Research Associations (AiF) in the programme of Industrial Collective Research (IGF) by the Federal Ministry for Economic Affairs and Energy (BMWi) based on a decision of the German Bundestag.

Partner

Your contact person