Augmented reality technologies have become indispensable in industrial production. They assist people during assembly, for example with projections that show assembly steps.
In the VizARd research project, the technology will be further developed – using two very different practical examples: for quality inspection in aircraft construction and for planning surgical interventions on humans. Before certain operations, three-dimensional sectional images (e.g. computer tomography, magnetic resonance imaging) are produced in order to plan them exactly. In the future, surgeons will be supported by an augmented reality solution developed in the VizARd project. This image data can then be visualized intuitively and user-friendly directly on the patient’s skin at the site of the incision. In the second industrial application, lightweight components made of fiber composites are examined for defects by image processing systems. The new technologies are intended to guide people more quickly to the virtually marked defects.
VizARd combines static and mobile AR devices that perceive their environment through real-time 3D sensors to visualize digital planning steps on real-world objects using AR technology. Novel non-rigid registration methods enable a highly precise mapping on deformable surfaces, and exact location-aware devices as well as accurate 3D perception permit high-quality AR presentations.
The goal of this project is to apply recent advances in deep learning to multimodal non-rigid image registration as well as real-world perception and location-aware data fusion.
Another challenge is the user-friendliness. VizARd utilizes user experience methods from the very beginning of the project. The integral involvement of users ensures their acceptance of the final technology, which is of huge importance in the given domains.
VizARd (Visual Augmented Reality Assistant for Spatial Mapping)
FFG – ICT of the Future
November 2018 – October 2020