Fraunhofer presents high-speed microscope with intuitive gesture control

25-Apr-2019 - Germany

The Fraunhofer Institute for Production Technology IPT in Aachen has developed a high-speed microscope for quality control of large-area objects for the semiconductor and electronics industries or for rapid testing of biological samples. The microscope digitizes samples with up to 500 frames per second. At Control, the international trade fair for quality assurance, from 7 to 10 May 2019 in Stuttgart, the metrology experts from Aachen will be demonstrating for the first time how this system can be combined with gesture control by means of Smart Glasses and thus controlled and operated even more efficiently.

Conventional microscope images of large components often take such a long time at high magnifications that 100 percent inspections cannot be performed due to time constraints and only random samples can be examined. For this reason, the Fraunhofer IPT has developed a new imaging process that combines a large number of images into a comprehensive overall image: The microscope stage moves the object continuously during the entire process in order to digitize the sample at very high frame rates. Since each object is only exposed extremely briefly with a flash, the shot is free of motion blur and is sharp at every point thanks to real-time hardware autofocus systems.

The additional Smart Glasses consist of data glasses that enrich the user's environment with virtual elements. The glasses are connected to a sensor for gesture recognition: If the user holds his hand over this sensor, he can not only see the image, but also move and focus the microscope with intuitive hand movements. The visualization is browser-based – both smartphone and tablet can be integrated.

The high-resolution images of the high-speed microscope are combined to form a large overall image that the user can not only view, but also move, freeze and save. The scanning process combines real-time data handling with powerful image pre-processing, which runs almost without delay thanks to GPU support. Current developments also include machine learning approaches such as Deep Learning and Convolutional Neuronal Networks (CNN).

https://www.bionity.com/en/news/1160742/fraunhofer-presents-high-speed-microscope-with-intuitive-gesture-control.html