In cooperation with the CDTM institute of the Technical University of Munich (TUM), Germany, Framos has developed an innovative wearable using real-time 3D technology to support visually impaired people in daily life. The glasses are equipped with the latest Intel RealSense stereo cameras, intelligent algorithms translate the visual impression into haptic and audio information. While audio information relies on object and character recognition, the haptic feedback is provided by a wrist band equipped with vibration motors. This new way of sensing enables visually impaired people to fully understand their environment and to have advanced guidance for safe navigation.
The eye is probably the most important human sense. But visual information is hidden for 108 million visually impaired people worldwide. Shop names, street names, route numbers of public transport or traffic signs are invisible, navigation without this information is a true challenge. The Framos-developed glasses now represent a new possibility for the visually impaired to explore the surrounding benefitting from the latest technology.
The 3D-enabled wearable creates a new way of sensing by translating visual information into haptic feedback on a wristband in real-time. The prototype includes an Intel RealSense 3D camera and speakers for audio feedback. The setup is controlled by a processing hub with a GPS sensor and a LTE module for mobile data connection. Connected via Bluetooth, a micro-processing unit translates visual data into haptic-feedback through a 2D array of vibration motors. Based on the exact location and movement of the vibrating feedback on the arm, the visually impaired is informed about the position and distance of things in the surroundings. A voice controlled interface makes interaction easy and rechargeable batteries enable a full day of use.
The glasses are a smart assistant helping the visually impaired to master their life and provides a new level of safety and knowledge by text and object recognition enabled with intelligent algorithms.