Wearable Device GIST Helps the Blind ‘See’ What’s Around Them | Singularity Hub
▻http://singularityhub.com/2013/10/19/wearable-device-gist-helps-the-blind-see-whats-around-them
GIST, a gesture-controlled wearable device that helps the visually impaired navigate the world around them. (...)
▻http://www.youtube.com/watch?v=wfZV9jt3240
The user wears GIST, or Gestural Interface for Remote Spatial Perception, around his or her neck. Using different gesture commands, the user can prompt the device to provide information on whether there’s a person nearby, the predominant color of an object or its distance from the user. The device can also measure the depth of a particular area, indicated with the hand.(...)
Based on Microsoft’s Kinect sensor, the device detects the hand signal and reads the pixels surrounding the user’s outstretched hand to provide an answer. It answers the queries out loud.
(...) In a video, Khambadkar and Folmer demonstrate a few use cases. In one, a woman uses the “color” command to locate a water bottle. She then uses the object distance command to find it with her hand and pick it up.