Gestures as Part of a Multimodal Communication System

Gesture Recognition in Aphasia Therapy (GeST) is a project that emphasizes the use of gestures to help individuals with aphasia communicate effectively. GeST is a computer-based program to teach simple gestures and provide home practice opportunities. Project leaders used a participatory design to gain the input from 5 people with aphasia in developing the program. They are currently evaluating its effectiveness in a pilot study.

We are big fans of multimodal communication and love the prAACtical applications of this program.

You can check it out for yourself at this video.