Among other things, children with autism spectrum disorder (ASD) often have difficulty initiating and maintaining conversations. That’s why a team of scientists, led by University of Toronto assistant professor Azadeh Kushki, created Holli. It’s an app that presently runs on Google Glass, and it tells ASD kids what they should say next.
“We developed software for a wearable system that helps coach children with autism spectrum disorder in everyday social interactions,” says Kushki, who is also a scientist at Toronto’s Bloorview Research Institute. “In this study, we show that children are able to use this new technology and they enjoy interacting with it.”
The system listens to what the user and another person are saying in a conversation, and recognizes commonly-used conversational prompts on the part of that other person. It then presents suitable responses for the user to choose from, in the glasses’ display.
If the other person were to greet the user by saying “Welcome,” for instance, the user would be presented with responses such as “Hey,” “Hello” or “Afternoon.” Once Holli heard the user say one of those things, it would clear the display and wait to hear the next prompt.
The app has been tested on 15 children with ASD, who were able to use it to carry on relatively smooth conversations. And although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses.
“The interesting thing about our new technology is that we are not trying to replace human-to-human interactions; instead, we use this app to coach children who are communicating with people in real-world situations,” says Kushki. “Children can practice their skills outside of their normal therapy sessions and it can provide them with increased independence in everyday interactions.”