Stanford Researchers Develop a Smartphone App to Simultaneously Treat and Track Autism

Diagnosing autism can take half a day or more of clinical observation, and that’s the quick part – often, families wait years just to get to that point. Now, in hopes of speeding things up, Stanford researchers are developing a smartphone app that could drastically reduce the time it takes to get a diagnosis.

The heart of the app, called Guess What?, is a game that encourages kids to act out concepts such as playing baseball or the feeling of being happy. But just as important, says creator Dennis Wall, an associate professor of pediatrics and of biomedical data science, is the fact that the app takes video of kids at play – video that preliminary work suggests can be analyzed to figure out if kids have autism.

With help from a Neuroscience:Translate seed grant from the Wu Tsai Neurosciences Institute, Wall, James Landay, a professor of computer science, and colleagues are expanding GuessWhat’s capabilities as not just a diagnostic tool but perhaps a therapeutic one as well.

“Children are missing an opportunity” to get help with autism, Wall said, and if the project is successful, it will “address a critical need in the diagnosis of autism.”

Charades as diagnostic tool

The original idea for Guess What?, Wall said, came to him while playing a smartphone-based version of charades. In that game, players hold a phone on their foreheads, screen facing out, so that others can see a cue – a picture of an astronaut, for example – and try to guess that cue from what their friends act out.

Wall realized that by getting kids to act out a variety of different concepts – astronauts and the like, but also emotions or social situations – he might be able to capture video of children and use machine learning algorithms on that video to determine the probability any one child had autism. That, Wall said, could be useful both for diagnosis and for tracking developmental progress. And for parents, it could be done relatively quickly and without having to wait years for a visit to a specialized clinic.

“I thought if we could do something like this for autism, if could be really powerful,” Wall said.

Here’s how it currently works. After parents or other adults open the app and sign in, they hold the phone up to their foreheads, screen facing out so a kid can see it. The screen then displays an image – pictures of emojis or people in various jobs or social situations – for the child to act out. The adult then tries to guess what the image represents.

The difference from usual charades is the video. While a child plays, the smartphone’s camera captures video, which serves two purposes. In the initial stages, Wall, Landay and colleagues already know which kids have autism and which don’t, and the point is to analyze the video using machine learning methods to figure out which facial expressions, movements or other behaviors distinguish those with autism. From that, the app would learn to detect indicators of autism, which a child’s doctor could then use to screen kids without having to see them in a specialized clinic. Preliminary experiments, Wall said, suggest the strategy could work – and that the time is right to expand the team’s efforts.

Charades as therapy

Now, Wall said, “our goal is to build it up, and that’s where the seed grant comes in.” With that funding, the team is gearing up for field tests with a wider group of families, who will participate in co-designing the next version of the app. The team will also continue to gather data that could help the app better distinguish between kids with and without autism.

Excerpted from “Stanford Researchers Develop a Smartphone App to simultaneously Treat and Track Autism” published in Stanford News online. Read the full article.

Source: Stanford News | Stanford Researchers Develop a Smartphone App to simultaneously Treat and Track Autism, https://news.stanford.edu/2019/03/06/smartphone-app-treat-track-autism | © Stanford University

More Information

Guess What? is for children between the ages of 3 and 12 years.  If you are interested in contributing to this research project, the app may be downloaded from the App Store or from Google Play. Learn more.