UI professor develops app to help the visually impaired with help from Microsoft
UI computer science professor Kyle Rector is developing an app to help visually impaired people walk around a track with help from an AI for accessibility grant from Microsoft.
The Old Capitol building is seen in 2018.
January 31, 2019
A University of Iowa assistant professor of computer science is developing a phone application to help visually impaired people walk around a track.
Kyle Rector said the app uses camera sensors to tell users if they are veering from their lane on a walking track. The app is being developed with help from the Microsoft AI for Accessibility grant in collaboration with researchers at the UI and at the State University of New York-Brockport.
According to the Microsoft website, the grant โharnesses the power of AI to amplify human capability for the more than 1 billion people around the world with a disability.โ
Rector said Microsoft provides some financial support, as well as technical support, for her research.
โMy adviser from grad school told me about [the grant], and I decided to apply,โ she said. โWeโre using custom vision service [for the app]. Basically, the computer sees instead of us.โ
Rector plans to test the appโs functionality this summer with children at Camp Abilities, a sports camp for blind and visually impaired children.
RELATED: UI professor develops a Siri for flood information
โWe want to work with people of different ages, and while we want to work with adults, a great opportunity to work with youth of many ages is to go to Camp Abilities, which is a sports and recreation camp,โ Rector said. โItโs not just in New York, which is where weโll definitely be going, but all over the world.โ
Lauren Lieberman, a professor of kinesiology, sports studies, and physical education at SUNY-Brockport, developed Camp Abilities in 1994. The camp now has locations in 22 states.
โYou can use [the app] with kids who are 2 to adults who are 100,โ she said. โTracks are found in just about any country. Youโre talking about an app that could change the lives of thousands of people around the world. Thereโs just no telling how many people it could help be active and independent.โ
UI graduate research assistant Masuma Rumi, who assists Rector, said the app is being developed for both iOS and Android systems, which can make phone applications more accessible on a global level.
โWhen I applied for graduate study, I looked at Kyleโs website and I [saw] that she is really interested in accessibility work,โ Rumi said. โBack in my country โ Iโm from Bangladesh โ blind people donโt receive as much care as U.S.A. people get. I was included in a project in my country to help blind people go in transportation safely. I was hoping to do something for blind people in my country to help them in their life. After coming here, I got to know about [Rectorโs] research, and I got involved.โ
Lieberman said Rectorโs research is receiving a lot of attention in the scientific community.
โShe has so many projects; sheโs getting so many grants and so much attention for this work, and I just think that she is a gift,โ Lieberman said. โIโm really honored to work with her and be part of her projects. We do a lot of cool things together.โ