VoxLens: Adding one line of code can make some interactive visualizations accessible to screen-reader users
Interactive visualizations have changed the way we understand our lives. For example, they can showcase the number of coronavirus infections in each state.
But these graphics often are not accessible to people who use screen readers, software programs that scan the contents of a computer screen and make the contents available via a synthesized voice or Braille. Millions of Americans use screen readers for a variety of reasons, including complete or partial blindness, learning disabilities or motion sensitivity.
University of Washington researchers worked with screen-reader users to design VoxLens, a JavaScript plugin that — with one additional line of code — allows people to interact with visualizations. VoxLens users can gain a high-level summary of the information described in a graph, listen to a graph translated into sound or use voice-activated commands to ask specific questions about the data, such as the mean or the minimum value.
The team presented this project May 3 at CHI 2022 in New Orleans.
“If I’m looking at a graph, I can pull out whatever information I am interested in, maybe it’s the overall trend or maybe it’s the maximum,” said lead author Ather Sharif, a UW doctoral student in the Paul G. Allen School of Computer Science & Engineering. “Right now, screen-reader users either get very little or no information about online visualizations, which, in light of the COVID-19 pandemic, can sometimes be a matter of life and death. The goal of our project is to give screen-reader users a platform where they can extract as much or as little information as they want.”
Screen readers can inform users about the text on a screen because it’s what researchers call “one-dimensional information.”
“There is a start and an end of a sentence and everything else comes in between,” said co-senior author Jacob O. Wobbrock, UW professor in the Information School. “But as soon as you move things into two dimensional spaces, such as visualizations, there’s no clear start and finish. It’s just not structured in the same way, which means there’s no obvious entry point or sequencing for screen readers.” More