Chinese library teaches the blind how to use smartphones
How handset features help visually impaired people “see” the world
A small library in southwest China is offering classes that teach visually impaired people how to use a device that many of us take for granted: the smartphone.
Opened last October by a private bookstore in Yunnan province, it’s one of only a handful of Braille libraries catering to visually impaired people in China -- home to the world’s largest number of blind people.
Besides offering hundreds of Braille titles, the library also gives lessons on how to use screen-reading smartphone apps to make phone calls and send messages.
It may not be apparent to most, but both Apple and Google have included a number of assistive features in their operating systems to help people with vision problems.
Let’s take a look how they work.
Navigating a smartphone
Both companies have developed functions to help visually impaired people navigate their devices. Apple’s is called VoiceOver, while Android has TalkBack -- both read out what appears on the screen.
VoiceOver, which was first introduced to macOS and later made available on iOS, can tell the user information such as battery levels, or which app their finger is touching.
The first step in sending a message or an email is to open an app -- something that is second nature to someone with full sight, but takes a little extra time for someone with impaired vision.
Fred Leung, an iPhone user and an advocate for visually impaired people in Hong Kong, explained; “For example if I want to open WhatsApp, I more or less know the app’s position. When I tap that area, the phone will tell me which app I’m touching -- but it won’t open that app unless I double tap.”
There are two ways to write a message.
The first is dictation, which types out what you say when tapping the microphone button on the keyboard. A visually impaired person can locate the button using VoiceOver or TalkBack.
“It’s actually very accurate, even in Chinese, which can be very difficult to differentiate between characters,” says Leung.
Then there’s typing, which also takes advantage of the screen-reading function. Simply place a finger over the keyboard and the phone will tell you which key you’re on, so you can double tap to select the right character.
Visually impaired people can also have their smartphones read out texts, emails, websites and e-books. Don’t like the voice you’re hearing? You can also adjust the dialect and speaking rate.
“Most people who aren’t VIP -- which is what I call visually impaired people -- don’t realize that we can even take photos,” said Leung.
Turns out, VoiceOver can describe to you what’s appearing in the phone camera.
“Even without a special app, the iPhone can tell me how many people are in the frame or if there is a face on the screen.”
As with other fields like self-driving cars, artificial intelligence is also promising new possibilities for visually impaired people.
Siri is already integrated with VoiceOver, which can describe what appears in a photo, like whether there’s a dog or a tree.
Microsoft recently launched its Seeing AI app -- a smartphone-based narrator that it says can describe what the smartphone is pointing at.
Need to identify a product at the supermarket? It can read the barcode and tell you what it is.
And it claims to go a step further.
“The Seeing AI means you can hold your phone up to a person and it can tell me what that person looks like, what their age is, the color of their hair, whether they're wearing glasses, whether they look happy or sad," Microsoft’s Dave Heiner told HuffPost Australia.