According to a BBC News report, scientists at Oxford University have developed a machine that can lip-read better than humans, with 93% accuracy.
By ‘humans,’ we’re unsure whether they mean the typical person on the street, or the best of the Deaf lipreading masses. (There’s a difference, clearly.)
But dig a little closer and the headline isn’t quite what it first appears. The artificial intelligence system appears to match pre-existing text to lip movements. That’s quite a bit different from watching what someone’s saying with no idea what it might be, then figuring out what it is (which is what Deaf folk do every day).
However, the machine did this task quite a lot better than ‘humans’ did. And even if the technology is at an early stage right now, in a decade or so, who knows how good it might be?
And if it could offer speech recognition in noisy environments, then us Deafies might finally get those subtitled glasses we’ve been dreaming of for years. Which might make up for losing all the lipreading work we used to get when there’s a royal wedding on.
The report says:
Scientists at Oxford University have developed a machine that can lip-read better than humans.
The artificial intelligence system – LipNet – watches video of a person speaking and matches the text to the movement of their mouths with 93% accuracy, the researchers said.
Automating the process could help millions, they suggested.
But experts said the system needed to be tested in real-life situations.
Lip-reading is a notoriously tricky business with professionals only able to decipher what someone is saying up to 60% of the time.
“Machine lip-readers have enormous potential, with applications in improved hearing aids, silent dictation in public spaces, covert conversations, speech recognition in noisy environments, biometric identification and silent-movie processing,” wrote the researchers.
They said that the AI system was provided with whole sentences so that it could teach itself which letter corresponded to which lip movement.
To train the AI, the team – from Oxford University’s AI lab – fed it nearly 29,000 videos, labelled with the correct text. Each video was three seconds long and followed a similar grammatical pattern.
While human testers given similar videos had an error rate of 47.7%, the AI had one of just 6.6%.
Read the full article here: http://www.bbc.co.uk/news/technology-37911135
By Charlie Swinbourne, Editor
The Limping Chicken is the UK’s deaf blogs and news website, and is the world’s most popular deaf blog. It is edited by Deaf journalist and filmmaker Charlie Swinbourne.
Please note that the views of the writers are their own, and not necessarily the views of the Editor or site as a whole. Read our disclaimer here.
- Phonak: innovative technology and products in hearing acoustics
- Ai-Media: Remote captioning. Check out these captioning fails!
- Bellman & Symfon: home alerting solutions
- Deaf Umbrella: sign language interpreting and communications support
- Clarion: BSL/English interpreting and employment services
- Appa: Communication services for Deaf, Deafblind and hard of hearing people
- Signature: Find out about the Signature conference here.
- SignVideo: Instant BSL video interpreting online
- 121 Captions: captioning and speech-to-text services
- Hearing Direct: Online hearing aids
- The National Theatre: Captioned and BSL accessible theatre in London
- Doncaster School for the Deaf: education for Deaf children
- SignLive: Online video interpreting for Deaf people
- RAD Tax Advice: Tax and Tax Credit info for Deaf people
- Deaf Independent: Deaf care and support services
- Signworld: online BSL learning and teaching materials
- Performance Interpreting: BSL interpreting at concerts
- National Deaf Children's Society: The leading charity for deaf children
- DCAL: Find out how to study at the Deafness Cognition and Language Research Centre, London
- cSeeker: Deaf-led educational communication support service
- Signed Culture: Advocating for BSL access to arts and culture
- Sarah Gatford: BSL interpreting, training and consultancy
- SignHealth: healthcare charity for Deaf people
- CJ Interpreting: communication support in BSL
- Sign Solutions:, language and learning
- Action Deafness Communications: sign language and Red Dot online video interpreting
- BSLcourses.co.uk: Provider of online BSL courses
- British Society for Mental Health and Deafness: Promoting positive mental health for deaf people
- deafPLUS: Money advice line in BSL
- Happy: Microsoft Office courses taught in BSL and SSE by a Deaf trainer – all abilities catered for
- Hamilton Lodge School in Brighton: education for Deaf children
- Lipspeaker UK: specialist lipspeaking support
- Ozen: Australian hearing aid specialists
- Elmfield School, Bristol: Inclusive education for Deaf pupils
- Exeter Deaf Academy: education for Deaf children