BBC News has reported that researchers have invented an artificial intelligence system that can now lipread BBC News programmes better than human lipreaders.
Extract:
The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google’s DeepMind AI division.
“Watch, Attend and Spell”, as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive – but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.
Joon Son Chung, a doctoral student at Oxford University’s Department of Engineering, explained to me just how challenging a task this is. “Words like mat, bat and pat all have similar mouth shapes.” It’s context that helps his system – or indeed a professional lip reader – to understand what word is being spoken.
Read the full article here: http://www.bbc.co.uk/news/technology-39298199
Enjoying our eggs? Support The Limping Chicken:
The Limping Chicken is the world's most popular Deaf blog, and is edited by Deaf journalist, screenwriter and director Charlie Swinbourne.
Our posts represent the opinions of blog authors, they do not represent the site's views or those of the site's editor. Posting a blog does not imply agreement with a blog's content. Read our disclaimer here and read our privacy policy here.
Find out how to write for us by clicking here, and how to follow us by clicking here.
The site exists thanks to our supporters. Check them out below:
- BSL Zone: TV programmes in BSL for the Deaf community
- Deaf Umbrella: what support is available for deaf students?
- Bellman & Symfon: home alerting solutions, including the mobile phone transceiver!
- SignVideo: Instant BSL video interpreting online
- SignHealth: check out the BSL health library
- 999 BSL: call 999 in an emergency, in BSL
- Appa: Looking for RSLIs, TSLIs and CSWs, apply here!
- Signly: Adding BSL to websites
- Signworld: Learn BSL online!
- DCAL: world-class research into deafness, cognition and language
- Action Deafness: “A Deaf-Led Charity” – interpreting & community support services
- Sign Solutions: Instant access to Interpreters, training and BSL translation nationwide
- InterpretersLive: On demand BSL video interpretation
- Lipspeaker UK: specialist lipspeaking support
- BID: Deaf services, including advice and support, interpreting, employment and letters
- Performance Interpreting: BSL interpreting at concerts
- National Deaf Children's Society: The leading charity for deaf children
Penelope Beschizza
March 20, 2017
Em….I had to check my calendar….
Oh it’s not the 1st of April for another 11 days.
All that money could be better spent on quality access and training great lipreaders instead.
Actually, the technology could breach privacy ethics. People would end up whispering, hiding their mouths with hands, we deaf people will be worse off.
mjfahey
March 20, 2017
Yes its good, but just lets wait until this AI gets to have to handle all the other problems a deaf person has to deal with before we celebrate. ie. people who are mumblers, wear bushy beards, pipe/ pencil chewers behind handers, back of headers, in the next roomers,dark rooms, hijab wearers, and the plain ignorant ” It doesn’t matterers… I bet this Artificial Intelligence will soon go insane and start suffering from depression.
Its alright pointing it at a newsreader (who are normally the easiest to lip read.) add all the rest of the stuff and and…BOOM! self destruction soon comes!