BBC News has reported that researchers have invented an artificial intelligence system that can now lipread BBC News programmes better than human lipreaders.
The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google’s DeepMind AI division.
“Watch, Attend and Spell”, as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive – but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.
Joon Son Chung, a doctoral student at Oxford University’s Department of Engineering, explained to me just how challenging a task this is. “Words like mat, bat and pat all have similar mouth shapes.” It’s context that helps his system – or indeed a professional lip reader – to understand what word is being spoken.
Read the full article here: http://www.bbc.co.uk/news/technology-39298199
The Limping Chicken is the world's most popular Deaf blog, and is edited by Deaf journalist and filmmaker Charlie Swinbourne. Find out how to write for us by clicking here, how to follow us by clicking here, and read our disclaimer here.
The site exists thanks to our supporters. Check them out below:
- Eyewitness Media: TV and film from a Deaf perspective
- Ai-Media: Remote captioning. Find out about 5 funny ways to use captions!
- Bellman & Symfon: home alerting solutions
- Deaf Umbrella: sign language interpreting and communications support
- Appa: Communication services for Deaf, Deafblind and hard of hearing people
- SignLive: Online video interpreting for Deaf people
- SignVideo: Instant BSL video interpreting online
- 121 Captions: captioning and speech-to-text services
- Signature: Leading awarding body for BSL qualifications
- The National Theatre: Captioned and BSL accessible theatre in London
- Doncaster School for the Deaf: education for Deaf children
- Signworld: Learn BSL online!
- Action Deafness Communications: sign language and Red Dot online video interpreting
- BSLcourses.co.uk: Provider of online BSL courses
- Association of Notetaking Professionals: The professional body representing Electronic and Manual Notetakers
- Sign Solutions: communication support, training and translation
- InterpretersLive: On demand BSL video interpretation
- Hamilton Lodge School in Brighton: education for Deaf children
- Lipspeaker UK: specialist lipspeaking support
- Ozen: Australian hearing aid specialists
- Elmfield School, Bristol: Inclusive education for Deaf pupils
- deafPLUS: BSL advice helpline
- Exeter Deaf Academy: education for Deaf children
- Royal Shakespeare Company: Captioned and BSL interpreted performances (see dates here)
- Royal School for the Deaf, Derby: Residential education for deaf children
- RAD Tax Advice: Tax and Tax Credit info for Deaf people
- Performance Interpreting: BSL interpreting at concerts
- National Deaf Children's Society: The leading charity for deaf children
- Signed Culture: Advocating for BSL access to arts and culture
- SignHealth: healthcare charity for Deaf people
- CJ Interpreting: communication support in BSL
- British Society for Mental Health and Deafness: Promoting positive mental health for deaf people