BBC News has reported that researchers have invented an artificial intelligence system that can now lipread BBC News programmes better than human lipreaders.
The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google’s DeepMind AI division.
“Watch, Attend and Spell”, as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive – but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.
Joon Son Chung, a doctoral student at Oxford University’s Department of Engineering, explained to me just how challenging a task this is. “Words like mat, bat and pat all have similar mouth shapes.” It’s context that helps his system – or indeed a professional lip reader – to understand what word is being spoken.
Read the full article here: http://www.bbc.co.uk/news/technology-39298199
The Limping Chicken is the UK’s deaf blogs and news website, and is the world’s most popular deaf blog. It is edited by Deaf journalist and filmmaker Charlie Swinbourne.
Please note that the views of the writers are their own, and not necessarily the views of the Editor or site as a whole. Read our disclaimer here.
- Ai-Media: Remote captioning. How to make Live Automated Captions with Apple’s Latest 'Clips' App
- Bellman & Symfon: home alerting solutions
- Deaf Umbrella: sign language interpreting and communications support
- Appa: Communication services for Deaf, Deafblind and hard of hearing people
- SignLive: Online video interpreting for Deaf people
- SignVideo: Instant BSL video interpreting online
- 121 Captions: captioning and speech-to-text services
- Hearing Direct: Online hearing aids
- Signature: Leading awarding body for BSL qualifications
- Signworld: Learn BSL online!
- Cast Theatre, Doncaster: The UK's the UK’s first fully BSL integrated pantomime
- The National Theatre: Captioned and BSL accessible theatre in London
- Doncaster School for the Deaf: education for Deaf children
- Hamilton Lodge School in Brighton: education for Deaf children
- Lipspeaker UK: specialist lipspeaking support
- Ozen: Australian hearing aid specialists
- Elmfield School, Bristol: Inclusive education for Deaf pupils
- deafPLUS: BSL advice helpline
- Exeter Deaf Academy: education for Deaf children
- Royal Shakespeare Company: Captioned and BSL interpreted performances (see dates here)
- Royal School for the Deaf, Derby: Residential education for deaf children
- RAD Tax Advice: Tax and Tax Credit info for Deaf people
- Deaf Independent: Deaf care and support services
- Performance Interpreting: BSL interpreting at concerts
- National Deaf Children's Society: The leading charity for deaf children
- cSeeker: Deaf-led educational communication support service
- Signed Culture: Advocating for BSL access to arts and culture
- SignHealth: healthcare charity for Deaf people
- CJ Interpreting: communication support in BSL
- Sign Solutions:, language and learning
- Action Deafness Communications: sign language and Red Dot online video interpreting
- BSLcourses.co.uk: Provider of online BSL courses
- British Society for Mental Health and Deafness: Promoting positive mental health for deaf people