Avatars that attempt to use sign language are viewed with suspicion by people who know sign language.
The avatars are often described as soulless, devoid of expression and people are unable to understand them.
It would seem that there has been a rush to fund projects associated with Avatar technology.
In the past 15 years, the European Union and multiple universities have thrown hundreds of thousands of pounds at research in the hope of developing avatars that can be used on websites, to and to record sign language dictionaries.
More recently, Microsoft has jumped on the bandwagon by developing Kinect Technology, using synthesised avatars to translate speech.
It is a dream of these people to provide automatic signing for speech and television broadcasts without having to drag a real, live interpreter in to the studio.
There could even be a off the shelf avatar product that deaf people can use to translate text.
Cost-effective in the long run they say. Really?
The real issue here is that most avatar technologies are NOT at a level that captures the full expressive wealth of sign language (1).
We CANNOT substitute an interpreter for an Avatar signing the 8 o’clock news. (Then again, we could always get Thamsanqa Jantjie, the Mandela Memorial’s Fake Sign Language Interpreter in)
Cultural context, subtle off the cuff expressions, incorporating prior knowledge, metaphors and examples into a signed conversation is the mark of a fluent signer.
If we do use avatars, they should reflect the movements of real, live signers.
Sceptical, I stumbled across the latest developments in Avatar technology by MocapLab in Paris.
I was so impressed by what they had done with their avatar technology, I had to have a go. Here is me signing several phrases in International, British , New Zealand and American Sign Languages.
MocapLab are definitely on the right track. See how they captured shoulder movements, squints and narrowing of the eyes and subtle mouth movements using real people who sign. That’s more like it!
If Avatar technology is done with the right signers, then hey-ho! This opens up WHOLE new areas!
Excited, I started thinking about the use of proper sign language Avatars in children’s TV programmes. We could have a signing dog WITH personality!
Avatars could be used in apps and in e-learning resources to teach both deaf and hearing children about emotions, facial expressions and to represent signing deaf characters properly.
People looking to deliver sensitive information (i.e. that of health or legal stuff) could use Avatars to conveniently screen the real person from the information itself without boring us rigid.
Avatars could even be used in rail station announcements declaring a change in platform – as the Gare de Lyon in Paris did. The Avatar sign for platform 3 could be replaced by another sign for platform 6.
By Amanda Everitt – views are her own. To read more about sign language, literacy and technology check out the rest of Amanda’s blog here or by following @playbyeye
1: Research on the limitations of Avatar technology: Bottoni, P., Capuano, D., De Marsico, M., Labella, A., and Levialdi, S., (2012b) ‘Experimenting DELE: a Deaf-centred E-Learning Visual Environment,’ Proceeding of AVI ’12 Proceedings of the International Working Conference on Advanced Visual Interfaces, New York, 2012, pp 780-781, also available online here. (Accessed 13 November 2013.)
Check out what Limping Chicken’s supporters provide:
- Phonak: innovative technology and products in hearing acoustics.
- Bellman: hearing loss solutions
- Ai-Live: Live captions and transcripts.
- Deaf Umbrella: sign language interpreting and communications support.
- 121 Captions: captioning and speech-to-text services.
- Signworld: online BSL learning and teaching materials.
- STAGETEXT: theatre captioning.
- Krazy Kat: visual theatre with BSL.
- SignHealth: healthcare support for Deaf people.
- Deafinitely Theatre: theatre from a Deaf perspective.
- Lipspeaker UK: specialist lipspeaking support.
- SDHH: Deaf television programmes online.
- Sign Solutions:, language and learning.
- Lexicon Signstream: BSL interpreting and communication services.
- Action Deafness Communications: sign language and Red Dot online video interpreting.
- Hamilton Lodge School in Brighton: education for Deaf children.
- RAD Deaf Law Centre: legal advice for Deaf people.
The Limping Chicken is the world's most popular Deaf blog, and is edited by Deaf journalist and filmmaker Charlie Swinbourne.
The site exists thanks to our supporters. Check them out below:
- Signature: Leading awarding body for BSL qualifications
- Ai-Media: Remote captioning. Find out the benefits of live captioning at university!
- Bellman & Symfon: home alerting solutions
- Deaf Umbrella: sign language interpreting and communications support
- BSL Zone: TV programmes in BSL for the Deaf community
- Stellar Communications: Speech-to-Text services
- Appa: Communication services for Deaf, Deafblind and hard of hearing people
- SignLive: Online video interpreting for Deaf people
- SignVideo: Instant BSL video interpreting online
- 121 Captions: captioning and speech-to-text services
- Eyewitness Media: TV and film from a Deaf perspective
- The National Theatre: Captioned and BSL accessible theatre in London
- Doncaster School for the Deaf: education for Deaf children
- Signworld: Learn BSL online!
- Helen Foulkes Translations: BSL translations
- RAD Tax Advice: Tax and Tax Credit info for Deaf people
- Performance Interpreting: BSL interpreting at concerts
- National Deaf Children's Society: The leading charity for deaf children
- Signed Culture: Advocating for BSL access to arts and culture
- SignHealth: healthcare charity for Deaf people
- CJ Interpreting: communication support in BSL
- British Society for Mental Health and Deafness: Promoting positive mental health for deaf people
- Action Deafness Communications: sign language and Red Dot online video interpreting
- BSLcourses.co.uk: Provider of online BSL courses
- Association of Notetaking Professionals: The professional body representing Electronic and Manual Notetakers
- Sign Solutions: communication support, training and translation
- InterpretersLive: On demand BSL video interpretation
- Hamilton Lodge School in Brighton: education for Deaf children
- Lipspeaker UK: specialist lipspeaking support
- Hearing Choices: Australian hearing aid specialists
- Elmfield School, Bristol: Inclusive education for Deaf pupils
- deafPLUS: BSL advice helpline
- Exeter Deaf Academy: education for Deaf children
- Royal Shakespeare Company: Captioned and BSL interpreted performances (see dates here)
- Royal School for the Deaf, Derby: Residential education for deaf children