Network Working Group N. Charlton
Request for Comments: 3351 Millpark
Category: Informational M. Gasson
Koru Solutions
G. Gybels
M. Spanner
RNID
A. van Wijk
Ericsson
August 2002
User Requirements for the Session Initiation Protocol (SIP)
in Support of Deaf, Hard of Hearing
and Speech-impaired Individuals
Status of this Memo
This memo provides information for the Internet community. It does
not specify an Internet standard of any kind. Distribution of this
memo is unlimited.
Copyright Notice
Copyright (C) The Internet Society (2002). All Rights Reserved.
Abstract
This document presents a set of Session Initiation Protocol
(SIP) user requirements that support communications for deaf, hard of
hearing and speech-impaired individuals. These user requirements
address the current difficulties of deaf, hard of hearing and
speech-impaired individuals in using communications facilities, while
acknowledging the multi-functional potential of SIP-based
communications.
A number of issues related to these user requirements are further
raised in this document.
Also included are some real world scenarios and some technical
requirements to show the robustness of these requirements on a
concept-level.
Table of Contents
1. Terminology and Conventions Used in this Document................2
2. Introduction.....................................................3
3. Purpose and Scope................................................4
4. Background.......................................................4
5. Deaf, Hard of Hearing and Speech-impaired Requirements for SIP...5
5.1 Connection without Difficulty................................5
5.2 User Profile.................................................6
5.3 Intelligent Gateways.........................................6
5.4 Inclusive Design.............................................7
5.5 Resource Management..........................................7
5.6 Confidentiality and Security.................................7
6. Some Real World Scenarios........................................8
6.1 Transcoding Service..........................................8
6.2 Media Service Provider.......................................9
6.3 Sign Language Interface......................................9
6.4 Synthetic Lip-reading Support for Voice Calls...............10
6.5 Voice-Activated Menu Systems................................10
6.6 Conference Call.............................................11
7. Some Suggestions for Service Providers and User Agent
Manufacturers...................................................13
8. Acknowledgements................................................14
Security Considerations.........................................14
Normative References............................................15
Informational References........................................15
Author's Addresses..............................................15
Full Copyright Statement........................................17
1. Terminology and Conventions Used in this Document
In this document, the key words "MUST", "MUST NOT","REQUIRED",
"SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY",
and "OPTIONAL" are to be interpreted as described in BCP 14,
RFC2119[1] and indicate requirement levels for compliant SIP
implementations.
For the purposes of this document, the following terms are considered
to have these meanings:
Abilities: A person's capacity for communicating which could include
a hearing or speech impairment or not. The terms Abilities and
Preferences apply to both caller and call-recipient.
Preferences: A person's choice of communication mode. This could
include any combination of media streams, e.g., text, audio, video.
The terms Abilities and Preferences apply to both caller and
call-recipient.
Relay Service: A third-party or intermediary that enables
communications between deaf, hard of hearing and speech-impaired
people, and people without hearing or speech-impairment. Relay
Services form a subset of the activities of Transcoding Services (see
definition).
Transcoding Services: A human or automated third party acting as an
intermediary in any session between two other User Agents (being a
User Agent itself), and transcoding one stream into another (e.g.,
voice to text or vice versa).
Textphone: Sometimes called a TTY (teletypewriter), TDD
(telecommunications device for the deaf) or a minicom, a textphone
enables a deaf, hard of hearing or speech-impaired person to place a
call to a telephone or another textphone. Some textphones use the
V.18[3] protocol as a standard for communication with other textphone
communication protocols world-wide.
User: A deaf, hard of hearing or speech-impaired individual. A user
is otherwise referred to as a person or individual, and users are
referred to as people.
Note: For the purposes of this document, a deaf, hard of hearing, or
speech-impaired person is an individual who chooses to use SIP
because it can minimize or eliminate constraints in using common
communication devices. As SIP promises a total communication
solution for any kind of person, regardless of ability and
preference, there is no attempt to specifically define deaf, hard of
hearing or speech-impaired in this document.
2. Introduction
The background for this document is the recent development of SIP[2]
and SIP-based communications, and a growing awareness of deaf, hard
of hearing and speech-impaired issues in the technical community.
The SIP capacity to simplify setting up, managing and tearing down
communication sessions between all kinds of User Agents has specific
implications for deaf, hard of hearing and speech-impaired
individuals.
As SIP enables multiple sessions with translation between multiple
types of media, these requirements aim to provide the standard for
recognizing and enabling these interactions, and for a communications
model that includes any and all types of SIP-networking abilities and
preferences.
3. Purpose and Scope
The scope of this document is firstly to present a current set of
user requirements for deaf, hard of hearing and speech-impaired
individuals through SIP-enabled communications. These are then
followed by some real world scenarios in SIP-communications that
could be used in a test environment, and some concepts of how these
requirements can be developed by service providers and User Agent
manufacturers.
These recommendations make explicit the needs of a currently often
disadvantaged user-group and attempt to match them with the capacity
of SIP. It is not the intention here to prioritize the needs of
deaf, hard of hearing and speech-impaired people in a way that would
penalize other individuals.
These requirements aim to encourage developers and manufacturers
world-wide to consider the specific needs of deaf, hard of hearing
and speech-impaired individuals. This document presents a
world-vision where deafness, hard of hearing or speech impairment are
no longer a barrier to communication.
4. Background
Deaf, hard of hearing and speech-impaired people are currently
often unable to use commonly available communication devices.
Although this is documented[4], this does not mean that developers or
manufacturers are always aware of this. Communication devices for
deaf, hard of hearing and speech-impaired people are
currently often primitive in design, expensive, and non-compatible
with progressively designed, cheaper and more adaptable communication
devices for other individuals. For example, many models of textphone
are unable to communicate with other models.
Additionally, non-technical human communications, for example sign
languages or lip-reading, are non-standard around the world.
There are intermediary or third-party relay services (e.g.
transcoding services) that facilitate communications, uni- or bi-
directional, for deaf, hard of hearing and speech-impaired people.
Currently relay services are mostly operator-assisted (manual),
although methods of partial automation are being implemented in some
areas. These services enable full access to modern facilities and
conveniences for deaf, hard of hearing and speech-impaired people.
Although these services are somewhat limited, their value is
undeniable as compared to their previous complete unavailability.
Yet communication methods in recent decades have proliferated:
email, mobile phones, video streaming, etc. These methods are an
advance in the development of data transfer technologies between
devices.
Developers and advocates of SIP agree that it is a protocol that not
only anticipates the growth in real-time communications between
convergent networks, but also fulfills the potential of the Internet
as a communications and information forum. Further, they agree that
these developments allow a standard of communication that can be
applied throughout all networking communities, regardless of
abilities and preferences.
5. Deaf, Hard of Hearing and Speech-impaired Requirements for SIP
Introduction
The user requirements in this section are provided for the benefit of
service providers, User Agent manufacturers and any other interested
parties in the development of products and services for deaf, hard of
hearing and speech-impaired people.
The user requirements are as follows:
5.1 Connection without Difficulty
This requirement states:
Whatever the preferences and abilities of the user and User Agent,
there SHOULD be no difficulty in setting up SIP sessions. These
sessions could include multiple proxies, call routing decisions,
transcoding services, e.g., the relay service Typetalk[5] or other
media processing, and could include multiple simultaneous or
alternative media streams.
This means that any User Agent in the conversation (including
transcoding services) MUST be able to add or remove a media stream
from the call without having to tear it down and re-establish it.
5.2 User Profile
This requirement states:
Deaf, hard of hearing and speech-impaired user abilities and
preferences (i.e., user profile) MUST be communicable by SIP, and
these abilities and preferences MUST determine the handling of the
session.
The User Profile for a deaf, hard of hearing or speech-impaired
person might include details about:
- How media streams are received and transmitted (text, voice, video,
or any combination, uni- or bi-directional).
- Redirecting specific media streams through a transcoding service
(e.g., the relay service Typetalk)
- Roaming (e.g., a deaf person accessing their User Profile from a
web-interface at an Internet cafe)
- Anonymity: i.e., not revealing that a deaf person is calling, even
through a transcoding service (e.g., some relay services inform the
call-recipient that there is an incoming text call without saying
that a deaf person is calling).
Part of this requirement is to ensure that deaf, hard of hearing
and speech-impaired people can keep their preferences and abilities
confidential from others, to avoid possible discrimination or
prejudice, while still being able to establish a SIP session.
5.3 Intelligent Gateways
This requirement states:
SIP SHOULD support a class of User Agents to perform as gateways for
legacy systems designed for deaf, hard of hearing and speech-impaired
people.
For example, an individual could have a SIP User Agent acting as a
gateway to a PSTN legacy textphone.
5.4 Inclusive Design
This requirement states:
Where applicable, design concepts for communications (devices,
applications, etc.) MUST include the abilities and preferences of
deaf, hard of hearing and speech-impaired people.
Transcoding services and User Agents MUST be able to connect with
each other regardless of the provider or manufacturer. This means
that new User Agents MUST be able to support legacy protocols through
appropriate gateways.
5.5 Resource Management
This requirement states:
User Agents SHOULD be able to identify the content of a media stream
in order to obtain such information as the cost of the media stream,
if a transcoding service can support it, etc.
User Agents SHOULD be able to choose among transcoding services and
similar services based on their capabilities (e.g., whether a
transcoding service carries a particular media stream), and any
policy constraints they impose (e.g., charging for use). It SHOULD
be possible for User Agents to discover the availability of
alternative media streams and to choose from them.
5.6 Confidentiality and Security
This requirement states:
All third-party or intermediaries (transcoding services) employed in
a session for deaf, hard of hearing and speech-impaired people MUST
offer a confidentiality policy. All information exchanged in this
type of session SHOULD be secure, that is, erased before
confidentiality is breached, unless otherwise required.
This means that transcoding services (e.g., interpretation,
translation) MUST publish their confidentiality and security
policies.
6. Some Real World Scenarios
These scenarios are intended to show some of the various types of
media streams that would be initiated, managed, directed, and
terminated in a SIP-enabled network, and shows how some resources
might be managed between SIP-enabled networks, transcoding services
and service providers.
To illustrate the communications dynamic of these kinds of scenarios,
each one specifically mentions the kind of media streams transmitted,
and whether User Agents and Transcoding Services are involved.
6.1 Transcoding Service
In this scenario, a hearing person calls the household of a deaf
person and a hearing person.
1. A voice conversation is initiated between the hearing
participants:
( Person A) <-----Voice ---> ( Person B)
2. During the conversation, the hearing person asks to talk with the
deaf person, while keeping the voice connection open so that voice
to voice communications can continue if required.
3. A Relay Service is invited into the conversation.
4. The Relay Service transcodes the hearing person's words into text.
5. Text from the hearing person's voice appears on the display of the
deaf person's User Agent.
6. The deaf person types a response.
7. The Relay Service receives the text and reads it to the hearing
person:
( ) <------------------Voice----------------> ( )
(Person A ) -----Voice---> ( Voice To Text ) -Text-> (Person B )
( ) <----Voice---- (Service Provider) <-Text- ( )
8. The hearing person asks to talk with the hearing person in the
deaf person's household.
9. The Relay Service withdraws from the call.
6.2 Media Service Provider
In this scenario, a deaf person wishes to receive the content of a
radio program through a text stream transcoded from the program's
audio stream.
1. The deaf person attempts to establish a connection to the radio
broadcast, with User Agent preferences set to receiving audio
stream as text.
2. The User Agent of the deaf person queries the radio station User
Agent on whether a text stream is available, other than the audio
stream.
3. However, the radio station has no text stream available for a deaf
listener, and responds in the negative.
4. As no text stream is available, the deaf person's User Agent
requests a voice-to-text transcoding service (e.g., a real-time
captioning service) to come into the conversation space.
5. The transcoding service User Agent identifies the audio stream as
a radio broadcast. However, the policy of the transcoding service
is that it does not accept radio broadcasts because it would
overload their resources far too quickly.
6. In this case, the connection fails.
Alternatively, continuing from 2 above:
3. The radio station does provide text with their audio streams.
4. The deaf person receives a text stream of the radio program.
Note: To support deaf, hard of hearing and speech-impaired people,
service providers are encouraged to provide text with audio streams.
6.3 Sign Language Interface
In this scenario, a deaf person enables a signing avatar (e.g.,
ViSiCAST[6]) by setting up a User Agent to receive audio streams as
XML data that will operate an avatar for sign-language. For outgoing
communications, the deaf person types text that is transcoded into an
audio stream for the other conversation participant.
For example:
( )-Voice->(Voice To Avatar Commands) ----XMLData-->( )
( hearing ) (deaf )
( Person A)<-Voice-( Text To Voice ) <--------Text-------- (Person B)
( ) (Service Provider) ( )
6.4 Synthetic Lip-speaking Support for Voice Calls
In order to receive voice calls, a hard of hearing person uses lip-
speaking avatar software (e.g., Synface[7]) on a PC. The lip-
speaking software processes voice (audio) stream data and displays a
synthetic animated face that a hard of hearing person may be able to
lip-read. During a conversation, the hard of hearing person uses the
lip-speaking software as support for understanding the audio stream.
For example:
( ) <------------------Voice-------------->( )
( hearing ) ( PC with ) ( hard of )
( Person A) -------Voice-----> ( lip-speaking)---->( hearing )
( ) ( software ) ( Person B)
6.5 Voice Activated Menu Systems
In this scenario, a deaf person wishing to book cinema tickets with a
credit card, uses a textphone to place the call. The cinema employs
a voice-activated menu system for film titles and showing times.
1. The deaf person places a call to the cinema with a textphone:
(Textphone) <-----Text ---> (Voice-activated System)
2. The cinema's voice-activated menu requests an auditory response to
continue.
3. A Relay Service is invited into the conversation.
4. The Relay Service transcodes the prompts of the voice-activated
menu into text.
5. Text from the voice-activated menu appears on the display of the
deaf person's textphone.
6. The deaf person types a response.
7. The Relay Service receives the text and reads it to the voice-
activated system:
( ) (Relay Service ) ( )
( deaf ) -Text-> (Provider ) -Voice-> (Voice-Activated)
( Person A ) <-Text- (Text To Voice ) <-Voice- (System )
8. The transaction is finalized with a confirmed booking time.
9. The Relay Service withdraws from the call.
6.6 Conference Call
A conference call is scheduled between five people:
- Person A listens and types text (hearing, no speech)
- Person B recognizes sign language and signs back (deaf, no speech)
- Person C reads text and speaks (deaf or hearing impaired)
- Person D listens and speaks
- Person E recognizes sign language and reads text and signs
A conference call server calls the five people and based on their
preferences sets up the different transcoding services required.
Assuming English is the base language for the call, the following
intermediate transcoding services are invoked:
- A transcoding service (English speech to English text)
- An English text to sign language service
- A sign language to English text service
- An English text to English speech service
Note: In order to translate from English speech to sign language, a
chain of intermediate transcoding services was used (transcoding and
English text to sign language) because there was no speech-to-sign
language available for direct translation. Accordingly, the same
applied for the translation from sign language to English speech.
(Person A) ----- Text ----> ( Text-to-SL ) --- Video ----> (Person B)
---------------------- Text --------------------> (Person C)
----- Text ----> (Text-to-Speech) --- Voice ----> (Person D)
---------------------- Text --------------------> (Person E)
----- Text ----> ( Text-to-SL ) --- Video ----> (Person E)
(Person B) -Video-> (SL-to-Text) -Text-> (Text-to-Speech) -> (Person A)
---- Video ----> ( SL-to-Text ) ---- Text ----> (Person C)
-Video-> (SL-to-Text) -Text-> (Text-to-Speech) -> (Person D)
--------------------- Video --------------------> (Person E)
---- Video ----> ( SL-to-Text ) ---- Text ----> (Person E)
(Person C) --------------------- Voice --------------------> (Person A)
Voice->(Speech-to-Text)-Text->(Text-to-SL)-Video->(Person B)
--------------------- Voice --------------------> (Person D)
---- Voice ----> (Speech-to-Text) ---- Text ----> (Person E)
Voice->(Speech-to-Text)-Text->(Text-to-SL)-Video->(Person E)
(Person D) --------------------- Voice --------------------> (Person A)
Voice->(Speech-to-Text)-Text->(Text-to-SL)-Video->(Person B)
---- Voice ----> (Speech-to-Text) ---- Text ----> (Person C)
---- Voice ----> (Speech-to-Text) ---- Text ----> (Person E)
Voice->(Speech-to-Text)-Text->(Text-to-SL)-Video->(Person E)
(Person E) -Video-> (SL-to-Text) -Text-> (Text-to-Speech) -> (Person A)
--------------------- Video --------------------> (person B)
---- Video ----> ( SL-to-Text ) ---- Text ----> (Person C)
-Video-> (SL-to-Text) -Text-> (Text-to-Speech) -> (Person D)
Remarks: - Some services might be shared by users and/or other
services.
- Person E uses two parallel streams (SL and English Text).
The User Agent might perform time synchronisation when
displaying the streams. However, this would require
synchronisation information to be present on the streams.
- The session protocols might support optional buffering of
media streams, so that users and/or intermediate services
could go back to previous content or to invoke a
transcoding service for content they just missed.
- Hearing impaired users might still receive audio as well,
which they will use to drive some visual indicators so
that they can better see where, for instance, the pauses
are in the conversation.
7. Some Suggestions for Service Providers and User Agent Manufacturers
This section is included to encourage service providers and user
agent manufacturers in developing products and services that can be
used by as wide a range of individuals as possible, including deaf,
hard of hearing and speech-impaired people.
- Service providers and User Agent manufacturers can offer to a deaf,
hard of hearing and speech-impaired person the possibility of being
able to prevent their specific abilities and preferences from being
made public in any transaction.
- If a User Agent performs auditory signalling, for example a pager,
it could also provide another signalling method; visual (e.g., a
flashing light) or tactile (e.g., vibration).
- Service providers who allow the user to store specific abilities
and preferences or settings (i.e., a user profile) might consider
storing these settings in a central repository, accessible no
matter what the location of the user and regardless of the User
Agent used at that time or location.
- If there are several transcoding services available, the User Agent
can be set to select the most economical/highest quality service.
- The service provider can show the cost per minute and any minimum
charge of a transcoding service call before a session starts,
allowing the user a choice of engaging in the service or not.
- Service providers are encouraged to offer an alternative stream to
an audio stream, for example, text or data streams that operate
avatars, etc.
- Service providers are encouraged to provide a text alternative to
voice-activated menus, e.g., answering and voice mail systems.
- Manufacturers of voice-activated software are encouraged to provide
an alternative visual format for software prompts, menus, messages,
and status information.
- Manufacturers of mobile phones are encouraged to design equipment
that avoids electro-magnetic interference with hearing aids.
- All services for interpreting, transliterating, or facilitating
communications for deaf, hard of hearing and speech-impaired people
are required to:
- Keep information exchanged during the transaction strictly
confidential
- Enable information exchange literally and simply, without
deviating and compromising the content
- Facilitate communication without bias, prejudice or opinion
- Match skill-sets to the requirements of the users of the service
- Behave in a professional and appropriate manner
- Be fair in pricing of services
- Strive to improve the skill-sets used for their services.
- Conference call services might consider ways to allow users who
employ transcoding services (which usually introduce a delay) to
have real-time information sufficient to be able to identify gaps
in the conversation so they could inject comments, as well as ways
to raise their hand, vote and carry out other activities where
timing of their response relative to the real-time conversation is
important.
8. Acknowledgements
The authors would like to thank the following individuals for their
contributions to this document:
David R. Oran, Cisco
Mark Watson, Nortel Networks
Brian Grover, RNID
Anthony Rabin, RNID
Michael Hammer, Cisco
Henry Sinnreich, Worldcom
Rohan Mahy, Cisco
Julian Branston, Cedalion Hosting Services
Judy Harkins, Gallaudet University, Washington, D.C.
Cary Barbin, Gallaudet University, Washington, D.C.
Gregg Vanderheiden, Trace R&D Center University of Wisconsin-Madison
Gottfried Zimmerman, Trace R&D Center University of Wisconsin-Madison
Security Considerations
This document presents some privacy and security considerations.
They are treated in Section 5.6 Confidentiality and Security.
Normative References
[1] Bradner, S., "Key words for use in RFCs to Indicate Requirement
Levels", BCP 14, RFC 2119, March 1997.
[2] Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston, A.,
Peterson, J., Sparks, R., Handley, M. and E. Schooler, "SIP:
Session Initiation Protocol", RFC 3261, June 2002.
Informational References
[3] International Telecommunication Union (ITU), "Operational and
interworking requirements for DCEs operating in the text
telephone mode". ITU-T Recommendation V.18, November 2000.
[4] Moore, Matthew, et al. "For Hearing People Only: Answers to Some
of the Most Commonly Asked Questions About the Deaf Community,
Its Culture, and the Deaf Reality". MSM Productions Ltd., 2nd
Edition, September 1993.
[5] http://www.typetalk.org.
[6] http://www.visicast.co.uk.
[7] http://www.speech.kth.se/teleface.
Authors' Addresses
Nathan Charlton
Millpark Limited
52 Coborn Road
London E3 2DG
Tel: +44-7050 803628
Fax: +44-7050 803628
EMail: nathan@millpark.com
Mick Gasson
Koru Solutions
30 Howland Way
London SE16 6HN
Tel: +44-20 7237 3488
Fax: +44-20 7237 3488
EMail: michael.gasson@korusolutions.com
Guido Gybels
RNID
19-23 Featherstone Street
London EC1Y 8SL
Tel: +44-20 7296 8000
Textphone: +44-20 7296 8001
Fax: +44-20 7296 8199
EMail: Guido.Gybels@rnid.org.uk
Mike Spanner
RNID
19-23 Featherstone Street
London EC1Y 8SL
Tel: +44-20 7296 8000
Textphone: +44-20 7296 8001
Fax: +44-20 7296 8199
EMail: mike.spanner@rnid.org.uk
Arnoud van Wijk
Ericsson EuroLab Netherlands BV
P.O. Box 8
5120 AA Rijen
The Netherlands
Fax: +31-161-247569
EMail: Arnoud.van.Wijk@eln.ericsson.se
Comments can be sent to the SIPPING mailing list.
Full Copyright Statement
Copyright (C) The Internet Society (2002). All Rights Reserved.
This document and translations of it may be copied and furnished to
others, and derivative works that comment on or otherwise explain it
or assist in its implementation may be prepared, copied, published
and distributed, in whole or in part, without restriction of any
kind, provided that the above copyright notice and this paragraph are
included on all such copies and derivative works. However, this
document itself may not be modified in any way, such as by removing
the copyright notice or references to the Internet Society or other
Internet organizations, except as needed for the purpose of
developing Internet standards in which case the procedures for
copyrights defined in the Internet Standards process must be
followed, or as required to translate it into languages other than
English.
The limited permissions granted above are perpetual and will not be
revoked by the Internet Society or its successors or assigns.
This document and the information contained herein is provided on an
"AS IS" basis and THE INTERNET SOCIETY AND THE INTERNET ENGINEERING
TASK FORCE DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING
BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION
HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Acknowledgement
Funding for the RFC Editor function is currently provided by the
Internet Society.
|
Comment about this RFC, ask questions, or add new information about this topic: