User interface for multi-media communication for the visually disabled

• US 7,673,241 B2
• Filed: 06/26/2002
• Issued: 03/02/2010
• Est. Priority Date: 06/26/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Siebel Systems Inc. (Oracle Corporation)
• Inventors: Sun, Zhaoyang, Annadata, Anil Kumar, Chen, Mingte, Rao, Shashidhar Gundu
• Primary Examiner(s): Hailu; Tadesse
• Assistant Examiner(s): Tan; Alvin H
• Application Number:
  US10/180,674
• Publication Number:
  US 20070198945A1
• Time in Patent Office: 2,806 Days
• Field of Search: 715/729, 715/865
• US Class Current: 715/729
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

A method, user interface module, computer program product, computer system and system that enable a graphical user interface to be used by persons with visual disabilities. The graphical user interface includes a toolbar, which provides features that enable a visually disabled user to navigate and activate the functions provided by buttons or other controls on the communication toolbar. As a user navigates around the user interface, auditory messages are read describing functionality of different features of the graphical user interface. The text can be audibly read by, for example, a screen reader module. By using a hotkey or menu navigation, a user can issue commands that would normally be issued by clicking on the toolbar. Furthermore, the user can type text into text input boxes, select items from combo boxes, enable broadcast messages to be read, and choose to listen to status messages.

Claims

1. A method comprising:

presenting a user interface, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

providing an audible indication of the audible control, if the audible control is in focus;

detecting an activation of the audible control by virtue of being configured to determine that the audible control is in focus, and determine that a designated key of a keyboard has been pressed;

identifying a command associated with the activation of the audible control, wherein

the interface is configured to identify the command using the mapping,

the functional control is associated with a function, and

the audible control is a non-functional control by virtue of being incapable of issuing the command; and

in response to the activation of the audible control, causing the functional control to issue the command, wherein

the issuance of the command causes the function to be performed,

the performance of the function results in communication via a communication channel of the plurality of communication channels, and

a media type of each of the plurality of communication channels is one of a plurality of media types.

2. The method of claim 1 further comprising:

determining that a second audible control has obtained focus; and

providing text for an audible message associated with the second audible control.

3. The method of claim 2 further comprising:

providing a user an ability to navigate user interface using a keyboard;

providing text for a second audible message in response to receiving a hot key activation, wherein

the hot key is configured to associate a plurality of keys on the keyboard with the second audible control.

4. The method of claim 3 further comprising:

accepting a user selection using a keyboard and a cursor.

5. The method of claim 4 wherein the user interface comprises a plurality of frames and the user can navigate from one frame to the next frame by depressing a tab key.

6. The method of claim 5, wherein each of the plurality of frames further comprises a plurality of controls and the user can navigate from one control to the next control by depressing the tab key.

7. The method of claim 6 wherein the depressing the tab key places a next control in focus and a screen reader reads text associated with the next control.

8. The method of claim 2 wherein said audible message further comprises a status of the second audible control which has obtained focus wherein the status comprises at least one of an enabled state, a disabled state, a blinking state, and a toggled state.

9. The method of claim 8 wherein when an element on the user interface blinks, a state of the element is changed to the blinking state and an audible sound is played to capture the user'"'"'s attention.

10. The method of claim 1 further comprising:

providing text for an audible message associated with the audible control.

11. The method of claim 1 further comprising:

providing text for an audible message in response to a change of state of the audible control.

12. The method of claim 1 wherein the audible control is activated using a hot key.

13. The method of claim 1 further comprising:

causing a state of the audible control to change in response to obtaining an event.

14. The method of claim 1, further comprising in response to whether a user is visually impaired or not, presenting the user interface by changing the set of toolbars to account for the user being visually impaired.

15. The method of claim 1, further comprising:

mapping a second audible control of a plurality of audible controls to a second functional control of a plurality of functional controls, wherein

the functional toolbar comprises the plurality of functional controls,

the functional controls comprise the functional control,

the readable toolbar comprises the plurality of functional controls, and

the plurality of audible controls comprise the audible control.

16. The method of claim 1, wherein

the communication is with a media-specific device coupled to the communication channel, and

the media-specific device and the communication channel have the same media type.

17. A method comprising:

presenting a user interface, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

receiving an incoming communication event;

identifying a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

causing a state of the audible control of the user interface to change in response to the identifying of the second functional control.

18. The method of claim 17 further comprising:

providing text for an audible message in response to the change in the state.

19. A user interface module comprising:

a plurality of instructions, wherein the plurality of instructions comprise;

presenting instructions to present a user interface, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

providing instructions to provide an audible indication of the audible control, if the audible control is in focus;

detecting instructions to detect an activation of the audible control by virtue of being configured to determine that the audible control is in focus, and determine that a designated key of a keyboard has been pressed;

identifying instructions to identify a command associated with the activation of the audible control, wherein

the identifying instructions are configured to use the mapping to identify the command,

the functional control is associated with a function, and

the audible control is a non-functional control by virtue of being incapable of issuing the command; and

issuing instructions to, in response to the activation of the audible control, cause the functional control to issue the command, wherein the issuance of the command causes the function to be performed,

the performance of the function results in communication via a communication channel of the plurality of communication channels, and

a media type of each of the plurality of communication channels is one of a plurality of media types; and

a computer readable storage medium to store the plurality of instructions.

20. The user interface module of claim 19 further comprising:

determining instructions to determine that a second audible control of the user interface has obtained focus; and

providing instructions to provide text for an audible message associated with the second audible control.

21. The user interface module of claim 19 further comprising:

providing instructions to provide text for an audible message associated with the audible control.

22. A user interface module comprising:

a plurality of instruction, wherein the plurality of instructions comprise;

presenting instructions to present a user interface, wherein the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

receiving instructions to receive an incoming communication event;

identifying instruction to identify a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

causing instructions to cause a state of the audible control of the user interface presented by the user interface module to change in response to the identifying of the second functional control; and

a computer readable storage medium to store the plurality of instructions.

23. The user interface module of claim 22 further comprising:

providing instructions to provide text for an audible message in response to the change in the state.

24. A system comprising:

a processor;

a display coupled to the processor;

a computer readable storage medium coupled to the processor;

means for presenting a user interface displayed on the display, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

means for providing an audible indication of the audible control, if the audible control is in focus;

means for detecting an activation of the audible control by virtue of being configured to determine that the audible control is in focus, and determine that a designated key of a keyboard has been pressed;

means for identifying a command associated with the activation of the audible control, wherein

the identifying means comprise using means for using the mapping to identify the command,

the functional control is associated with a function, and

the audible control is a non-functional control by virtue of being incapable of issuing the command; and

means for, in response to the activation of the audible control, causing the functional control to issue the command, wherein the issuance of the command causes the function to be performed,

the performance of the function results in communication via a communication channel of the plurality of communication channels, and

a media type of each of the plurality of communication channels is one of a plurality of media types.

25. The system of claim 24 further comprising:

means for determining that a second readable control has obtained focus; and

means for providing text for an audible message associated with the second readable control.

26. The system of claim 24 further comprising:

means for providing text for an audible message associated with the readable control.

27. A system comprising:

means for identifying a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

means for causing a state of the audible control of the user interface to change in response to the identifying of the second functional control,

means for presenting a user interface displayed on the display

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

means for receiving an incoming communication event;

means for identifying a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

means for causing a state of the audible control of the user interface to change in response to the identifying of the second functional control.

28. The system of claim 27 further comprising:

means for providing text for an audible message in response to the change in the state.

29. A computer program product comprising:

presenting instructions to present a user interface, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

providing instructions to provide an audible indication of the audible control, if the audible control is in focus;

detecting instructions to determine that an detect an activation of the audible control by virtue of being configured to determine that the audible control is in focus, and determine that a designated key of a keyboard has been pressed;

identifying instructions to identify a command associated with activation of the audible control, wherein

the identifying instructions comprise using instructions to use the mapping to identify the command,

the functional control is associated with a function, and

the audible control is a non-functional control by virtue of being incapable of issuing the command; and

issuing instructions to cause the functional control to, in response to the activation of the audible control, cause the functional control to issue the command, wherein

the issuance of the command causes the function to be performed,

the performance of the function results in communication via a communication channel of the plurality of communication channels, and

a media type of each of the plurality of communication channels is one of a plurality of media types; and

a computer-readable storage medium to store the instructions.

30. The computer program product of claim 29 further comprising:

second detecting instructions to detect that a second audible control has obtained focus; and

second providing instructions to provide text for an audible message associated with the second audible control;

wherein

the computer-readable storage medium further stores the second detecting instructions and the second providing instructions.

31. The computer program product of claim 29 further comprising:

second providing instructions to provide text for an audible message associated with the audible control;

wherein

the computer-readable storage medium further stores the second providing instructions.

32. A computer program product comprising:

presenting instruction to present a user interface, wherein

the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

receiving instructions to receive an incoming communication event

identifying instruction to identify a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

causing instructions to cause a state of the audible control of the user interface presented by the user interface module to change in response to the identifying of the second functional control; and

a computer-readable storage medium to store the causing instructions and the identifying instructions.

33. The computer program product of claim 32 further comprising:

providing instructions to provide text for an audible message in response to the change in the state;

wherein

the computer-readable storage medium further stores the second providing instructions.

34. A computer system comprising:

a processor for executing computer instructions; and

a memory storing the computer instructions, wherein the computer instructions comprise;

presenting instructions to present a user interface, wherein the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

providing instructions to provide an audible indication of the audible control, if the audible control is in focus;

detecting instructions to detect activation of the audible control by virtue of being configured to

determine that the audible control is in focus, and

determine that a designated key of a keyboard has been pressed;

identifying instructions to identify a command associated with the activation of the audible control, wherein

the identifying instructions comprise using instructions to use the mapping to identify the command, the functional control is associated with a function, and the audible control is a non-functional control by virtue of being incapable of issuing the command; and

issuing instructions to, in response to the activation of the audible control, cause the functional control to issue the command, wherein the issuance of the command causes the function to be performed,

the performance of the function results in communication via a communication channel of the plurality of communication channels, and

a media type of each of the plurality of communication channels is one of a plurality of media types.

35. The computer system of claim 34 wherein the computer instructions further comprise:

second detecting instructions to determine that a second audible control has obtained focus; and

second providing instructions to provide text for an audible message associated with the second audible control.

36. The computer system of claim 34 wherein the computer instructions further comprise:

second providing instructions to provide text for an audible message associated with the audible control.

37. A computer system comprising:

a processor for executing computer instructions;

a memory storing the computer instructions, wherein the computer instructions comprise;

presenting instructions to present a user interface, wherein the user interface comprises a set of toolbars, wherein

the set of toolbars comprises

a functional toolbar, and

a readable toolbar,

the readable toolbar is associated with an image-based toolbar,

the functional toolbar comprises a functional control,

the readable toolbar comprises an audible control,

the user interface further comprises a mapping between the audible control and the functional control, and

the user interface is configured to support communication via a plurality of communication channels;

receiving instructions to receive an incoming communication event

identifying instruction to identifying a second functional control of the functional toolbar based on the incoming communication event, wherein the second functional control is identified using the mapping; and

causing instructions to cause a state of the audible control of the user interface to change in response to the identifying of the second functional control.

38. The computer system of claim 37 wherein the computer instructions further comprise:

providing instructions to provide text for an audible message in response to the change in the state.