Method and system for enabling visually impaired computer users to graphically select displayed objects

• US 5,461,399 A
• Filed: 12/23/1993
• Issued: 10/24/1995
• Est. Priority Date: 12/23/1993
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines SA (International Business Machines Corporation)
• Inventors: Cragun, Brian J.
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): CHANG, KENT WU
• Application Number:
  US08/173,536
• Time in Patent Office: 670 Days
• Field of Search: 345/145, 345/156, 345/157, 341/21, 341/27, 340/384.1, 340/825.19, 434/112, 434/113, 434/114, 434/116
• US Class Current: 715/729
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G09B 21/005 Details of specially-adapted software to access information, e.g. to browse through hyperlinked information
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

A method and system for enabling a visually impaired computer user to distinctly visualize individual objects classified among multiple classes of objects within a graphical user interface environment. Within the graphical user interface environment, graphical user interface objects are classified among multiple classes of objects. An audio signal, having at least two audible characteristics, is associated with each object within a class of objects. The first audible characteristic is common among all objects within a class of objects and unique among all objects in other classes of objects. The second audible characteristic is unique among all objects within a class of objects. Thereafter, a composite audible signal is generated for each displayed object which includes audio signals which each include these two audible characteristics. By listening to the first audible characteristic, which is associated with all objects within a particular class, a visually impaired user may be able to determine how many classes of objects are displayed, and distinguish those classes of objects from one another. By listening to the second audible characteristic, which is unique among all audible characteristics associated with objects in the same class, a visually impaired user may be able to determine how many objects are displayed within a particular class, and distinguish those objects from one another. By enabling a visually impaired user to distinguish classes of objects, and the distinguish objects in a particular class, such a user may perform computer operations and utilize a graphical user interface more efficiently.

Claims

1. A method in a data processing system for enabling a visually impaired user to distinctly visualize individual displayed objects within multiple classes of objects displayed within a graphical user interface environment, said data processing system having a display pointing device associated with a moveable cursor element, a user input device, and an audio output device, said method comprising the steps of:

associating an audio signal having at least two audible characteristics with each object within a class of objects displayed within said graphical user interface environment, wherein a first of said at least two audible characteristics is common among all objects within a class of objects and unique among all of said multiple classes of objects within said graphical user interface environment, and a second of said at least two audible characteristics is unique among all objects within a class of objects; and

generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment, wherein a user may determine how many classes of objects are displayed, and how many objects are displayed within each of said multiple classes of objects within said graphical user interface environment.

2. A method according to claim 1 wherein said first of said at least two audible characteristics comprises a timbre, and said second of said at least two audible characteristics comprises a pitch.

3. A method according to claim 1 wherein said first of said at least two audible characteristics comprises a generic drum audible characteristic, and said second of said at least two audible characteristics comprises a particular drum audible characteristic.

4. A method according to claim 1 wherein said first of said at least two audible characteristics comprises a tone, and said second of said at least two audible characteristics comprises a periodicity.

5. A method according to claim 1 further including the step of determining a direction from said moveable cursor element to each of said displayed objects, and wherein said step of generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment further includes the step of generating a left composite audible signal and a right composite audible signal.

6. A method according to claim 5 further including the step of determining a distance from said moveable cursor element to each of said displayed objects, and wherein said step of generating a left composite audible signal and a right composite audible signal further comprising the step of varying an intensity of each associated audio signal in proportion to said determined distance from said moveable cursor element to each of said displayed objects.

7. A method according to claim 1 wherein said step of generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment further comprises the step of generating a composite audible signal which includes elements of each audio signal associated with a selected class of said objects displayed within said graphical user interface environment, in response to a user input utilizing said user input device.

8. A data processing system for enabling a visually impaired user to distinctly visualize individual displayed objects within multiple classes of objects displayed within a graphical user interface environment, said data processing system having a display pointing device associated with a moveable cursor element, a user input device, and an audio output device, said data processing system comprising:

means for associating an audio signal having at least two audible characteristics with each object within a class of objects displayed within said graphical user interface environment, wherein a first of said at least two audible characteristics is common among all objects within a class of objects and unique among all of said multiple classes of objects within said graphical user interface environment, and a second of said at least two audible characteristics is unique among all objects within a class of objects; and

means for generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment, wherein a user may determine how many classes of objects are displayed, and how many objects are displayed within each of said multiple classes of objects within said graphical user interface environment.

9. A data processing system according to claim 8 wherein said first of said at least two audible characteristics comprises a timbre, and said second of said at least two audible characteristics comprises a pitch.

10. A data processing system according to claim 8 wherein said first of said at least two audible characteristics comprises a generic drum audible characteristic, and said second of said at least two audible characteristics comprises a particular drum audible characteristic.

11. A data processing system according to claim 8 wherein said first of said at least two audible characteristics comprises a tone, and said second of said at least two audible characteristics comprises a periodicity.

12. A data processing system according to claim 8 further including means for determining a direction from said moveable cursor element to each of said displayed objects, and wherein said means for generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment further includes means for generating a left composite audible signal and a right composite audible signal.

13. A data processing system according to claim 12 further including means for determining a distance from said moveable cursor element to each of said displayed objects, and wherein said means for generating a left composite audible signal and a right composite audible signal further comprising means for varying an intensity of each associated audio signal in proportion to said determined distance from said moveable cursor element to each of said displayed objects.

14. A data processing system according to claim 8 wherein said means for generating a composite audible signal which includes elements of each audio signal associated with each of said objects displayed within said graphical user interface environment further comprises means for generating a composite audible signal which includes elements of each audio signal associated with a selected class of said objects displayed within said graphical user interface environment, in response to a user input utilizing said user input device.