Method and system for enabling a blind computer user to locate icons in a graphical user interface

• US 5,287,102 A
• Filed: 12/20/1991
• Issued: 02/15/1994
• Est. Priority Date: 12/20/1991
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: McKiel, Frank A. Jr.
• Primary Examiner(s): Yusko, Donald J.
• Assistant Examiner(s): GIUST, JOHN
• Application Number:
  US07/811,507
• Time in Patent Office: 788 Days
• Field of Search: 340/825.19, 340/709, 340/710, 340/711, 340/407, 434/112, 434/116, 434/117, 358/94, 341/21
• US Class Current: 340/4.14
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

Disclosed is a computer audio interface adapted to enable blind or visually impaired users to locate icons positioned in rows in the background of a graphical user interface. Whenever the pointer of the interface is positioned on the background, the system produces a distinctive tone. Whenever the pointer is positioned in an icon row that is occupied by one or more icons, the system produces a distinctive chord. Whenever the pointer is positioned in the background and not in an occupied row, the system produces stereo effects that give the user information as to the relative left/right position of the pointer. Whenever the pointer is positioned in an occupied row, the amplitude of the left and right stereo channels is controlled such that whenever the pointer is to the left of the leftmost icon, substantially all of the volume is produced by the left speaker and whenever the pointer is to the right of the rightmost icon, substantially all of the the volume is produced by the right speaker. Whenever the pointer is located between the leftmost and rightmost icons, the volume is balanced substantially equally between the two speakers.

Claims

1. A method of providing the user of a computer system, including a display screen, a pointing device for manually positioning a pointer on said screen, a left speaker, and a right speaker, with audio information regarding the position of said pointer on said screen, wherein said screen has displayed thereon a background and at least one row of spaced apart icons, said method comprising the steps of:

generating a first sound from at least one of said speakers whenever said pointer is located on said background; and

generating a second sound from at least one of said speakers whenever said pointer is located on said row.

2. The method as claimed in claim 1, wherein said first sound is a first tone.

3. The method as claimed in claim 2, wherein said second sound is a chord.

4. The method as claimed in claim 3, wherein said chord includes said first tone and a second tone.

5. The method as claimed in claim 1, wherein the relative volume of said first sound generated by said speakers is related to the relative horizontal position of said pointer on said screen.

6. The method as claimed in claim 1, wherein said row of icons is oriented horizontally on said screen and said second sound is generated substantially only from said right speaker whenever said pointer is located on said row and to the right of the rightmost icon in said row.

7. The method as claimed in claim 6, wherein said second sound is generated substantially only from said left speaker whenever said pointer is located on said row and to the left of the leftmost icon in said row.

8. The method as claimed in claim 7, wherein said second sound is generated from each of said speakers at substantially equal volume whenever said pointer is located on said row and between the leftmost and rightmost icons.

9. The method as claimed in claim 1, including the step of generating a distinctive sound whenever said pointer is located on an icon.

10. The method as claimed in claim 1, wherein more than one row of icons is displayed on said screen and including the step of generating a different sound for each of said rows.

11. Apparatus for providing the user of a computer system, including a display screen and a pointing device for manually positioning a pointer on said screen, with audio information regarding the position of said pointer on said screen, wherein said screen has displayed thereon a background and at least one row of spaced apart icons, said apparatus comprising:

a left speaker and a right speaker;

means for generating a first sound from at least one of said speakers whenever said pointer is located on said background; and

means for generating a second sound from at least one of said speakers whenever said pointer is located on said row.

12. The apparatus as claimed in claim 11, wherein said means for generating said first sound includes means for generating a first tone.

13. The apparatus as claimed in claim 12, wherein said means for generating said second sound includes means for generating a chord.

14. The apparatus as claimed in claim 13, wherein said chord includes said first tone and a second tone.

15. The apparatus as claimed in claim 11, including means for controlling the relative volume of said first sound generated by said speakers relative to the horizontal position of said pointer on said screen.

16. The apparatus as claimed in claim 11, wherein said row of icons is oriented horizontally on said screen and said second sound is generated substantially only from said right speaker whenever said pointer is located on said row and to the right of the rightmost icon in said row.

17. The apparatus as claimed in claim 16, wherein said second sound is generated substantially only from said left speaker whenever said pointer is located on said row and to the left of the leftmost icon in said row.

18. The apparatus as claimed in claim 17, wherein said second sound is generated from each of said speakers at substantially equal volume whenever said pointer is located on said row and between the leftmost and rightmost icons.

19. The apparatus as claimed in claim 11, including, means for generating a distinctive sound whenever said point is located on an icon.