Computer user interface with stereo and filtered sound effects

• US 5,374,924 A
• Filed: 02/23/1993
• Issued: 12/20/1994
• Est. Priority Date: 08/19/1991
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: McKiel, Frank A. Jr.
• Primary Examiner(s): Yusko, Donald J.
• Assistant Examiner(s): Holloway, III, Edwin C.
• Application Number:
  US08/022,788
• Time in Patent Office: 665 Days
• Field of Search: 340/825.19, 340/407.1, 340/706, 340/709, 340/710, 340/721, 341/21, 434/112, 434/116, 345/157, 395/157, 273/85 G
• US Class Current: 715/729
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

Disclosed is a computer audio interface having stereo and filtered sound effects to enable blind users to operate a graphical user interface. Stereo balance and incremental filtering are used along separate axes to guide a blind or visually impaired user within an area of a graphical user interface, particularly the client area of a window. As the pointer approaches the left boundary of the client area, the sounds representing the client area come more and more exclusively from the left audio channel. Likewise, when approaching the right boundary, the sound shifts to the right channel. Additionally, as the pointer is moved toward the top of the window client area, the pitch of the sound increases in stepwise fashion.

Claims

1. A method of providing a user of a computer system which includes a display screen for displaying at least one window on a portion thereof, said at least One window including a title bar and a client area, a pointing device for manually positioning a pointer on said display screen, and a pair of spaced apart speakers, with audio information regarding the position of the pointer on the display screen which comprises the steps of:

monitoring the position of the pointer on said display screen; and

generating a distinctive audio signal from each of said speakers only when said pointer is positioned in a client area of a window, the relative amplitudes of said audio signals being proportional to the relative left/right position of said pointer in said client area of said window.

2. The method as claimed in claim 1, wherein the frequency of said distinctive audio signal is proportional to the relative top/bottom position of said pointer in said client area of said window.

3. The method as claimed in claim 1, including the step of:

discontinuing said distinctive audio signal whenever said pointer is positioned outside a client area of a window.

4. The method as claimed in claim 1, wherein said window includes a left boundary and a right boundary of said client area of said window, and said generating step includes the steps of:

determining the positions of said left and right boundaries on said display screen;

calculating the position of said pointer relative to said left and right boundaries; and

controlling the amplitude of said distinctive audio signal generated by each of said speakers such that the relative amplitudes of said audio signals are equal to the position of said pointer relative to said left and right boundaries.

5. A method of providing a user of a computer system which includes a display screen for displaying at least one window on a portion thereof, said at least one window including a title bar and a client area, and a pointing device for manually positioning a pointer on said display screen, with audio information regarding the position of the pointer on the display screen, which comprises the steps of:

monitoring the position of the pointer on said display screen; and

generating a first distinctive audio signal only when said pointer is positioned in a client area of a window, wherein the frequency of said first distinctive audio signal is proportional to the relative top/bottom position of said pointer in said client area of said window.

6. The method as claimed in claim 5, wherein said first distinctive audio emanates from a position located to one side of said user and including the step of:

generating a second distinctive audio signal emanating from a position located to the opposite side of said user, said second distinctive audio signal having a frequency substantially equal to the frequency of said first audio signal.

7. The method as claimed in claim 6, wherein the relative amplitudes of said first and second distinctive audio signals are proportional to the relative right/left position of said pointer in said client area of said window.

8. The method as claimed in claim 7, wherein said first distinctive audio signal emanates from a right speaker and said second distinctive audio signal emanates from a left speaker, and the amplitude of said first distinctive audio signal increases as said pointers move toward the right in said client area of said window and the amplitude of said second distinctive audio signal increases as said pointers move toward the left in said client area of said window.

9. The method as claimed in claim 5, wherein said frequency increases in stepwise fashion as said pointer is moved toward the top of said screen.

10. The method as claimed in claim 5, including the step of:

discontinuing said distinctive audio signal whenever said pointer is positioned outside said client area of said window.