Projected audio for computer displays

• US 6,469,712 B1
• Filed: 03/25/1999
• Issued: 10/22/2002
• Est. Priority Date: 03/25/1999
• Status: Expired due to Term

• Current Assignee: Activision Publishing Incorporated (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Paolini, Michael A., Hilpert, Jr., Edwin James
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Thai, Cuong T.
• Application Number:
  US09/276,387
• Time in Patent Office: 1,307 Days
• Field of Search: 345/764, 345/700, 345/727, 345/729, 345/862, 345/859, 345/856, 345/978, 345/757, 345/848, 345/835, 340/384.5, 340/384.1, 340/384.3
• US Class Current: 715/727
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method and implementing computer system is provided in which sounds are projected or rendered in space surrounding a computer system to provide information concerning various aspects of information displayed on the computer system display screen. Computer system users are able to ascertain predetermined information relative to the displayed information, such as a relative scroll point in a lengthy context, by perceiving certain characteristics of the projected sounds, including the perceived location of the source of the projected sounds relative to a designated point of origin, such a user'"'"'s head or the computer display screen.

Claims

1. A method for presenting audio effects in association with an image which may be displayed on a display screen of a computer system, said method comprising:

presenting a plurality of user selections on said display screen, said user selections being related to said image;

effecting a selection made by said user to associate a selected sound with a corresponding selected image;

determining an indicator location of a screen position indicator on said display screen;

detecting a presence of a displayed image at said indicator location; and

projecting a sound from said computer system, said sound being related to said displayed image, said sound being projected to a point away from said computer system such that said sound is perceivable as emanating from an emanation point displaced in space from said computer system.

2. The method as set forth in claim 1 wherein position of said emanation point is related to a predetermined characteristic of said displayed image.

3. The method as set forth in claim 2 wherein said predetermined characteristic is a relative position of said displayed image on said display screen.

4. The method as set forth in claim 1 wherein said sound is projected to an emanation point displaced in three dimensions from said computer system.

5. The method as set forth in claim 1 wherein presence of a plurality of displayed images are detected.

6. The method as set forth in claim 5 wherein said plurality of displayed images are located at a plurality of locations on said display screen.

7. The method as set forth in claim 5 wherein said plurality of displayed images include at least two displayed images, said displayed images at least partially overlapping each other on said display screen.

8. The method as set forth in claim 1 wherein said user selections include a selection to effect said projecting of said sound.

9. The method as set forth in claim 1 wherein said user selections include a selection of a particular type of displayed image, said particular type being related to an associated selectable particular sound.

10. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display of text.

11. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display of hypertext links.

12. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display of a scroll bar function indicium.

13. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display container.

14. The method as set forth in claim 13 wherein said display container comprises a window presentation.

15. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display of a menu function indicium.

16. The method as set forth in claim 9 wherein said particular type of displayed image comprises a display of a graphics image.

17. The method as set forth in claim 16 wherein said graphics image represents an executable function.

18. The method as set forth in claim 9 and further including a plurality of types of displayed images.

19. The method as set forth in claim 18 and further including enabling said user to select a particular sound to be associated with each selected particular type of displayed image.

20. A storage medium including machine readable coded indicia, said storage medium being selectively coupled to a reading device, said reading device being selectively coupled to processing circuitry within a computer system, said reading device being selectively operable to read said machine readable coded indicia and provide program signals representative thereof, said program signals being effective for presenting audio effects in association with e an image which may be displayed on a display screen of said computer system, said program signals being selectively operable to accomplish the steps of:

presenting a plurality of user selections on said display screen, said user selections being related to said image;

effecting a selection made by said user to associate a selected sound with a corresponding selected image;

determining an indicator location of a screen position indicator on said display screen;

detecting a presence of a displayed image at said indicator location; and

projecting a sound from said computer system, said sound being related to said displayed image, said sound being projected to a point away from said computer system such that said sound is perceivable as emanating from an emanation point displaced in space from said computer system.

21. A computer system comprising:

a system bus;

a sound producing subsystem, said sound producing subsystem being coupled to said system bus;

a processor device connected to said system bus;

a memory connected to said system bus; and

a display device including a display screen, said display device being coupled to said system bus, said processor device being responsive to program signals received from said memory for causing said sound producing subsystem to present audio effects in association with a an image which may be displayed on said

display screen of said computer system, said program signals being selectively operable to accomplish the steps of;

presenting a plurality of user selections on said display screen, said user selections being related to said image;

effecting a selection made by said user to associate a selected sound with a corresponding selected image;

determining an indicator location of a screen position indicator on said display screen;

detecting a presence of a displayed image at said indicator location; and

projecting a sound from said computer system, said sound being related to said displayed image, said sound being projected to a point away from said computer system such that said sound is perceivable as emanating from an emanation point displaced in space from said computer system.

22. A method for presenting audio effects in association with a display screen of a computer system, said method comprising:

enabling a user to make selections from a displayed listing of sound types and image types, said selections being effective to associate selected sound types with corresponding selected image types;

determining a display screen location and image type for a displayed image; and

projecting a sound from said computer system, said sound corresponding to said displayed image type, said sound being projected such that said sound is perceivable as emanating from an emanation point displaced in space from said computer system.