Distinguishing real-world sounds from audio user interface sounds

• US 20020154179A1
• Filed: 01/29/2002
• Published: 10/24/2002
• Est. Priority Date: 01/29/2001
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Wilcock, Lawrence, Coles, Alistair Neil, Tucker, Roger Cecil Ferry
• Application Number:
  US10/058,052
• Publication Number:
  US 20020154179A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G11B 19/025 'Virtual' control panels, e.g. Graphical User Interface [GUI]
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04S 1/005 For headphones
• CPC Class Codes: H04S 7/304 For headphones

Abstract

An audio user interface is provided in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate. The nature of the audio output devices used to render the synthesized sounds is such that the user is also able to hear real-world sounds from the environment. Under user control, a distinctive presentation effect is selectively applied to the item-related sounds emanating from a group of at least one synthesized sound source whereby to assist the user in distinguishing these sounds from the real-world sounds.

Claims

1. An audio user-interfacing method in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the user being able also to hear real-world sounds from the environment;

the method including the step of selectively applying, under user control, a distinctive presentation effect to the item-related sounds emanating from a group of at least one synthesised sound source whereby to assist the user in distinguishing these sounds from said real-world sounds.

2. A method according to claim 1, wherein the said group of at least one sound source is associated with an audio-field reference relative to which the member sound sources of the group are positioned, the audio-field reference being offset relative to a presentation reference determined by a mounting configuration of audio output devices used to synthesise said sound sources such as to world stabilise the audio-field reference as the user moves;

the or each group sound source representing a corresponding augmented reality service that has an associated real-world location, and the or each group sound source being positioned relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the associated real-world location.

3. A method according to claim 1, wherein said distinctive presentation is a sound effect.

4. A method according to claim 3, wherein said sound effect is at least one of:

volume modulation

pitch modulation

frequency shifting

distortion

echo

added noise

added distinction sounds.

5. A method according to claim 1, wherein the said group of at least one sound source is associated with an audio-field reference relative to which the sound sources of the group are positioned, the audio-field reference being movable relative to a presentation reference determined by a mounting configuration of audio output devices used to synthesise said sound sources such as to impart a particular stabilisation to the audio-field reference as the user moves, this stabilisation giving said distinctive presentation to the group of at least one sound sources.

6. A method according to claim 5, wherein the audio-field reference is head stabilised.

7. A method according to claim 5, wherein the audio-field reference has an underlying stabilisation to which it is periodically updated, the audio-field reference between such updating having a stabilisation inherent to the presentation reference.

8. A method according to claim 5, wherein the or each group sound source represents an augmented reality service that has an associated real-world location, the or each group sound source being positioned relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the associated real-world location.

9. A method according to claim 1, wherein each sound source is associated with one of multiple audio-field references relative to which the associated sound sources are positioned, the audio-field references being independently movable relative to a presentation reference determined by a mounting configuration of audio output devices used to synthesise said sound sources, with movement of a said audio-field reference relative to the presentation reference resulting in corresponding movement of the associated sound sources relative to the presentation reference;

the user applying a selected said distinctive presentation effect to the group of sound sources associated with an audio-field reference by choosing that group as a whole.

10. A method according to claim 1, wherein at least some of the said items represented by the sound sources are audio labels for services, the method further involving selecting a service by selecting the corresponding audio-label sound source.

11. An audio user-interfacing method in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the user being able also to hear real-world sounds from the environment;

the method involving applying a distinctive presentation effect to the item-related sounds emanating from a group of at least one synthesised sound source whereby to assist the user in distinguishing these sounds from said real-world sounds;

the said distinctive presentation being an underlying stabilisation to which the group of sound sources is only periodically updated.

13. Apparatus according to claim 12, wherein the rendering-position determining means comprises:

means for setting the location of the or each group sound source relative to an audio-field reference;

means for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

means for deriving the rendering position of the or each group sound source based on its location relative to the audio-field reference and said offset;

the or each group sound source representing a corresponding augmented reality service that has an associated real-world location, the rendering-position determining means being operative to world-stabilise the audio field reference and to position the or each group sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

14. Apparatus according to claim 12, wherein said distinctive presentation applied by the distinctive-presentation means is a sound effect.

15. Apparatus according to claim 14, wherein said sound effect is at least one of:

volume modulation

pitch modulation

frequency shifting

distortion

echo

added noise

added distinction sounds.

16. Apparatus according to claim 12, wherein the rendering-position determining means comprises:

means for setting the location of the or each said group sound source relative to an audio-field reference;

means for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

means for deriving the rendering position of the or each group sound source based on its location relative to the audio-field reference and said offset;

the rendering-position determining means incorporating said distinctive-presentation means and being operative to impart a particular stabilisation to the audio-field reference as the user moves, this stabilisation giving said distinctive presentation to the group of at least one sound sources.

17. Apparatus according to claim 16, wherein the audio-field reference is head stabilised.

18. Apparatus according to claim 16, wherein the audio-field reference has an underlying stabilisation to which it is periodically updated, the audio-field reference between such updating having a stabilisation inherent to the presentation reference.

19. Apparatus according to claim 16, wherein the or each group sound source represents a corresponding augmented reality service that has an associated real-world location, the rendering-position determining means being operative to world-stabilise the audio field reference and to position the or each group sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

20. Apparatus according to claim 12, wherein at least some of the said items represented by the sound sources are audio labels for services, the apparatus including a selection arrangement for enabling a user to select a service by selecting the corresponding audio-label sound source.

12. Apparatus for providing an audio user interface in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the apparatus comprising:

rendering-position determining means for determining, for each said sound source, an associated rendering position at which the sound source is to be synthesized to sound in the audio field;

rendering means, including audio output devices, for generating an audio field in which said sound sources are synthesized at their associated rendering positions, the audio output devices being such as to permit the user also to hear real-world sounds from the environment; and

distinctive-presentation means for selectively applying, under user control, a distinctive presentation effect to the item-related sounds emanating from a group of at least one synthesised sound source whereby to assist the user in distinguishing these sounds from said real-world sounds.

21. Apparatus for providing an audio user interface in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the apparatus comprising:

a rendering-position determining arrangement operative to determine, for each said sound source, an associated rendering position at which the sound source is to be synthesized to sound in the audio field;

a rendering subsystem, including audio output devices, arranged to generate an audio field in which said sound sources are synthesized at their associated rendering positions, the audio output devices being such as to permit the user also to hear real-world sounds from the environment; and

a distinctive-presentation arrangement operative to selectively apply, under user control, a distinctive presentation effect to the item-related sounds emanating from a group of at least one synthesised sound source whereby to assist the user in distinguishing these sounds from said real-world sounds.

22. Apparatus according to claim 21, wherein the rendering-position determining arrangement comprises:

a setting arrangement for setting the location of the or each group sound source relative to an audio-field reference;

a control arrangement for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

a deriving arrangement operative to derive the rendering position of the or each group sound source based on its location relative to the audio-field reference and said offset;

the or each group sound source representing a corresponding augmented reality service that has an associated real-world location, the rendering-position determining arrangement being operative to world-stabilise the audio field reference and to position the or each group sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

23. Apparatus according to claim 21, wherein said distinctive presentation applied by the distinctive-presentation arrangement is a sound effect.

24. Apparatus according to claim 23, wherein said sound effect is at least one of:

volume modulation

pitch modulation

frequency shifting

distortion

echo

added noise

added distinction sounds.

25. Apparatus according to claim 21, wherein the rendering-position determining arrangement comprises:

a setting arrangement for setting the location of the or each said group sound source relative to an audio-field reference;

a control arrangement for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

a deriving arrangement operative to derive the rendering position of the or each group sound source based on its location relative to the audio-field reference and said offset;

the rendering-position determining arrangement incorporating said distinctive-presentation arrangement and being operative to impart a particular stabilisation to the audio-field reference as the user moves, this stabilisation giving said distinctive presentation to the group of at least one sound sources.

26. Apparatus according to claim 25, wherein the audio-field reference is head stabilised.

27. Apparatus according to claim 25, wherein the audio-field reference has an underlying stabilisation to which it is periodically updated, the audio-field reference between such updating having a stabilisation inherent to the presentation reference.

28. Apparatus according to claim 25, wherein the or each group sound source represents a corresponding augmented reality service that has an associated real-world location, the rendering-position determining arrangement being operative to world-stabilise the audio field reference and to position the or each group sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

29. Apparatus according to claim 21, wherein at least some of the said items represented by the sound sources are audio labels for services, the apparatus including a selection arrangement for enabling a user to select a service by selecting the corresponding audio-label sound source.