Facilitation of clear presentation in audio user interface

• US 7,065,222 B2
• Filed: 01/29/2002
• Issued: 06/20/2006
• Est. Priority Date: 01/29/2001
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Wilcock, Lawrence
• Primary Examiner(s): Le, Huyen
• Assistant Examiner(s): MICHALSKI, JUSTIN I
• Application Number:
  US10/058,000
• Publication Number:
  US 20020143414A1
• Time in Patent Office: 1,603 Days
• Field of Search: 700/94, 381/310, 381/17, 381/18, 381/19, 381/20, 381/304, 381/305, 381/61, 381/94.5, 381/106
• US Class Current: 381/310
• CPC Class Codes: G11B 19/025 'Virtual' control panels, e.g. Graphical User Interface [GUI]
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04S 1/005 For headphones
• CPC Class Codes: H04S 7/304 For headphones

Abstract

An audio user interface is provided in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate. At least some of the sound sources are associated in a collection as members of the collection; the collection itself has an associated collection-representing sound source. The collection can be changed in either direction between an un-collapsed state in which the member sound sources are present un-muted in the audio field, and a collapsed state in which the member sound sources are muted with the collection-representing sound source providing an audible presence for the collection in the audio field.

Claims

1. An audio user-interfacing method in which items, at least some of which are service labels, are represented in an audio field by corresponding synthesized sound sources from where item-related sounds appear to emanate, the method comprising:

associating only some of the sound sources as members of a collection;

upon user command, and within an audio environment formed by audibly present sound sources unrelated to said collection, changing the collection in either direction between;

an un-collapsed state in which the member sound sources are individually audibly present in the audio field; and

a collapsed state in which the member sound sources are fully muted and a collection-representing sound source provides an audible presence for the collection; and

selecting a service by selecting the sound source representing the corresponding service label.

2. A method according to claim 1, wherein the collection changes state, at least in one direction, automatically upon detection of predetermined trigger conditions.

3. A method according to claim 1, wherein the collection-representing sound source remains audibly present in the audio field when the collection is in its un-collapsed state.

4. A method according to claim 1, wherein the collection-representing sound source is fully muted when the collection is in its un-collapsed state.

5. A method according to claim 1, wherein the change between collection states, at least in one direction, is accompanied by a corresponding sound suggestive of moving to the end state of the current change.

6. A method according to claim 1, wherein the change between collection states, at least in one direction, is accompanied by moving the member sound sources through the audio field between their normal locations and the location of the collection-representing sound source, the direction of this movement being dependent on the end state of the current change.

7. A method according to claim 1, wherein when the collection is in its collapsed state, the collection-representing sound source provides an audio label for the collection, this label being repeated at intervals.

8. A method according to claim 1, wherein when the collection is in its collapsed state, the collection-representing sound source outputs at least extracts of the sounds associated with the collection member sound sources when un-collapsed.

9. A method according to claim 1, wherein the collection is associated with a respective audio-field reference relative to which the member sound sources of the collection are positioned, other sound sources in the audio field being positioned relative to one or more further audio-field references, the audio-field references being independently movable relative to a presentation reference determined by a mounting configuration of audio output devices used to synthesise said sound sources, with movement of a said audio-field reference relative to the presentation reference resulting in corresponding movement of the associated sound sources.

10. A method according to claim 9, wherein the audio field reference associated with the collection is world-stabilised and the member sound sources represent augmented reality services, each member sound source being positioned relative to the audio field reference of the collection such that for a user located in a notional reference position, the sound source lies in the same direction as a corresponding real-world location associated with the augmented reality service represented by the sound source.

11. A method according to claim 1, wherein the audio field is rendered by apparatus including audio output devices according to sound-source data indicative of the rendering position and audibility of the each sound source in the audio field, the muting and un-muting of said member sound sources to collapse and un-collapse the collection being effected by changing the sound-source data for these sound sources to appropriately set the audibility of the sources.

12. A method according to claim 1, wherein upon un-collapsing of the collection, at least some of the other sound sources in the audio field have their positions in the audio field adjusted.

13. Apparatus for providing an audio user interface in which items, at least some of which are audio labels for services, are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the apparatus comprising:

a data store for storing data on the sound sources, this data including audibility data for controlling the audibility of the sources in the audio field, and collection data for associating only some of the sound sources into a collection of which those sound sources are members and for further associating with the collection a collection-representing sound source;

a rendering position determining arrangement for determining, for each of said sound sources, a respective associated rendering position at which the sound source is to be synthesized to sound in the audio field;

a collection-control arrangement for changing, upon user command, the collection in either direction between un-collapsed and collapsed states and for correspondingly setting the audibility data of the collection-related sound sources such that;

in the un-collapsed state of the collection, the member sound sources are audible at their respective rendering positions; and

in the collapsed state of the collection, the member sound sources are fully muted and the collection-representing sound source provides an audible presence for the collection in the audio field;

a rendering subsystem, including audio output devices, for generating an audio field in which said sound sources are synthesized at their associated rendering positions and with the audibility of the collection-related sound sources set by said collection-control arrangement, the rendering subsystem being arranged to audibly present in said audio field, independently of the current state of said collection, those sound sources that are unrelated to said collection; and

a selection arrangement for enabling a user to select a service by selecting the corresponding audio-label sound source.

14. Apparatus according to claim 13, wherein the collection-control arrangement is arranged to automatically change the state of the collection, at least in one direction, upon detection of predetermined trigger conditions.

15. Apparatus according to claim 13, wherein the collection-control arrangement is arranged to set the audibility data of the collection-representing sound source such that this source remains present in the audio field when the collection is in its un-collapsed state.

16. Apparatus according to claim 13, wherein the collection-control arrangement is arranged to set the audibility data of the collection-representing sound source such that this source is muted in the audio field when the collection is in its un-collapsed state.

17. Apparatus according to claim 13, wherein the collection-control arrangement is arranged in changing between collection states, at least in one direction, to modify the rendering positions of the member sound sources such they move through the audio field between their normal positions and the positions of the collection-representing sound source, the direction of this movement being dependent on the end state of the current change.

18. Apparatus according to claim 13, wherein when the collection is in its collapsed state, the collection-representing sound source provides an audio label for the collection, this label being repeated at intervals.

19. Apparatus according to claim 13, further comprising a notification arrangement arranged when the collection is in its collapsed state, to provide via the collection-representing sound source, audio notifications of events related to the items represented by the member sound sources.

20. Apparatus according to claim 13, wherein the rendering-position determining arrangement comprises:

a setting arrangement for setting the location of each said collection member sound source relative to an audio-field reference;

a control arrangement for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

a deriving arrangement for deriving the rendering position of each sound source based on the location of the sound source in the audio field and said offset.

21. Apparatus according to claim 20, wherein the collection member sound sources represent augmented reality services that have associated real-world locations, the rendering-position determining arrangement being arranged to world-stabilise the audio field reference associated with the collection and to position each member sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

22. Apparatus according to claim 20, wherein the said setting arrangement for setting an offset between the audio field reference and a presentation reference, comprises user input arrangement for enabling a user to change said offset, and a stabilisation arrangement for varying the said offset such as to stabilise the audio field reference relative to one of:

a user'"'"'s head;

a user'"'"'s body;

a vehicle mounting the apparatus;

the world.

23. Apparatus for providing an audio user interface in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the apparatus comprising:

a data store for storing data on the sound sources, this data including audibility data for controlling the audibility of the sources in the audio field, and collection data for associating only some of the sound sources into a collection of which those sound sources are members and for further associating with the collection a collection-representing sound source;

a rendering-position determining arrangement arranged to determine, for each of said sound sources, a respective associated rendering position at which the sound source is to be synthesized to sound in the audio field;

a collection-control arrangement arranged to change, upon user command, the collection in either direction between un-collapsed and collapsed states and to correspondingly set the audibility data of the collection-related sound sources such that;

in the un-collapsed state of the collection, the member sound sources are audible at their respective rendering positions; and

in the collapsed state of the collection, the member sound sources are fully muted and the collection-representing sound source provides an audible presence for the collection in the audio field;

a rendering subsystem, including audio output devices, arranged to generate an audio field in which said sound sources are synthesized at their associated rendering positions with the audibility of the collection-related sound sources set by said collection-control arrangement, the rendering subsystem being arranged to audibly present in said audio field, independently of the current state of said collection, any said sound sources that are unrelated to said collection; and

a notification arrangement arranged when the collection is in its collapsed state to provide via the collection-representing sound source, audio notifications of events related to the items represented by the member sound sources.

24. Apparatus according to claim 23, wherein the collection-control arrangement includes a user input arrangement for changing the collection state, at least in one direction.

25. Apparatus according to claim 23, wherein the collection-control arrangement is arranged to automatically change the state of the collection, at least in one direction, upon detection of predetermined trigger conditions.

26. Apparatus according to claim 23, wherein the collection-control arrangement is arranged to set the audibility data of the collection-representing sound source such that this source remains present in the audio field when the collection is in its un-collapsed state.

27. Apparatus according to claim 23, wherein the collection-control arrangement is arranged to set the audibility data of the collection-representing sound source such that this source is muted in the audio field when the collection is in its un-collapsed state.

28. Apparatus according to claim 23, wherein the collection-control arrangement is arranged in changing between collection states, at least in one direction, to modify the rendering positions of the member sound sources such they move through the audio field between their normal positions and the positions of the collection-representing sound source, the direction of this movement being dependent on the end state of the current change.

29. Apparatus according to claim 23, wherein when the collection is in its collapsed state, the collection-representing sound source provides an audio label for the collection, this label being repeated at intervals.

30. Apparatus according to claim 23, wherein the rendering-position determining arrangement comprises:

a setting arrangement for setting the location of each said collection member sound source relative to an audio-field reference;

a control arrangement for controlling an offset between the audio field reference and a presentation reference, the presentation reference being determined by a mounting configuration of the audio output devices; and

a deriving arrangement arranged to derive the rendering position of each sound source based on the location of the sound source in the audio field and said offset.

31. Apparatus according to claim 30, wherein the collection member sound sources represent augmented reality services that have associated real-world locations, the rendering-position determining arrangement being arranged to world stabilise the audio field reference associated with the collection and to position each member sound source relative to the audio field reference such that for a user located in a notional reference position, the sound source lies in the same direction as the corresponding said real-world location.

32. Apparatus according to claim 30, wherein the said setting arrangement comprises a user input arrangement arranged to enable a user to change said offset, and a stabilisation arrangement arranged to vary the said offset such as to stabilise the audio field reference relative to one of:

a user'"'"'s head;

a user'"'"'s body;

a vehicle mounting the apparatus;

the world.

33. An audio user-interfacing method in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate, the method comprising:

associating some only of the sound sources into a collection of which they are members;

upon user command, and within an audio environment formed by audibly-present sound sources unrelated to said collection, changing the collection in either direction between;

an un-collapsed state in which the member sound sources are individually audibly present; and

a collapsed state in which the member sound sources are fully muted and a collection-representing sound source provides an audible presence for the collection; and

using the collection-representing sound source, when, the collection is in its collapsed state, to provide audio notifications of events related to the items represented by the member sound sources.

34. A method according to claim 33, wherein the collection changes state, at least in one direction, automatically upon detection of predetermined trigger conditions.

35. A method according to claim 33, wherein the collection-representing sound source remains audibly present in the audio field when the collection is in its un-collapsed state.

36. A method according to claim 33, wherein the collection-representing sound source is fully muted when the collection is in its un-collapsed state.

37. A method according to claim 33, wherein the change between collection states, at least in one direction, is accompanied by a corresponding sound suggestive of moving to the end state of the current change.

38. A method according to claim 33, wherein the change between collection states, at least in one direction, is accompanied by moving the member sound sources through the audio field between their normal locations and the location of the collection-representing sound source, the direction of this movement being dependent on the end state of the current change.

39. A method according to claim 33, wherein when the collection is in its collapsed state, the collection-representing sound source provides an audio label for the collection, this label being repeated at intervals.

40. A method according to claim 33, wherein when the collection is in its collapsed state, the collection-representing sound source outputs at least extracts of the sounds associated with the collection member sound sources when un-collapsed.

41. A method according to claim 33, wherein the collection is associated with a respective audio-field reference relative to which the member sound sources of the collection are positioned, other sound sources in the audio field being positioned relative to one or more further audio-field references, the audio-field references being independently movable relative to a presentation reference determined by a mounting configuration of audio output devices used to synthesise said sound sources, with movement of a said audio-field reference relative to the presentation reference resulting in corresponding movement of the associated sound sources.

42. A method according to claim 41, wherein the audio field reference associated with the collection is world-stabilised and the member sound sources represent augmented reality services, each member Sound source being positioned relative to the audio field reference of the collection such that for a user located in a notional reference position, the sound source lies in the same direction as a corresponding real-world location associated with the augmented reality service represented by the sound source.

43. A method according to claim 33, wherein the audio field is rendered by apparatus including audio output devices according to sound-source data indicative of the rendering position and audibility of the each sound source in the audio field, the muting and un-muting of said member sound sources to collapse and un-collapse the collection being effected by changing the sound-source data for these sound sources to appropriately set the audibility of the sources.

44. A method according to claim 33, wherein upon un-collapsing of the collection, at least some of the other sound sources in the audio field have their positions in the audio field adjusted.