Audio user interface with audio field orientation indication

• US 20020150256A1
• Filed: 01/29/2002
• Published: 10/17/2002
• Est. Priority Date: 01/29/2001
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Belrose, Guillaume, Bijsmans, Jeroen Geert
• Application Number:
  US10/058,047
• Publication Number:
  US 20020150256A1
• Time in Patent Office: Days
• US Class Current: 381/17
• CPC Class Codes: G11B 19/025 'Virtual' control panels, e.g. Graphical User Interface [GUI]

Abstract

An audio user interface is provided in which items are represented in an audio field by corresponding synthesized sound sources from where sounds related to the items appear to emanate. The sound sources are located in the audio field relative to an audio field reference. In order to rotate the audio field either in response to user input or to achieve a particular stabilisation of the audio field, the audio-field reference can be offset relative to presentation reference determined by a mounting configuration of audio output devices through which the sound sources are synthesised. To assist the user in appreciating the current orientation of the audio field, a visual indication is given of the orientation of the audio-field reference relative to a predetermined indicator reference taking account, at least at a component level, of any change in value of said offset and any change in value of indicator-reference orientation relative to the presentation reference. The visual indication is, for example, provided via an indicator arrangement incorporated in an input device through which the user can command offset changes.

Claims

13-1. A user-interface method according to claim 1, wherein the sound sources are rendered through headphones and step (a) involves varying said offset in dependence on the rotation of the user'"'"'s head relative to their body whereby to stabilise the audio field relative to the user'"'"'s body;

said predetermined indicator reference being one of;

current facing direction, in which case step (b) takes account, at least at a component level, of changes in said offset, there being no change in the orientation of the indicator reference relative to the presentation reference;

straight-ahead facing direction in which case step (b) takes account, at least at a component level, of changes in said offset except that changes in offset resulting from rotation of the user'"'"'s head relative to their body are matched out by the changes in the orientation of the indicator reference relative to the presentation reference;

a direction fixed relative to the world, in which case step (b) takes account, at least at a component level, of both of changes in said offset, and changes in orientation of the indicator reference relative to the presentation reference resulting from rotation of the user'"'"'s body relative to the world.

14-2. A user-interface method according to claim 1, wherein the sound sources are rendered through headphones and step (a) involves varying said offset in dependence on the rotation of the user'"'"'s head relative to the world whereby to stabilise the audio field relative to the world;

said predetermined indicator reference being one of;

current facing direction, in which case step (b) takes account, at least at a component level, of changes in said offset, there being no change in the orientation of the indicator reference relative to the presentation reference;

straight-ahead facing direction in which case step (b) takes account, at least at a component level, of changes in said offset except that components of offset changes resulting from rotation of the user'"'"'s head relative to their body are matched out by the changes in the orientation of the indicator reference relative to the presentation reference;

a direction fixed relative to the world, in which case step (b) takes account, at least at a component level, of changes in said offset except that changes in offset resulting from rotation of the user'"'"'s head relative to the world are matched out by the changes in the orientation of the indicator reference relative to the presentation reference.

20. An audio user-interfacing method in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the method comprising the steps of:

(a) setting the location of each sound source relative to an audio-field reference;

(b) controlling an offset between the audio-field reference and a presentation reference determined by a mounting configuration of the audio output devices, this offset being varied both in response to user input and to achieve a particular stabilisation of the audio field;

(c) determining a rendering position for each sound source by combining the location of the sound source in the audio field with said offset;

(d) rendering said sound sources at their associated rendering positions in the audio field; and

(e) determining and visually indicating the orientation of the audio field reference relative to a predetermined indicator reference direction taking account, at least at a component level, of any change in said offset and any change the orientation of said indicator reference direction relative to the presentation reference, at least where such changes do not match each other.

21. Apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the apparatus including:

offset means for varying an offset between an audio-field reference relative to which the sounds sources are located in the audio field, and a presentation reference determined by a mounting configuration of audio output devices of the apparatus through which the sound sources are synthesised;

orientation-determining means for determining the orientation of the audio-field reference relative to a predetermined indicator reference taking account, at least at a component level, of any change in value of said offset and any change in value of indicator-reference orientation relative to the presentation reference, at least where such changes do not match each other; and

a visual orientation indicator arrangement for visually indicating the said orientation determined by the orientation-determining means.

22. Apparatus according to claim 21, wherein the orientation-determining means is operative to determine the orientation of the audio field reference relative to the indicator reference on the basis of components of said offset and said indicator-reference orientation without intermediate determination of said offset and indicator-reference direction.

23. Apparatus according to claim 21, wherein the orientation-determining means is operative to determine the orientation of the audio field reference relative to the indicator reference through the intermediate determination of said offset and said indicator-reference orientation.

24. Apparatus according to claim 21, wherein the offset means is operative to vary said offset such as to stabilise audio field relative to one of:

a user'"'"'s head;

a user'"'"'s body;

a vehicle in which the user is travelling;

the world;

this stabilisation taking account of whether the audio output devices used to synthesise the sound sources are world, vehicle, body or head mounted, and, as appropriate, rotation of the user'"'"'s head or body, or turning of the vehicle.

25. Apparatus according to claim 21 or claim 24, wherein the offset means is operative to vary the said offset in response to user input via an input device of the apparatus.

26. Apparatus according to claim 21, wherein the visual orientation indicator arrangement comprises a set of selectively energisable indicator elements, one of the orientation-determining means and the visual orientation indicator arrangement including means for energising a selected one of the elements in dependence on the determined orientation of the audio field reference relative to the indicator reference.

27. Apparatus according to claim 21, wherein the visual orientation indicator arrangement comprises a display screen, one of the orientation-determining means and the visual orientation indicator arrangement including means for causing the display on the screen of an indication of the determined orientation of the audio field reference relative to the indicator reference.

28. Apparatus according to claim 25, wherein the visual orientation indicator arrangement is incorporated in the input device.

29. Apparatus according to claim 28, wherein said input device is a trackball device, the visual orientation indicator arrangement comprising a display screen, and one of the orientation-determining means and the visual orientation indicator arrangement including means for energising a selected one of the elements in dependence on the determined orientation of the audio field reference relative to the indicator reference.

30. Apparatus according to claim 28, wherein said input device is a trackball device, the visual orientation indicator arrangement comprising a set of selectively energisable indicator elements, and one of the orientation-determining means and the visual orientation indicator arrangement including means for energising a selected one of the elements in dependence on the determined orientation of the audio field reference relative to the indicator reference.

31. Apparatus according to claim 28, further comprising means for indicating the location of new item-representing sound sources in the audio field by using the visual orientation indicator arrangement to indicate the orientation of the new sound source relative to said indicator reference.

32. Apparatus according to claim 28, further comprising means for indicating the occurrence of an event relating to a said item by using the visual orientation indicator arrangement to indicate the orientation of the corresponding sound source relative to said indicator reference.

33. Apparatus according to claim 21, wherein the orientation of the audio-field reference relative to a predetermined indicator reference has at least two degrees of freedom.

34. Apparatus according to claim 21, wherein the indicator reference is one of:

the presentation reference;

a current facing direction of the user;

a straight-ahead facing direction of the user;

a world-fixed direction.

40. In apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the input device of claim 39 wherein the user-operable element is a trackball.

41. In apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the input device of claim 39 wherein the user-operable element is a cylinder that is displaceable along, and rotatable about, its axis.

35. Apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the apparatus including:

a control arrangement for varying an offset between an audio-field reference relative to which the sounds sources are located in the audio field, and a presentation reference determined by a mounting configuration of audio output devices of the apparatus through which the sound sources are synthesised;

an orientation-determining arrangement operative to determine the orientation of the audio-field reference relative to a predetermined indicator reference taking account, at least at a component level, of any change in value of said offset and any change in value of indicator-reference orientation relative to the presentation reference, at least where such changes do not match each other; and

a visual orientation indicator arrangement for visually indicating the said orientation determined by the orientation-determining means.

36. Apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, the apparatus comprising:

means for setting the location of each said sound source relative to an audio-field reference;

offset means for controlling an offset between the audio-field reference and a presentation reference determined by a mounting configuration of the audio output devices;

means for deriving the rendering position of each sound source based on the location of the sound source in the audio field and said offset;

rendering means, including audio output devices, for generating an audio field in which said sound sources are synthesized at their associated rendering positions to provide sounds related to the items concerned; and

a visual indicator arrangement for determining and visually indicating the orientation of the audio field reference relative to a predetermined indicator reference taking account, at least at a component level, of any change in said offset and any change the orientation of said indicator reference direction relative to the presentation reference, at least where such changes do not match each other.

37. In apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, an input device comprising:

at least one user-operable element, with associated sensing means, for commanding a change in offset between an audio-field reference relative to which the sounds sources are located in the audio field, and a presentation reference determined by a mounting configuration of audio output devices through which the sound sources are synthesised; and

a visual orientation indicator arrangement for visually indicating the orientation of the audio field reference relative to a predetermined indicator reference, the visual orientation indicator arrangement comprising a set of selectively energisable indicator elements.

38. In apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, an input device comprising:

at least one user-operable element, with associated sensing means, for commanding a change in offset between an audio-field reference relative to which the sounds sources are located in the audio field, and a presentation reference determined by a mounting configuration of audio output devices through which the sound sources are synthesised; and

a visual orientation indicator arrangement for visually indicating the orientation of the audio field reference relative to a predetermined indicator reference, the visual orientation indicator arrangement comprising a visual display screen.

39. In apparatus for providing an audio user interface in which each of a plurality of items is represented in an audio field by at least one respective synthesized sound source from where sounds related to the item appear to emanate, an input device comprising:

at least one user-operable mechanical element with at least two degrees of freedom and associated sensing means, for commanding a change in offset between an audio-field reference relative to which the sounds sources are located in the audio field, and a presentation reference determined by a mounting configuration of audio output devices through which the sound sources are synthesised; and

a visual orientation indicator arrangement for visually indicating the orientation of the audio field reference relative to a predetermined indicator reference, the visual orientation indicator arrangement comprising markings on an external surface of the user-operable element.