DIRECTIONAL AUDIO INTERFACE FOR PORTABLE MEDIA DEVICE

• US 20110153044A1
• Filed: 12/22/2009
• Published: 06/23/2011
• Est. Priority Date: 12/22/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Powell, Richard, Lindahl, Aram
• Granted Patent: US 8,923,995 B2
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Methods and apparatus for a user to interact with and control a portable media device through an audio user interface. The audio user interface includes one or more audible control nodes perceived by the user to be spatially located at different points about the user of the portable media device. A sensor in the portable media device senses a movement of the portable media device by the user toward one or more of the audible control nodes. The operation of the portable device is modified in accordance with the sensed movement of the portable media device.

Claims

1. A method for controlling a portable device by a user, the portable device having a processor and a sensor, the method comprising:

receiving a directional audio signal by the user, the directional audio signal generated by the portable device;

moving the portable device by the user in response to the receiving of the directional audio signal;

sensing the movement of the portable device by the sensor; and

modifying an operation of the portable device in accordance with the sensed movement of the portable device.

2. The method of claim 1 wherein the sensed movement is one of a plurality of sensed movements each of which corresponds to a specific modification in the operation of the portable device, the method further comprising:

identifying the specific modification of the operation of the portable device that corresponds to the sensed movement; and

operating the portable device in accordance with the identifying.

3. The method of claim 2 wherein the sensor is arranged to detect at least a change in position of the portable device with respect to the user or a change in orientation of the portable device or an acceleration of the portable device.

4. The method of claim 3 wherein the directional audio signal includes an audible segment of stored media and a stored media binaural spatialization cue representing an audio direction perceived by the user to be associated with the audible segment.

5. The method of claim 3 wherein the directional audio signal includes an audible menu selection and an audible menu selection binaural spatialization cue representing an audio direction perceived by the user to be associated with the audible menu selection.

6. The method of claim 1, wherein the portable device includes a visual display and wherein modifying the operation of the portable device comprises:

updating the visual display based on the sensed movement of the portable device.

7. The method as recited in claim 6, wherein the updating the visual display comprises:

updating a graphical user interface presented on the visual display, wherein the graphical user interface includes at least a list of selectable items each corresponding to content stored in the portable device.

8. The method as recited in claim 7, wherein the modifying the operation of the portable device in accordance with the sensed movement comprises:

selecting one of the list of selectable items.

9. A portable device arranged to provide an audio user interface to a user of the portable device, the portable device comprising:

a processor configured to generate a directional audio signal;

an audio output circuit configured to communicate the directional audio signal to the user of the portable device; and

a sensor configured to sense a movement of the portable device generated by the user in response to the directional audio signal;

wherein an operation of the portable device is modified in accordance with the sensed movement.

10. The portable device of claim 9 wherein the sensed movement is one of a plurality of sensed movements each of which corresponds to a specific operational change in the portable device, and the processor is further configured to identify the specific operational change that corresponds to the sensed movement and to modify the operation of the portable device using the identified specific operational change.

11. The portable device of claim 10 wherein the sensor is a sensor arranged to detect a change in position of the portable device in relation to user of the portable device, an orientation change, and an acceleration of the portable device.

12. The portable device of claim 10 further including:

a storage unit configured to store media, wherein the directional audio signal includes an audible segment of media retrieved from the storage unit.

13. The portable device of claim 10 wherein the processor is configured to generate an audible menu selection and a binaural spatialization cue representing an associated audio direction included in the directional audio signal.

14. The portable device of claim 13 wherein the binaural spatialization cue includes an audible segment of stored media or an audible menu selection altered by the processor to audibly emanate from the associated audio direction.

15. The portable device of claim 10 further comprising:

a visual display, wherein the processor is configured to update the visual display based on the sensed movement of the portable device.

16. An audio user interface perceived by a user of a portable device to include one or more audible control nodes each perceived by the user to be spatially located at different points in a three dimensional region surrounding the user, wherein the portable device is controlled by the user moving the portable device in the direction of a spatial location in response to a directional audio signal received by the user, wherein the spatial location is that location in the three dimensional region that is perceived by the user as an origin of a selected one of the audible control nodes, the user perception resulting from the directional audio signal.

17. The audio user interface as recited in claim 16, wherein the movement of the portable device is sensed by a sensor incorporated into the portable device, and wherein the sensed movement is one of a plurality of sensed movements each of which corresponds to a specific modification in an operation of the portable device.

18. The audio user interface as recited in claim 17, wherein the sensor is arranged to detect at least a change in position of the portable device with respect to the user or a change in orientation of the portable device or an acceleration of the portable device.

19. A method of providing the audio user interface at a portable device, comprising:

generating by a processor in the portable device a directional audio signal having a directional audio cue;

communicating the directional audio signal to the user of the portable device through an audio output circuit; and

sensing with a sensor in the portable device a movement of the portable device effected by the user in response to the communicated directional audio signal, wherein the processor associates the sensed movement of the portable device with a specific operational change of the portable device.

20. The method of claim 19 wherein the sensor is arranged to detect at least a change in position, an orientation change and an acceleration of the portable device.

21. A method for updating an audio user interface of a portable device having a processor and a directional audio interface, the method comprising:

transmitting a directional audio menu including at least one menu item selection to a user of the portable device;

sensing a movement of the portable device in response to the transmitted directional audio menu;

identifying a menu item selection of the directional audio menu based on the sensed movement; and

associating the identified menu item selection in the directional audio menu with the sensed movement.

22. The method of claim 21 further comprising:

communicating the identified menu item selection to the user; and

receiving a confirmation of the menu item selection from the user.

23. The method of claim 21 wherein each menu item selection in the directional audio menu includes a distinct binaural spatialization cue representing an associated audio direction.

24. The method of claim 23 wherein the distinct binaural spatialization cue includes the menu item selection altered to audibly emanate from the associated audio direction.

25. The method of claim 21 wherein the portable device includes a sensor arranged to detect a change in position, an orientation change and an acceleration of the portable device.

26. The method of claim 22 wherein the portable device includes a visual display and wherein communicating the identified menu item selection to the user comprises:

updating the visual display based on identified menu item selection.