ELECTRONIC DEVICE WITH 3D POSITIONAL AUDIO FUNCTION AND METHOD

• US 20090282335A1
• Filed: 05/06/2008
• Published: 11/12/2009
• Est. Priority Date: 05/06/2008
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Alexandersson, Petter
• Application Number:
  US12/115,812
• Publication Number:
  US 20090282335A1
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10H 2210/301 Soundscape or sound field simulation, reproduction or control for musical purposes, e.g. surround or 3D sound; Granular synthesis
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

An electronic device is provided that plays back a collection of media objects. The electronic device includes a controller that assigns a virtual spatial location within a virtual space to a sample of each media object and plays back at least one of the samples to a user through a multichannel audio device. Each played sample is within a virtual audible range of a virtual user position in the virtual space, and each played sample is played using spatial audio so that the user perceives each played sample as emanating from the corresponding virtual spatial location within the virtual space. The electronic device further includes a navigation device that inputs navigational signals to the controller to move the virtual user position relative to the virtual space in accordance with user manipulation of the navigation device. In response to the received navigational input, the controller adjusts the playback to maintain a correspondence between the virtual spatial location of each played sample and the virtual user position.

Claims

1. An electronic device that plays back a collection of media objects, comprising:

a controller that assigns a virtual spatial location within a virtual space to a sample of each media object and plays back at least one of the samples to a user through a multichannel audio device, wherein each played sample is within a virtual audible range of a virtual user position in the virtual space and wherein each played sample is played using spatial audio so that the user perceives each played sample as emanating from the corresponding virtual spatial location within the virtual space; and

a navigation device that inputs navigational signals to the controller to move the virtual user position relative to the virtual space in accordance with user manipulation of the navigation device,

wherein in response to the received navigational input, the controller adjusts the playback to maintain a correspondence between the virtual spatial location of each played sample and the virtual user position.

2. The electronic device of claim 1, wherein in response to received navigational input to move the virtual user position toward the virtual spatial location of a user specified one of the samples, the controller adjusts the playback so that the user perceives the user specified sample with prominence over other played samples in the virtual audible range to provide user perception of being located at the corresponding virtual spatial location.

3. The electronic device of claim 2, wherein in response to a received input command, the controller plays back the media object corresponding to the user specified sample from a beginning of the media object.

4. The electronic device of claim 1, wherein the adjustment of the playback in response to received navigational input to move the virtual user position toward a user specified sample includes exclusive playback of the user specified sample.

5. The electronic device of claim 1, wherein the adjustment of the playback in response to received navigational input to move the virtual user position toward a user specified sample includes playback of the user specified sample in stereo.

6. The electronic device of claim 1, further comprising:

a display driven to display a graphical simulation of the virtual space, the graphical simulation including graphical objects that represent the virtual spatial locations of the samples, wherein the graphical simulation is updated in response to the received navigational inputs.

7. The electronic device of claim 1, wherein each media object is an individual audio file.

8. The electronic device of claim 1, wherein each media object is a playlist having plural audio files.

9. The electronic device of claim 8, wherein in response to a received input command, the controller plays back samples of the audio files from the playlist using spatial audio to represent a spatial layout of the audio files.

10. The electronic device of claim 1, wherein each media object is associated with at least one audio file or at least one video file.

11. The electronic device of claim 1, wherein the navigation inputs are generated by moving the electronic device.

12. A method of browsing a collection of media objects using an electronic device, comprising:

(a) assigning a virtual spatial location within a virtual space to a sample of each media object;

(b) playing back at least one of the samples to a user through a multichannel audio device, wherein each played sample is within a virtual audible range of a virtual user position in the virtual space and wherein each played sample is played using spatial audio so that the user perceives each played sample as emanating from the corresponding virtual spatial location within the virtual space; and

(c) in response to a received navigational input to move the virtual user position relative to the virtual space, adjusting the playback to maintain a correspondence between the virtual spatial location of each played sample and the virtual user position.

13. The method of claim 12, wherein in response to received navigational input to move the virtual user position toward the virtual spatial location of a user specified one of the samples, adjusting the playback so that the user perceives the user specified sample with prominence over other played samples in the virtual audible range to provide user perception of being located at the corresponding virtual spatial location.

14. The method of claim 13, wherein in response to a received input command, playing back the media object corresponding to the user specified sample from a beginning of the media object.

15. The method of claim 12, wherein the adjusting of the playback in response to received navigational input to move the virtual user position toward a user specified sample includes exclusively playing back the user specified sample.

16. The method of claim 12, wherein the adjusting of the playback in response to received navigational input to move the virtual user position toward a user specified sample includes playing back the user specified sample in stereo.

17. The method of claim 12, further comprising:

displaying a graphical simulation of the virtual space, the graphical simulation including graphical objects that represent the virtual spatial locations of the samples; and

updating the graphical simulation in response to the received navigational inputs.

18. The method of claim 12, wherein each media object is an individual audio file.

19. The method of claim 12, wherein each media object is a playlist having plural audio files.

20. The method of claim 19, wherein in response to a received input command, repeating steps (a), (b), and (c) using the audio files of a user specified one of the playlists as the media objects.