Dynamic virtual remote tagging

• US 9,019,202 B2
• Filed: 01/27/2012
• Issued: 04/28/2015
• Est. Priority Date: 02/23/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hagg, Wilhelm
• Primary Examiner(s): OLSON, JASON C
• Application Number:
  US13/359,651
• Publication Number:
  US 20120212460A1
• Time in Patent Office: 1,187 Days
• Field of Search: None
• US Class Current: 345/156
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9032 Query formulation
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content

Abstract

Method for selecting content items, comprising determining a location in a space, the location depending on at least one of a position, an orientation or a movement of a selection device in a real world environment surrounding the selection device; determining a virtual tag included in a set of virtual tags as a selected virtual tag, the selected virtual tag being associated with the determined location; and selecting a subset of content items of a set of content items, the subset of content items being associated with the selected virtual tag.

Claims

1. A method for selecting content items, the method comprising:

determining, by a selection device held by a user, an object in a space according to at least one of a position, an orientation or a movement of the selection device in a real world environment;

determining, by the selection device, a virtual tag included in a set of virtual tags as a selected virtual tag, the selected virtual tag being associated with the determined object;

selecting, by the selection device, a content item that corresponds to the selected virtual tag, the content item being multimedia data stored in an electronic storage; and

commanding, by the selection device, an electronic device in the real world environment to execute the content item.

2. The method according to claim 1, further comprising:

associating, by the selection device, a second virtual tag with a second object in the space, the second object being determined according to at least one of a second position, a second orientation or a second movement of the selection device in the real world environment.

3. The method according to claim 1, further comprising:

selecting, by the selection device, a second content item; and

associating, by the selection device, the second content item with a second virtual tag of the set of virtual tags.

4. The method according to claim 1, wherein

the space is the real world environment or is a virtual environment defined in an electronic storage.

5. The method according to claim 1, wherein

the object is determined in the real world environment according to a pointing direction or a focusing direction of the selection device, and

the selection device includes a light beam generator for illuminating the location in the pointing direction or in the focusing direction.

6. The method according to claim 1, wherein

the selection device includes a selection display for displaying at least a part of the space and for marking the object within the displayed part of the space, the displayed part of the space and the marked object depending on the movement, the tilt or the rotation of the selection device, and

the object is determined depending on a pointing direction or a focusing direction of the selection device with respect to the displayed part of the space.

7. The method according to claim 1, wherein the selection device includes a display.

8. The method according to claim 6, wherein

the space is a virtual environment defined in an electronic storage, and

the method further comprises:

upon a switching request received by the selection device, a second virtual environment is displayed within the selection display instead of the space,

upon a speed adjustment request received by the selection device, a speed of movement of the pointing direction or the focusing direction within the space displayed in the selection display is varied, and

upon a zoom angle adjustment request received by the selection device, a virtual zoom angle of the space or of the focusing direction displayed in the selection display is varied.

9. The method according to claim 1, wherein the selection device outputs an optic, acoustic or haptic notification when a particular object associated with a respective virtual tag is identified by the position, the orientation or the movement of the selection device.

10. The method according to claim 1, wherein, when the selected content item is multimedia data that includes a plurality of additional content items, the content item is selectable by the user on the selection device by the user pressing a respective key of the selection device.

11. The method according to claim 10, wherein the additional content items included in the selected content item are displayed in a spatial arrangement at a result display, the spatial arrangement allowing a further selection of one of the additional content items by navigation with arrow keys of the selection device, and

the result display is included in the selection device.

12. The method according to claim 5, wherein

the virtual environment includes a keyboard having a two-dimensional arrangement of alphanumeric keys including one or more alphanumeric characters, each of the alphanumeric keys corresponding to a location associated with a virtual tag, the virtual tag being associated with a corresponding alphanumeric content item, and

the method further comprises determining, by the selection device, a text string depending on a sequence determined by concatenating consecutively the selected alphanumeric content items.

13. The method according to claim 1, wherein

the content item of the set of content items includes an instruction to control the electronic device, and

the selection device commands the electronic device to execute the content item according to the instruction.

14. The method according to claim 13, wherein the instruction includes information on a user profile to be activated at the electronic device.

15. The method according to claim 1, wherein the virtual tags associated with the object further depend on information related to a user or to the real world environment.

16. A system for selecting content items, the system comprising:

a content storage that stores content items, each of the content items being multimedia data and the content storage being an electronic storage;

a tag storage that stores a set of virtual tags and information associating each virtual tag of the set of virtual tags with a respective content item stored in the content storage and with a respective object in a space; and

a selection device that, when held by a user,

identifies an object in the space, the space being a real world environment or a virtual environment, the identification of the object according to at least one of a position, an orientation and a movement of the selection device;

determines a virtual tag included in the set of virtual tags as a selected virtual tag, the selected virtual tag being associated with the determined object;

selects a content item that corresponds to the selected virtual tag, the content item being stored in the content storage; and

commands an electronic device in the real world environment to execute the content item.

17. The system according to claim 16, further comprising the electronic device, wherein

the electronic device accesses the content storage, and

the selection device transmits, along with a command to execute the content item, information that identifies the selected content item to the electronic device.

18. A device for selecting content items, the device comprising:

a network interface that accesses, via a wireless network, a set of content items stored in a remote storage, each of the content items being multimedia data and the remote storage being an electronic storage;

a tag storage that stores a set of virtual tags and information associating each virtual tag of the set of virtual tags with a respective content item stored in the remote storage and with a respective object in a space; and

circuitry configured to

when the device is held by a user, identify an object in the space, the space being a real world environment or in a virtual environment, the identification of the object according to at least one of a position, an orientation and a movement of the device;

determine a virtual tag included in the set of virtual tags as a selected virtual tag, the selected virtual tag being associated with the determined object;

select a content item that corresponds to the selected virtual tag, the content item being stored in the remote storage; and

command an electronic device in the real world environment to execute the content item.

19. The device according to claim 18, wherein the tag storage is located within the device.

20. The device according to claim 18, wherein

the device is a mobile device.

21. The device according to claim 18, further comprising a light beam emitter that illuminates the object, the object being situated in the real world environment.

22. A pointing device comprising:

a selection handpiece; and

circuitry configured to

identify an object in a real world environment, the identification of the object according to on at least one of a position, an orientation and a movement of the selection handpiece in the real world environment;

determine a virtual tag associated with the identified object;

select a content item that corresponds to the virtual tag, the content item being multimedia data stored in a remote electronic content storage; and

command an electronic device in the real world environment to execute the content item, wherein

the selection handpiece includes a light beam emitter that illuminates the object.