Information processing apparatus and method, information processing system, and providing medium

• US 9,563,267 B2
• Filed: 10/25/2012
• Issued: 02/07/2017
• Est. Priority Date: 10/19/1998
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US13/660,321
• Publication Number:
  US 20130054420A1
• Time in Patent Office: 1,566 Days
• Field of Search: 715/848
• US Class Current: 1/1
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.

Claims

1. A non-transitory computer readable storage medium storing instructions which, when executed, cause at least one processor in an information processing system to:

receive optical information relating to a product from a wearable user device at a first location on which a user has started an application for on-line shopping;

receive attachment information relating to the product, wherein the attachment information relating to the product was input by a different user of the product via an internet interface at a second different location;

transmit the attachment information relating to the product and a link for on-line shopping corresponding to the product to the wearable user device, which is configured to control a display device to display the attachment information and the link for on-line shopping and access the link for on-line shopping to display an on-line page selling the product,

wherein the display device is configured to display a screen image including a context-aware area and a personal information tray, wherein the context-aware area corresponds to a real world associated with the wearable user device, and wherein an icon corresponding to the attachment information is configured to be generated in the personal information tray, wherein a drag and drop operation of the icon is configured to be performed on the display device, wherein the icon is configured to be dragged from a first position in the personal information tray and dropped at a second position in the context-aware area, and wherein accessing the icon provides the attachment information.

2. The non-transitory computer readable storage medium of claim 1, wherein a second user inputs second attachment information corresponding to the product via a second internet interface and the second attachment information is transmitted to the information processing system for exchange with a plurality of different users.

3. The non-transitory computer readable storage medium of claim 1, wherein the attachment information is provided by a plurality of different users.

4. The non-transitory computer readable storage medium of claim 1, wherein the information processing system comprises:

a storage device; and

a communication device,

wherein the storage device stores the attachment information relating to the product and the link for on-line shopping corresponding to the product.

5. The non-transitory computer readable storage medium of claim 1, wherein the attachment information is text.

6. The non-transitory computer readable storage medium of claim 1, wherein the attachment information includes a time indicator.

7. The non-transitory computer readable storage medium of claim 1, wherein the optical information includes at least one of barcode information, a numerical identification code, a product ID, a two-dimensional ID, an ISBN code, a JAN code, an EAN code, and a CDDB code.

8. The non-transitory computer readable storage medium of claim 1, wherein the product is at least one of a music medium, a CD, and a book.

9. The non-transitory computer readable storage medium of claim 1, wherein the attachment information includes evaluation information for the product.

10. A non-transitory computer readable storage medium storing instructions which, when executed, cause at least one processor in a wearable user device to:

start, based on an input by a user to the wearable user device at a first location, an application for on-line shopping;

receive optical information relating to a product;

transmit the optical information, from the wearable user device at the first location, to a second information processing apparatus;

receive attachment information relating to the product and a link for on-line shopping corresponding to the product from a third information processing apparatus which received the attachment information relating to the product, wherein the attachment information relating to the product was input by a different user of the product via an internet interface at a second different location;

control a display device to display the attachment information and the link for on-line shopping; and

access the link for on-line shopping to display an on-line page selling the product,

wherein the display device is configured to display a screen image including a context-aware area and a personal information tray, wherein the context-aware area corresponds to a real world associated with the wearable user device, and wherein an icon corresponding to the attachment information is configured to be generated in the personal information tray, wherein a drag and drop operation of the icon is configured to be performed on the display device, wherein the icon is configured to be dragged from a first position in the personal information tray and dropped at a second position in the context-aware area, and wherein accessing the icon provides the attachment information.

11. The non-transitory computer readable storage medium of claim 10, wherein a second user inputs second attachment information corresponding to the product via a second internet interface and the second attachment information is transmitted to the third information processing apparatus for exchange with a plurality of different users.

12. The non-transitory computer readable storage medium of claim 10, wherein after the application is started, the wearable user device waits to receive the optical information.

13. The non-transitory computer readable storage medium of claim 10, wherein the attachment information is provided by a plurality of different users.

14. The non-transitory computer readable storage medium of claim 10, wherein the wearable user device comprises:

an optical input device; and

a communication device.

15. The non-transitory computer readable storage medium of claim 14, wherein the input device is at least one of a bar code reader and a camera.

16. The non-transitory computer readable storage medium of claim 10, wherein the attachment information is text.

17. The non-transitory computer readable storage medium of claim 10, wherein the attachment information includes a time indicator.

18. The non-transitory computer readable storage medium of claim 10, wherein the optical information includes barcode information.

19. The non-transitory computer readable storage medium of claim 10, wherein the optical information includes at least one of a numerical identification code, a product ID, a two-dimensional ID, an ISBN code, a JAN code, an EAN code, and a CDDB code.

20. The non-transitory computer readable storage medium of claim 10, wherein the product is at least one of a music medium, a CD, and a book.

21. The non-transitory computer readable storage medium of claim 10, wherein the attachment information includes evaluation information for the product.

22. A wearable user device comprising:

at least one processor; and

a memory device storing instructions which when executed by the at least one processor cause the wearable user device to;

start, based on an input by a user to the wearable user device at a first location, an application for on-line shopping;

receive optical information relating to a product;

transmit the optical information, from the wearable user device at the first location, to a second information processing apparatus;

receive attachment information relating to the product and a link for on-line shopping corresponding to the product from a third information processing apparatus which received the attachment information relating to the product, wherein the attachment information relating to the product was input by a different user of the product via an internet interface at a second different location;

control a display device to display the attachment information and the link for on-line shopping; and

access the link for on-line shopping to display an on-line page selling the product,

wherein the display device is configured to display a screen image including a context-aware area and a personal information tray, wherein the context-aware area corresponds to a real world associated with the wearable user device, and wherein an icon corresponding to the attachment information is configured to be generated in the personal information tray, wherein a drag and drop operation of the icon is configured to be performed on the display device, wherein the icon is configured to be dragged from a first position in the personal information tray and dropped at a second position in the context-aware area, and wherein accessing the icon provides the attachment information.

23. The wearable user device of claim 22, wherein the attachment information includes evaluation information for the product.