INFORMATION PROCESSING APPARATUS AND METHOD, INFORMATION PROCESSING SYSTEM, AND PROVIDING MEDIUM

• US 20160253845A1
• Filed: 05/09/2016
• Published: 09/01/2016
• Est. Priority Date: 12/11/1986
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Application Number:
  US15/149,299
• Publication Number:
  US 20160253845A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings

Abstract

The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.

Claims

1. An information processing apparatus, comprising:

an image acquiring unit that acquires an image of real world;

a detector that detects location information of the information processing apparatus;

an object recognizing unit that specifies an object based on the image of the real world;

an additional information acquiring unit that acquires first additional information based on the location information and second additional information associated with the object detected in the image of the real world; and

a display control unit that controls a display to display the first and second additional information simultaneously with the image of the real world.

2. The information processing apparatus according to claim 1, wherein the object includes a real world object.

3. The information processing apparatus according to claim 1, wherein the image acquiring unit is configured to continuously acquire the image of the real world.

4. The information processing apparatus according to claim 1, further comprising an input device, wherein the input device includes a search condition.

5. The information processing apparatus according to claim 4, wherein the search condition includes a time key entry allowing the second additional information to be searched within a time period.

6. The information processing apparatus according to claim 4, wherein the search condition includes a distance scale condition allowing the second additional information to be searched within a distance from the information processing apparatus.

7. A method of information processing, comprising:

acquiring an image of real world;

detecting location information of an information processing apparatus;

specifying an object based on the image of the real world;

acquiring first additional information based on the location information and second additional information associated with the object detected in the image of the real world; and

displaying the first and second additional information simultaneously with the image of the real world.

8. The method according to claim 7, wherein the object includes a real world object.

9. The method according to claim 7, wherein an image acquiring unit is configured to continuously acquire the image of the real world.

10. The method according to claim 7, wherein an input device includes a search condition.

11. The method according to claim 10, wherein the search condition includes a time key entry allowing the second additional information to be searched within a time period.

12. The method according to claim 10, wherein the search condition includes a distance scale condition allowing the second additional information to be searched within a distance from the information processing apparatus.

13. An information processing system, comprising:

a camera;

an information processing apparatus connected to the camera; and

a detector that detects location information of the information processing apparatus,

wherein the information processing apparatus includes;

an image acquiring unit that acquires an image of real world from the camera;

an object recognizing unit that specifies an object based on the image of the real world;

an additional information acquiring unit that acquires first additional information based on the location information and second additional information associated with the object detected in the image of the real world; and

a display control unit that controls a display to display the first and second additional information simultaneously with the image of the real world.

14. The information processing system according to claim 13, wherein the object includes a real world object.

15. The information processing system according to claim 13, wherein the image acquiring unit is configured to continuously acquire the image of the real world.

16. The information processing system according to claim 13, further comprising an input device, wherein the input device includes a search condition.

17. The information processing system according to claim 16, wherein the search condition includes a time key entry allowing the second additional information to be searched within a time period.

18. The information processing system according to claim 16, wherein the search condition includes a distance scale condition allowing the second additional information to be searched within a distance from the information processing apparatus.