INFORMATION PROCESSING APPARATUS AND METHOD, INFORMATION PROCESSING SYSTEM, AND PROVIDING MEDIUM

• US 20100198867A1
• Filed: 04/05/2010
• Published: 08/05/2010
• Est. Priority Date: 10/19/1998
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Granted Patent: US 9,594,425 B2
• Time in Patent Office: Days
• US Class Current: 707/769
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.

Claims

1. An information processing apparatus comprising:

a display device;

a specific information input unit;

an input device;

a transmitter;

a receiver;

a processor; and

a memory device storing instructions which when executed by the processor cause the processor to operate with the display device, the specific information input unit, the input device, the transmitter and the receiver to;

(a) receive specific information;

(b) specify a situation in a physical environment based on the received specific information;

(c) receive first attachment information relating to the specified situation in the physical environment;

(d) attach the first attachment information to the specified situation in the physical environment;

(e) transmit, to a second information processing apparatus, the first attachment information and the specific information;

(f) receive second attachment information from the second information processing apparatus, the second attachment information;

relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information; and

(g) display said received second attachment information.

2. The information processing apparatus of claim 1, wherein:

(a) the specific information input unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

3. The information processing apparatus of claim 1, wherein:

(a) the specific information input unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

4. The information processing apparatus of claim 1, wherein:

(a) the specific information input unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

5. The information processing apparatus of claim 1, wherein when executed by the processor, the instructions cause the processor to operate with the input device to enable a user to input a search condition, said second attachment information being selected based on said search condition.

6. The information processing apparatus of claim 1, wherein said second attachment information is selected based on a position in the physical environment.

7. The information processing apparatus of claim 1, wherein the first attachment information includes at least one of voice information, image information, and text information.

8. The information processing apparatus of claim 1, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which;

(i) is related to the object; and

(ii) can be browsed and exchanged.

9. The information processing apparatus of claim 1, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

10. A method of operating an information processing apparatus including instructions, the method comprising:

(a) causing a processor to execute the instructions to cause a specific information input unit to receive specific information;

(b) causing the processor to execute the instructions to specify a situation in a physical environment;

(c) causing the processor to execute the instructions to receive first attachment relating to the specified situation in the physical environment;

(d) causing the processor to execute the instructions to attach the first attachment information to the specified situation in the physical environment;

(e) causing the processor to execute the instructions to cause a transmitter to transmit, to a second information processing apparatus, the first attachment information and the specific information;

(f) causing the processor to execute the instructions to cause a receiver to receive second attachment information from the second information processing apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information; and

(g) causing the processor to execute the instructions to cause a display device to display said received second attachment information.

11. The method of claim 10, wherein:

(a) the specific information input unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

12. The method of claim 10, wherein:

(a) the specific information input unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

13. The method of claim 10, wherein:

(a) the specific information input unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

14. The method of claim 10, which includes causing the processor to execute the instructions to enable a user to input a search condition, said second attachment information being selected based on said search condition.

15. The method of claim 10, wherein said second attachment information is further selected based on a position in the physical environment.

16. The method of claim 10, wherein the first attachment information includes at least one of voice information, image information, and text information.

17. The method of claim 10, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

18. The method of claim 10, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

19. A computer readable-medium storing instructions structured to cause an information processing apparatus to:

(a) receive specific information;

(b) specify a situation in a physical environment based on the received specific information;

(c) receive first attachment information relating to the specified situation in the physical environment;

(d) attach the first attachment information to the specified situation in the physical environment;

(e) transmit, to a second information processing apparatus, the first attachment information and the specific information;

(f) receive second attachment information from the second information processing apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information; and

(g) display said received second attachment information.

20. An information processing apparatus comprising:

a receiver;

a transmitter;

a processor; and

a memory device storing instructions which when executed by the processor, cause the processor to operate with the transmitter and the receiver to;

(a) receive, from a second information processing apparatus;

(i) specific information for specifying a situation in a physical environment; and

(ii) first attachment information attached to the specified situation in the physical environment, said first attachment information relating to the specified situation in the physical environment;

(b) store the received specific information and first attachment information;

(c) read second attachment information that corresponds to the received specific information; and

(d) transmit, to the second information processing apparatus, the second attachment information relating to the specified situation in the physical environment.

21. The information processing apparatus of claim 20, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

22. The information processing apparatus of claim 20, wherein when executed by the processor, the instructions cause the processor to select the second attachment information based on a received search condition.

23. The information processing apparatus of claim 20, wherein when executed by the processor, the instructions cause the processor to select the second attachment information based on a position in the physical environment.

24. The information processing apparatus of claim 20, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the transmitted second attachment information;

(i) is related to the object; and

(ii) can be browsed and exchanged.

25. The information processing apparatus of claim 20, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted second attachment information;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.

26. A method of operating an information processing apparatus including instructions, the method comprising:

(a) causing a processor to execute the instructions to cause a receiver to receive, from a second information processing apparatus;

(i) specific information for specifying a situation in a physical environment; and

(ii) first attachment information attached to the specified situation in the physical environment, said first attachment information relating to the specified situation in the physical environment;

(b) causing the processor to execute the instructions to store the received specific information and attachment information;

(c) causing the processor to execute the instructions to read second attachment information that corresponds to the received specific information; and

(d) causing the processor to execute the instructions to cause a transmitter to transmit, to the second information processing apparatus, the second attachment information which relates to the specified situation in the physical environment.

27. The method of claim 26, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

28. The method of claim 26, which includes causing the processor to execute the instructions to select the second attachment information based on a position in the physical environment.

29. The method of claim 26, which includes causing the processor to execute the instructions to select the second attachment information based on a received search condition.

30. The method of claim 26, wherein:

(a) the situation in the physical environment is includes an object in the physical environment;

(b) the specific information includes an ID attached to the object in the physical environment; and

(c) the transmitted second attachment information includes information that;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

31. The method of claim 26, wherein:

(a) the situation in the physical environment includes a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted second attachment information includes information that;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.

32. A computer readable-medium storing instructions structured to cause an information processing apparatus to:

(a) receive, from a second information processing apparatus;

(i) specific information for specifying a situation in a physical environment; and

(ii) first attachment information attached to the specified situation in the physical environment, said first attachment information relating to the specified situation in the physical environment;

(b) store the received specific information and first attachment information;

(c) read second attachment information that corresponds to the received specific information; and

(d) transmit, to the second information processing apparatus, the second attachment information relating to the specified situation in the physical environment.

33. An information processing system comprising:

a first information processing apparatus; and

a second information processing apparatus,

the first information processing apparatus including;

(a) a specific information input unit for inputting specific information to specify a situation in the real world;

(b) an attachment information input unit for inputting attachment information to be attached to the situation in the real world specified by the specific information;

(d) a first transmitting unit for transmitting the attachment information and the specific information to the second information processing apparatus;

(e) a searching unit for searching the second information processing apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit;

(f) a first receiving unit for receiving the further attachment information transmitted from the second information processing apparatus; and

(g) a display controlling unit for controlling to display the further attachment information received by the receiving unit; and

the second information processing apparatus including;

(a) a second receiving unit for receiving, from the first transmitting unit;

(i) the specific information; and

(ii) the attachment information;

(b) a storage unit for storing the received specific information and attachment information;

(c) a reader for reading the further attachment information based on the further specific information inputted by the attachment information input unit; and

(d) a second transmitter for transmitting the further attachment information read by the reader to the first information processing apparatus.

34. The information processing system of claim 33, wherein:

(a) the specific information input unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

35. The information processing system of claim 33, wherein:

(a) the specific information input unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

36. The information processing system of claim 33, wherein:

(a) the specific information input unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

37. The information processing system of claim 33, which includes an input unit configured to enable a user to input a search condition, said further attachment information being selected based on said search condition.

38. The information processing system of claim 33, wherein said further attachment information is selected based on a position in the physical environment.

39. The information processing system of claim 33, wherein the attachment information includes at least one of voice information, image information, and text information.

40. The information processing system of claim 33, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object; and

(ii) can be browsed and exchanged.

41. The information processing system of claim 33, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

42. An information processing apparatus comprising:

a specific information input unit for inputting specific information to specify a situation in the real world;

an attachment information input unit for inputting attachment information to be attached to the situation in the real world specified by the specific information;

a transmitting unit for transmitting the attachment information and the specific information to another information processing apparatus, the another information processing apparatus storing the attached information that is associated with the specific information;

a searching unit for searching the another information processing apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit;

a receiving unit for receiving the further attachment information transmitted from the another information processing apparatus; and

a display controlling unit for controlling to display the further attachment information received by the receiving unit.

43. The information processing apparatus of claim 42, wherein:

(a) the specific information input unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

44. The information processing apparatus of claim 42, wherein:

(a) the specific information input unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

45. The information processing apparatus of claim 42, wherein:

(a) the specific information input unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

46. The information processing apparatus of claim 42, which includes an input unit configured to enable a user to input a search condition, said further attachment information being selected based on said search condition.

48. The information processing apparatus of claim 42, wherein the attachment information includes at least one of voice information, image information, and text information.

49. The information processing apparatus of claim 42, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object; and

(ii) can be browsed and exchanged.

50. The information processing apparatus of claim 42, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

47. The information processing apparatus of 42, wherein said further attachment information is selected based on a position in the physical environment.

51. A method of operating an information processing apparatus including instructions, the method comprising:

(a) inputting specific information to specify a situation in the real world;

(b) inputting attachment information to be attached to the situation in the real world specified by the specific information;

(c) transmitting the attachment information and the specific information to another information processing apparatus, the another information processing apparatus storing the attached information that is associated with the specific information;

(d) causing a processor to execute the instructions to search the another information processing apparatus to acquire further attachment information based on further specific information inputted by an attachment information input unit;

(e) receiving the further attachment information transmitted from the another information processing apparatus; and

(f) causing a display unit to display the received further attachment information.

52. The method of claim 51, wherein:

(a) the specific information input unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

53. The method of claim 51, wherein:

(a) the specific information input unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

54. The method of claim 51, wherein:

(a) the specific information input unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

55. The method of claim 51, which includes causing the processor to execute the instructions to enable a user to input a search condition, said further attachment information being selected based on said search condition.

56. The method of claim 51, wherein said further attachment information is further selected based on a position in the physical environment.

57. The method of claim 51, wherein the attachment information includes at least one of voice information, image information, and text information.

58. The method of claim 51, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

59. The method of claim 51, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

60. A computer-readable medium storing instruction structured to cause an information processing apparatus to:

(a) input specific information to specify a situation in the real world;

(b) input attachment information to be attached to the situation in the real world specified by the specific information;

(c) transmit the attachment information and the specific information to another information processing apparatus, the another information processing apparatus storing the attached information that is associated with the specific information;

(d) search the another information processing apparatus to acquire further attachment information based on further specific information which is input;

(e) receive the further attachment information transmitted from the another information processing apparatus; and

(f) display the received further attachment information.

61. An information processing apparatus comprising:

a receiving unit for receiving, from another information processing apparatus;

(a) specific information to specify a situation in the real world; and

(b) attachment information attached to the situation in the real world specified by the specific information;

a storage unit for storing the received specific information and attachment information;

a reader for reading further attachment information based on further specific information inputted by the another information processing apparatus; and

a transmitter for transmitting the further attachment information read by the reader to the another information processing apparatus.

62. The information processing apparatus of claim 61, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

63. The information processing apparatus of claim 61, the second attachment information is selected based on a received search condition.

64. The information processing apparatus of claim 61, the second attachment information is selected based on a position in the physical environment.

65. The information processing apparatus of claim 61, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the transmitted further attachment information;

(i) is related to the object; and

(ii) can be browsed and exchanged.

66. The information processing apparatus of claim 61, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted further attachment information;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.