Information processing apparatus and method, information processing system, and providing medium

• US 9,594,425 B2
• Filed: 04/05/2010
• Issued: 03/14/2017
• Est. Priority Date: 10/19/1998
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US12/754,102
• Publication Number:
  US 20100198867A1
• Time in Patent Office: 2,535 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.

Claims

1. A wearable augmentable reality apparatus comprising:

a processor configured to control a display device, a real-world-environment information recognizing unit, an input device which is different from the real-world-environment information recognizing unit, and a communication unit to;

(a) receive specific information from the real-world-environment information recognizing unit;

(b) specify a situation in a physical environment based on the received specific information;

(c) receive, from at least one of the input device and an information processing apparatus, first attachment information relating to the specified situation in the physical environment, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device;

(d) attach the first attachment information to the specified situation in the physical environment;

(e) transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information;

(f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information;

(g) transmit time information to an information processing apparatus; and

(h) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

2. The wearable augmentable reality apparatus of claim 1, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

3. The wearable augmentable reality apparatus of claim 1, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

4. The wearable augmentable reality apparatus of claim 1, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

5. The wearable augmentable reality apparatus of claim 1, wherein the processor is configured to operate with the input device to enable a user to input a search condition, said second attachment information being selected based on said search condition.

6. The wearable augmentable reality apparatus of claim 1, wherein said second attachment information is selected based on a position in the physical environment.

7. The wearable augmentable reality apparatus of claim 1, wherein the first attachment information includes at least one of voice information, image information, and text information.

8. The wearable augmentable reality apparatus of claim 1, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which

(i) is related to the object; and

(ii) can be browsed and exchanged.

9. The wearable augmentable reality apparatus of claim 1, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

10. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:

(a) causing a processor to execute the instructions to cause a real-world-environment information recognizing unit to receive specific information;

(b) causing the processor to execute the instructions to specify a situation in a physical environment;

(c) causing the processor to execute the instructions to receive, from at least one of an input device and an information processing apparatus which is different from the real-world-environment information recognizing unit, first attachment information relating to the specified situation in the physical environment, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device;

(d) causing the processor to execute the instructions to attach the first attachment information to the specified situation in the physical environment;

(e) causing the processor to execute the instructions to cause a transmitter to transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information and to transmit time information to an information processing apparatus;

causing the processor to execute the instructions to cause a receiver to receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information; and

(g) causing the processor to execute the instructions to cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

11. The method of claim 10, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

12. The method of claim 10, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

13. The method of claim 10, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

14. The method of claim 10, which includes causing the processor to execute the instructions to enable a user to input a search condition, said second attachment information being selected based on said search condition.

15. The method of claim 10, wherein said second attachment information is further selected based on a position in the physical environment.

16. The method of claim 10, wherein the first attachment information includes at least one of voice information, image information, and text information.

17. The method of claim 10, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

18. The method of claim 10, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

19. A non-transitory computer readable-medium storing instructions structured to cause a wearable augmentable reality apparatus to:

(a) receive specific information from a real-world-environment information recognizing unit;

(b) specify a situation in a physical environment based on the received specific information;

(c) receive, from an input device which is different from the real-world-environment information recognizing unit, first attachment information relating to the specified situation in the physical environment based on a user entry to the input device, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received;

(d) attach the first attachment information received from the input device to the specified situation in the physical environment;

(e) transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information;

(f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information;

(g) transmit time information to an information processing apparatus, and

(h) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

80. The non-transitory computer readable-medium of claim 19, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

81. The non-transitory computer readable-medium of claim 19, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

82. The non-transitory computer readable-medium of claim 19, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

83. The non-transitory computer readable-medium of claim 19, wherein the instructions cause the wearable augmentable reality apparatus to enable a user to input a search condition, said second attachment information being selected based on said search condition.

84. The non-transitory computer readable-medium of claim 19, wherein said second attachment information is selected based on a position in the physical environment.

85. The non-transitory computer readable-medium of claim 19, wherein the first attachment information includes at least one of voice information, image information, and text information.

86. The non-transitory computer readable-medium of claim 19, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which

(i) is related to the object; and

(ii) can be browsed and exchanged.

87. The non-transitory computer readable-medium of claim 19, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

20. A wearable augmentable reality apparatus comprising:

a processor configured to control a communication unit to;

(a) receive, from a second different wearable augmentable reality apparatus;

(i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and

(ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received;

(b) store the received specific information and the first attachment information received from the input device;

(c) read second attachment information that corresponds to the received specific information;

(d) transmit, to the second different wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment and transit time information to an information processing apparatus; and

(e) cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

21. The wearable augmentable reality apparatus of claim 20, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

22. The wearable augmentable reality apparatus of claim 20, wherein the processor is configured to select the second attachment information based on a received search condition.

23. The wearable augmentable reality apparatus of claim 20, wherein the processor is configured to select the second attachment information based on a position in the physical environment.

24. The wearable augmentable reality apparatus of claim 20, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the transmitted second attachment information;

(i) is related to the object; and

(ii) can be browsed and exchanged.

25. The wearable augmentable reality apparatus of claim 20, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted second attachment information;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.

26. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:

(a) causing a processor to execute the instructions to cause a receiver to receive, from a second different wearable augmentable reality apparatus;

(i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and

(ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received;

(b) causing the processor to execute the instructions to store the received specific information and the first attachment information received from the input device;

(c) causing the processor to execute the instructions to read second attachment information that corresponds to the received specific information;

(d) causing the processor to execute the instructions to cause a transmitter to transmit, to the second different wearable augmentable reality apparatus, the second attachment information which relates to the specified situation in the physical environment and transmit time information to an information processing apparatus; and

(e) causing the processor to execute the instructions to cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

27. The method of claim 26, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

28. The method of claim 26, which includes causing the processor to execute the instructions to select the second attachment information based on a position in the physical environment.

29. The method of claim 26, which includes causing the processor to execute the instructions to select the second attachment information based on a received search condition.

30. The method of claim 26, wherein:

(a) the situation in the physical environment is includes an object in the physical environment;

(b) the specific information includes an ID attached to the object in the physical environment; and

(c) the transmitted second attachment information includes information that;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

31. The method of claim 26, wherein:

(a) the situation in the physical environment includes a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted second attachment information includes information that;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.

32. A non-transitory computer readable-medium storing instructions structured to cause a wearable augmentable reality apparatus to:

(a) receive, from a second different wearable augmentable reality apparatus;

(i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and

(ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received;

(b) store the received specific information and the first attachment information received from the input device;

(c) read second attachment information that corresponds to the received specific information;

(d) transmit, to the second different wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment and transmit time information to an information processing apparatus; and

(e) cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

88. The non-transitory computer readable-medium of claim 32, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

89. The non-transitory computer readable-medium of claim 32, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

90. The non-transitory computer readable-medium of claim 32, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

91. The non-transitory computer readable-medium of claim 32, wherein the instructions cause the wearable augmentable reality apparatus to enable a user to input a search condition, said second attachment information being selected based on said search condition.

92. The non-transitory computer readable-medium of claim 32, wherein said second attachment information is selected based on a position in the physical environment.

93. The non-transitory computer readable-medium of claim 32, wherein the first attachment information includes at least one of voice information, image information, and text information.

94. The non-transitory computer readable-medium of claim 32, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which

(i) is related to the object; and

(ii) can be browsed and exchanged.

95. The non-transitory computer readable-medium of claim 32, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

33. An information processing system comprising:

a first wearable augmentable reality apparatus; and

a second different wearable augmentable reality apparatus, the first wearable augmentable reality apparatus including first circuitry configured to control;

(a) a real-world-environment information recognizing unit to input specific information to specify a situation in the real world;

(b) an attachment information input unit, which is different from the real-world-environment information recognizing unit, to input attachment information, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the first wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received;

(d) a first transmitting unit to transmit the attachment information and the specific information to the second different wearable augmentable reality apparatus and transmit time information to an information processing apparatus;

(e) a searching unit to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit;

(f) a first receiving unit to receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and

(g) a display controlling unit to control to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

the second different wearable augmentable reality apparatus including a second circuitry configured to control;

(a) a second receiving unit to receive, from the first transmitting unit;

(i) the specific information; and

(ii) the attachment information;

(b) a storage unit configured to store the received specific information and the attachment information;

(c) a reader to read the further attachment information based on the further specific information inputted by the attachment information input unit; and

(d) a second transmitting unit to transmit the further attachment information read by the reader to the first wearable augmentable reality apparatus,

wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and

wherein the attachment information and further attachment information correspond to the transmitted time information.

34. The information processing system of claim 33, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

35. The information processing system of claim 33, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

36. The information processing system of claim 33, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

37. The information processing system of claim 33, which includes an input unit configured to enable a user to input a search condition, said further attachment information being selected based on said search condition.

38. The information processing system of claim 33, wherein said further attachment information is selected based on a position in the physical environment.

39. The information processing system of claim 33, wherein the attachment information includes at least one of voice information, image information, and text information.

40. The information processing system of claim 33, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object; and

(ii) can be browsed and exchanged.

41. The information processing system of claim 33, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

42. A wearable augmentable reality apparatus comprising:

a circuitry configured to control;

a real-world-environment information recognizing unit to input specific information to specify a situation in the real world;

an attachment information input unit, which is different from the real-world-environment information recognizing unit, to input attachment information, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received;

a transmitting unit to transmit the attachment information and the specific information to a second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmit time information to an information processing apparatus;

a searching unit to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit;

a receiving unit to receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and

a display controlling unit to control to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and

wherein the attachment information and further attachment information correspond to the transmitted time information.

43. The wearable augmentable reality apparatus of claim 42, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

44. The wearable augmentable reality apparatus of claim 42, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

45. The wearable augmentable reality apparatus of claim 42, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

46. The wearable augmentable reality apparatus of claim 42, which includes an input unit configured to enable a user to input a search condition, said further attachment information being selected based on said search condition.

48. The wearable augmentable reality apparatus of claim 42, wherein the attachment information includes at least one of voice information, image information, and text information.

49. The wearable augmentable reality apparatus of claim 42, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object; and

(ii) can be browsed and exchanged.

50. The wearable augmentable reality apparatus of claim 42, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

47. The wearable augmentable reality apparatus of 42, wherein said further attachment information is selected based on a position in the physical environment.

51. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:

(a) inputting specific information via a real-world-environment information recognizing unit to specify a situation in the real world;

(b) inputting attachment information via an attachment information input unit, which is different from the real-world-environment information recognizing unit, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received;

(c) transmitting the attachment information and the specific information to a second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmitting time information to an information processing apparatus;

(d) causing a processor to execute the instructions to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by an attachment information input unit;

(e) receiving the further attachment information transmitted from the second different wearable augmentable reality apparatus;

(f) causing a display unit to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and

wherein the attachment information and further attachment information correspond to the transmitted time information.

52. The method of claim 51, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

53. The method of claim 51, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

54. The method of claim 51, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

55. The method of claim 51, which includes causing the processor to execute the instructions to enable a user to input a search condition, said further attachment information being selected based on said search condition.

56. The method of claim 51, wherein said further attachment information is further selected based on a position in the physical environment.

57. The method of claim 51, wherein the attachment information includes at least one of voice information, image information, and text information.

58. The method of claim 51, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which;

(i) is related to the object in the physical environment; and

(ii) can be browsed and exchanged.

59. The method of claim 51, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

60. A non-transitory computer-readable medium storing instruction structured to cause a wearable augmentable reality apparatus to:

(a) input specific information via a real-world-environment information recognizing unit to specify a situation in the real world;

(b) input attachment information via an attachment information input unit, which is different from the real-world-environment information recognizing unit, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received;

(c) transmit the attachment information and the specific information to second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmit time information to an information processing apparatus;

(d) search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information which is input;

(e) receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and

(f) display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and

wherein the attachment information and further attachment information correspond to the transmitted time information.

96. The non-transitory computer readable-medium of claim 60, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

97. The non-transitory computer readable-medium of claim 60, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

98. The non-transitory computer readable-medium of claim 60, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

99. The non-transitory computer readable-medium of claim 60, wherein the instructions cause the wearable augmentable reality apparatus to enable a user to input a search condition, said second attachment information being selected based on said search condition.

100. The non-transitory computer readable-medium of claim 60, wherein said further attachment information is selected based on a position in the physical environment.

101. The non-transitory computer readable-medium of claim 60, wherein the attachment information includes at least one of voice information, image information, and text information.

102. The non-transitory computer readable-medium of claim 60, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the further attachment information includes information which

(i) is related to the object; and

(ii) can be browsed and exchanged.

103. The non-transitory computer readable-medium of claim 60, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received further attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.

61. A wearable augmentable reality apparatus comprising:

a circuitry configured to control;

a receiving unit to receive, from second different wearable augmentable reality apparatus;

(a) specific information, received from a real-world-environment information recognizing unit, to specify a situation in the real world; and

(b) attachment information, received from an input device which is different from the real-world-environment information recognizing unit, based on a user entry to the input device, attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received;

a storage unit to store the received specific information and the attachment information received from the input device;

a reader to read further attachment information based on further specific information inputted by the second different wearable augmentable reality apparatus;

a transmitter to transmit the further attachment information read by the reader to the second different wearable augmentable reality apparatus and transmit time information to an information processing apparatus; and

a display unit to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and

wherein the attachment information and further attachment information correspond to the transmitted time information.

62. The wearable augmentable reality apparatus of claim 61, wherein the specific information includes at least one of image information of the physical environment, position information of the physical environment, and object information of the physical environment.

63. The wearable augmentable reality apparatus of claim 61, the further attachment information is selected based on a received search condition.

64. The wearable augmentable reality apparatus of claim 61, the further attachment information is selected based on a position in the physical environment.

65. The wearable augmentable reality apparatus of claim 61, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the transmitted further attachment information;

(i) is related to the object; and

(ii) can be browsed and exchanged.

66. The wearable augmentable reality apparatus of claim 61, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the transmitted further attachment information;

(i) is related to the position in the physical environment; and

(ii) can be browsed and exchanged.

67. The wearable augmentable reality apparatus of claim 61, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

68. The wearable augmentable reality apparatus of claim 61, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

69. The wearable augmentable reality apparatus of claim 61, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

70. The wearable augmentable reality apparatus of claim 61, wherein the attachment information includes at least one of voice information, image information, and text information.

71. An information processing system comprising:

a first wearable augmentable reality apparatus; and

a second different wearable augmentable reality apparatus, the first wearable augmentable reality apparatus including;

a first processor configured to control a display device, a real-world-environment information recognizing unit, an input device which is different from the real-world-environment information recognizing unit, and a communication unit to;

(a) receive specific information from the real-world-environment information recognizing unit;

(b) specify a situation in a physical environment based on the received specific information;

(c) receive, from the input device, first attachment information relating to the specified situation in the physical environment based on a user entry to the input device, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received;

(d) attach the first attachment information received from the input device to the specified situation in the physical environment;

(e) transmit, to the second different wearable augmentable reality apparatus, the first attachment information and the specific information and transmit time information to an information processing apparatus;

(f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information;

(i) relating to the specified situation in the physical environment; and

(ii) corresponding to said transmitted specific information; and

(g) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus,

the second different wearable augmentable reality apparatus including;

a second processor configured to control a second communication unit to;

(a) receive, from the first wearable augmentable reality apparatus;

(i) the specific information for specifying a situation in a physical environment; and

(ii) the first attachment information attached to the specified situation in the physical environment based on the user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information;

(b) store the received specific information and the first attachment information received from the input device;

(c) read second attachment information that corresponds to the received specific information; and

(d) transmit, to the first wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment,

wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and

wherein the first and second attachment information correspond to the transmitted time information.

72. The information processing system of claim 71, wherein:

(a) the real-world-environment information recognizing unit includes an image input unit; and

(b) the specific information includes an image of the physical environment.

73. The information processing system of claim 71, wherein:

(a) the real-world-environment information recognizing unit includes a position detecting unit; and

(b) the specific information includes a position in the physical environment.

74. The information processing system of claim 71, wherein:

(a) the real-world-environment information recognizing unit includes an object identifying unit; and

(b) the specific information includes an object in the physical environment.

75. The information processing system of claim 71, wherein the processor is configured to operate with the input device to enable a user to input a search condition, said second attachment information being selected based on said search condition.

76. The information processing system of claim 71, wherein said second attachment information is selected based on a position in the physical environment.

77. The information processing system of claim 71, wherein the first attachment information includes at least one of voice information, image information, and text information.

78. The information processing system of claim 71, wherein:

(a) the situation in the physical environment is associated with an object in the physical environment;

(b) the specific information includes an ID associated with the object; and

(c) the second attachment information includes information which

(i) is related to the object; and

(ii) can be browsed and exchanged.

79. The information processing system of claim 71, wherein:

(a) the situation in the physical environment is associated with a position in the physical environment;

(b) the specific information includes position information of the physical environment; and

(c) the received second attachment information includes information which;

(i) is related to the position; and

(ii) can be browsed and exchanged.