Information processing apparatus and method, information processing system, and providing medium
First Claim
1. A wearable augmentable reality apparatus comprising:
- a processor configured to control a display device, a real-world-environment information recognizing unit, an input device which is different from the real-world-environment information recognizing unit, and a communication unit to;
(a) receive specific information from the real-world-environment information recognizing unit;
(b) specify a situation in a physical environment based on the received specific information;
(c) receive, from at least one of the input device and an information processing apparatus, first attachment information relating to the specified situation in the physical environment, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device;
(d) attach the first attachment information to the specified situation in the physical environment;
(e) transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information;
(f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information;
(i) relating to the specified situation in the physical environment; and
(ii) corresponding to said transmitted specific information;
(g) transmit time information to an information processing apparatus; and
(h) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus,wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, andwherein the first and second attachment information correspond to the transmitted time information.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.
185 Citations
103 Claims
-
1. A wearable augmentable reality apparatus comprising:
-
a processor configured to control a display device, a real-world-environment information recognizing unit, an input device which is different from the real-world-environment information recognizing unit, and a communication unit to; (a) receive specific information from the real-world-environment information recognizing unit; (b) specify a situation in a physical environment based on the received specific information; (c) receive, from at least one of the input device and an information processing apparatus, first attachment information relating to the specified situation in the physical environment, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device; (d) attach the first attachment information to the specified situation in the physical environment; (e) transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information; (f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information; (i) relating to the specified situation in the physical environment; and (ii) corresponding to said transmitted specific information; (g) transmit time information to an information processing apparatus; and (h) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:
-
(a) causing a processor to execute the instructions to cause a real-world-environment information recognizing unit to receive specific information; (b) causing the processor to execute the instructions to specify a situation in a physical environment; (c) causing the processor to execute the instructions to receive, from at least one of an input device and an information processing apparatus which is different from the real-world-environment information recognizing unit, first attachment information relating to the specified situation in the physical environment, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device; (d) causing the processor to execute the instructions to attach the first attachment information to the specified situation in the physical environment; (e) causing the processor to execute the instructions to cause a transmitter to transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information and to transmit time information to an information processing apparatus; causing the processor to execute the instructions to cause a receiver to receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information; (i) relating to the specified situation in the physical environment; and (ii) corresponding to said transmitted specific information; and (g) causing the processor to execute the instructions to cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer readable-medium storing instructions structured to cause a wearable augmentable reality apparatus to:
-
(a) receive specific information from a real-world-environment information recognizing unit; (b) specify a situation in a physical environment based on the received specific information; (c) receive, from an input device which is different from the real-world-environment information recognizing unit, first attachment information relating to the specified situation in the physical environment based on a user entry to the input device, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received; (d) attach the first attachment information received from the input device to the specified situation in the physical environment; (e) transmit, to a second different wearable augmentable reality apparatus, the first attachment information and the specific information; (f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information; (i) relating to the specified situation in the physical environment; and (ii) corresponding to said transmitted specific information; (g) transmit time information to an information processing apparatus, and (h) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (80, 81, 82, 83, 84, 85, 86, 87)
-
-
20. A wearable augmentable reality apparatus comprising:
-
a processor configured to control a communication unit to; (a) receive, from a second different wearable augmentable reality apparatus; (i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and (ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received; (b) store the received specific information and the first attachment information received from the input device; (c) read second attachment information that corresponds to the received specific information; (d) transmit, to the second different wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment and transit time information to an information processing apparatus; and (e) cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:
-
(a) causing a processor to execute the instructions to cause a receiver to receive, from a second different wearable augmentable reality apparatus; (i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and (ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received; (b) causing the processor to execute the instructions to store the received specific information and the first attachment information received from the input device; (c) causing the processor to execute the instructions to read second attachment information that corresponds to the received specific information; (d) causing the processor to execute the instructions to cause a transmitter to transmit, to the second different wearable augmentable reality apparatus, the second attachment information which relates to the specified situation in the physical environment and transmit time information to an information processing apparatus; and (e) causing the processor to execute the instructions to cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (27, 28, 29, 30, 31)
-
-
32. A non-transitory computer readable-medium storing instructions structured to cause a wearable augmentable reality apparatus to:
-
(a) receive, from a second different wearable augmentable reality apparatus; (i) specific information, received from a real-world-environment information recognizing unit, for specifying a situation in a physical environment; and (ii) first attachment information, received from an input device which is different from the real-world-environment information recognizing unit, attached to the specified situation in the physical environment based on a user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received; (b) store the received specific information and the first attachment information received from the input device; (c) read second attachment information that corresponds to the received specific information; (d) transmit, to the second different wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment and transmit time information to an information processing apparatus; and (e) cause a display device to display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the wearable augmentable reality apparatus, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (88, 89, 90, 91, 92, 93, 94, 95)
-
-
33. An information processing system comprising:
-
a first wearable augmentable reality apparatus; and a second different wearable augmentable reality apparatus, the first wearable augmentable reality apparatus including first circuitry configured to control; (a) a real-world-environment information recognizing unit to input specific information to specify a situation in the real world; (b) an attachment information input unit, which is different from the real-world-environment information recognizing unit, to input attachment information, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the first wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received; (d) a first transmitting unit to transmit the attachment information and the specific information to the second different wearable augmentable reality apparatus and transmit time information to an information processing apparatus; (e) a searching unit to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit; (f) a first receiving unit to receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and (g) a display controlling unit to control to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus including a second circuitry configured to control; (a) a second receiving unit to receive, from the first transmitting unit; (i) the specific information; and (ii) the attachment information; (b) a storage unit configured to store the received specific information and the attachment information; (c) a reader to read the further attachment information based on the further specific information inputted by the attachment information input unit; and (d) a second transmitting unit to transmit the further attachment information read by the reader to the first wearable augmentable reality apparatus, wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and wherein the attachment information and further attachment information correspond to the transmitted time information. - View Dependent Claims (34, 35, 36, 37, 38, 39, 40, 41)
-
-
42. A wearable augmentable reality apparatus comprising:
-
a circuitry configured to control; a real-world-environment information recognizing unit to input specific information to specify a situation in the real world; an attachment information input unit, which is different from the real-world-environment information recognizing unit, to input attachment information, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received; a transmitting unit to transmit the attachment information and the specific information to a second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmit time information to an information processing apparatus; a searching unit to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by the attachment information input unit; a receiving unit to receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and a display controlling unit to control to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and wherein the attachment information and further attachment information correspond to the transmitted time information. - View Dependent Claims (43, 44, 45, 46, 48, 49, 50)
-
-
47. The wearable augmentable reality apparatus of 42, wherein said further attachment information is selected based on a position in the physical environment.
-
51. A method of operating a wearable augmentable reality apparatus including instructions, the method comprising:
-
(a) inputting specific information via a real-world-environment information recognizing unit to specify a situation in the real world; (b) inputting attachment information via an attachment information input unit, which is different from the real-world-environment information recognizing unit, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received; (c) transmitting the attachment information and the specific information to a second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmitting time information to an information processing apparatus; (d) causing a processor to execute the instructions to search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information inputted by an attachment information input unit; (e) receiving the further attachment information transmitted from the second different wearable augmentable reality apparatus; (f) causing a display unit to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and wherein the attachment information and further attachment information correspond to the transmitted time information. - View Dependent Claims (52, 53, 54, 55, 56, 57, 58, 59)
-
-
60. A non-transitory computer-readable medium storing instruction structured to cause a wearable augmentable reality apparatus to:
-
(a) input specific information via a real-world-environment information recognizing unit to specify a situation in the real world; (b) input attachment information via an attachment information input unit, which is different from the real-world-environment information recognizing unit, based on a user entry to the attachment information input unit, to be attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received; (c) transmit the attachment information and the specific information to second different wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus storing the attached information that is associated with the specific information and transmit time information to an information processing apparatus; (d) search the second different wearable augmentable reality apparatus to acquire further attachment information based on further specific information which is input; (e) receive the further attachment information transmitted from the second different wearable augmentable reality apparatus; and (f) display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and wherein the attachment information and further attachment information correspond to the transmitted time information. - View Dependent Claims (96, 97, 98, 99, 100, 101, 102, 103)
-
-
61. A wearable augmentable reality apparatus comprising:
-
a circuitry configured to control; a receiving unit to receive, from second different wearable augmentable reality apparatus; (a) specific information, received from a real-world-environment information recognizing unit, to specify a situation in the real world; and (b) attachment information, received from an input device which is different from the real-world-environment information recognizing unit, based on a user entry to the input device, attached to the situation in the real world specified by the specific information, the attachment information being different than the specific information, wherein the second wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the attachment information is received; a storage unit to store the received specific information and the attachment information received from the input device; a reader to read further attachment information based on further specific information inputted by the second different wearable augmentable reality apparatus; a transmitter to transmit the further attachment information read by the reader to the second different wearable augmentable reality apparatus and transmit time information to an information processing apparatus; and a display unit to display an image with the attachment information and the further attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, wherein the current position of the first wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the attachment information and the further attachment information, and wherein the attachment information and further attachment information correspond to the transmitted time information. - View Dependent Claims (62, 63, 64, 65, 66, 67, 68, 69, 70)
-
-
71. An information processing system comprising:
-
a first wearable augmentable reality apparatus; and a second different wearable augmentable reality apparatus, the first wearable augmentable reality apparatus including; a first processor configured to control a display device, a real-world-environment information recognizing unit, an input device which is different from the real-world-environment information recognizing unit, and a communication unit to; (a) receive specific information from the real-world-environment information recognizing unit; (b) specify a situation in a physical environment based on the received specific information; (c) receive, from the input device, first attachment information relating to the specified situation in the physical environment based on a user entry to the input device, the first attachment information being different than the specific information, wherein the wearable augmentable reality apparatus is a wearable unit that includes both of the real-world-environment information recognizing unit from which the specific information is received and the input device from which the first attachment information is received; (d) attach the first attachment information received from the input device to the specified situation in the physical environment; (e) transmit, to the second different wearable augmentable reality apparatus, the first attachment information and the specific information and transmit time information to an information processing apparatus; (f) receive second attachment information from the second different wearable augmentable reality apparatus, the second attachment information; (i) relating to the specified situation in the physical environment; and (ii) corresponding to said transmitted specific information; and (g) display an image with the first and second attachment information along with distance scale information and direction information based on a current position of the first wearable augmentable reality apparatus, the second different wearable augmentable reality apparatus including; a second processor configured to control a second communication unit to; (a) receive, from the first wearable augmentable reality apparatus; (i) the specific information for specifying a situation in a physical environment; and (ii) the first attachment information attached to the specified situation in the physical environment based on the user entry to the input device, the first attachment information relating to the specified situation in the physical environment, and the first attachment information being different than the specific information; (b) store the received specific information and the first attachment information received from the input device; (c) read second attachment information that corresponds to the received specific information; and (d) transmit, to the first wearable augmentable reality apparatus, the second attachment information relating to the specified situation in the physical environment, wherein the current position of the wearable augmentable reality apparatus is provided in a center of the image and the distance scale information indicates a distance between the center and the first and second attachment information, and wherein the first and second attachment information correspond to the transmitted time information. - View Dependent Claims (72, 73, 74, 75, 76, 77, 78, 79)
-
Specification