INFORMATION PROCESSING APPARATUS AND METHOD, INFORMATION PROCESSING SYSTEM, AND PROVIDING MEDIUM

• US 20130067337A1
• Filed: 10/25/2012
• Published: 03/14/2013
• Est. Priority Date: 10/19/1998
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi
• Granted Patent: US 9,575,556 B2
• Time in Patent Office: Days
• US Class Current: 715/733
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The invention enables users to virtually attach information to situations in the real world, and also enables users to quickly and easily find out desired information. An IR sensor receives an IR signal transmitted from an IR beacon, and supplies the received signal to a sub-notebook PC. A CCD video camera takes in a visual ID from an object, and supplies the inputted visual ID to the sub-notebook PC. A user inputs, through a microphone, a voice to be attached to situations in the real world. The sub-notebook PC transmits position data, object data and voice data, which have been supplied to it, to a server through a communication unit. The transmitted data is received by the server via a wireless LAN. The server stores the received voice data in a database in correspondence to the position data and the object data.

Claims

1. A user device comprising:

at least one processing unit configured to;

transmit position information indicating a physical position to a first information processing apparatus;

receive attachment information corresponding to the transmitted position information from a second information processing apparatus; and

control a display to display the attachment information,

wherein the attachment information includes information inputted by a user using at least one of the user device and another user device.

2. A user device according to claim 1, wherein the at least one processing unit is further configured to:

control the display to display a combined image including image data and the attachment information.

3. A user device according to claim 2, wherein the at least one processing unit is further configured to:

receive the image data; and

generate the combined image by combining the image data and the attachment information.

4. A user device according to claim 1, wherein the at least one processing unit is further configured to:

start application software.

5. A user device according to claim 1, wherein the attachment information includes an advertisement.

6. A user device according to claim 1, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

7. A user device according to claim 1, wherein the processing unit is further configured to:

control the display to display a first area that varies when the position information changes, and to display a second area that includes information independent of a change in the position information.

8. A user device according to claim 1, wherein the at least one processing unit is further configured to:

cause the display to display the attachment information as an icon.

9. A user device according to claim 1, wherein the at least one processing unit is further configured to:

input new attachment information to be attached to the position information.

10. A user device according to claim 9, wherein the new attachment information to be attached to the position information is input based on a user operation.

11. A user device according to claim 10, wherein the user operation is a drag and drop operation.

12. A user device according to claim 9, wherein the new attachment information is accessible by at least one other user device.

13. A user device according to claim 1, wherein the attachment information includes personal information.

14. A user device according to claim 13, wherein the at least one processing unit is further configured to:

control the display to display a personal information area and another area, wherein the personal information is displayed in the personal information area.

15. A user device according to claim 1, wherein the attachment information includes time information indicating at least one of a date and a time.

16. A user device according to claim 1, wherein the attachment information includes a URL.

17. A user device according to claim 1, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

18. A user device according to claim 1, wherein the attachment information includes at least one of image data, text data, and audio data.

19. A user device according to claim 1, wherein the at least one processing unit is further configured to:

transmit time information to the first information processing apparatus,

wherein the received attachment information corresponds to the transmitted time information.

20. A user device according to claim 1, wherein the at least one processing unit is further configured to:

control the display to display a search field.

21. A user device according to claim 1, wherein the attachment information includes at least one of distance information and direction information, and

the at least one processing unit is further configured to:

cause the display to display the at least one of the distance information and the direction information.

22. A user device according to claim 21, wherein the at least one processing unit is further configured to:

cause the display to display the distance information and the direction information simultaneously.

23. A user device according to claim 1, wherein the first information processing apparatus and the second information processing apparatus are a same apparatus.

24. A user device according to claim 1, further comprising:

a GPS device configured to detect the physical position,

wherein the at least one processor is further configured to;

generate the position information based on the detection by the GPS device.

25. A user device according to claim 1, wherein the at least one processing unit is further configured to:

at least one of transmit the position information to the first information processing apparatus via wireless LAN and receive the attachment information from the second information processing apparatus via wireless LAN.

26. An information processing method comprising:

transmitting, by a user device, position information indicating a physical position to a first information processing apparatus;

receiving, by the user device, attachment information corresponding to the transmitted position information from a second information processing apparatus; and

controlling, by the user device, a display to display the attachment information,

wherein the attachment information includes information inputted by a user using at least one of the user device and another user device.

27. An information processing method according to claim 26, further comprising:

controlling the display to display a combined image including image data and the attachment information.

28. An information processing method according to claim 27, further comprising:

receiving the image data; and

generating the combined image by combining the image data and the attachment information.

29. An information processing method according to claim 26, further comprising:

starting application software.

30. An information processing method according to claim 26, wherein the attachment information includes an advertisement.

31. An information processing method according to claim 26, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

32. An information processing method according to claim 26, further comprising:

controlling the display to display a first area that varies when the position information changes, and to display a second area that includes information independent of a change in the position information.

33. An information processing method according to claim 26, further comprising:

causing the display to display the attachment information as an icon.

34. An information processing method according to claim 26, further comprising:

inputting new attachment information to be attached to the position information.

35. An information processing method according to claim 34, wherein the new attachment information to be attached to the position information is input based on a user operation.

36. An information processing method according to claim 35, wherein the user operation is a drag and drop operation.

37. An information processing method according to claim 34, wherein the new attachment information is accessible by at least one other user device.

38. An information processing method according to claim 26, wherein the attachment information includes personal information.

39. An information processing method according to claim 38, further comprising:

controlling the display to display a personal information area and another area, wherein the personal information is displayed in the personal information area.

40. An information processing method according to claim 26, wherein the attachment information includes time information indicating at least one of a date and a time.

41. An information processing method to claim 26, wherein the attachment information includes a URL.

42. An information processing method according to claim 26, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

43. An information processing method according to claim 26, wherein the attachment information includes at least one of image data, text data, and audio data.

44. An information processing method according to claim 26, further comprising:

transmitting time information to the first information processing apparatus,

wherein the received attachment information corresponds to the transmitted time information.

45. An information processing method according to claim 26, further comprising:

controlling the display to display a search field.

46. An information processing method according to claim 26, wherein the attachment information includes at least one of distance information and direction information, and

causing the display to display the at least one of the distance information and the direction information.

47. An information processing method according to claim 46, further comprising:

causing the display to display the distance information and the direction information simultaneously.

48. An information processing method according to claim 26, wherein the first information processing apparatus and the second information processing apparatus are a same apparatus.

49. An information processing method according to claim 26, further comprising:

detecting, via a GPS device, the physical position; and

generating the position information based on the detection by the GPS device.

50. An information processing method according to claim 26, further comprising:

at least one of transmitting the position information to the first information processing apparatus via wireless LAN and receiving the attachment information from the second information processing apparatus via wireless LAN.

51. A non-transitory computer readable storage medium storing a computer program for causing a user device to:

transmit position information indicating a physical position to a first information processing apparatus;

receive attachment information corresponding to the transmitted position information from a second information processing apparatus; and

control a display to display the attachment information,

wherein the attachment information includes information inputted by a user using at least one of the user device and another user device.

52. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

control the display to display a combined image including image data and the attachment information.

53. A non-transitory computer readable storage medium according to claim 52, further causing the user device to:

receive the image data; and

generate the combined image by combining the image data and the attachment information.

54. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

start application software.

55. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes an advertisement.

56. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

57. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

control the display to display a first area that varies when the position information changes, and to display a second area that includes information independent of a change in the position information.

58. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

cause the display to display the attachment information as an icon.

59. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

input new attachment information to be attached to the position information.

60. A non-transitory computer readable storage medium according to claim 59, wherein the new attachment information to be attached to the position information is input based on a user operation.

61. A non-transitory computer readable storage medium according to claim 60, wherein the user operation is a drag and drop operation.

62. A non-transitory computer readable storage medium according to claim 59, wherein the new attachment information is accessible by at least one other user device.

63. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes personal information.

64. A non-transitory computer readable storage medium according to claim 63, further causing the user device to:

control the display to display a personal information area and another area, wherein the personal information is displayed in the personal information area.

65. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes time information indicating at least one of a date and a time.

66. A non-transitory computer readable storage medium to claim 51, wherein the attachment information includes a URL.

67. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

68. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes at least one of image data, text data, and audio data.

69. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

transmit time information to the first information processing apparatus,

wherein the received attachment information corresponds to the transmitted time information.

70. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

control the display to display a search field.

71. A non-transitory computer readable storage medium according to claim 51, wherein the attachment information includes at least one of distance information and direction information, and

further causing the user device to:

cause the display to display the at least one of the distance information and the direction information.

72. A non-transitory computer readable storage medium according to claim 71, further causing the user to:

cause the display to display the distance information and the direction information simultaneously.

73. A non-transitory computer readable storage medium according to claim 51, wherein the first information processing apparatus and the second information processing apparatus are a same apparatus.

74. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

detect, via a GPS device, the physical position; and

generate the position information based on the detection by the GPS device.

75. A non-transitory computer readable storage medium according to claim 51, further causing the user device to:

at least one of transmit the position information to the first information processing apparatus via wireless LAN and receive the attachment information from the second information processing apparatus via wireless LAN.

76. An information processing device comprising:

a storage device configured to store position information indicating a physical position and corresponding attachment information, wherein the attachment information includes information inputted by a user using a user device; and

at least one processing unit configured to;

receive position information from at least one of the user device and another user device;

transmit the stored attachment information corresponding to the received position information to the at least of the user device and the other user device.

77. An information processing device according to claim 76, wherein the attachment information includes an advertisement.

78. An information processing device according to claim 76, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

79. An information processing device according to claim 76, wherein the attachment information includes an icon to be displayed.

80. An information processing device according to claim 76, wherein the at least one processing unit is further configured to:

receive new attachment information associated to the position information from the user device; and

store the new attachment information in the storage device.

81. An information processing device according to claim 80, wherein the new attachment associated to the position information is input at the user device by a user operation.

82. An information processing device according to claim 81, wherein the user operation is a drag and drop operation.

83. An information processing device according to claim 80, wherein the new attachment information is accessible from the storage device by at least one other user device.

84. An information processing device according to claim 76, wherein the attachment information includes personal information.

85. An information processing device according to claim 76, wherein the attachment information includes time information indicating at least one of a date and a time.

86. An information processing device according to claim 76, wherein the attachment information includes a URL.

87. An information processing device according to claim 76, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

88. An information processing device according to claim 76, wherein the attachment information includes at least one of image data, text data, and audio data.

89. An information processing device according to claim 76, wherein the at least one processing unit is further configured to:

receive time information from the at least one of the user device and the other user device,

wherein the transmitted attachment information corresponds to the received time information.

90. An information processing device according to claim 76, wherein the at least one processing unit is further configured to:

receive a search request from the at least one of the user device and the other user device.

91. An information processing device according to claim 76, wherein the attachment information includes at least one of distance information and direction information.

92. An information processing device according to claim 76, wherein the at least one processing unit is further configured to:

at least one of receive the position information from the at least one of the user device and the other user device via wireless LAN, and transmit the attachment information to the at least one of the user device and the other user device via wireless LAN.

93. An information processing method comprising:

storing, by a storage device, position information indicating a physical position and corresponding attachment information, wherein the attachment information includes information inputted by a user using a user device;

receiving, by an information processing device, position information from at least one of the user device and another user device; and

transmitting the stored attachment information corresponding to the received position information to the at least of the user device and the other user device.

94. An information processing method according to claim 93, wherein the attachment information includes an advertisement.

95. An information processing method according to claim 93, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

96. An information processing method according to claim 93, wherein the attachment information includes an icon to be displayed.

97. An information processing method according to claim 93, further comprising:

receiving new attachment information associated to the position information from the user device; and

storing the new attachment information in the storage device.

98. An information processing method according to claim 97, wherein the new attachment information associated to the position information is input at the user device by a user operation.

99. An information processing method according to claim 98, wherein the user operation is a drag and drop operation.

100. An information processing method according to claim 97, wherein the new attachment information is accessible from the storage device by at least one other user device.

101. An information processing method according to claim 93, wherein the attachment information includes personal information.

102. An information processing method according to claim 93, wherein the attachment information includes time information indicating at least one of a date and a time.

103. An information processing method according to claim 93, wherein the attachment information includes a URL.

104. An information processing method according to claim 93, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

105. An information processing method according to claim 93, wherein the attachment information includes at least one of image data, text data, and audio data.

106. An information processing method according to claim 93, further comprising:

receiving time information from the at least one of the user device and the other user device,

wherein the transmitted attachment information corresponds to the received time information.

107. An information processing method according to claim 93, further comprising:

receiving a search request from the at least one of the user device and the other user device.

108. An information processing method according to claim 93, wherein the attachment information includes at least one of distance information and direction information.

109. An information processing method according to claim 93, further comprising:

at least one of receiving the position information from the at least one of the user device and the other user device via wireless LAN, and transmitting the attachment information to the at least one of the user device and the other user device via wireless LAN.

110. A non-transitory computer readable storage medium storing a computer program for causing an information processing device to:

store position information indicating a physical position and corresponding attachment information, wherein the attachment information includes information inputted by a user using a user device;

receive position information from at least one of the user device and another user device; and

transmit the stored attachment information corresponding to the received position information to the at least of the user device and the other user device.

111. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes an advertisement.

112. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes information related to at least one of a virtual community, an information exchange service, and an on-line bulletin board.

113. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes an icon to be displayed.

114. A non-transitory computer readable storage medium according to claim 110, further causing the information processing device to:

receive new attachment information associated to the position information from the user device; and

store the new attachment information in the storage device.

115. A non-transitory computer readable storage medium according to claim 114, wherein the new attachment information associated to the position information is input at the user device by a user operation.

116. A non-transitory computer readable storage medium according to claim 115, wherein the user operation is a drag and drop operation.

117. A non-transitory computer readable storage medium according to claim 114, wherein the new attachment information is accessible from the storage device by at least one other user device.

118. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes personal information.

119. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes time information indicating at least one of a date and a time.

120. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes a URL.

121. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes information related to other physical positions near the physical position indicated by the transmitted position information.

122. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes at least one of image data, text data, and audio data.

123. A non-transitory computer readable storage medium according to claim 110, further causing the information processing apparatus to:

receive time information from the at least one of the user device and the other user device,

wherein the transmitted attachment information corresponds to the received time information.

124. A non-transitory computer readable storage medium according to claim 110, further causing the information processing apparatus to:

receive a search request from the at least one of the user device and the other user device.

125. A non-transitory computer readable storage medium according to claim 110, wherein the attachment information includes at least one of distance information and direction information.

126. A non-transitory computer readable storage medium according to claim 110, further causing the information processing apparatus to:

at least one of receive the position information from the at least one of the user device and the other user device via wireless LAN, and transmit the attachment information to the at least one of the user device and the other user device via wireless LAN.