Mobile terminal, server device, community generation system, display control method, and program

• US 8,743,144 B2
• Filed: 05/24/2010
• Issued: 06/03/2014
• Est. Priority Date: 06/11/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Takeshita, Kazutaka
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US12/785,655
• Publication Number:
  US 20100315433A1
• Time in Patent Office: 1,471 Days
• Field of Search: 701207-208, 701/438, 705/10, 705 1456- 1458, 715738-743
• US Class Current: 345/632
• CPC Class Codes: G06Q 10/109 Time management, e.g. calendars, reminders, meetings or time accounting
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

There is provided a mobile terminal including a movement information acquisition section for acquiring movement information of a mobile terminal possessed by a user, a picked-up image acquisition section for acquiring a peripheral image of the mobile terminal, which is imaged by an imaging device, a transmission section for transmitting the movement information acquired by the movement information acquisition section to a server device which is connected to the mobile terminal via a network, a reception section for receiving community information which is generated by the server device based on a history of the movement information and which can be shared between the user possessing the mobile terminal and another user other than the user possessing the mobile terminal, and a display control section for displaying, on a display screen, a displayed image included in the community information in a superimposed manner on a peripheral image of the mobile terminal.

Claims

1. A mobile terminal comprising:

a movement information acquisition section for acquiring movement information of a mobile terminal possessed by a user;

a picked-up image acquisition section for acquiring a peripheral image of the mobile terminal, the peripheral image being imaged by an imaging device;

a transmission section for transmitting the movement information acquired by the movement information acquisition section to a server device connected to the mobile terminal via a network;

a reception section for receiving community information generated by the server device, based on a history of movement information that is determined to be common to both the user possessing the mobile terminal and another user, the community information being sharable between the user possessing the mobile terminal and the other user; and

a display control section for displaying, on a display screen, an image included in the community information received by the reception section, in a superimposed manner, on a peripheral image of the mobile terminal acquired by the picked-up image acquisition section,

wherein a history of movement information of the mobile terminal user is switched from being inaccessible to accessible to at least one user belonging to a group of users associated with the mobile terminal user through a common entity, the switch happening at a time when the mobile terminal enters a structure usually occupied by members of the group during a certain time-span, the time of entry falling within the time-span, and the at least one user being present within the structure at the time of entry.

2. The mobile terminal according to claim 1,

wherein the server device stores histories of movement information of a plurality of users other than the user possessing the mobile terminal.

3. The mobile terminal according to claim 1, wherein the movement information acquisition section acquires movement information including position information of the mobile terminal and time information at which the position information is acquired.

4. The mobile terminal according to claim 3, wherein, when a history of position information is common to the user possessing the mobile terminal and the other user, the community information is generated by the server device by using the common history of position information.

5. The mobile terminal according to claim 4, wherein the history of the movement information of the other user used for generating the community information is a history of the movement information of a user having at least one attribute in common with the user possessing the mobile terminal.

6. The mobile terminal according to claim 4, wherein the history of the movement information of the other user used for generating the community information is a history of the movement information of a registered user.

7. The mobile terminal according to claim 4, wherein the history of the movement information of the other user used for generating the community information is a history of the movement information which can be opened to the public.

8. The mobile terminal according to claim 4, wherein, when the position information included in a predetermined position area is common to the user possessing the mobile terminal and the other user, the community information is generated by the server device by using the common position information.

9. The mobile terminal according to claim 1, wherein, when the community information received by the reception section comprises position information in a predetermined position area, the display control section displays the community information on the display screen.

10. The mobile terminal according to claim 1, further comprising an angle/direction information acquisition section for acquiring angle/direction information of the mobile terminal,

wherein the display control section superimposes an image included in the community information on the peripheral image acquired by the picked-up image acquisition section, based on the angle/direction information acquired by the angle/direction information acquisition section.

11. The mobile terminal according to claim 10,

wherein the angle/direction information acquisition section acquires angle/direction information including an azimuth of a user corresponding to an angle/direction of the mobile terminal, and

wherein the display control section superimposes an image included in the community information which corresponds to the azimuth of the user, on the peripheral image imaged by the imaging device.

12. A server device comprising:

a reception section for receiving movement information of mobile terminals possessed by a plurality of users from the respective mobile terminals;

a recording section for accumulating a history of the movement information received by the reception section with respect to each user and recording the history in a storage medium; and

a community information generation section for generating community information which can be shared between one user and another user, based on the history of the movement information with respect to each user recorded in the storage medium;

wherein the community information is generated by using a history of movement information that is determined to be common to the one user and the other user, and

wherein a history of movement information of the one user is switched from being inaccessible to accessible to at least another user belonging to a group of users associated with the one user through a common entity, the switch happening at a time when a mobile terminal of the one user enters a structure usually occupied by members of the group during a certain time-span, the time of entry falling within the time-span, and the at least another user being present within the structure at the time of entry.

13. An information processing system comprising:

a mobile terminal possessed by a user comprising;

a movement information acquisition section for acquiring movement information of the mobile terminal,

a picked-up image acquisition section for acquiring a peripheral image of the mobile terminal imaged by an imaging device, and

a transmission section for transmitting the movement information acquired by the movement information acquisition section to a server device connected to the mobile terminal via a network; and

the server device comprising;

a reception section for receiving movement information of a plurality of mobile terminals possessed by a plurality of users associated with the plurality of mobile terminals,

a recording section for accumulating a history of the movement information received by the reception section with respect to each of the plurality of users and recording the history in a storage medium, and

a community information generation section for generating community information which is sharable between one user and another user, based on the history of the movement information with respect to each user recorded in the storage medium, wherein the community information is generated by using a history of movement information that is determined to be common to the one user and the other user,

wherein the mobile terminal includes

a reception section for receiving the community information generated by the server device, and

a display control section for displaying, on a display screen, an image included in the community information received by the reception section, in a superimposed manner on a peripheral image of the mobile terminal acquired by the picked-up image acquisition section,

wherein a history of movement information of the mobile terminal user is switched from being inaccessible to accessible to at least another user belonging to a group of users associated with the mobile terminal user through a common entity, the switch happening at a time when the mobile terminal enters a structure usually occupied by members of the group during a certain time-span, the time of entry falling within the time-span, and the at least another user being present within the structure at the time of entry.

14. A display control method for community information in a mobile terminal possessed by a user, comprising the steps of:

acquiring movement information of the mobile terminal;

acquiring a peripheral image of the mobile terminal, which is imaged by an imaging device;

transmitting the acquired movement information to a server device which is connected to the mobile terminal via a network;

receiving community information which is generated by the server device, based on a history of the movement information that is determined to be common to both the user possessing the mobile terminal and another user, the community information being sharable between the user possessing the mobile terminal and the other user; and

displaying, on a display screen, an image included in the received community information, in a superimposed manner on the acquired peripheral image of the mobile terminal,

wherein a history of movement information of the user possessing the mobile terminal is switched from being inaccessible to accessible to at least another user belonging to a group of users associated with the user possessing the mobile terminal through a common entity, the switch happening at a time when the mobile terminal enters a structure usually occupied by members of the group during a certain time-span, the time of entry falling within the time-span, and the at least another user being present within the structure at the time of entry.

15. A non-transitory computer readable medium comprising program code for causing a computer to perform steps comprising:

acquiring movement information of a mobile terminal possessed by a user,

acquiring a peripheral image of the mobile terminal, which is imaged by an imaging device,

transmitting the acquired movement information to a server device which is connected to the mobile terminal via a network,

receiving community information generated by the server device based on a history of the movement information that is determined to be common to both the user possessing the mobile terminal and another user, the community information being sharable between the user possessing the mobile terminal and the other user, and

displaying, on a display screen, an image included in the received community information, in a superimposed manner on the acquired peripheral image of the mobile terminal,

wherein a history of movement information of the mobile terminal user is switched from being inaccessible to accessible to at least another user belonging to a group of users associated with the mobile terminal user through a common entity, the switch happening at a time when the mobile terminal enters a structure usually occupied by members of the group during a certain time-span, the time of entry falling within the time-span, and the at least another user being present within the structure at the time of entry.