STORAGE MEDIUM STORING PANORAMIC IMAGE DISPLAY PROGRAM, PANORAMIC IMAGE DISPLAY DEVICE, PANORAMIC IMAGE DISPLAY SYSTEM, AND PANORAMIC IMAGE DISPLAY METHOD

• US 20140354683A1
• Filed: 05/20/2014
• Published: 12/04/2014
• Est. Priority Date: 05/31/2013
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: SUZUKI, Toshiaki, KIRA, Satoshi, UMEHARA, Akihiro
• Granted Patent: US 9,904,982 B2
• Time in Patent Office: Days
• US Class Current: 345/632
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20212 Image combination
• CPC Class Codes: G06T 3/067 Reshaping or unfolding 3D tree structures onto 2D planes
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]

Abstract

An example of an information processing system displays, on a display device, a plurality of panoramic images associated with locations on a map. Here, a predetermined virtual object is set for at least one of the plurality of panoramic images. an information processing system 1 determines one of the locations on the map as a current location based on a user operation. Where the virtual object is set for a panoramic image associated with the current location, the virtual object is placed at a predetermined position of the panoramic image. The information processing system 1 displays, on the display device, an image of a partial area of the panoramic image associated with the current location. A predetermined information process is performed in response to satisfaction of a predetermined condition regarding the virtual object while the panoramic image for which the virtual object is set is displayed.

Claims

1. A non-transitory computer-readable storage medium storing a panoramic image display program to be executed on a computer of an information processing device for displaying, on a display device, a plurality of panoramic images associated with locations on a map,

wherein a predetermined virtual object is set for at least one of the plurality of panoramic images,

the panoramic image display program causing the computer to execute:

determining one of the locations on the map as a current location based on a user operation;

where the virtual object is set for a panoramic image associated with the current location, placing the virtual object at a predetermined position of the panoramic image;

displaying, on the display device, an image of a partial area of the panoramic image associated with the current location, wherein the partial area is determined in response to a user operation; and

performing a predetermined information process in response to satisfaction of a predetermined condition regarding the virtual object while the panoramic image for which the virtual object is set is displayed.

2. The storage medium according to claim 1, wherein the computer obtains data of a panoramic image provided in advance in the information processing device or another information processing device, obtains data of the virtual object provided in advance in the information processing device or another information processing device, and displays, on the display device, the image of the partial area of the panoramic image using the obtained data.

3. The storage medium according to claim 1, wherein:

a virtual object is set for each of two or more of the plurality of panoramic images; and

the predetermined information process is performed in response to satisfaction of a predetermined condition regarding a plurality of predetermined virtual objects.

4. The storage medium according to claim 1, wherein the predetermined information process is performed on a condition that the virtual object is displayed on the display device.

5. The storage medium according to claim 1, wherein the predetermined information process is performed at least on a condition that the user performs an operation of specifying the virtual object displayed on the display device.

6. The storage medium according to claim 1, wherein the predetermined information process is performed on a condition that a panoramic image for which a virtual object is set is displayed.

7. The storage medium according to claim 1, wherein a virtual object set for a panoramic image is displayed together with the panoramic image on a condition that a line-of-sight direction corresponding to an area of the panoramic image to be displayed is a direction within a predetermined range.

8. The storage medium according to claim 1, wherein the panoramic image display program causes the computer to further execute displaying suggestion information on the display device together with the panoramic image, wherein the suggestion information suggests a position of the virtual object on the map or on a panoramic image.

9. The storage medium according to claim 8, wherein a suggestion object is displayed, as the suggestion information, at a position on the panoramic image determined based on a position of the virtual object on the map.

10. The storage medium according to claim 8, wherein:

a suggestion object suggesting a position of the virtual object on a panoramic image is displayed as the suggestion information; and

the suggestion object indicates a direction toward the virtual object from a position of the suggestion object on the panoramic image.

11. The storage medium according to claim 1, wherein the virtual object is erased when a predetermined condition regarding the virtual object is satisfied.

12. The storage medium according to claim 1, wherein a process of giving the user a bonus related to a panoramic image is performed as the predetermined information process.

13. The storage medium according to claim 1, wherein:

the virtual object is associated with a location different from a location associated with the panoramic image for which the virtual object is set; and

an information process of selecting a location associated with the virtual object in response to satisfaction of a predetermined condition regarding the virtual object, and displaying, on the display device, a panoramic image associated with the selected location instead of the panoramic image for which the virtual object is set is performed.

14. The storage medium according to claim 1, wherein a virtual object which is set for a panoramic image associated with another location different from the current location is defined as an other-location virtual object, and an additional virtual object representing the other-location virtual object as viewed from a viewpoint of the panoramic image in the current location is displayed on the display device together with the panoramic image associated with the current location.

15. The storage medium according to claim 14, wherein the panoramic image display program causes the computer to further execute determining an placement position of the additional virtual object for the panoramic image associated with the current location based on a direction toward the other location from the current location on the map.

16. The storage medium according to claim 15, wherein the placement position of the additional virtual object for the panoramic image associated with the current location is determined based on a positional relationship on the map between a viewpoint of the other location and the other-location virtual object.

17. The storage medium according to claim 16, wherein the placement position of the additional virtual object for the panoramic image associated with the current location is determined based on a distance from the current location to the other location, wherein the distance is calculated based on information indicating positions of the current location and the other location on the map.

18. The storage medium according to claim 15, wherein an orientation of the additional virtual object as viewed from the viewpoint of the current location is determined so as to represent an orientation of the other-location virtual object as viewed from the viewpoint of the current location.

19. The storage medium according to claim 14, wherein the computer determines whether an other-location virtual object is present for another location satisfying a predetermined condition with respect to the current location, and if the other-location virtual object is present, the additional virtual object is displayed on the display device together with the panoramic image.

20. The storage medium according to claim 14, wherein the computer does not perform the predetermined information process even if the same condition as the predetermined condition is satisfied for the additional virtual object.

21. A panoramic image display system for displaying, on a display device, a plurality of panoramic images associated with locations on the map,

wherein a predetermined virtual object is set for at least one of the plurality of panoramic images,

one or more processor of the panoramic image display system executes:

determining one of the locations on the map as a current location based on a user operation;

where the virtual object is set for a panoramic image associated with the current location, placing the virtual object at a predetermined position of the panoramic image;

displaying, on the display device, an image of a partial area of the panoramic image associated with the current location, wherein the partial area is determined in response to a user operation; and

performing a predetermined information process in response to satisfaction of a predetermined condition regarding the virtual object while the panoramic image for which the virtual object is set is displayed.

22. A panoramic image display device for displaying, on a display device, a plurality of panoramic images associated with locations on the map,

wherein a predetermined virtual object is set for at least one of the plurality of panoramic images,

one or more processor of the panoramic image display device executes:

determining one of the locations on the map as a current location based on a user operation;

where the virtual object is set for a panoramic image associated with the current location, placing the virtual object at a predetermined position of the panoramic image;

displaying, on the display device, an image of a partial area of the panoramic image associated with the current location, wherein the partial area is determined in response to a user operation; and

performing a predetermined information process in response to satisfaction of a predetermined condition regarding the virtual object while the panoramic image for which the virtual object is set is displayed.

23. A panoramic image display method to be carried out on an information processing system for displaying, on a display device, a plurality of panoramic images associated with locations on the map,

wherein a predetermined virtual object is set for at least one of the plurality of panoramic images, the method comprising:

determining one of the locations on the map as a current location based on a user operation;

where the virtual object is set for a panoramic image associated with the current location, placing the virtual object at a predetermined position of the panoramic image;

displaying, on the display device, an image of a partial area of the panoramic image associated with the current location, wherein the partial area is determined in response to a user operation; and

performing a predetermined information process in response to satisfaction of a predetermined condition regarding the virtual object while the panoramic image for which the virtual object is set is displayed.