Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

• US 9,749,672 B2
• Filed: 08/24/2016
• Issued: 08/29/2017
• Est. Priority Date: 06/01/2012
• Status: Active Grant

• Current Assignee: HAL Laboratory, Inc., Nintendo Company Limited
• Original Assignee: HAL Laboratory, Inc., Nintendo Company Limited
• Inventors: Suzuki, Toshiaki, Kawase, Shigefumi
• Primary Examiner(s): ADAMS, EILEEN M
• Application Number:
  US15/245,451
• Publication Number:
  US 20160366460A1
• Time in Patent Office: 370 Days
• Field of Search: None
• CPC Class Codes: G11B 20/10 Digital recording or reproducing
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

An example information processing device displays a partial area of a panoramic video on a display device. The information processing device obtains range information with which it is possible to identify a display range of the panoramic video to be displayed and/or to identify a position within the display range. The obtained range information is information regarding a display range determined based on an input made on a predetermined input device while the panoramic video is played. Where the panoramic video is output using the display device, the information processing device outputs the panoramic video while changing output content thereof in accordance with the obtained range information.

Claims

1. A non-transitory computer-readable storage medium comprising an information processing program to be executed by a computer of an information processing device for displaying a virtual image on a first display device, wherein the information processing program instructs the computer to:

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

2. The non-transitory computer-readable storage medium according to claim 1, wherein

the information processing program further instructs the computer to determine a display range of a virtual image in the first display device based on a user input;

and

the virtual image of the display range determined based on the user input is displayed on the first display device, and history-related information produced based on the history information is output.

3. The non-transitory computer-readable storage medium according to claim 2, wherein the history-related information output together with the virtual image represents a direction of the display range identified by the range information included in the history information with respect to a current display range in the first display device.

4. The non-transitory computer-readable storage medium according to claim 2, wherein the output history-related information represents a display frequency for a predetermined range in the virtual image obtained from the history information.

5. The non-transitory computer-readable storage medium according to claim 4, wherein the history-related information represents a display frequency determined in accordance with the number of pieces of history information that satisfy a predetermined condition regarding the time information and the range information.

6. The non-transitory computer-readable storage medium according to claim 1, wherein when display of the virtual image is completed on the second display device, a virtual image of a display range determined based on the range information stored as the history information during the display is displayed on the first display device as a still image or a video.

7. The non-transitory computer-readable storage medium according to claim 6, wherein

range information representing the display range and/or a position within the display range is obtained as the history information;

the information processing program further instructs the computer to determine whether or not an object appearing in the virtual image is included in a display range identified by the history information so as to select an object to be output based on a result of the determination; and

a virtual image including the selected object therein is displayed on the first display device as a still image or a video.

8. The non-transitory computer-readable storage medium according to claim 6, wherein

the information processing program further instructs the computer to determine whether or not an object is included within a display range during display of the virtual image on the second display device so as to select an object to be output based on a result of the determination;

information representing the selected object is obtained as the range information; and

a virtual image of a display range including therein the object represented by the range information is displayed on the first display device as a still image or a video.

9. The non-transitory computer-readable storage medium according to claim 6, wherein

a virtual image of a display range, determined based on a plurality of pieces of history information, is displayed on the first display device as a still image or a video.

10. The non-transitory computer-readable storage medium according to claim 1, wherein the second display device is the same as the first display device.

11. The non-transitory computer-readable storage medium according to claim 1, wherein the second display device is different from the first display device.

12. The non-transitory computer-readable storage medium according to claim 11, wherein the information processing program further instructs the computer to:

determine the display range based on an input made on the predetermined input device while the virtual image is displayed on the second display device; and

display the virtual image of the determined display range on the first display device while the virtual image is displayed on the second display device.

13. The non-transitory computer-readable storage medium according to claim 1, wherein a virtual image of a display range determined based on the range information is displayed on the first display device.

14. The non-transitory computer-readable storage medium according to claim 13, wherein:

range information regarding a virtual image displayed on a second display device different from the first display device is obtained; and

the virtual image is displayed on the first display device while reducing a change in the display range determined based on the range information.

15. The non-transitory computer-readable storage medium according to claim 1, wherein:

the obtained range information represents a position specified by a user while the virtual image is displayed on the second display device; and

an image representing a position on a virtual image determined based on the range information is displayed on the first display device together with the virtual image.

16. The non-transitory computer-readable storage medium according to claim 1, wherein an image representing a viewing direction corresponding to a display range or a position based on the range information is displayed on the first display device.

17. The non-transitory computer-readable storage medium according to claim 1, wherein an image representing a space represented by the virtual image and a position in the space corresponding to a position on the virtual image based on the range information is displayed on the first display device.

18. The non-transitory computer-readable storage medium according to claim 1, wherein the range information is obtained from an external device via a network.

19. The non-transitory computer-readable storage medium according to claim 1, wherein:

user information representing a user who has made an input regarding the range information is further obtained; and

the user information is output when the virtual image is output.

20. An information processing device comprising at least one processor and configured to display a virtual image on a first display device, the at least one processor controlling the information processing device to:

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

21. An information processing system for displaying a virtual image on a first display device, the information processing system comprising:

a processing system having at least one processor, the processing system configured to;

obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

22. An image display method for displaying a virtual image on a first display device, comprising:

obtaining range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and

outputting the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein

the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,

information based on the history information is output after the history information is stored, and

the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.