Method and apparatus for changing a field of view without synchronization with movement of a head-mounted display

• US 10,139,902 B2
• Filed: 08/26/2016
• Issued: 11/27/2018
• Est. Priority Date: 09/16/2015
• Status: Active Grant

• Current Assignee: Colopl, Inc.
• Original Assignee: Colopl, Inc.
• Inventors: Inomata, Atsushi, Shiraishi, Taichiro
• Primary Examiner(s): Dicke, Chad
• Application Number:
  US15/249,330
• Publication Number:
  US 20170076496A1
• Time in Patent Office: 823 Days
• Field of Search: None
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A method includes generating a visual field image to be visually recognized by a user within a virtual space image, the virtual space image forming a virtual space within which the user is immersed. The method also includes generating a transitional image to be visually recognized by the user during a transitional period, the visual field image being updated during the transitional period. The method further includes displaying the visual field image and the transitional image using a head mounted display. Generating the transitional image includes one or more of updating the visual field image in synchronization with a movement of the head mounted display; or updating the visual field image without synchronization with the movement of the head mounted display by generating a transitional image having a reduced information amount to be visually recognized by the user.

Claims

1. A method, comprising:

defining a virtual space within which a user is immersed;

defining a virtual camera in the virtual space, wherein the virtual camera defines a visual field;

generating a visual field image corresponding to the visual field to be visually recognized by the user;

displaying the visual field image on a head mounted display;

detecting movement of the head mounted display;

determining, using the head mounted display, to move a location of the virtual camera without synchronization with the detected movement of the head mounted display;

moving the location of the virtual camera within the virtual space from a first location to a second location without synchronization with the detected movement of the head mounted display;

determining, using an external controller, to move the location of the virtual camera without synchronization with the detected movement of the head mounted display in response to an input from the external controller;

determining, based on a context within which the virtual space is used, whether to move the location of the virtual camera automatically and without synchronization with the detected movement of the head mounted display or based on the input from the external controller;

generating a transitional image, having reduced information compared to the visual field image, in response to moving the location of the virtual camera without synchronization with the detected movement of the head mounted display

displaying the transitional image on the head mounted display during the movement of the location of the virtual camera;

changing an angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display; and

updating the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display without displaying the transitional image.

2. The method according to claim 1, wherein updating the visual field image without synchronization with the movement of the head mounted display-further comprises:

updating the visual field image such that the visual field image corresponding to the first location is changed to the visual field image corresponding to the second location by moving the location of the virtual camera.

3. The method according to claim 1, wherein

updating the visual field image further comprises generating the transitional image in response to a movement amount of the virtual camera exceeding a predetermined amount.

4. The method according to claim 1, wherein displaying-the transitional image during the movement of the location of the virtual camera further comprises:

changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display during movement of the location of the virtual camera; and

updating the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display while displaying the transitional image.

5. The method according to claim 1, wherein updating the visual field image further comprises updating the visual field image by moving the virtual camera configured to define the visual field image at a predetermined speed, and wherein the predetermined speed is at least 200°

/second in response to the virtual camera moving so as to revolve about a predetermined point within the virtual space.

6. The method according to claim 1, wherein updating the visual field image further comprises updating the visual field image by moving the virtual camera at a predetermined speed, and wherein the predetermined speed is at least 300°

/second in response to the virtual camera moving so as to revolve about a predetermined point within the virtual space.

7. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to:

define a virtual space within which a user is immersed;

define a virtual camera in the virtual space, wherein the virtual camera defines a visual field;

generate the visual field image corresponding to the visual field to be visually recognized by the user;

display the visual field image on a head mounted display;

detect movement of the head mounted display;

determine, using the head mounted display, to move a location of the virtual camera without synchronization with the detected movement of the head mounted display;

move a location of the virtual camera within the virtual space from a first location to a second location without synchronization with the detected movement of the head mounted display;

determine, using an external controller, to move the location of the virtual camera without synchronization with the detected movement of the head mounted display in response to an input from the external controller;

determine, based on a context within which the virtual space is used, whether to move the location of the virtual camera automatically and without synchronization with the detected movement of the head mounted display or based on the input from the external controller;

generate a transitional image, having reduced information compared to the visual field image, in response to moving the location of the virtual camera without synchronization with the detected movement of the head mounted display;

display the transitional image on the head mounted display during the movement of the location of the virtual camera;

change an angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display;

update the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display without displaying the transitional image.

8. The non-transitory computer-readable storage medium according to claim 7, wherein to display-the transitional image during the location of the virtual camera moving, the apparatus is further caused to:

change the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display during movement of the location of the virtual camera; and

update the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display while displaying the transitional image.

9. The non-transitory computer-readable storage medium according to claim 7, wherein

to update the visual field image, the apparatus is further caused to update the visual field image by moving the virtual camera toward a direction of a visual axis of the virtual camera, and

the transitional image comprises an image obtained by reducing the information amount to be visually recognized by the user within an area excluding a predetermined range including the visual axis.

10. The non-transitory computer-readable storage medium according to claim 7, wherein to update the visual field image, the apparatus is further caused to update the visual field image by moving the virtual camera at a predetermined speed.

11. The non-transitory computer-readable storage medium according to claim 10, wherein the predetermined speed is at least 200°

/second when the virtual camera moves so as to revolve about a predetermined point within the virtual space.

12. The non-transitory computer-readable storage medium according to claim 10, wherein the predetermined speed is at least 300°

/second when the virtual camera moves so as to revolve about a predetermined point within the virtual space.

13. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to;

define a virtual space within which a user is immersed;

define a virtual camera in the virtual space, wherein the virtual camera defines a visual field;

generate the visual field image corresponding to the visual field to be visually recognized by the user;

display the visual field image on a head mounted display;

detect movement of the head mounted display;

determine, using the head mounted display, to move a location of the virtual camera without synchronization with the detected movement of the head mounted display;

move a location of the virtual camera within the virtual space from a first location to a second location without synchronization with the detected movement of the head mounted display;

determine, using an external controller, to move the location of the virtual camera without synchronization with the detected movement of the head mounted display in response to an input from the external controller;

determine, based on a context within which the virtual space is used, whether to move the location of the virtual camera automatically and without synchronization with the detected movement of the head mounted display or based on the input from the external controller;

generate a transitional image, having reduced information compared to the visual field image, in response to moving the location of the virtual camera without synchronization with the detected movement of the head mounted display;

display the transitional image on the head mounted display during the movement of the location of the virtual camera;

change an angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display;

update the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display without displaying the transitional image.

14. The apparatus according to claim 13, wherein to display the transitional image during the location of the virtual camera moving, the apparatus is further caused to:

change the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display during movement of the location of the virtual camera; and

update the visual field image in response to changing the angular orientation of the virtual camera in synchronization with the detected movement of the head mounted display with displaying the transitional image.

15. The apparatus according to claim 13, wherein

the transitional image comprises an image obtained by reducing the information amount to be visually recognized by the user within an area excluding a predetermined range including the visual axis.

16. The apparatus according to claim 13, wherein to move the virtual camera, the apparatus is further cased to move the virtual camera at a predetermined speed.

17. The apparatus according to claim 16, wherein the predetermined speed is at least 200°

/second when the virtual camera moves so as to revolve about a predetermined point within the virtual space.

18. The apparatus according to claim 16, wherein the predetermined speed is at least 300°

/second when the virtual camera moves so as to revolve about a predetermined point within the virtual space.

19. The apparatus according to claim 16, further comprising:

at least one sensor configured to detect a location of the head mounted display,

wherein the processor is configured to determine an amount of movement of the head mounted display based on the location of the head mounted display detected by the at least one sensor.

20. The apparatus according to claim 19, wherein the at least one sensor is a component of a sensor unit having a plurality of sensors configured to determine an orientation of the head mounted display, and the apparatus is further configured to determine a direction of movement of the head mounted display based at least on the amount of movement and the orientation of the head mounted display.