Head-mountable display system

• US 10,187,633 B2
• Filed: 02/03/2016
• Issued: 01/22/2019
• Est. Priority Date: 02/06/2015
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Bickerstaff, Ian Henry, Raghoebardajal, Sharwin Winesh, Benson, Simon Mark
• Primary Examiner(s): Nguyen, Jennifer
• Application Number:
  US15/014,170
• Publication Number:
  US 20160234482A1
• Time in Patent Office: 1,084 Days
• Field of Search: 345 7, 345 8, 349 11
• CPC Class Codes: G02B 2027/0129 comprising devices for correcting parallax
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0149 characterised by mechanical features G02B27/0176 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A method of operation of a head mountable display (HMD) system, in which stereoscopic images are displayed with respect to a virtual display screen (VDS) position, is provided. The method includes setting a VDS position for a stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display. The method also includes generating the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

Claims

1. A method of operation of a head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the method comprising the steps of:

setting, by one or more processors including at least one of an image processor and a display controller, a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer'"'"'s head; and

generating, by one or more processors including at least the display controller, the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

2. A method according to claim 1, in which the setting step comprises:

setting the VDS position for the stereoscopic image for display to be substantially equal to a depth represented by the depth parameter of the region of interest (ROI) in respect of the stereoscopic image for display.

3. A method according to claim 1, in which the generating step comprises:

rendering the stereoscopic image for display having the image parallax appropriate to the VDS position set by the setting step.

4. A method according to claim 1, in which the generating step comprises:

image-shifting portions of a first stereoscopic image to generate the stereoscopic image for display.

5. A method according to claim 1, further comprising the step of:

detecting image content of the stereoscopic image for display so as to detect the ROI in respect of the stereoscopic image for display.

6. A method according to claim 1, further comprising the step of:

detecting a viewer gaze direction in respect of a preceding displayed stereoscopic image so as to detect the ROI in respect of the stereoscopic image for display.

7. A method according to claim 1, further comprising the step of:

detecting the depth parameter from metadata accompanying the stereoscopic image for display.

8. A method according to claim 1, in which the VDS is non-planar.

9. A method according to claim 8, in which the VDS is curved so as to at least partially surround the viewer.

10. A method according to claim 8, in which the setting step comprises setting a local radial depth for a portion of the VDS according to a depth parameter of a portion of the stereoscopic image for display by the portion of the VDS.

11. A method according to claim 10, in which the setting step comprises setting two or more different local radial depths for respective portions of the VDS according to respective depth parameters of respective portions of the stereoscopic image for display by the corresponding portion of the VDS.

12. A non-transitory machine-readable storage medium that stores computer instructions thereon, the instructions, when executed by a computer including one or more processors including at least one of an image processor and a display controller, cause the computer to carry out a method of operation of a head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the method comprising the steps of:

setting, by at least one of the image processor and the display controller a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer'"'"'s head; and

generating, by one or more processors including at least the display controller, the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

13. A head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the system comprising an image processor and a display controller:

at least one of the image processor and the display controller being configured to set a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer'"'"'s head; and

at least the display controller being configured to generate the stereoscopic image for display having an image parallax appropriate to the VDS position set by the image processor.

14. An HMD system according to claim 13, further comprising a display arrangement operatively coupled to the image processor, the display arrangement being configured to display the generated stereoscopic image to a wearer of the HMD.