HEAD MOUNTABLE DISPLAY

• US 20140104692A1
• Filed: 10/11/2012
• Published: 04/17/2014
• Est. Priority Date: 10/11/2012
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment Europe Limited (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Europe Limited (Sony Group Corp.)
• Inventors: Bickerstaff, Ian Henry, Benson, Simon Mark
• Application Number:
  US13/649,425
• Publication Number:
  US 20140104692A1
• Time in Patent Office: Days
• US Class Current: 359/630
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features

Abstract

A head-mountable display device comprises a frame to be mounted onto a user'"'"'s head. The frame defines an eye display position which is positioned in front of a user'"'"'s eye. A reflective element is mounted with respect to the eye display position and comprises a reflective surface which is visible to the eye of the user. A mobile device holder is configured to hold a mobile device on the frame. The reflective surface is configured to reflect light incident upon the reflective surface, forming a reflected image. The location and orientation in which the mobile device is held relative to a location and orientation of the reflective surface are such that light arriving from a screen of the mobile device held in the mobile device holder is reflected by the reflective surface so that a reflected image of at least part of the screen is visible to the user.

Claims

1. A head-mountable display device, comprising:

a frame to be mounted onto a user'"'"'s head, the frame defining an eye display position which, in use, is positioned in front of an eye of the user;

a reflective element mounted with respect to the eye display position, the reflective element comprising a reflective surface which, in use, is visible to the eye of the user; and

a mobile device holder configured to hold a mobile device at a location and orientation on the frame;

wherein;

the reflective surface is configured to reflect light incident upon the reflective surface so as to form a reflected image; and

the location and orientation in which the mobile device is held relative to a location and orientation of the reflective surface are such that, in use, light arriving from a screen of the mobile device held in the mobile device holder is reflected by the reflective surface so that a reflected image of at least a portion of the screen is visible to the user.

2. The head-mountable display device according to claim 1, wherein:

the reflective surface forms a concave mirror; and

the location and orientation in which the mobile device is held are such that, in use, at least a portion of the screen of the mobile device is at a distance from the concave mirror which is less than or equal to the focal length of the concave mirror.

3. The head-mountable display device according to claim 1, wherein the reflective element is partially transparent.

4. The head-mountable display device according to claim 3, comprising:

a non-transparent shutter element movably mounted on the frame and operable to be moved into a position in which at least a portion of a surface of the reflective element other than the reflective surface is overlapped by the non-transparent shutter element, so that the amount of light incident upon the at least a portion of the surface of the reflective element is reduced.

5. The head-mountable display device according to claim 1, wherein the reflective element is formed from a single piece of acrylic glass.

6. The head-mountable display device according to claim 1, wherein:

the head-mountable display device comprises a reflective element transparency control unit; and

the reflective element comprises a liquid crystal shutter element operable to alter the transparency of the reflective element in response to an instruction issued by the reflective element transparency control unit.

7. The head-mountable display device according to claim 1, wherein the mobile device holder is configured to hold one of a mobile telephone and a hand-held games console as the mobile device.

8. A mobile device for being held by the mobile device holder of the head-mountable display device according to claim 1, the mobile device comprising:

a screen;

an image generation unit operable to generate an image for being displayed on the screen and reflected in the reflective surface of the reflective element of the head-mountable display device; and

an image warp compensation unit operable to warp the generated image so as to compensate for a warped appearance of the image when it is reflected, the image warp compensation unit warping the generated image on the basis of one or more parameters related to the curvature of the reflective surface of the reflective element of the head-mountable display device;

wherein the screen is operable to display the warp-compensated image.

9. A method for use in a system comprising a mobile device and a head-mountable display device, the head-mountable display device comprising a frame to be mounted onto a user'"'"'s head, the frame defining an eye display position which, in use, is positioned in front of an eye of the user;

a reflective element mounted with respect to the eye display position, the reflective element comprising a reflective surface which, in use, is visible to the eye of the user; and

a mobile device holder configured to hold the mobile device at a location and orientation on the frame;

wherein the reflective surface is configured to reflect light incident upon the reflective surface so as to form a reflected image; and

the location and orientation in which the mobile device is held relative to a location and orientation of the reflective surface are such that, in use, light arriving from a screen of the mobile device held in the mobile device holder is reflected by the reflective surface so that a reflected image of at least a portion of the screen is visible to the user;

wherein the method comprises;

generating an image for being displayed on the screen of the mobile device and reflected in the reflective surface of the reflective element of the head-mountable display device;

warping the generated image so as to compensate for a warped appearance of the image when it is reflected, the warping of the generated image being on the basis of one or more parameters related to the curvature of the reflective surface of the reflective element of the head-mountable display device; and

displaying the warp-compensated image on the screen of the mobile device.

10. A non-transitory machine-readable storage medium storing a computer program thereon for controlling a computer to perform the method according to claim 9.

11. A head-mountable device, comprising:

a frame to be mounted onto a user'"'"'s head, the frame defining an eye-tracking reflection position which, in use, is positioned in front of an eye of the user;

a reflective element mounted with respect to the eye-tracking reflection position, the reflective element comprising a reflective surface which is located and orientated so as to, in use, reflect light arriving from the eye of the user; and

a mobile device holder configured to hold a mobile device at a location and orientation on the frame;

wherein

the reflective surface is configured to reflect light incident upon the reflective surface so as to form a reflected image; and

the location and orientation in which the mobile device is held relative to the location and orientation of the reflective surface are such that, in use, the light arriving from the eye of the user is reflected by the reflective surface so that a reflected image of the eye of the user is within a field of view of a camera of the mobile device.

12. The head-mountable device according to claim 11, wherein:

the reflective surface forms a concave mirror, located and orientated such that, in use, at least a portion of the eye of the user is at a distance from the concave mirror which is less than or equal to the focal length of the concave mirror.

13. The head-mountable device according to claim 11, wherein the location and orientation in which the mobile device is held are such that, in use, a portion of the user'"'"'s visual environment is within the field of view of the camera of the mobile device.

14. The head-mountable device according to claim 13, wherein the reflective element is semi-transparent.

15. The head-mountable device according to claim 14, comprising:

a non-transparent shutter element movably mounted on the frame and operable to be moved into a position in which at least a portion of a surface of the reflective element other than the reflective surface is overlapped by the non-transparent shutter element, so that the amount of light incident upon the at least a portion of the surface of the reflective element is reduced.

16. The head-mountable device according to claim 11, wherein the reflective element is formed from a single piece of acrylic material.

17. The head-mountable device according to claim 13, wherein:

the head-mountable device comprises a reflective element transparency control unit; and

the reflective element comprises a liquid crystal shutter element operable to alter the transparency of the reflective element in response to an instruction issued by the reflective element transparency control unit.

18. The head-mountable display device according to claim 11, wherein the mobile device holder is configured to hold one of a mobile telephone and a hand-held games console as the mobile device.

19. A mobile device for being held by the mobile device holder of the head-mountable device according to claim 13, the mobile device comprising:

a camera operable to capture an image comprising a reflected image of the eye of the user reflected by the reflective surface of the reflective element and comprising an image of a portion of the user'"'"'s visual environment;

an eye-tracking unit operable to determine a first portion of the captured image corresponding to the reflected image of the eye of the user and to perform eye-tracking processing on the first portion; and

a location and mapping unit operable to determine a second portion of the captured image corresponding to the image of the portion of the user'"'"'s visual environment and to perform location and mapping processing on the second portion.

20. A method for use in a system comprising a mobile device and a head-mountable device, the head-mountable device comprising a frame to be mounted onto a user'"'"'s head, the frame defining an eye-tracking reflection position which, in use, is positioned in front of an eye of the user;

an reflective element mounted with respect to the eye-tracking reflection position, the reflective element comprising a reflective surface which is located and orientated so as to, in use, reflect light arriving from the eye of the user; and

a mobile device holder configured to hold the mobile device at a location and orientation on the frame;

wherein the reflective surface is configured to reflect light incident upon the reflective surface so as to form a reflected image;

the location and orientation in which the mobile device is held relative to the location and orientation of the reflective surface are such that, in use, the light arriving from the eye of the user is reflected by the reflective surface so that a reflected image of the eye of the user is within a field of view of a camera of the mobile device; and

the location and orientation in which the mobile device is held are such that, in use, a portion of the user'"'"'s visual environment is within the field of view of the camera of the mobile device;

wherein the method comprises;

capturing an image comprising a reflected image of the eye of the user reflected by the reflective surface of the reflective element and comprising an image of a portion of the user'"'"'s visual environment, using the camera of the mobile device;

determining a first portion of the captured image corresponding to the reflected image of the eye of the user and performing eye-tracking processing on the first portion; and

determining a second portion of the captured image corresponding to the image of the portion of the user'"'"'s visual environment and performing location and mapping processing on the second portion.

21. A non-transitory machine-readable storage medium storing a computer program thereon for controlling a computer to perform the method according to claim 20.