Head-mountable apparatus and systems
First Claim
1. A head mountable display (HMD) comprising:
- an upward facing camera associated with a wide angle lens configured to capture images of an environment of the HMD;
an image comparator operatively coupled to the upward facing camera, the image comparator being arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; and
a processor configured to identify feature points in the images captured at different points in time, and to detect positions in the images of the identified feature points so as to provide an indication of rotational movement of the HMD between two respective images, in which the processor is configured to detect indications of the rotational movement from a plurality of pairs of image positions, each pair representing opposite viewpoints of the camera, and in which the processor is further configured to derive the indication of rotational movement from one or more pairs exhibiting a lowest difference between the viewpoints of that pair.
3 Assignments
0 Petitions
Accused Products
Abstract
A head mountable display (HMD) is provided that has an upward facing camera associated with a wide angle (such as a fisheye) lens arranged to capture images of the environment of the HMD. The HMD also includes an image comparator arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time. The image comparator may be configured to perform two or more detection techniques to detect HMD yaw, and to combine the results of the two or more detection techniques. The HMD may also include a tilt detector. Here, the image comparator may be configured to ignore one or more portions of a captured image in dependence upon a current tilt of the HMD as detected by the tilt detector.
-
Citations
18 Claims
-
1. A head mountable display (HMD) comprising:
-
an upward facing camera associated with a wide angle lens configured to capture images of an environment of the HMD; an image comparator operatively coupled to the upward facing camera, the image comparator being arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; and a processor configured to identify feature points in the images captured at different points in time, and to detect positions in the images of the identified feature points so as to provide an indication of rotational movement of the HMD between two respective images, in which the processor is configured to detect indications of the rotational movement from a plurality of pairs of image positions, each pair representing opposite viewpoints of the camera, and in which the processor is further configured to derive the indication of rotational movement from one or more pairs exhibiting a lowest difference between the viewpoints of that pair. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system, comprising:
-
a head mountable display (HMD) including; an upward facing camera associated with a wide angle lens configured to capture images of an environment of the HMD; an image comparator operatively coupled to the upward facing camera, the image comparator being arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; and a processor configured to identify feature points in the images captured at different points in time, and to detect positions in the images of the identified feature points so as to provide an indication of rotational movement of the HMD between two respective images, in which the processor is configured to detect indications of the rotational movement from a plurality of pairs of image positions, each pair representing opposite viewpoints of the camera, and in which the processor is further configured to derive the indication of rotational movement from one or more pairs exhibiting a lowest difference between the viewpoints of that pair; and one or more of a base device and an intermediate device operatively coupled to the HMD.
-
-
10. A method of operation of a head mountable display (HMD) having an upward facing camera associated with a wide angle lens arranged to capture images of the environment of the HMD, the method comprising:
-
deriving, by one or more processors, an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; identifying feature points in the images captured at the different points in time; detecting positions in the images of the identified feature points so as to provide an indication of rotational movement of the HMD between two respective images; detecting indications of the rotational movement from a plurality of pairs of image positions, each pair representing opposite viewpoints of the camera; and deriving the indication of rotational movement from one or more pairs exhibiting a lowest difference between the viewpoints of that pair.
-
-
11. A non-transitory computer-readable storage medium on which computer readable instructions are stored, the instructions, when executed by one or more processors, causing the one or more processors to execute a method of operation of a head mountable display (HMD) having an upward facing camera associated with a wide angle lens arranged to capture images of the environment of the HMD, the method comprising:
-
deriving an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; identifying feature points in the images captured at the different points in time; detecting positions in the images of the identified feature points so as to provide an indication of rotational movement of the HMD between two respective images; detecting indications of the rotational movement from a plurality of pairs of image positions, each pair representing opposite viewpoints of the camera; and deriving the indication of rotational movement from one or more pairs exhibiting a lowest difference between the viewpoints of that pair.
-
-
12. A head mountable display (HMD) comprising:
-
an upward facing camera associated with a wide angle lens configured to capture images of an environment of the HMD; and an image comparator operatively coupled to the upward facing camera, the image comparator being arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; in which the image comparator is configured to detect inter-image scaling in two or more regions of the captured images, and not to use a region, in the detection of HMD yaw, in which inter-image scaling of more than a threshold scaling has been detected. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A system, comprising:
-
a head mountable display (HMD) including; an upward facing camera associated with a wide angle lens configured to capture images of an environment of the HMD; and an image comparator operatively coupled to the upward facing camera, the image comparator being arranged to derive an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; in which the image comparator is configured to detect inter-image scaling in two or more regions of the captured images, and not to use a region, in the detection of HMD yaw, in which inter-image scaling of more than a threshold scaling has been detected; and one or more of a base device and an intermediate device operatively coupled to the HMD.
-
-
18. A method of operation of a head mountable display (HMD) having an upward facing camera associated with a wide angle lens arranged to capture images of the environment of the HMD, the method comprising:
-
deriving, by one or more processors, an indication of yaw of the HMD from images captured by the upward facing camera at different points in time; detecting inter-image scaling in two or more regions of the captured images; and not using a region, in the detection of HMD yaw, in which inter-image scaling of more than a threshold scaling has been detected.
-
Specification