CONTROLLING A HEAD MOUNTED DEVICE

• US 20160349838A1
• Filed: 08/02/2015
• Published: 12/01/2016
• Est. Priority Date: 05/31/2015
• Status: Active Grant

• Current Assignee: Fieldbit Ltd. (Help Lightning, Inc.)
• Original Assignee: Fieldbit Ltd. (Help Lightning, Inc.)
• Inventors: Solomon, Shay, Meiron, Evyatar, Rapoport, Alex
• Granted Patent: US 10,437,323 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

A method for controlling a display of a head mounted display (HMD) device, the method may include projecting on a display of the HMD device a given user interface element; sensing, by a sensor, a head movement of a user of the HMD device; unchanging a position of the projection of the given user interface element when a speed of the head movement is below a first speed threshold; and changing the position of the given user interface element when the speed of the head movement exceeds the first speed threshold

Claims

1. A method for controlling a display of a head mounted display (HMD) device, the method comprises:

projecting on a display of the HMD device a given user interface element and a selectable user interface element;

sensing, by a sensor, a head movement of a user of the HMD device;

unchanging a position of the projection of the selectable user interface element when a speed of the head movement is below a first speed threshold; and

changing the position of the projection of the selectable user interface element when the speed of the head movement exceeds the first speed threshold.

2. The method according to claim 1 wherein the changing of the position of the selectable user interface element by tracking the head movement.

3. The method according to claim 1 comprising:

projecting the given user interface element on a fixed location of the display of the HMD device; and

determining that the user selected the selectable user interface element when the given user interface element and the selectable user interface element overlap for a predefined overlap period.

4. The method according to claim 3, comprising determining that the user selected the selectable user interface element when during the predefined overlap period the head of the user maintained still.

5. The method according to claim 4, wherein the predefined overlap period exceeds one second.

6. The method according to claim 1 comprising associating multiple frames of user selectable interface elements with multiple segments of a three dimensional space having a axes system;

unchanging a position of the axes system when the speed of the head movement is below the first speed threshold; and

changing the position of the axes system when the speed of the head movement exceeds the first speed threshold; and

displaying to the user at least one of the multiple frames based upon a relationship between a field of view of the user and the axes system.

7. The method according to claim 1 wherein the given user interface element is projected on a center of the display of the HMD device.

8. The method according to claim 1 comprising:

associating a first frame of user interface elements with an area of the display of the HMD device; and

unchanging a position of the projection of the first frame of the user interface elements when the speed of the head movement is below the first speed threshold;

wherein the first frame of user interface elements comprises the given user interface element.

9. The method according to claim 1 wherein the HMD device is a see-through binocular head mounted display (STBHMD) device;

wherein the method comprises;

performing a calibration process based upon (i) at least a first image of an object and (ii) feedback from the user of the STBHMD device;

receiving an input augmented image of the object;

wherein the input augmented image of the object comprises a certain image of the object and input digital content that refers to a certain element of the object;

calculating, in response to an outcome of the calibration process, output digital content that refers to a visual representation of the certain element of the object in second images of the object; and

displaying the output digital content on the display of the STBHMD thereby forming output augmented images of the object.

10. A non-transitory computer readable medium that stores instructions that once executed by a head mounted display (HMD) device cause the HMD device to execute the steps of:

projecting on a display of the HMD device a given user interface element;

sensing, by a sensor, a head movement of a user of the HMD device;

unchanging a position of the projection of the given user interface element when a speed of the head movement is below a first speed threshold; and

changing the position of the given user interface element when the speed of the head movement exceeds the first speed threshold.

11. A head mounted display (HMD) device that comprises a camera, a display, a projector, a processor and a sensor;

wherein the projector is configured to project on a display of the HMD device a given user interface element;

wherein the sensor is configured to sense a head movement of a user of the HMD device;

wherein the processor is configured to unchange a position of the projection of the given user interface element when a speed of the head movement is below a first speed threshold; and

wherein the processor is configured to change the position of the given user interface element when the speed of the head movement exceeds the first speed threshold.

12. The head mounted display according to claim 11 wherein the changing of the position of the selectable user interface element by tracking the head movement.

13. The head mounted display according to claim 11 wherein the projector is configured to project the given user interface element on a fixed location of the display of the HMD device;

and wherein the processor is configured to determine that the user selected the selectable user interface element when the given user interface element and the selectable user interface element overlap for a predefined overlap period.

14. The head mounted display according to claim 13, wherein the processor is configured to determine that the user selected the selectable user interface element when during the predefined overlap period the head of the user maintained still.

15. The head mounted display according to claim 14, wherein the predefined overlap period exceeds one second.

16. The head mounted display according to claim 11 wherein the processor is configured to associate multiple frames of user selectable interface elements with multiple segments of a three dimensional space having a axes system;

unchange a position of the axes system when the speed of the head movement is below the first speed threshold;

change the position of the axes system when the speed of the head movement exceeds the first speed threshold; and

wherein the projector is configured to display to the user at least one of the multiple frames based upon a relationship between a field of view of the user and the axes system.

17. The head mounted display according to claim 11 wherein the given user interface element is projected on a center of the display of the HMD device.

18. The head mounted display according to claim 11 wherein the processor is configured to associate a first frame of user interface elements with an area of the display of the HMD device;

and wherein the processor is configured to unchange a position of the projection of the first frame of the user interface elements when the speed of the head movement is below the first speed threshold;

wherein the first frame of user interface elements comprises the given user interface element.