Control systems and methods for head-mounted information systems

• US 9,292,084 B2
• Filed: 10/13/2010
• Issued: 03/22/2016
• Est. Priority Date: 10/13/2009
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Abdollahi, Hamid, Eisenhardt, Dan, Chen, Li
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): ZUBAJLO, JENNIFER L
• Application Number:
  US13/501,735
• Publication Number:
  US 20120235902A1
• Time in Patent Office: 1,987 Days
• Field of Search: 345/8, 345156-184
• US Class Current: 1/1
• CPC Class Codes: A42B 3/042 Optical devices night vision goggles G02B23/12
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A head-mounted information system is provided, the head-mounted information system comprising a frame configured to be mounted on a head of a user, a display unit coupled to the frame, a sensor unit coupled to the frame comprising one or more motion sensors, and, a processor unit coupled to the frame and connected to receive signals from the motion sensors. The processor unit comprises a processor and a memory accessible by the processor. The processor unit is configured to monitor the received signals and enter a gesture control mode upon detection of a gesture control enable signal. In the gesture control mode the processor is configured to convert signals received from the motion sensors into menu navigation commands.

Claims

1. A head-mounted information system comprising:

a frame configured to be mounted on a head of a user;

a display unit coupled to the frame, the display unit comprising a display for producing an image;

a sensor unit coupled to the frame, the sensor unit comprising one or more motion sensors; and

,

a processor unit coupled to the frame, the processor unit connected to receive signals from the one or more motion sensors and configured to process the one or more motion signals to produce outputs representing parameters relating to user performance of a physical activity, the processor unit comprising a processor and a memory accessible by the processor,

wherein the processor unit is configured to;

monitor the received signals and enter a gesture control mode upon occurrence of a gesture control enable signal, wherein in the gesture control mode the processor is configured to convert signals received from the motion sensors into menu navigation commands; and

in the gesture control mode, monitor received rotation signals to detect angular velocity about an axis to determine a first head angular velocity and compare the first head angular velocity to one or more threshold angular velocities to produce first motion control signals for menu navigation along a first direction.

2. A system according to claim 1 wherein the memory has a gesture control enable movement profile stored therein and the processor is configured to generate the gesture control enable signal when the received signals contain an occurrence of the gesture control enable movement profile.

3. A system according to claim 2 wherein the memory has a frame movement profile stored therein and the gesture control enable movement profile comprises the frame movement profile.

4. A system according to claim 3 wherein the frame movement profile comprises a tap profile.

5. A system according to claim 4 wherein the processor is configured to generate the gesture control enable signal when the received signals contain two occurrences of the tap profile within a predetermined time period.

6. A system according to claim 4 wherein the processor is configured to generate the gesture control enable signal when an amplitude of an occurrence of the tap profile is within a predefined range.

7. A system according to claim 1 wherein the processor is configured to, in the gesture control mode, sum received rotation signals about a vertical axis to determine a first head angle and compare the first head angle to one or more threshold angles to produce first motion control signals for menu navigation along a first direction.

8. A system according to claim 7 wherein the one or more threshold angles comprise a plurality of threshold angles, and wherein the processor is configured to produce a motion control signal indicating a desired amount of movement based on a highest exceeded one of the plurality of threshold angles.

9. A system according to claim 7 wherein the processor is configured to sum received rotation signals about a lateral horizontal axis to determine a second head angle and compare the second head angle to one or more threshold angles to produce second motion control signals for menu navigation along a second direction.

10. A system according to claim 1 wherein the processor is configured to detect angular velocity about a vertical axis.

11. A system according to claim 10 wherein the processor is configured to sum received rotation signals about a lateral horizontal axis to determine a second head angular velocity and compare the second head angular velocity to one or more threshold angular velocities to produce second motion control signals for menu navigation along a second direction.

12. A system according to claim 1 wherein the one or more threshold angular velocities comprise a plurality of threshold angular velocities, and wherein the processor is configured to produce a motion control signal indicating a desired amount of movement based on a highest exceeded one of the plurality of threshold angular velocities.

13. A system according to claim 1 wherein the processor is configured to, in the gesture control mode, after producing a motion control signal for menu navigation, wait to convert further signals from the motion sensors into menu navigation commands until a reset condition is met.

14. A system according to claim 13 wherein waiting for the reset condition to be met comprises waiting for a pre-determined refractory period.

15. A system according to claim 14 wherein the processor is configured to start the refractory period upon producing the motion control signal.

16. A system according to claim 14 wherein the processor is configured to start the refractory period upon detecting a change in a direction of head movement.

17. A system according to claim 13 wherein waiting for the reset condition to be met comprises summing received rotation signals about a vertical axis to determine a head angle and waiting until the determined head angle is within a pre-determined displacement of an initial angle.

18. A system according to claim 1 wherein the processor is configured to detect angular velocity about a lateral horizontal axis.

19. A system according to claim 1 wherein the processor is configured to, in the gesture control mode, produce an execute control signal when the received signals contain a single occurrence of a tap profile.

20. A system according to claim 19 wherein the processor is configured to, in the gesture control mode, produce the execute control signal when the received signals contain the single occurrence of the tap profile within a predetermined, user-configurable or calibratable time period from a most recent motion control signal.

21. A method of controlling a head-mounted information system comprising a frame configured to be mounted on a head of a user, a display unit coupled to the frame, the display unit comprising a display for producing an image, a sensor unit coupled to the frame, the sensor unit comprising one or more motion sensors, and, a processor unit coupled to the frame, the processor unit connected to receive signals from the one or more motion sensors and configured to process the one or more motion signals to produce outputs representing parameters relating to user performance of a physical activity, the processor unit comprising a processor and a memory accessible by the processor, the method comprising:

monitoring the signals from the motion sensors;

entering a gesture control mode upon occurrence of a gesture control enable signal; and

,

in the gesture control mode;

displaying a menu comprising a plurality of menu items on the display; and

,

converting signals received from the motion sensors into menu navigation commands by monitoring received signals to detect angular velocity about an axis to determine a first head angular velocity and comparing the first head angular velocity to one or more threshold angular velocities to produce first motion control signals for menu navigation along a first direction.

22. A method according to claim 21 wherein the memory has a gesture control enable movement profile stored therein, comprising generating the gesture control enable signal when the received signals contains an occurrence of the gesture control enable movement profile.

23. A method according to claim 22 wherein the memory has a frame movement profile stored therein and the gesture control enable movement profile comprises the frame movement profile.

24. A method according to claim 23 wherein the frame movement profile comprises a tap profile.

25. A method according to claim 24 comprising generating the gesture control enable signal when the received signals contain two occurrences of the tap profile within a predetermined time period.

26. A method according to claim 24 comprising generating the gesture control enable signal when an amplitude of an occurrence of the tap profile is within a predefined range.

27. A method according to claim 21 wherein the axis is a vertical axis.

28. A method according to claim 27 comprising, in the gesture control mode, monitoring received rotation signals about a lateral horizontal axis to determine a second head angular velocity and comparing the second head angular velocity to one or more threshold angular velocities to produce second motion control signals for menu navigation along a second direction.

29. A method according to claim 21 wherein the one or more threshold angular velocities comprise a plurality of threshold angular velocities, comprising producing a motion control signal indicating a desired amount of movement based on a highest exceeded one of the plurality of threshold angular velocities.

30. A method according to claim 21 comprising, in the gesture control mode, after producing a motion control signal for menu navigation, waiting to convert further signals from the motion sensors into menu navigation commands until a reset condition is met.

31. A method according to claim 30 wherein waiting for the reset condition to be met comprises waiting for a pre-determined refractory period.

32. A method according to claim 31 comprising starting the refractory period upon producing the motion control signal.

33. A method according to claim 31 comprising starting the refractory period upon detecting a change in a direction of head movement.

34. A method according to claim 30 wherein waiting for the reset condition to be met comprises summing received rotation signals about a vertical axis to determine a head angle and waiting until the determined head angle is within a pre-determined displacement of an initial angle.

35. A method according to claim 21 wherein the axis is a lateral horizontal axis.

36. A method according to claim 21 comprising, in the gesture control mode, producing an execute control signal when the received signals contain a single occurrence of a tap profile.

37. A method according to claim 36 comprising, in the gesture control mode, producing the execute control signal when the received signals contain the single occurrence of the tap profile within a predetermined, user-configurable or calibratable time period from a most recent motion control signal.