User interface systems for head-worn computers

• US 10,684,478 B2
• Filed: 08/22/2016
• Issued: 06/16/2020
• Est. Priority Date: 05/09/2016
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Inventors: Osterhout, Ralph F.
• Primary Examiner(s): Osorio, Ricardo
• Application Number:
  US15/242,893
• Publication Number:
  US 20170322416A1
• Time in Patent Office: 1,394 Days
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0156 with optionally usable elements
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0362 : with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0485 : Scrolling or panning
• CPC Class Codes: G06F 3/147 : using display panels
• CPC Class Codes: G06F 3/165 : Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09G 2354/00 : Aspects of interface with display user

Abstract

Aspects of the present disclosure relates to user interface systems and methods for use in head-worn computing systems.

Claims

1. A wearable head device, comprising:

a display;

one or more processors;

a frame adapted to position the display in front of a user of the wearable head device; and

an input device comprising a region that is both touch-sensitive and proximity-sensitive;

wherein;

the input device is configured to present a proximity signal to the one or more processors in accordance with detecting a presence of the user in proximity to the region,

the input device is further configured to present a parameter adjustment signal to the one or more processors in accordance with detecting a touch of the region by the user, the parameter adjustment signal corresponding to one or more parameters, and

the one or more processors are configured to perform a method comprising;

in response to receiving the proximity signal, presenting, via the display, a visual indication that the user is in proximity to the input device, and

in response to receiving the parameter adjustment signal, adjusting the corresponding one or more parameters.

2. The wearable head device of claim 1, wherein the method further comprises presenting, via the display, a second visual indication of the corresponding one or more parameters.

3. The wearable head device of claim 1, wherein the visual indication that the user is in proximity to the input device comprises a visual representation of a position of the user with respect to the wearable head device.

4. The wearable head device of claim 3, wherein the visual representation comprises one or more of a horizontal view, a vertical view, a 2D view, a 3D view, and a perspective view.

5. The wearable head device of claim 1, wherein the input device is configured to receive signals from a plurality of proximity detectors indicative of a proximity of the user, and detecting the presence of the user in proximity to the region comprises detecting the presence of the user based on the signals.

6. The wearable head device of claim 1, wherein the input device is configured to receive signals from a proximity detector mounted to a surface of the wearable head device that includes a user interface element, and detecting the presence of the user in proximity to the region comprises detecting the presence of the user based on the signals.

7. The wearable head device of claim 6, wherein the proximity detector comprises a ring mounted fully around, partially around, or in proximity to the user interface element.

8. The wearable head device of claim 1, wherein the wearable head device further comprises a haptic actuator, and the method further comprises, in response to receiving the proximity signal, presenting a haptic signal via the haptic actuator concurrently with presenting the visual indication via the display.

18. The wearable head device of claim 1, wherein the one or more parameters comprises a brightness of the display, and wherein adjusting the one or more parameters comprises:

presenting via the display a second visual indication of a brightness level;

adjusting the brightness of the display; and

changing the second visual indication of the brightness level to correspond to the adjusted brightness of the display.

19. The wearable head device of claim 1, wherein the one or more parameters comprises a volume for audio presented via a speaker coupled to the head device, and wherein adjusting the one or more parameters comprises:

presenting via the display a second visual indication of the volume level;

adjusting the volume of the speaker; and

changing the second visual indication of the volume level to correspond to the adjusted volume of the speaker.

20. The wearable head device of claim 1, wherein the visual indication that the user is in proximity to the input device comprises a visual representation of a position of the user with respect to a user interface element.

9. A method comprising:

receiving, via a touch-sensitive and proximity-sensitive region of an input device of a wearable head device, a proximity signal presented in accordance with detecting a presence of a user of the wearable head device in proximity to the region;

receiving, via the input device, a parameter adjustment signal presented in accordance with detecting a touch of the region by the user, the parameter adjustment signal corresponding to one or more parameters;

in response to receiving the proximity signal, presenting, via a display of the wearable head device, a visual indication that the user is in proximity to the input device; and

in response to receiving the parameter adjustment signal, adjusting the corresponding one or more parameters.

10. The method of claim 9, further comprising presenting, via the display, a second visual indication of the corresponding one or more parameters.

11. The method of claim 9, wherein the visual indication that the user is in proximity to the input device comprises a visual representation of a position of the user with respect to the wearable head device.

12. The method of claim 11, wherein the visual representation comprises one or more of a horizontal view, a vertical view, a 2D view, a 3D view, and a perspective view.

13. The method of claim 9, wherein the input device is configured to receive signals from a plurality of proximity detectors indicative of a proximity of the user, and detecting the presence of the user in proximity to the region comprises detecting the presence of the user based on the received signals.

14. The method of claim 9, wherein the input device is configured to receive signals from a proximity detector mounted to a surface of the wearable head device that includes a user interface element, and detecting the presence of the user in proximity to the region comprises detecting the presence of the user based on the received signals.

15. The method of claim 14, wherein the proximity detector comprises a ring mounted fully around, partially around, or in proximity to the user interface element.

16. The method of claim 9, further comprising, in response to receiving the proximity signal, presenting a haptic signal via a haptic actuator of the wearable head device concurrently with presenting the visual indication via the display.

17. A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, execute a method comprising:

receiving, via a touch-sensitive and proximity-sensitive region of an input device of a wearable head device, a proximity signal presented in accordance with detecting a presence of a user of the wearable head device in proximity to the region;

receiving, via the input device, a parameter adjustment signal presented in accordance with detecting a touch of the region by the user, the parameter adjustment signal corresponding to one or more parameters;

in response to receiving the proximity signal, presenting, via a display of the wearable head device, a visual indication that the user is in proximity to the input device; and

in response to receiving the parameter adjustment signal, adjusting the corresponding one or more parameters.