Systems and methods for unlocking a wearable device

• US 9,229,235 B2
• Filed: 12/01/2014
• Issued: 01/05/2016
• Est. Priority Date: 12/01/2013
• Status: Active Grant

• Current Assignee: Upskill, Inc. (TeamViewer AG)
• Original Assignee: APX Labs, Inc.
• Inventors: Ballard, Brian Adams, Kim, Wonjae, Jenkins, Jeffrey Edward, Reily, Todd Richard
• Primary Examiner(s): Sharifi-Tafreshi, Koosha
• Application Number:
  US14/556,686
• Publication Number:
  US 20150153922A1
• Time in Patent Office: 400 Days
• Field of Search: 345/156, 345/633, 345/7, 345/8, 359/630
• US Class Current: 1/1
• CPC Class Codes: A45C 11/00 Receptacles for purposes not provided for in groups A45C1/00-A45C9/00 specially adapted for toiletry or cosmetic equipment A45D29/20, A45D44/18; travelling sewing kits A45F3/48
• CPC Class Codes: A45C 2011/002 for portable handheld communication devices, e.g. mobile phone, pager, beeper, PDA, smart phone
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 21/71 to assure secure computing or processing of information
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 : Scrolling or panning
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/0487 : using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 12/1822 : Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 67/52 : specially adapted for the location of the user terminal
• CPC Class Codes: H04M 1/72454 : according to context-related or environment-related conditions
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/61 : based on recognised objects
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04W 12/084 : using delegated authorisation, e.g. open authorisation [OAuth] protocol
• CPC Class Codes: H04W 4/08 : User group management
• CPC Class Codes: H04W 76/10 : Connection setup

Abstract

Systems and methods allow a user to interact with an augmented reality device. In one implementation, a lockable, wearable device is provided. The wearable device comprises a display; at least one sensor configured to provide an output indicative of a viewing direction of a user; and at least one processing device. The at least one processing device is configured to track a pattern of the viewing direction of the user; and unlock the lockable, wearable device to provide the user with access to information on the display of the device when the tracked pattern of movement matches a predetermined pattern of movement.

Claims

1. A lockable, wearable device, the wearable device comprising:

a display;

at least one sensor configured to provide an output indicative of a viewing direction of a user; and

at least one processing device configured to;

track a pattern of the viewing direction of the user;

cause a counter indicating an elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward at least one region in an environment of the user;

determine a tracked time duration during which the viewing direction of the user is directed toward the at least one region; and

unlock the lockable, wearable device to provide the user with access to information on the display of the device when the tracked pattern matches a predetermined pattern of movement and the tracked time duration matches a required time duration associated with the at least one region.

2. The wearable device of claim 1, wherein the predetermined pattern of movement includes two or more movements along different directions.

3. The wearable device of claim 2, wherein the two or more movements along different directions include a leftward movement and a rightward movement.

4. The wearable device of claim 2, wherein the two or more movements along different directions include an upward movement and a downward movement.

5. The wearable device of claim 1, wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a pattern of movement of an orientation of the head of the user.

6. The wearable device of claim 1, wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a gaze of the user'"'"'s eyes.

7. A lockable, wearable device, the wearable device comprising:

a display;

at least one sensor configured to provide an output indicative of a viewing direction of a user; and

at least one processing device configured to;

cause an array of graphical objects to be shown on the display of the wearable device;

cause a first counter indicating a first elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward a first graphical object;

cause a second counter indicating a second elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward a second graphical object;

detect selection by the user of at least the first graphical object and the second graphical object from among the array of graphical objects based on the output indicative of the viewing direction of the user;

determine a first tracked time duration during which the viewing direction of the user is directed toward the first graphical object;

determine a second tracked time duration during which the viewing direction of the user is directed toward the second graphical object; and

unlock the lockable, wearable device to provide the user with access to information on the display of the device based on whether the detected selection of the first and second graphical objects matches a predetermined object selection sequence and whether the first tracked time duration matches a first required time duration associated with the first graphical object and the second tracked time duration matches a second required time duration associated with the second graphical object.

8. The wearable device of claim 7, wherein detecting selection of the first and second graphical objects includes detecting an interception of a reticle position with an area of the display associated with the first and second graphical objects.

9. The wearable device of claim 8, wherein the at least one processing device is further configured to monitor a dwell time of the interception of the reticle and an area of the display.

10. The wearable device of claim 9, wherein the at least one processing device is further configured to determine whether the first and second graphical objects have been selected based on whether the dwell time is greater than a predetermined time.

11. The wearable device of claim 7, wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a pattern of movement of an orientation of the head of the user.

12. The wearable device of claim 7, wherein the at least one sensor is configured to provide an output indicative of the viewing direction of the user by tracking a gaze of the user'"'"'s eyes.

13. A method for unlocking a wearable device, the method comprising:

tracking, using at least one sensor of the wearable device, a viewing direction of a user of the wearable device;

causing a counter indicating an elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward at least one region in an environment of the user;

determining a tracked time duration during which the viewing direction of the user is directed toward the at least one region; and

unlocking the wearable device to provide the user with access to information on a display of the wearable device when the tracked viewing direction matches a predetermined pattern of movement and the tracked time duration matches a required time duration associated with the at least one region.

14. The method of claim 13, wherein the predetermined pattern of movement includes two or more movements along different directions.

15. The method of claim 14, wherein the two or more movements along different directions include a leftward movement and a rightward movement.

16. The method of claim 14, wherein the two or more movements along different directions include an upward movement and a downward movement.

17. The method of claim 13, wherein the tracked viewing direction includes a tracked pattern of movement of an orientation of the head of the user.

18. The method of claim 13, wherein the tracked viewing direction includes a tracked gaze of the user'"'"'s eyes.

19. A method for unlocking a wearable device, the method comprising:

tracking, using at least one sensor of the wearable device, a viewing direction of a user of the wearable device;

causing an array of graphical objects to be shown on a display of the wearable device;

causing a first counter indicating a first elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward a first graphical object;

causing a second counter indicating a second elapsed time duration to be displayed on the display when the viewing direction of the user is directed toward a second graphical object;

detecting selection by the user of at least the first graphical object and the second graphical object from among the array of graphical objects based on the viewing direction of the user;

determining a first tracked time duration during which the viewing direction of the user is directed toward the first graphical object;

determining a second tracked time duration during which the viewing direction of the user is directed toward the second graphical object; and

unlocking the wearable device to provide the user with access to information on a display of the device based on whether the detected selection of the first and second graphical objects matches a predetermined object selection sequence and whether the first tracked time duration matches a first required time duration associated with the first graphical object and the second tracked time duration matches a second required time duration associated with the second graphical object.

20. The method of claim 19, wherein detecting selection includes determining whether a reticle intercepts an area of the display associated with the first and second graphical objects of the array of graphical objects.

21. The method of claim 20, further comprising monitoring a dwell time of the interception of the reticle and the area of the display.

22. The method of claim 21, further comprising determining selection by the user if the dwell time is greater than a predetermined time.

23. The method of claim 19, wherein the viewing direction includes a tracked a pattern of movement of an orientation of the head of the user.

24. The method of claim 19, wherein the viewing direction includes a tracked gaze of the user'"'"'s eyes.