Systems and methods for unlocking a wearable device

• US 9,727,211 B2
• Filed: 12/11/2015
• Issued: 08/08/2017
• Est. Priority Date: 12/01/2013
• Status: Expired due to Fees

• Current Assignee: Upskill, Inc. (TeamViewer AG)
• Original Assignee: Upskill, Inc. (TeamViewer AG)
• Inventors: Ballard, Brian Adams, Kim, Wonjae, Jenkins, Jeffrey Edward, Reily, Todd Richard
• Primary Examiner(s): Sharifi-Tafreshi, Koosha
• Application Number:
  US14/966,066
• Publication Number:
  US 20160098579A1
• Time in Patent Office: 606 Days
• Field of Search: 345 7, 345 8, 345633, 345156, 359630
• CPC Class Codes: A45C 11/00 Receptacles for purposes not provided for in groups A45C1/00-A45C9/00 specially adapted for toiletry or cosmetic equipment A45D29/20, A45D44/18; travelling sewing kits A45F3/48
• CPC Class Codes: A45C 2011/002 for portable handheld communication devices, e.g. mobile phone, pager, beeper, PDA, smart phone
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 21/71 to assure secure computing or processing of information
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 : Scrolling or panning
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/0487 : using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 12/1822 : Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 67/52 : specially adapted for the location of the user terminal
• CPC Class Codes: H04M 1/72454 : according to context-related or environment-related conditions
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/61 : based on recognised objects
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04W 12/084 : using delegated authorisation, e.g. open authorisation [OAuth] protocol
• CPC Class Codes: H04W 4/08 : User group management
• CPC Class Codes: H04W 76/10 : Connection setup

Abstract

Systems and methods allow a user to interact with an augmented reality device. In one implementation, a lockable, wearable device is provided. The wearable device comprises a display; at least one sensor configured to provide an output indicative of a viewing direction of a user; and at least one processing device. The at least one processing device is configured to track a pattern of the viewing direction of the user; and unlock the lockable, wearable device to provide the user with access to information on the display of the device when the tracked pattern of movement matches a predetermined pattern of movement.

Claims

1. A wearable device, comprising:

a display;

at least one sensor configured to provide an output indicative of a viewing direction of a user; and

at least one processing device configured to;

cause a plurality of graphical objects to be displayed on the display;

track a pattern of movement of a plurality of viewing directions as the user views the graphical objects;

determine an input value based on a time duration during which a viewing direction is maintained toward a graphical object; and

unlock the wearable device to display additional information to the user when the pattern of movement of the viewing directions matches a predetermined pattern associated with the graphical objects, and when input values associated with the viewing directions match predetermined values associated with the graphical objects.

2. The wearable device of claim 1, wherein the processing device is further configured to determine the viewing direction of the user based on at least one of an orientation of a head of the user or a gaze direction of an eye of the user.

3. The wearable device of claim 1, wherein each of the plurality of graphical objects is associated with a time duration.

4. The wearable device of claim 3, wherein the processing device is further configured to select a graphical object when a viewing direction has been maintained toward the graphical object for a time period that is greater than or equal to the time duration associated with the graphical object.

5. The wearable device of claim 1, wherein the processing device is further configured to:

cause a cursor to be displayed on the display; and

move the cursor on the display over a graphical object based on an orientation of a head of the user or a gaze direction of an eye of the user.

6. The wearable device of claim 5,

wherein the input value comprises a dwell time, and

wherein the processing device is further configured to determine the dwell time associated with each viewing direction during which the cursor stays overlapping the graphical object on the display.

7. The wearable device of claim 5, wherein the processing device is further configured to determine the input value associated with the viewing direction based on accuracy of an alignment of the cursor over the graphical object.

8. The wearable device of claim 5, wherein the processing device is further configured to determine the input value based on a speed at which the cursor is moved to the graphical object.

9. The wearable device of claim 1, wherein the processing device is further configured to cause a graphical representation of the input value to be displayed on the display.

10. The wearable device of claim 9, wherein the processing device is further configured to change the graphical representation of the input value as the input value changes.

11. The wearable device of claim 10, wherein the processing device is further configured to change the graphical representation of the input value as a time duration increases during which the viewing direction is maintained toward the graphical object.

12. The wearable device of claim 9, wherein the graphical representation is one of a number, a color, or a letter of an alphabet.

13. The wearable device of claim 8,

wherein the processing device is further configured to determine the input value associated with the viewing direction based on a time duration during which the viewing direction is maintained toward the graphical object.

14. The wearable device of claim 11,

wherein the plurality of graphical objects are assigned with a plurality of predetermined values, and

wherein the processing device is further configured to determine whether a sequence of input values matches a predetermined sequence of the predetermined values assigned to the plurality of graphical objects.

15. The wearable device of claim 1, wherein the processing device is further configured to increase the input value by a predetermined value when a predetermined time duration associated with the graphical object has passed while the viewing direction is maintained toward the graphical object.

16. A method of unlocking a wearable device, comprising:

displaying a plurality of graphical objects on a display;

receiving an output from a sensor indicative of a viewing direction of a user of the wearable device;

tracking a pattern of movement of a plurality of viewing directions as the user views the graphical objects;

determining an input value based on a time duration during which a viewing direction is maintained toward a graphical object; and

unlocking the wearable device to display additional information to the user when the pattern of movement of the viewing directions matches a predetermined pattern associated with the graphical objects, and when input values associated with the viewing directions match predetermined values associated with the graphical objects.

17. The method of claim 16, further comprising:

displaying a graphical representation of the input value on the display.

18. The method of claim 17, further comprising:

changing the graphical representation of the input value as the input value changes.