Systems and methods for interacting with a virtual menu
First Claim
1. A wearable device for providing a virtual menu to a user, the wearable device comprising:
- a display;
at least one sensor configured to provide an output indicative of an orientation of a head of the user; and
at least one processing device configured to;
monitor the orientation of the head of the user based on the output of the at least one sensor;
track a pattern of a movement of the head of the user;
cause the virtual menu to be shown on the display after detecting, via the at least one sensor, that the pattern of the movement of the head of the user matches a predetermined pattern, the virtual menu including at least one selectable element;
cause an indicator of a predetermined dwell time threshold representing a predetermined time duration to be shown on the display, the predetermined time duration being associated with selecting the at least one selectable element on the display;
determine, based on the orientation of the head of the user, whether the user is looking in a direction of the at least one selectable element of the virtual menu;
determine, based on the output indicative of the orientation of the head of the user, an amount of time that the user looks in the direction of the at least one selectable element of the virtual menu;
cause at least one action associated with the at least one selectable element of the virtual menu if the amount of time exceeds the predetermined dwell time threshold;
receive a user selection of one of a menu locked mode and a menu unlocked mode;
in response to the user'"'"'s selection of the menu locked mode, fix the virtual menu relative to the display such that the virtual menu does not move relative to the display as the head of the user moves;
in response to the user'"'"'s selection of the menu unlocked mode, fix the virtual menu relative to a real-world coordinate system such that the virtual menu moves relative to the display as the head of the user moves;
in response to receiving a user'"'"'s request to unlock the wearable device, cause the display to display an image including an arrangement of points for entering a password and a cursor movable based on the output of the at least one sensor;
in response to detecting that the cursor is moved to a first point among the arrangement of points, record a first dwell time associated with the first point;
in response to detecting the cursor is moved from the first point to a second point among the arrangement of points, record a second dwell time associated with the second point;
determine whether a sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches a password sequence pattern, the password sequence pattern including a sequence of points and their respectively associated dwell times; and
in response to determining that the sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches the password sequence pattern, unlock the wearable device.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods allow a user to interact with an augmented reality device. In one implementation, a wearable device for providing a virtual menu to a user includes a display; at least one sensor configured to provide an output indicative of a viewing direction the user; and at least one processing device. The at least one processing device is configured to cause a virtual menu to be shown on the display; monitor a viewing direction of the user based on the output of the at least one sensor; determine, based on the monitored viewing direction, whether the user is looking in a direction of a selectable element of the virtual menu; determine an amount of time that the user looks in the direction of the selectable element; and cause at least one action associated with the selectable element if the amount of time exceeds a predetermined dwell time threshold.
22 Citations
26 Claims
-
1. A wearable device for providing a virtual menu to a user, the wearable device comprising:
-
a display; at least one sensor configured to provide an output indicative of an orientation of a head of the user; and at least one processing device configured to; monitor the orientation of the head of the user based on the output of the at least one sensor; track a pattern of a movement of the head of the user; cause the virtual menu to be shown on the display after detecting, via the at least one sensor, that the pattern of the movement of the head of the user matches a predetermined pattern, the virtual menu including at least one selectable element; cause an indicator of a predetermined dwell time threshold representing a predetermined time duration to be shown on the display, the predetermined time duration being associated with selecting the at least one selectable element on the display; determine, based on the orientation of the head of the user, whether the user is looking in a direction of the at least one selectable element of the virtual menu; determine, based on the output indicative of the orientation of the head of the user, an amount of time that the user looks in the direction of the at least one selectable element of the virtual menu; cause at least one action associated with the at least one selectable element of the virtual menu if the amount of time exceeds the predetermined dwell time threshold; receive a user selection of one of a menu locked mode and a menu unlocked mode; in response to the user'"'"'s selection of the menu locked mode, fix the virtual menu relative to the display such that the virtual menu does not move relative to the display as the head of the user moves; in response to the user'"'"'s selection of the menu unlocked mode, fix the virtual menu relative to a real-world coordinate system such that the virtual menu moves relative to the display as the head of the user moves; in response to receiving a user'"'"'s request to unlock the wearable device, cause the display to display an image including an arrangement of points for entering a password and a cursor movable based on the output of the at least one sensor; in response to detecting that the cursor is moved to a first point among the arrangement of points, record a first dwell time associated with the first point; in response to detecting the cursor is moved from the first point to a second point among the arrangement of points, record a second dwell time associated with the second point; determine whether a sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches a password sequence pattern, the password sequence pattern including a sequence of points and their respectively associated dwell times; and in response to determining that the sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches the password sequence pattern, unlock the wearable device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 25, 26)
-
-
15. A method for providing a virtual menu to a user of a wearable device, the method comprising:
-
monitoring an orientation of a head of the user based on an output of at least one sensor configured to track the orientation of the head of the user; tracking a pattern of a movement of the head of the user; causing the virtual menu to be shown on a display of the wearable device after detecting, via the at least one sensor, that the pattern of the movement of the head of the user matches a predetermined pattern, wherein the virtual menu includes at least one selectable element; causing an indicator of a predetermined dwell time threshold representing a predetermined time duration to be shown on the display, the predetermined time duration being associated with selecting the at least one selectable element on the display; determining, based on the orientation of the head of the user, whether the user is looking in a direction of the at least one selectable element of the virtual menu; determining, based on the output indicative of the orientation of the head of the user, an amount of time that the user looks in the direction of the at least one selectable element of the virtual menu; causing at least one action associated with the at least one selectable element of the virtual menu if the amount of time exceeds the predetermined dwell time threshold; receiving a user selection of one of a menu locked mode and a menu unlocked mode; in response to the user'"'"'s selection of the menu locked mode, fixing the virtual menu relative to the display such that the virtual menu does not move relative to the display as the head of the user moves; in response to the user'"'"'s selection of the menu unlocked mode, fixing the virtual menu relative to a real-world coordinate system such that the virtual menu moves relative to the display as the head of the user moves; in response to receiving a user'"'"'s request to unlock the wearable device, causing the display to display an image including an arrangement of points for entering a password and a cursor movable based on the output of the at least one sensor; in response to detecting that the cursor is moved to a first point among the arrangement of points, recording a first dwell time associated with the first point; in response to detecting the cursor is moved from the first point to a second point among the arrangement of points, recording a second dwell time associated with the second point; determining whether a sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches a password sequence pattern, the password sequence pattern including a sequence of points and their respectively associated dwell times; and in response to determining that the sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches the password sequence pattern, unlocking the wearable device. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A non-transitory computer-readable storage medium storing program instructions executable by at least one processor to perform a method for providing a virtual menu to a user of a wearable device, the method comprising:
-
monitoring an orientation of a head of the user based on an output of at least one sensor configured to track the orientation of the head of the user; tracking a pattern of a movement of the head of the user; causing the virtual menu to be shown on a display of the wearable device after detecting, via the at least one sensor, that the pattern of the movement of the head of the user matches a predetermined pattern, wherein the virtual menu includes at least one selectable element; causing an indicator of a predetermined dwell time threshold representing a predetermined time duration to be shown on the display, the predetermined time duration being associated with selecting the at least one selectable element on the display; determining, based on the orientation of the head of the user, whether the user is looking in a direction of the at least one selectable element of the virtual menu; determining, based on the output indicative of the orientation of the head of the user, an amount of time that the user looks in the direction of the at least one selectable element of the virtual menu; causing at least one action associated with the at least one selectable element of the virtual menu if the amount of time exceeds the predetermined dwell time threshold; receiving a user selection of one of a menu locked mode and a menu unlocked mode; in response to the user'"'"'s selection of the menu locked mode, fixing the virtual menu relative to the display such that the virtual menu does not move relative to the display as the head of the user moves; in response to the user'"'"'s selection of the menu unlocked mode, fixing the virtual menu relative to a real-world coordinate system such that the virtual menu moves relative to the display as the head of the user moves; in response to receiving a user'"'"'s request to unlock the wearable device, causing the display to display an image including an arrangement of points for entering a password and a cursor movable based on the output of the at least one sensor; in response to detecting that the cursor is moved to a first point among the arrangement of points, recording a first dwell time associated with the first point; in response to detecting the cursor is moved from the first point to a second point among the arrangement of points, recording a second dwell time associated with the second point; determining whether a sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches a password sequence pattern, the password sequence pattern including a sequence of points and their respectively associated dwell times; and in response to determining that the sequence of the first point and the second point and their respectively associated first dwell time and second dwell time matches the password sequence pattern, unlocking the wearable device.
-
Specification