Magnetometer-based gesture sensing with a wearable device
First Claim
1. In a wearable head-mounted display (HMD) having a processor and a magnetometer device with three orthogonal measurement axes, a computer-implemented method comprising:
- operating in a background detection state;
while operating in the background detection state, carrying out functions of the background state including,measuring three orthogonal components of a background magnetic field with the magnetometer device, and determining a field magnitude of the background magnetic field from the three measured orthogonal components,determining an occurrence of a trigger from a hand-wearable magnet (HWM) at a time Tstart upon detecting a perturbation by the HWM of the determined field magnitude at least as large as a perturbation threshold,and upon determining the occurrence of the trigger, transitioning to operating in a gesture detection state; and
while operating in the gesture detection state, carrying out functions of the gesture detection state including,for the duration of the gesture detection state, tracking motion of the HWM by determining time derivatives of magnetic field strength measured by the magnetometer device along each of the three orthogonal measurement axes,making a comparison of the determined time derivatives with one or more sets of pre-determined time derivatives of magnetic field strength, each of the one or more sets being stored at the wearable HMD and each being associated with a respective known gesture,upon matching the determined time derivatives with a particular set of the one or more sets based on the comparison, identifying the respective known gesture associated with the particular set,and transitioning to operating in the background detection state upon both of, measuring the magnitude perturbation by the HWM of the determined field magnitude to be less than the perturbation threshold, and determining an expiration of a time interval W that begins at Tstart.
2 Assignments
0 Petitions
Accused Products
Abstract
A wearable computing device such as a head-mounted display (HMD) may be equipped with a magnetometer for detecting presence and motion of a hand-wearable magnet (HWM). The HMD may analyze magnetic field measurements of the magnetometer to determine when the HWM moves within a threshold distance of the magnetometer, and may thereafter determine one or more patterns of motion of the HWM based the magnetic field measurements. The HMD may operate in a background detection state in order to determine a background magnetic field strength and to monitor for magnetic disturbances from the HWM. Upon occurrence of a trigger event corresponding to magnetic disturbance above a threshold level, the HMD may transition to operating in a gesture detection state in which it analyzes magnetometer measurements for correspondence with known gestures. Upon recognizing a known gesture, the HMD may carry out one or more actions based on the recognized known gesture.
-
Citations
35 Claims
-
1. In a wearable head-mounted display (HMD) having a processor and a magnetometer device with three orthogonal measurement axes, a computer-implemented method comprising:
-
operating in a background detection state; while operating in the background detection state, carrying out functions of the background state including, measuring three orthogonal components of a background magnetic field with the magnetometer device, and determining a field magnitude of the background magnetic field from the three measured orthogonal components, determining an occurrence of a trigger from a hand-wearable magnet (HWM) at a time Tstart upon detecting a perturbation by the HWM of the determined field magnitude at least as large as a perturbation threshold, and upon determining the occurrence of the trigger, transitioning to operating in a gesture detection state; and while operating in the gesture detection state, carrying out functions of the gesture detection state including, for the duration of the gesture detection state, tracking motion of the HWM by determining time derivatives of magnetic field strength measured by the magnetometer device along each of the three orthogonal measurement axes, making a comparison of the determined time derivatives with one or more sets of pre-determined time derivatives of magnetic field strength, each of the one or more sets being stored at the wearable HMD and each being associated with a respective known gesture, upon matching the determined time derivatives with a particular set of the one or more sets based on the comparison, identifying the respective known gesture associated with the particular set, and transitioning to operating in the background detection state upon both of, measuring the magnitude perturbation by the HWM of the determined field magnitude to be less than the perturbation threshold, and determining an expiration of a time interval W that begins at Tstart. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. In a wearable head-mounted display (HMD) having a processor and a magnetometer device with three orthogonal measurement axes, a computer-implemented method comprising:
-
operating in a background detection state; while operating in the background detection state, carrying out functions of the background state including, measuring three orthogonal components of a background magnetic field with the magnetometer device, and determining a field magnitude of the background magnetic field from the three measured orthogonal components, determining an occurrence of a trigger from a hand-wearable magnet (HWM) at a time Tstart upon detecting a perturbation by the HWM of the determined field magnitude at least as large as a perturbation threshold, and upon determining the occurrence of the trigger, transitioning to operating in a gesture detection state; and while operating in the gesture detection state, carrying out functions of the gesture detection state including, for the duration of the gesture detection state, tracking motion of the HWM by determining time derivatives of magnetic field strength measured by the magnetometer device along each of the three orthogonal measurement axes, analyzing the determined time derivatives to determine a known gesture, identifying a pre-determined computer-executable action associated with the determined known gesture, and transitioning to operating in the background detection state upon both of, measuring the magnitude perturbation by the HWM of the determined field magnitude to be less than the perturbation threshold, and determining an expiration of a time interval W that begins at Tstart.
-
-
22. A wearable head-mount display (HMD) comprising:
-
a processor; memory accessible to the processor; a magnetometer device with three orthogonal measurement axes; and executable instructions stored in the memory that upon execution by the processor cause the HMD to carry out operations including; operating in a background detection state, while operating in the background detection state, carrying out functions of the background state including; measuring three orthogonal components of a background magnetic field with the magnetometer device, and determining a field magnitude of the background magnetic field from the three measured orthogonal components, determining an occurrence of a trigger from a hand-wearable magnet (HWM) at a time Tstart by detecting a perturbation upon the HWM of the determined field magnitude at least as large as a perturbation threshold, and upon determining the occurrence of the trigger, transitioning to operating in a gesture detection state, and while operating in the gesture detection state, carrying out functions of the gesture detection state including; for the duration of the gesture detection state, tracking motion of the HWM by determining time derivatives of magnetic field strength measured by the magnetometer device along each of the three orthogonal measurement axes, making a comparison of the determined time derivatives with one or more sets of pre-determined time derivatives of magnetic field strength, wherein each of the one or more sets is stored at the wearable HMD and each is associated with a respective known gesture, upon matching the determined time derivatives with a particular set of the one or more sets based on the comparison, identifying the respective known gesture associated with the particular set, and transitioning to operating in the background detection state upon both of, measuring the magnitude perturbation by the HWM of the determined field magnitude to be less than the perturbation threshold, and determining an expiration of a time interval W that begins at Tstart. - View Dependent Claims (23, 24, 25, 26, 27, 28)
-
-
29. A nontransitory computer-readable medium having instructions stored thereon that, upon execution by one or more processors of a wearable head-mounted display (HMD), cause the wearable HMD to carry out operations comprising:
-
operating in a background detection state; while operating in the background detection state, carrying out functions of the background state including, measuring three orthogonal components of a background magnetic field using three orthogonal measurement axes of magnetometer device of the wearable HMD, and determining a field magnitude of the background magnetic field from the three measured orthogonal components, determining an occurrence of a trigger from a hand-wearable magnet (HWM) at a time Tstart upon detecting a perturbation by the HWM of the determined field magnitude at least as large as a perturbation threshold, and upon determining the occurrence of the trigger, transitioning to operating in a gesture detection state; and while operating in the gesture detection state, carrying out functions of the gesture detection state including, for the duration of the gesture detection state, tracking motion of the HWM by determining time derivatives of magnetic field strength measured by the magnetometer device along each of the three orthogonal measurement axes, making a comparison of the determined time derivatives with one or more sets of pre-determined time derivatives of magnetic field strength, wherein each of the one or more sets is configured to be stored at the wearable HMD and each is associated with a respective known gesture, upon matching the determined time derivatives with a particular set of the one or more sets based on the comparison, identifying the respective known gesture associated with the particular set, and transitioning to operating in the background detection state upon both of, measuring the magnitude perturbation by the HWM of the determined field magnitude to be less than the perturbation threshold, and determining an expiration of a time interval W that begins at Tstart. - View Dependent Claims (30, 31, 32, 33, 34, 35)
-
Specification