Methods, systems, and apparatuses to display visibility changes responsive to user gestures

• US 9,817,481 B2
• Filed: 10/06/2015
• Issued: 11/14/2017
• Est. Priority Date: 09/23/2014
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Pantelopoulos, Alexandros, Yuen, Shelten Gee Jao, Panther, Heiko Gernot Albert
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US14/876,781
• Publication Number:
  US 20160077596A1
• Time in Patent Office: 770 Days
• Field of Search: 345156-173
• CPC Class Codes: A61B 5/6802 Sensor mounted on worn items
• CPC Class Codes: A61B 5/681 Wristwatch-type devices
• CPC Class Codes: A61B 5/6824 Arm or wrist
• CPC Class Codes: G01C 22/006 Pedometers
• CPC Class Codes: G01P 15/00 Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G09G 2330/026 Arrangements or methods related to booting a display
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: Y02D 30/50 in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

In one embodiment, an electronic device to be worn on a user'"'"'s forearm includes a display and a set of one or more sensors that provide sensor data. In one aspect, a device may detect, using sensor data obtained from a set of sensors, that a first activity state of a user is active. The device may determine, while the first activity state is active, that the sensor data matches a watch check rule associated with the first activity state. Responsive to the detected match, the device may cause a change in visibility of the display.

Claims

1. An apparatus comprising:

a display;

a set of one or more sensors configured to generate sensor data during a first time period and a second time period;

a set of one or more processors coupled to the display and the set of one or more sensors; and

a non-transitory machine readable storage medium coupled to the set of one or more processors and having stored therein a watch check gesture detector for receiving the sensor data, the watch check gesture detector comprising a watch check rule for causing a change to the display, wherein the watch check rule includes data or logic that represents one or more patterns of movement indicative of a user of the apparatus checking the display,

wherein the storage medium further comprises instructions that, when executed by the set of one or more processors, cause the set of one or more processors to;

detect, using the sensor data, that the user is performing a particular type of activity;

enable the watch check rule based on the detection;

determine, based on the sensor data generated during the first time period and while a first activity metric is displayed on the display, that the user has made a bodily adjustment matching the one or more patterns of movement indicative of the user checking the display such that the watch check rule is satisfied;

in response to determining that the watch check rule is satisfied, cause a first change to the display, the first change causing the display displaying the first activity metric to display a second activity metric different from the first activity metric and indicative of the user'"'"'s performance with respect to the particular type of activity;

log first accelerometer data extracted from the sensor data generated during the first time period, the first accelerometer data comprising a first x-axis value and a first y-axis value;

extract second accelerometer data from the sensor data generated during the second time period, the second accelerometer data comprising a second x-axis value and a second y-axis value;

determine whether the second x-axis value of the second accelerometer data exceeds the first x-axis value of the logged first accelerometer data by a first threshold amount;

determine whether the second y-axis value of the second accelerometer data exceeds the first y-axis value of the logged first accelerometer data by a second threshold amount; and

in response to determining that (i) the second x-axis value exceeds the first x-axis value by the first threshold amount and (ii) the second y-axis value exceeds the first y-axis value by the second threshold amount, cause a second change to the display, the second change causing the display displaying the second activity metric to display the first activity metric.

2. The apparatus of claim 1, wherein the set of one or more sensors is further configured to generate sensor data during a third time period, and the instructions, when executed by the set of one or more processors, further cause the set of one or more processors to calculate the second activity metric from the sensor data generated during the third time period.

3. The apparatus of claim 2, wherein the sensor data generated during the third time period includes third accelerometer data, and the second activity metric is a step count.

4. The apparatus of claim 2, wherein the second activity metric is at least one of a time, a pace, a speed, a distance, a mile split, a heart rate, a clock, a step count, a floor count, an estimation of calories burned, or an active minute count.

5. The apparatus of claim 1, wherein the instructions, when executed by the set of one or more processors, further cause the set of one or more processors to determine that the second x-axis value exceeds the first x-axis value by the first threshold amount when the second x-axis value exceeds the first x-axis value by the first threshold amount for a first threshold number of samples, and to determine that the second y-axis value exceeds the first y-axis value by the second threshold amount when the second y-axis value exceeds the first y-axis value by the second threshold amount for a second threshold number of samples.

6. The apparatus of claim 1, wherein the instructions, when executed by the set of one or more processors, further cause the set of one or more processors to transform each of one or more of the first and second x-axis values and the first and second y-axis values to an absolute value.

7. A non-transitory machine readable storage medium storing therein a watch check detector for receiving sensor data generated by one or more sensors of a wearable electronic device, the watch check gesture detector comprising a watch check rule for causing a change to a display of the wearable electronic device, wherein the watch check rule includes data or logic that represents one or more patterns of movement indicative of a user of the wearable electronic device checking the display,

wherein the storage medium further comprises instructions that, when executed by one or more processors, cause the one or more processors to:

detect, using the sensor data, that the user is performing a particular type of activity;

enable the watch check rule based on the detection;

determine, based on sensor data generated by the one or more sensors during a first time period and while a first content is displayed on the display, that the user has made a bodily adjustment matching the one or more patterns of movement indicative of the user checking the display such that the watch check rule is satisfied;

in response to determining that the watch check rule is satisfied, cause a first change to the display, the first change causing the display displaying the first content to display a first activity metric different from the first content and indicative of the user'"'"'s performance with respect to the particular type of activity;

log first accelerometer data extracted from the sensor data generated during the first time period, the first accelerometer data comprising a first x-axis value and a first y-axis value;

extract second accelerometer data from sensor data generated during a second time period, the second accelerometer data comprising a second x-axis value and a second y-axis value;

determine whether the second x-axis value of the second accelerometer data exceeds the first x-axis value of the logged first accelerometer data by a first threshold amount;

determine whether the second y-axis value of the second accelerometer data exceeds the first y-axis value of the logged first accelerometer data by a second threshold amount; and

in response to determining that (i) the second x-axis value exceeds the first x-axis value by the first threshold amount and (ii) the second y-axis value exceeds the first y-axis value by the second threshold amount, cause a second change to the display, the second change causing the display displaying the first activity metric to display the first content.

8. The non-transitory machine readable storage medium of claim 7, wherein causing the first change includes causing the display displaying a second activity metric different from the first activity metric to display the first activity metric.

9. The non-transitory machine readable storage medium of claim 7, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

obtain sensor data generated by the one or more sensors during a third time period; and

calculate the first activity metric from the sensor data generated during the third time period.

10. The non-transitory machine readable storage medium of claim 9, wherein the sensor data generated during the third time period includes third accelerometer data, and the first activity metric is a step count.

11. The non-transitory machine readable storage medium of claim 9, wherein the first activity metric is at least one of a time, a pace, a speed, a distance, a mile split, a heart rate, a clock, a step count, a floor count, an estimation of calories burned, or an active minute count.

12. The non-transitory machine readable storage medium of claim 7, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to determine that the second x-axis value exceeds the first x-axis value by the first threshold amount when the second x-axis value exceeds the first x-axis value by the first threshold amount for a first threshold number of samples, and to determine that the second y-axis value exceeds the first y-axis value by the second threshold amount when the second y-axis value exceeds the first y-axis value by the second threshold amount for a second threshold number of samples.

13. The non-transitory machine readable storage medium of claim 7, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to transform each of one or more of the first and second x-axis values and the first and second y-axis values to an absolute value.

14. The non-transitory machine readable storage medium of claim 7, wherein the second change to the display is causing the display displaying the first activity metric to display a second activity metric different from the first activity metric.

15. A method operable by a wearable electronic device comprising one or more sensors configured to generate sensor data, the wearable electronic device having stored thereon a watch check rule for causing a change to a display of the wearable electronic device, wherein the watch check rule includes data or logic that represents one or more patterns of movement indicative of a user of the wearable electronic device checking the display, the method comprising:

detecting, using the sensor data, that the user is performing a particular type of activity;

enabling the watch check rule based on the detection;

determining, based on sensor data generated by the one or more sensors during a first time period and while a first content is displayed on the display, that the user has made a bodily adjustment matching the one or more patterns of movement indicative of the user checking the display such that the watch check rule is satisfied;

in response to determining that the watch check rule is satisfied, causing a first change to the display, the first change causing the display displaying the first content to display a first activity metric different from the first content and indicative of the user'"'"'s performance with respect to the particular type of activity;

logging first accelerometer data extracted from the sensor data generated during the first time period, the first accelerometer data comprising a first x-axis value and a first y-axis value;

extracting second accelerometer data from sensor data generated during a second time period, the second accelerometer data comprising a second x-axis value and a second y-axis value;

determining whether the second x-axis value of the second accelerometer data exceeds the first x-axis value of the logged first accelerometer data by a first threshold amount;

determining whether the second y-axis value of the second accelerometer data exceeds the first y-axis value of the logged first accelerometer data by a second threshold amount; and

in response to determining that (i) the second x-axis value exceeds the first x-axis value by the first threshold amount and (ii) the second y-axis value exceeds the first y-axis value by the second threshold amount, causing a second change to the display, the second change causing the display displaying the first activity metric to display the first content.

16. The method of claim 15, wherein causing the first change includes causing the display displaying a second activity metric different from the first activity metric to display the first activity metric.

17. The method of claim 15, further comprising:

obtaining sensor data generated by the one or more sensors during a third time period; and

calculating the first activity metric from the sensor data generated during the third time period.

18. The method of claim 17, wherein the first activity metric is at least one of a time, a pace, a speed, a distance, a mile split, a heart rate, a clock, a step count, a floor count, an estimation of calories burned, or an active minute count.

19. The method of claim 15, further comprising determining that the second x-axis value exceeds the first x-axis value by the first threshold amount when the second x-axis value exceeds the first x-axis value by the first threshold amount for a first threshold number of samples, and determining that the second y-axis value exceeds the first y-axis value by the second threshold amount when the second y-axis value exceeds the first y-axis value by the second threshold amount for a second threshold number of samples.

20. The method of claim 15, further comprising transforming each of one or more of the first and second x-axis values and the first and second y-axis values to an absolute value.