Biometric monitoring device with immersion sensor and swim stroke detection and related methods

• US 9,655,548 B2
• Filed: 10/23/2015
• Issued: 05/23/2017
• Est. Priority Date: 06/22/2012
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Yuen, Shelten Gee Jao, Hong, Jung Ook, Axley, Andrew Cole
• Primary Examiner(s): LAU, TUNG S
• Application Number:
  US14/921,626
• Publication Number:
  US 20160051169A1
• Time in Patent Office: 578 Days
• Field of Search: 702188
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 2560/0252 using ambient temperature
• CPC Class Codes: A61B 2560/0257 using atmospheric pressure
• CPC Class Codes: A61B 2560/0475 Special features of memory means, e.g. removable memory cards
• CPC Class Codes: A61B 2562/0214 Capacitive electrodes
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/0223 Magnetic field sensors
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/02427 Details of sensor
• CPC Class Codes: A61B 5/02433 for infrared radiation
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/4812 Detecting sleep stages or cycles
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/681 Wristwatch-type devices
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/7455 characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: A63B 2024/0068 : Comparison to target or threshold, previous performance or not real time comparison to other individuals
• CPC Class Codes: A63B 2209/10 : with adhesive type surfaces, i.e. hook and loop-type fastener
• CPC Class Codes: A63B 2220/44 : Angular acceleration
• CPC Class Codes: A63B 2220/80 : Special sensors, transducers or devices therefor
• CPC Class Codes: A63B 2220/836 : Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/50 : Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2244/20 : Swimming
• CPC Class Codes: A63B 24/0062 : Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 71/06 : Indicating or scoring devices for games or players , or for other sports activities
• CPC Class Codes: G01C 19/005 : Measuring angular rate using gyroscopic effects
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/027 : using movement velocity, acceleration information
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

Biometric monitoring devices, including various technologies that may be implemented in such devices, are discussed herein. Additionally, techniques for utilizing gyroscopes in biometric monitoring devices are provided. Such techniques may, in some implementations, involve obtaining swimming metrics regarding swim stroke count, lap count, and stroke type. A biometric monitoring device for obtaining such metrics may include an immersions sensor.

Claims

1. A biometric monitoring system comprising:

a housing configured to be worn on a person'"'"'s forearm or insertable into an accessory to be worn on the person'"'"'s forearm;

at least one motion sensor located in the housing;

a notification system;

an immersion sensor, wherein the immersion sensor is selected from the group consisting of;

a barometric altimeter sensor, a galvanic skin response sensor, and a temperature sensor;

a memory; and

control logic, wherein;

the control logic, the memory, the immersion sensor, and the at least one motion sensor are communicatively connected with one another, and

the control logic is configured to;

a) obtain motion data from the at least one motion sensor,

b) determine that data from the immersion sensor indicates that the immersion sensor has undergone immersion in liquid on a continuous or regular basis consistent with immersion experienced by the person when the person is swimming,

c) determine, based on the motion data corresponding with intervals in which the data from the immersion sensor indicates that the immersion sensor has undergone immersion in liquid on a continuous or regular basis consistent with immersion experienced by the person when the person is swimming, each time a swim stroke is indicated, at least in part, by characteristics of the motion data,

d) alter stored information pertaining to a number of swim strokes in the memory responsive to (c),

e) provide a notification regarding achievement of a biometric performance goal using the notification system, and

f) increase an intensity with which the notification system provides the notification when data from the immersion sensor indicates that the immersion sensor is submerged in liquid on a continuous or regular basis consistent with immersion experienced by a person'"'"'s hand when the person is swimming as compared with the intensity with which the notification system normally provides notifications when data from the immersion sensor indicates that the immersion sensor is not submerged in liquid on a continuous or regular basis consistent with immersion experienced by the person'"'"'s hand when the person is swimming.

2. The biometric monitoring system of claim 1, wherein the at least one motion sensor includes a motion sensor selected from the group consisting of:

(i) a true gyroscopic motion sensor and (ii) a simulated gyroscopic sensor selected from the group consisting of;

two or more accelerometers, a magnetometer, and combinations thereof.

3. The biometric monitoring system of claim 1, wherein the notification system includes at least one item selected from the group consisting of:

an audio notification device, a haptic feedback notification device, and combinations thereof.

4. The biometric monitoring system of claim 1, wherein the control logic is further configured to perform (c) by using peak detection to detect peaks in the motion data associated with each swim stroke.

5. The biometric monitoring system of claim 1, wherein the control logic is further configured to:

g) determine one or more swim stroke types represented by the motion data, and

h) alter stored information pertaining to the one or more swim stroke types based on the determination of the one or more swim stroke types.

6. The biometric monitoring system of claim 1, wherein the control logic is further configured to:

g) determine, for each swim stroke and based at least in part on the motion data, a swim stroke type that corresponds to that swim stroke; and

h) alter stored information pertaining to the corresponding swim stroke type based on each swim stroke type determination in (g).

7. The biometric monitoring system of claim 1, wherein the immersion sensor is a barometric altimeter sensor configured to output pressure data and the control logic is further configured to:

g) analyze at least the motion data for each swim stroke in conjunction with the pressure data for that swim stroke to determine a corresponding swim stroke type for that swim stroke; and

h) alter stored information pertaining to the corresponding swim stroke type based on each swim stroke type determination in (g).

8. The biometric monitoring system of claim 1, wherein the control logic is further configured to:

g) determine, based at least in part on the motion data, that a swimming lap has ended, and

h) alter stored information pertaining to an amount of swimming laps responsive, at least in part, to (g).

9. The biometric monitoring system of claim 1, wherein the control logic is further configured to:

g) determine, based at least in part on the motion data, a first swim stroke rate at a first time,

h) determine, based at least in part on the motion data, a second swim stroke rate at a second time after the first time,

i) determine that the second swim stroke rate is lower than the first swim stroke rate by a predefined metric, and

j) cause the notification system to provide a notification responsive to (i), wherein the notification is indicative of potential swimmer fatigue.

10. The biometric monitoring system of claim 6, wherein the control logic is further configured to perform (g) by:

determining one or more data points for each swim stroke, each data point representative of an item selected from the group consisting of;

a maximum within a portion of the motion data for that swim stroke and a minimum within a portion of the motion data for that swim stroke, and

determining, for each swim stroke, that the one or more data points for that swim stroke at least correlate temporally with a temporal maxima/minima signature associated with the corresponding swim stroke type.

11. The biometric monitoring system of claim 8, wherein the control logic is further configured to:

perform (g) by determining, based at least on the motion data, that one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately preceding the one or more consecutive swim strokes.

12. The biometric monitoring system of claim 8, wherein the control logic is further configured to:

perform (g) by determining, based at least on the motion data, that one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately preceding the one or more consecutive swim strokes and that the one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately following the one or more consecutive swim strokes.

13. The biometric monitoring system of claim 8, wherein the control logic is further configured to:

perform (g) by determining, based at least on the motion data, that one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately preceding the one or more consecutive swim strokes and that the motion data for the one or more consecutive swim strokes does not correlate with any of one or more predetermined swim stroke type signatures.

14. The biometric monitoring system of claim 8, wherein the control logic is further configured to:

i) determine, based at least in part on the motion data, a first number of swim strokes per lap for a first lap,

j) determine, based at least in part on the motion data, a second number of swim strokes per lap for a second lap after the first lap,

k) determine that the second number of swim strokes per lap is higher than the first number of swim strokes per lap by a predetermined amount, and

l) cause the notification system to provide a notification responsive to (k), wherein the notification is indicative of potential swimmer fatigue.

15. The biometric monitoring system of claim 8, wherein the control logic is further configured to:

i) determine, based at least in part on the motion data, a first lap duration for a first lap,

j) determine, based at least in part on the motion data, a second lap duration for a second lap after the first lap,

k) determine that the second lap duration is higher than the first lap duration by a predetermined amount, and

l) cause the notification system to provide a notification responsive to (k), wherein the notification is indicative of potential swimmer fatigue.

16. The biometric monitoring system of claim 14, wherein the notification system includes at least one item selected from the group consisting of:

an audio notification device, a haptic feedback notification device, and combinations thereof.

17. The biometric monitoring system of claim 15, wherein the notification system includes at least one item selected from the group consisting of:

an audio notification device, a haptic feedback notification device, and combinations thereof.

18. The biometric monitoring system of claim 9, wherein the notification system includes at least one item selected from the group consisting of:

an audio notification device, a haptic feedback notification device, and combinations thereof.

19. A method comprising:

a) obtaining motion data from at least one motion sensor of a wearable biometric monitoring system having;

a housing configured to be worn on a person'"'"'s forearm or insertable into an accessory to be worn on the person'"'"'s forearm;

at least one motion sensor located in the housing;

a notification system;

an immersion sensor, wherein the immersion sensor is selected from the group consisting of;

a barometric altimeter sensor, a galvanic skin response sensor, and a temperature sensor;

a memory; and

control logic communicatively connected with the memory, the immersion sensor, and the at least one motion sensor;

b) determining that data from the immersion sensor of the wearable biometric monitoring system indicates that the immersion sensor is immersed in liquid on a continuous or regular basis consistent with immersion experienced by a person when the person is swimming;

c) determining, based on the motion data corresponding with intervals in which the data from the immersion sensor indicates that the immersion sensor has undergone immersion in liquid on a continuous or regular basis consistent with immersion experienced by the person when the person is swimming, each time a swim stroke is indicated, at least in part, by characteristics of the motion data;

d) altering stored information pertaining to a number of swim strokes in a memory of the biometric monitoring system responsive to (c); and

e) providing a notification regarding achievement of a biometric performance goal using the notification system of the wearable biometric monitoring system at an increased intensity when data from the immersion sensor indicates that the immersion sensor is submerged in liquid on a continuous or regular basis consistent with immersion experienced by a person'"'"'s hand when the person is swimming as compared with the intensity with which the notification system normally provides notifications when data from the immersion sensor indicates that the immersion sensor is not submerged in liquid on a continuous or regular basis consistent with immersion experienced by the person'"'"'s hand when the person is swimming.

20. The method of claim 19, wherein (c) is performed by using peak detection to detect peaks in the motion data associated with each swim stroke.

21. The method of claim 19, further comprising:

f) determining one or more swim stroke types represented by the motion data, and

g) altering stored information pertaining to the one or more swim stroke types based on the determination of the one or more swim stroke types.

22. The method of claim 19, further comprising:

f) determining, for each swim stroke and based at least in part on the motion data, a swim stroke type that corresponds to that swim stroke; and

g) altering stored information pertaining to the corresponding swim stroke type based on each swim stroke type determination in (f).

23. The method of claim 19, wherein the immersion sensor is a barometric altimeter sensor configured to output pressure data and the method further comprises:

f) analyzing at least the motion data for each swim stroke in conjunction with the pressure data for that swim stroke to determine a corresponding swim stroke type for that swim stroke; and

g) altering stored information pertaining to the corresponding swim stroke type based on each swim stroke type determination in (f).

24. The method of claim 19, further comprising:

f) determining, based at least in part on the motion data, that a swimming lap has ended, and

g) altering stored information pertaining to an amount of swimming laps responsive, at least in part, to (f).

25. The method of claim 22, wherein (f) is performed by:

determining one or more data points for each swim stroke, each data point representative of an item selected from the group consisting of;

a maximum within a portion of the motion data for that swim stroke and a minimum within a portion of the motion data for that swim stroke, and

determining, for each swim stroke, that the one or more data points for that swim stroke at least correlate temporally with a temporal maxima/minima signature associated with the corresponding swim stroke type.

26. The method of claim 24, further comprising:

performing (f) by determining, based at least on the motion data, that one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately preceding the one or more consecutive swim strokes.

27. The method of claim 24, further comprising:

performing (f) by determining, based at least on the motion data, that one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately preceding the one or more consecutive swim strokes and that the one or more consecutive swim strokes has a duration or durations that are different from durations of a plurality of swim strokes immediately following the one or more consecutive swim strokes.