Swim Lap Counting and Timing System and Methods for Event Detection from Noisy Source Data

• US 20170178524A1
• Filed: 03/03/2017
• Published: 06/22/2017
• Est. Priority Date: 05/06/2015
• Status: Abandoned Application

• Current Assignee: Ocula Corporation
• Original Assignee: Ocula Corporation
• Inventors: Firmin, Robert L.
• Application Number:
  US15/449,323
• Publication Number:
  US 20170178524A1
• Time in Patent Office: Days
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: A63B 2220/17 Counting, e.g. counting periodical movements, revolutions or cycles, or including further data processing to determine distances or speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2230/06 heartbeat rate only
• CPC Class Codes: A63B 2230/75 calorie expenditure
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 33/002 Swimming goggles
• CPC Class Codes: A63B 71/0619 Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: A63B 71/0686 Timers, rhythm indicators or pacing apparatus using electric or electronic means
• CPC Class Codes: G06N 20/10 using kernel methods, e.g. support vector machines [SVM]
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/758 Involving statistics of pixels or of feature values, e.g. histogram matching
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G07C 1/22 in connection with sports or games
• CPC Class Codes: G07C 1/24 Race time-recorders
• CPC Class Codes: G09B 19/003 Repetitive work cycles; Sequence of movements
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip

Abstract

Systems and methods for lap timing and counting in athletic events are disclosed. The systems and methods do not require the athlete to wear a counter/timer, a transmitter, a reflector or another kind of marker. A portable computing device with a sensor, such as a tablet computer with a camera, is positioned in an appropriate location. Data from the sensor is transformed into a time series of data, and one or more learned statistics are calculated in real time as benchmark ambient conditions. The learned statistics are essentially continuously updated and data that indicates irrelevant volatility is excluded. A detection threshold is determined and essentially continuously updated based on the learned statistics, and lap completion is determined based on the threshold. Times, lap counts, and other data are displayed on the portable device in real time.

Claims

1. A system, comprising:

a pair of swim goggles having an informational display; and

a computing device including

at least one sensor,

a communication device adapted to communicate with the goggles, and

a set of computer-readable instructions on a non-transitory computer-readable medium coupled to or associated with the computing device that, when executed on the computing device, cause the computing device to

gather data indicating whether a swimmer has passed a defined point to complete a lap using the at least one sensor,

when the data indicates that the athlete has passed the defined point, increment a lap count and lap timing information, and

cause the informational display of the goggles to display the lap count and lap timing information.

2. The system of claim 1, wherein the set of computer-readable instructions are further adapted to cause the computing device to:

transform the data using the computing device from a first form into a second form in which the data can be evaluated as a time series;

evaluate selected data points of the time series of data in real time using the computing device to establish at least one learned statistic that is updated continuously at a defined rate and that represents a set of ambient conditions around the defined point over one or more time spans of undisturbed data, the time spans being selected in real time during a time period of the data gathering and being within the time period of data gathering; and

detect that the swimmer has passed the defined point in real time using the computing device by determining that the time series of data has deviated from the learned statistic in a specified way by more than a defined threshold, the defined threshold determined, at least in part, using the learned statistic, the deviation of the learned statistic in the specified way indicating that the swimmer has moved through a detection field of the at least one sensor and has thus passed the defined point.

3. The system of claim 1, wherein the informational display comprises a head-up display (HUD) or a virtual retinal display (VRD).

4. The system of claim 3, further comprising a body sensor selected from the group consisting of a heart monitor and an accelerometer.

5. The system of claim 4, wherein the body sensor is adapted to be placed under a swim cap.

6. The system of claim 5, wherein output from the body sensor is displayed using the informational display.

7. The system of claim 6, wherein metrics derived or calculated from the output are displayed using the HUD or VRD.

8. The system of claim 7, wherein the derived metrics comprise one or more of stroke count, heart rate mean for an entire session, heart rate mean for a current lap, heart rate mean for a previous completed lap, heart rate relative to maximum rate, heart rate relative to a predefined target, calories burned, or hydration or dehydration status.

9. The system of claim 1, wherein the at least one sensor comprises a camera.

11. The system of claim 1, wherein the at least one sensor comprises an ultrasonic sensor.

12. A system, comprising:

a swim cap having at least one body sensor therein; and

a computing device including

a display,

at least one sensor,

a communication device adapted to communicate with the at least one body sensor, and

a set of computer-readable instructions on a non-transitory computer-readable medium coupled to or associated with the computing device that, when executed on the computing device, cause the computing device to

gather data indicating whether a swimmer has passed a defined point to complete a lap using the at least one sensor,

when the data indicates that the athlete has passed the defined point, increment a lap count and lap timing information, and

cause the display to display the lap count and lap timing information along with corresponding information from the at least one body sensor.

13. The system of claim 12, wherein the set of computer-readable instructions are further adapted to cause the computing device to:

transform the data using the computing device from a first form into a second form in which the data can be evaluated as a time series;

evaluate selected data points of the time series of data in real time using the computing device to establish at least one learned statistic that is updated continuously at a defined rate and that represents a set of ambient conditions around the defined point over one or more time spans of undisturbed data, the time spans being selected in real time during a time period of the data gathering and being within the time period of data gathering; and

detect that the swimmer has passed the defined point in real time using the computing device by determining that the time series of data has deviated from the learned statistic in a specified way by more than a defined threshold, the defined threshold determined, at least in part, using the learned statistic, the deviation of the learned statistic in the specified way indicating that the swimmer has moved through a detection field of the at least one sensor and has thus passed the defined point.

14. The system of claim 12, wherein the body sensor comprises a heart monitor or an accelerometer.

15. The system of claim 12, wherein the information from the at least one body sensor comprises derived metrics including one or more of stroke count, heart rate mean for an entire session, heart rate mean for a current lap, heart rate mean for a previous completed lap, heart rate relative to maximum rate, heart rate relative to a predefined target, calories burned, or hydration or dehydration status.

16. The system of claim 12, wherein the at least one sensor comprises a camera.

17. The system of claim 12, wherein the at least one sensor comprises an ultrasonic sensor.

18. The system of claim 12, wherein the at least one body sensor comprises an accelerometer.

19. The system of claim 18, wherein the set of computer-readable instructions further cause the computing system to derive a stroke count based on a number of head turns counted using the accelerometer.