Swim lap counting and timing system and methods for event detection from noisy source data

• US 9,778,622 B2
• Filed: 11/10/2015
• Issued: 10/03/2017
• Est. Priority Date: 05/06/2015
• Status: Active Grant

• Current Assignee: Ocula Corporation
• Original Assignee: Ocula Corporation
• Inventors: Firmin, Robert L
• Primary Examiner(s): BLOSS, STEPHANIE E
• Application Number:
  US14/937,474
• Publication Number:
  US 20160327913A1
• Time in Patent Office: 693 Days
• Field of Search: 702150
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G01V 8/10 Detecting, e.g. by using light barriers by reflection from the object G01S17/00
• CPC Class Codes: G04F 10/00 Apparatus for measuring unknown time intervals by electric means
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 18/2193 based on specific statistical tests
• CPC Class Codes: G06F 18/24155 Bayesian classification
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/7796 based on specific statistical tests
• CPC Class Codes: G06V 20/42 of sport video content

Abstract

Systems and methods for lap timing and counting in athletic events are disclosed. The systems and methods do not require the athlete to wear a counter/timer, a transmitter, a reflector or another kind of marker. A portable computing device with a sensor, such as a tablet computer with a camera, is positioned in an appropriate location. Data from the sensor is transformed into a time series of data, and one or more learned statistics are calculated in real time as benchmark ambient conditions. The learned statistics are essentially continuously updated and data that indicates irrelevant volatility is excluded. A detection threshold is determined and essentially continuously updated based on the learned statistics, and lap completion is determined based on the threshold. Times, lap counts, and other data are displayed on the portable device in real time.

Claims

1. A system, comprising:

a computing device including at least one sensor and a display, the computing device being adapted to be placed in a position to observe a moving object with the at least one sensor;

a set of computer-readable instructions on a non-transitory computer-readable medium coupled to or associated with the computing device that, when executed on the computing device, cause the computing device to

gather data indicating whether the moving object has passed a defined point using the at least one sensor with the at least one sensor operating according to a predefined set of parameters selected for the position and environment around the computing device, such that each of the data points is taken consistently according to the set of parameters,

transform the data using the computing device from a first form into a second form in which the data can be evaluated as a time series,

evaluate selected data points of the time series of data in real time using the computing device to establish at least one learned statistic that is updated continuously at a defined rate and that represents a set of ambient conditions around the defined point over one or more time spans of undisturbed data, the time spans being selected in real time during a time period of the data gathering and being within the time period of data gathering,

detect that the event has occurred in real time using the computing device by determining that the time series of data has deviated from the learned statistic in a specified way by more than a defined threshold, the defined threshold determined, at least in part, using the learned statistic, the deviation of the learned statistic in the specified way indicating that the moving object has moved through a detection field of the at least one sensor and has thus passed the defined point, and

display one or both of timing or event count information on the display screen based on the detection.

2. The system of claim 1, wherein the set of computer-readable instructions further cause the computing device to repeat and increment the event count with additional detections.

3. The system of claim 1, wherein the evaluation further comprises updating the learned statistic with new data values from the time series of data only when the new data values satisfy a maximum acceptable proportional change criterion indicating that a period of non-ambient volatility has passed.

4. The system of claim 1, wherein the evaluation further comprises updating the learned statistic with new data values only if the new data values evince a change in a specified way.

5. The system of claim 1, wherein the evaluation comprises evaluating and correcting the level of the learned statistic over time.

6. The system of claim 1, wherein the set of computer-readable instructions further cause the computing device to delay the detection for a non-zero interval of time such that the detection occurs only when it is physically possible for the event to occur.

7. The system of claim 1, further comprising a waterproof case enclosing the computing device.

8. The system of claim 1, wherein the at least one sensor comprises a camera.

9. The system of claim 8, wherein the set of computer-readable instructions, when executed, also cause the computing device to gather light intensity data from the camera at a first defined rate.

10. The system of claim 9, wherein the set of computer-readable instructions, when executed, also cause the computing device to gather photographs or video from the camera at a second defined rate.

11. The system of claim 10, wherein the first defined rate is different than the second defined rate.

12. The system of claim 9, further comprising a periscope positioned and adapted to change a field of view of the rear camera from a rear of the computing device to a front of the computing device.

13. The system of claim 8, wherein the camera comprises a rear camera.

14. The system of claim 1, wherein the moving object comprises a swimmer and the defined point comprises a lap end point.

15. A set of computer-readable instructions on a non-transitory computer-readable medium that, when executed on the computing device, cause the computing device to

gather data indicating whether the moving object has passed a defined point using at least one sensor connected to the computing device with the at least one sensor operating according to a predefined set of parameters selected for the position and environment around the computing device, such that each of the data points is taken consistently according to the set of parameters;

transform the data using the computing device from a first form into a second form in which the data can be evaluated as a time series;

evaluate selected data points of the time series of data in real time using the computing device to establish at least one learned statistic that is updated continuously at a defined rate and that represents a set of ambient conditions around the defined point over one or more time spans of undisturbed data, the time spans being selected in real time during a time period of the data gathering and being within the time period of data gathering;

detect that the event has occurred in real time using the computing device by determining that the time series of data has deviated from the learned statistic in a specified way by more than a defined threshold, the defined threshold determined, at least in part, using the learned statistic, the deviation of the learned statistic in the specified way indicating that the moving object has moved through a detection field of the at least one sensor and has thus passed the defined point; and

display one or both of timing or event count information on a display screen of the computing device based on the detection.

16. The set of computer-readable instructions of claim 15, wherein the set of computer-readable instructions is also adapted to cause the computing device to display one or more of pre-determined messages, audio or video correlated to the timing or event count information.

17. A system for swim timing and lap counting, comprising:

a portable computer having at least one sensor;

a waterproof case enclosing the portable computer so as to adapt the portable computer for placement underwater at the side or bottom of a swimming pool;

a set of computer-readable instructions on a non-transitory computer-readable medium coupled to or associated with the portable computer that, when executed on the portable computer, cause the portable computer to

take data from the at least one sensor with the at least one sensor operating according to a predefined set of parameters selected for the underwater environment of the portable computer, such that each of the data points is taken consistently according to the set of parameters,

transform the data into a time series of data points indicative of the ambient conditions,

calculate and, continuously at a defined rate in real time, update at least one learned statistic by (1) selectively excluding the data points from the learned statistic when those data points indicate a period of non-ambient volatility, (2) including only those of the time series of data points that indicate change in a defined direction or way relevant to the method of detecting laps, (3) periodically checking and adjusting the level of the learned statistic to accommodate longer-term shifts in the ambient conditions,

define a threshold based on the learned statistic, the threshold indicating that the time series of data has deviated from the learned statistic in a specified way to an extent that indicates that a swimmer has completed a lap, the threshold being continuously updated at a defined rate,

detect that a swimmer has completed a lap in real time using the portable computer by determining that the threshold has been exceeded, indicating that the swimmer has passed the detection area of the at least one sensor, said detecting being delayed for a non-zero interval of time such that said detecting occurs only when it is physically possible for the swimmer to have completed a lap, and

display one or more of a lap time, a total elapsed time, pacing information, or a lap count to the athlete using a screen of the computing device based on said detecting.

18. The system of claim 17, wherein the at least one sensor comprises a camera and the set of computer-readable instructions transform the data into a time series of light intensity values.

19. The system of claim 18, wherein the camera is a rear camera.

20. The system of claim 19, further comprising a periscope positioned and adapted to change a field of view of the rear camera from a rear of the portable computer to a front of the portable computer.

21. The system of claim 18, wherein the set of parameters causes the points of data to be taken by the camera using consistent shutter speed, aperture, and sensitivity settings.