Sensor-based evaluation and feedback of exercise performance

• US 9,292,935 B2
• Filed: 12/31/2014
• Issued: 03/22/2016
• Est. Priority Date: 01/14/2014
• Status: Active Grant

• Current Assignee: Zsolutionz LLC
• Original Assignee: Zsolutionz LLC
• Inventors: Koduri, Sunil, Adams, Bobby Joe, Hand, John Michael, Koduri, Shalini, Ransone, John W., Bhatia, Surendra P. S.
• Primary Examiner(s): RICHMAN, GLENN E
• Application Number:
  US14/588,289
• Publication Number:
  US 20150196804A1
• Time in Patent Office: 447 Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Disclosed herein are techniques and systems for evaluating exercise performance of a user by utilizing one or more intelligent sensors, including at least one camera-based sensor configured to detect image data of the user. The at least one camera-based sensor may be mounted on any suitable structure, including a stationary exercise device. A system including the camera-based sensor may further comprise a performance assessment module stored in memory and executable by one or more processors to determine an exercise performance condition of the user based at least in part on the detected image data. An output module may output an evaluation of the exercise performance condition or an instruction to take corrective action. The fitness machine may thereby provide real-time, constructive feedback regarding the user'"'"'s exercise performance based on the sensed data and utilizing fuzzy logic and other forms of intelligent software.

Claims

1. A system comprising:

at least one camera-based sensor to detect image data of a user during an exercise routine;

one or more processors; and

one or more memories maintaining instructions that, when executed by the one or more processors, perform operations comprising;

analyzing the image data detected by the at least one camera-based sensor;

determining an exercise performance condition of the user based at least in part on analysis of the image data;

providing an instruction to correct a body form of the user;

determining, from analysis of additional image data detected by the at least one camera-based sensor, that the user has failed to correct the body form after a lapse of a predetermined period of time from providing the instruction; and

modifying the exercise routine for the user.

2. The system of claim 1, wherein the camera-based sensor is further configured to identify the user based on facial recognition.

3. The system of claim 1, further comprising one or more sensors to detect information about the user.

4. The system of claim 3, wherein the information about the user includes one or more of body weight, heart rate, blood pressure, oxygen level, hydration level, body temperature, blood glucose level, or respiratory rate.

5. The system of claim 1, wherein the exercise performance condition is further based on detected pressure forces on at least one foot of the user obtained from an electronic textile (e-textile) sensor.

6. The system of claim 1, further comprising a stationary exercise device, wherein the at least one camera-based sensor is mounted on the stationary exercise device.

7. The system of claim 6, wherein the stationary exercise device comprises a treadmill, and the exercise performance condition comprises one or more of a gait form of the user, a stride length of the user, a gait pace of the user, or muscle tension of the user.

8. The system of claim 6, further comprising:

a video display mounted at a front end of the stationary exercise device, and

wherein the operations further comprise presenting, on the video display;

an image of a reference user having an ideal exercise form, and

an avatar of the user that indicates the exercise performance condition of the user based on the image data.

9. The system of claim 8, wherein the operations further comprise overlaying the avatar of the user on top of the image of the reference user.

10. The system of claim 8, wherein the instruction is at least partly output on the video display in the form of a text-based message of the instruction.

11. The system of claim 6, wherein the one or more sensors include two or more cameras mounted on the stationary exercise device to capture at least a substantial portion of the user in the form of the image data.

12. The system of claim 11, wherein the operations further comprise composing a three-dimensional model of the user by stitching together the image data received from the two or more cameras.

13. The system of claim 11, wherein the at least one camera-based sensor is mounted at a front end of the stationary exercise device, and the two or more cameras are mounted at a back end of the stationary exercise device.

14. The system of claim 1, wherein the at least one camera-based sensor comprises a mounting structure to mount the at least one camera-based sensor onto another structure.

15. The system of claim 14, wherein the mounting structure comprises at least one of a clip, a ball, a socket, hooks, loops, or adhesive.

16. A method of evaluating an exercise performance condition of a user, the method comprising:

detecting, by a camera-based sensor, image data of the user;

analyzing the image data;

determining, by one or more processors, the exercise performance condition of the user based at least in part on analysis of the image data;

evaluating, by the one or more processors, the exercise performance condition; and

providing, on a display;

an avatar of the user; and

an evaluation of the exercise performance condition or an instruction to take corrective action by color coding a portion of the avatar that corresponds to a portion of the user'"'"'s body relating to the exercise performance condition.

17. The method of claim 16, further comprising identifying, by the camera-based sensor, the user using facial recognition.

18. The method of claim 16, further comprising detecting, by one or more sensors, information about the user including one or more of body weight, heart rate, blood pressure, oxygen level, hydration level, body temperature, blood glucose level, or respiratory rate.

19. The method of claim 16, further comprising:

detecting, by an electronic textile (e-textile) sensor, pressure forces on at least one foot of the user, and

wherein the determining the exercise performance condition is further based on the pressure forces.

20. The method of claim 16, wherein the detecting the image data of the user is while the user is exercising on a fitness machine.

21. The method of claim 20, wherein the fitness machine includes a treadmill, and wherein determining the exercise performance condition comprises determining one or more of a gait form of the user, a stride length of the user, a gait pace of the user, or muscle tension of the user.

22. The method of claim 16, further comprising causing display of an image of a reference user having an ideal exercise form.

23. The method of claim 22, further comprising overlaying the avatar of the user on top of the image of the reference user.

24. The method of claim 16, wherein the providing the evaluation or the instruction comprises causing display of a text-based message of the evaluation or the instruction.

25. The method of claim 16, further comprising:

providing the instruction as an instruction to correct a body form of the user;

determining, from analysis of additional image data detected by the camera-based sensor, that the user has failed to correct the body form after a lapse of a predetermined period of time from the providing the instruction;

determining that a current workout routine can be modified; and

modifying the current workout routine to initiate a new workout routine.

26. A system comprising:

at least one camera-based sensor to detect image data of a user during exercise;

a display;

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, perform operations comprising;

analyzing the image data detected by the at least one camera-based sensor;

determining an exercise performance condition of the user based at least in part on analysis of the image data;

providing, on the display;

an avatar of the user; and

an evaluation of the exercise performance condition or an instruction to take corrective action by color coding a portion of the avatar that corresponds to portion of the user'"'"'s body relating to the exercise performance condition.

27. The system of claim 26, further comprising a treadmill, wherein the exercise performance condition comprises one or more of a gait form of the user, a stride length of the user, a gait pace of the user, or muscle tension of the user.