Providing visual motion feedback based on sensor data

• US 9,827,478 B1
• Filed: 02/06/2015
• Issued: 11/28/2017
• Est. Priority Date: 03/22/2010
• Status: Active Grant

• Current Assignee: BBY Solutions Incorporated (Best Buy Co., Inc.), Rosalind Franklin University of Medicine and Science
• Original Assignee: BioSensics, LLC (Best Buy Co., Inc.), Rosalind Franklin University of Medicine and Science
• Inventors: Najafi, Bijan, Wrobel, James Stanley, Boloori, Ali-Reza
• Primary Examiner(s): Galka, Lawrence
• Application Number:
  US14/616,522
• Time in Patent Office: 1,026 Days
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2230/62 posture
• CPC Class Codes: A63B 69/3608 Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: A63B 71/0619 Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising

Abstract

The present disclosure is directed to a body-worn sensor-based system for evaluating the biomechanics and the motor adaptation characteristics of postural control during a sport activity such as a golf swing. Various embodiments use sensors such as accelerometers, gyroscopes, and magnetometers to measure the three-dimensional motion of ankle and hip joints. In several embodiments, additional sensors attached to other body segments are used to improve the accuracy of the data or detect particular instants during the swing (e.g., top of back swing, instant of the maximum speed of arm, and instant of ball impact). In a golf embodiment, the system combines the measured data in conjunction with a biomechanical model of the human body to: (1) estimate the two-dimensional sway of the golfer'"'"'s center of mass; (2) quantify and evaluate the golfer'"'"'s balance via his/her postural compensatory strategy; and (3) provide visual feedback to the golfer for improving dynamic postural control.

Claims

1. A method for providing data for use in displaying visual feedback to a person engaged in a physical activity, comprising:

electronically receiving with one or more computing devices data collected from one or more sensors supported by a body of a person;

determining, with the one or more computing devices, one or more center of mass positions of the person based on the data collected from the one or more sensors, the data reflecting movement and position of the person while performing the activity;

generating first visual display data corresponding to a first visual indication reflecting said one or more determined center of mass positions;

generating second visual display data corresponding to a second visual indication reflecting a target center of mass position; and

providing the first and second visual display data for use in displaying the first and second visual indications to the person,

wherein the first and second visual indications enable the person to determine a difference between (1) at least said one or more center of mass positions of the person while performing the activity reflected by the first visual indication and (2) the target center of mass position reflected by the second visual indication, and

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

2. The method of claim 1, wherein the one or more sensors are worn by the person.

3. The method of claim 1, wherein the one or more sensors are in a device that is carried by the person or embedded into clothing of the person.

4. The method of claim 1, wherein the activity is training.

5. The method of claim 1, wherein said target center of mass position that has been determined to contribute to a desired performance of the activity is determined based on data collected from the sensors when the person is in a standing position and not performing the activity.

6. A system for providing data for use in displaying visual feedback relating to a physical activity, the system comprising:

a computing system configured to receive sensor data from one or more sensors supported by a body of a person, the data reflecting movement and position of the person during the activity;

wherein the computing system is further configured to;

determine one or more center of mass positions of the person based on the data collected from said one or more sensors;

generate visual display data corresponding to a visual feedback about the activity, the visual feedback reflecting a difference between said one or more determined center of mass positions and a target center of mass position; and

provide the visual display data for use in displaying the visual feedback to the person, and

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

7. The system of claim 6, wherein said target center of mass position that has been determined to contribute to a desired performance of the activity is determined based on data collected from said one or more sensors when the person is in a standing position and not engaged in the activity.

8. The system of claim 6, wherein said one or more sensors comprise sensors embedded in a mobile device carried by the person.

9. A method for providing data for use in presenting feedback relating to a physical activity, the method comprising:

electronically receiving with one or more computing devices data collected from one or more sensors supported by a body of a person engaging in an activity;

determining, with the one or more computing devices, one or more center of mass positions of the person based on the data collected from the one or more sensors, the data reflecting movement and position of the person while performing the activity;

generating feedback data corresponding to feedback indicating a difference between said one or more determined center of mass positions and a target center of mass position; and

providing the feedback data for use in presenting the feedback,

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

10. The method of claim 9, wherein the target center of mass position is determined based on sensor data received when the person is in a pre-defined position.

11. The method of claim 9, wherein the activity is a training.

12. The method of claim 9, wherein the activity is a sport.

13. The method of claim 10, wherein said pre-defined position is specified by a user input.

14. The method of claim 10, wherein said pre-defined position is a standing position and the person is not engaged in said activity.

15. A method for providing data for use in displaying visual feedback relating to a physical activity, comprising:

electronically receiving with one or more computing devices data collected from one or more sensors supported by a body of a person;

prompting for positioning of a body segment of the person in a pre-defined static position;

determining, with the one or more computing devices, a target body segment position based on sensor data received when the body segment of the person is in the pre-defined static position such that the target body segment position is calibrated for the particular person based on the pre-defined static position;

determining, with the one or more computing devices, one or more body segment positions of the person based on the data collected from the one or more sensors, the data reflecting movement and position of the person while performing said activity;

generating first visual display data corresponding to a first visual indication reflecting said one or more determined body segment positions;

generating second visual display data corresponding to a second visual indication reflecting the target body segment position; and

providing the first and second visual display data for use in displaying the first and second visual indications to the person,

wherein the first and second visual indications enable the person to determine a difference between (1) at least said one or more body segment positions of the person reflected by the first visual indication and (2) the target body segment position reflected by the second visual indication, and

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

16. The method of claim 15, wherein the activity is training.

17. The method of claim 15, wherein said target body segment position is determined based on sensor data received when the body segment of the person is in the pre-defined static position while not performing the activity.

28. The method of claim 15, wherein said pre-defined static position corresponds to an initial target associated with the physical activity.

29. The method of claim 15, wherein said pre-defined static position corresponds to an address position or a standing position.

18. A system for providing data for use in displaying visual feedback relating to a physical activity, the system comprising:

a computing system configured to receive sensor data from one or more sensors supported by a body of a person, the data reflecting movement and position of the person during said activity;

wherein the computing system is further configured to;

prompt positioning of a body segment of the person in a pre-defined static position;

determine a target body segment position based on sensor data received when the body segment of the person is in the pre-defined static position such that the target body segment position is calibrated for the particular person based on the pre-defined static position;

determine one or more body segment positions of the person based on the data collected from said one or more sensors;

generate visual display data corresponding to a visual feedback about the activity, the visual feedback reflecting a difference between said one or more determined body segment positions and the target body segment position; and

provide the visual display data for use in displaying the visual feedback to the person,

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

19. The system of claim 18, wherein said target body segment position is determined based on sensor data received when the body segment of the person is in the pre-defined static position while not performing the activity.

20. The system of claim 18, wherein said one or more sensors include sensors embedded in a mobile device carried by the person.

30. The system of claim 18, wherein said pre-defined static position corresponds to an initial target associated with the physical activity.

31. The system of claim 18, wherein said pre-defined static position corresponds to an address position or a standing position.

21. A method for providing data for use in presenting feedback relating to a physical activity, the method comprising:

electronically receiving with one or more computing devices data collected from one or more sensors supported by a body of a person engaged in the activity;

prompting for positioning of a body segment of the person in a pre-defined static position;

determining, with the one or more computing devices, a target body segment position based on sensor data received when the body segment of the person is in the pre-defined static position such that the target body segment position is calibrated for the particular person based on the pre-defined static position;

determining, with the one or more computing devices, one or more body segment position of the person based on the data collected from the one or more sensors, the data reflecting movement and position of the person while performing the activity;

generating feedback data corresponding to feedback indicating a difference between said one or more determined body segment positions and the target body segment position; and

providing the feedback data for use in presenting the feedback,

wherein said one or more sensors comprise at least one of;

an accelerometer, gyroscope, and magnetometer.

22. The method of claim 21, wherein the target body segment position is determined based on sensor data received when the body segment of the person is in the pre-defined static position while not performing the activity.

23. The method of claim 21, wherein the activity is training.

24. The method of claim 21, wherein the activity is a sport.

25. The method of claim 21, wherein said pre-defined static position is specified by a user input.

26. The method of claim 21, wherein said pre-defined static position is a standing position and the person is not engaged in said activity.

27. The method of claim 21, wherein one of said one or more determined body segment positions is determined when said body segment of the person has reached maximum speed during the activity.