Apparatus and method for automatically analyzing a motion in a sport

• US 10,307,657 B2
• Filed: 04/14/2015
• Issued: 06/04/2019
• Est. Priority Date: 04/22/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hashimoto, Hirokazu, Murakoshi, Sho, Okamoto, Hiroshige
• Primary Examiner(s): Yen, Jason T
• Application Number:
  US15/304,146
• Publication Number:
  US 20170039882A1
• Time in Patent Office: 1,512 Days
• Field of Search: None
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 5/1127 using markers
• CPC Class Codes: A61B 5/7425 Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2024/0068 Comparison to target or threshold, previous performance or not real time comparison to other individuals
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 69/3608 Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: A63B 71/146 Golf gloves
• CPC Class Codes: G09B 19/0038 Sports

Abstract

An apparatus includes a communications interface that receives first sensed data from a first sensor attached to a user and second sensed data from a second sensor attached to a user. That apparatus also includes circuitry that analyzes the first sensed data and the second sensed data and provides a display signal that causes a display to produce first visual information regarding a motion of the user and second visual information regarding the motion of the user, the first visual information being different than the second visual information.

Claims

1. An apparatus, comprising:

circuitry configured to;

receive first data from a first sensor attached to a first body part of a user, and second data from a second sensor attached to a second body part of the user;

adjust a delay of at least one of the first data or the second data for analysis of a body movement of the user, wherein the adjustment is based on a time stamp issued to each of the first data and the second data;

determine a time-series change of angles of the first body part to represent the body movement, based on the first data, the second data, and the adjusted delay; and

generate a display signal that causes a display device to generate first visual information regarding the time-series change of the angles, and second visual information regarding the body movement so as to visualize the body movement,

wherein the generation of the display signal is based on at least one of the first data or the second data, and

wherein the first visual information is different from the second visual information.

2. The apparatus of claim 1, wherein the first visual information is based on analysis of the body movement of the user.

3. The apparatus of claim 1, wherein the first visual information includes a trajectory, of an object based on a user swing, as part of the body movement of the user.

4. The apparatus of claim 1, wherein the first visual information includes a change in a state of at least one of the first body part or the second body part.

5. The apparatus of claim 4, wherein the circuitry is further configured to:

cause the display device to provide a user selectable indication that identifies a selected body part associated with the change in the state;

analyze the body movement of the selected body part, based on a selection of the user selectable indication; and

include in the display signal the first visual information based on the change in the state of the selected body part.

6. The apparatus of claim 3, wherein the circuitry is further configured to cause the display device to provide a user selectable indication associated with reset of a displayed trajectory of the object.

7. The apparatus of claim 1, wherein the first visual information includes at least one of an image, a figure, a video, or a picture.

8. The apparatus of claim 1, wherein the first visual information and the second visual information are displayed in a synchronous relationship so as to show a time-based relationship between the first visual information and the second visual information.

9. The apparatus of claim 8, wherein the second visual information is associated with an object trajectory, and the first visual information is associated with a change of a state of at least one of a user hand or a user wrist.

10. The apparatus of claim 9 wherein the object trajectory is a trajectory of a tennis racket.

11. A method, comprising:

acquiring first data from a first sensor attached to a first body part of a user, and second data from a second sensor attached to a second body part of the user;

sending, by a communications interface, the first data and the second data to analysis circuitry,

wherein the analysis circuitry adjusts a delay of at least one of the first data or the second data for analysis of a body movement of the user, wherein the adjustment is based on a time stamp issued to each of the first data and the second data, and wherein the analysis circuitry determines a time-series change of angles of the first body part to represent the body movement, based on the first data, the second data, and the adjusted delay;

receiving a display signal from the analysis circuitry; and

displaying first visual information regarding the time-series change of the angles, and second visual information regarding the body movement so as to visualize the body movement, wherein the first visual information and the second visual information are displayed based on the display signal, and

wherein the first visual information is different from the second visual information.

12. The method of claim 11, wherein the first visual information is based on analysis of the body movement of the user.

13. The method of claim 11, wherein the first visual information includes a trajectory, of an object based on a user swing, as part of the body movement of the user.

14. The method of claim 11, wherein the first visual information includes a change in a state of at least one of the first body part or the second body part.

15. The method of claim 14 further comprising:

displaying a user selectable indication that identifies a selected body part that is associated with the change in the state; and

displaying the first visual information, based on a selection of the user selectable indication, regarding the change in the state of the selected body part.

16. The method of claim 13, further comprising displaying a user selectable indication associated with reset of a displayed trajectory of the object.

17. The method of claim 11, wherein the first visual information includes at least one of an image, a figure, a video, or a picture.

18. The method of claim 11, further comprising displaying the first visual information and the second visual information in a synchronous relationship so as to show a time-based relationship between the first visual information and the second visual information.

19. An apparatus, comprising:

a display device;

a communications interface configured to receive first data from a first sensor attached to a first body part of a user, and a second data from a second sensor attached to a second body part of the user; and

circuitry configured to;

adjust a delay of at least one of the first data or the second data for analysis of a body movement of the user, wherein the adjustment is based on a time stamp issued to each of the first data and the second data;

determine a time-series change of angles of the first body part to represent the body movement, based on the first data, the second data, and the adjusted delay; and

generate a display signal that causes the display device to generate first visual information regarding the time-series change of the angles, and second visual information regarding the body movement,

wherein the generation of the display signal is based on at least one of the first data or the second data,

wherein the first visual information is different from the second visual information, and

wherein the display device is configured to display the first visual information and the second visual information.

20. The apparatus of claim 19, wherein the first visual information is based on analysis of the body movement of the user.