Method for interactive training and analysis

• US 9,878,206 B2
• Filed: 05/19/2016
• Issued: 01/30/2018
• Est. Priority Date: 11/22/2011
• Status: Active Grant

• Current Assignee: Scott Dallas Rowe
• Original Assignee: Scott Dallas Rowe
• Inventors: Rowe, Scott Dallas
• Primary Examiner(s): YENKE, BRIAN P
• Application Number:
  US15/159,254
• Publication Number:
  US 20160256740A1
• Time in Patent Office: 621 Days
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/66 of image moments or centre of gravity
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

Apparatus and methods are provided that can display selected predetermined postures or predetermined motions on a frame by frame basis or as a continuous motion for imitation or emulation by a system user or subject to, for example, learn the motion or posture, or to be guided in rehabilitation from a trauma, surgery or other injury, or to permit comparison of the users posture or motion to a baseline posture or motion for purposes of analysis or diagnosis.

Claims

1. A computer-program product for teaching a subject to learn a full range of a motion performed by an object, said product comprising a non-transitory computer-readable medium encoded with computer-executable instructions that, as a result of being executed by a processor coupled to a display and to motion capture apparatus, said motion capture apparatus capturing video representations and data in three dimensions, said processor executes a method for teaching said subject to learn said full range of motion performed by said object, said processor comprising a memory, said memory comprising a database comprising video representations and data of said object, the method comprising:

a. displaying on said display said full range of motion as a time stopped sequence of a plurality of object frame representations of said object in motion, each said object frame representation comprising said object in one time stopped stationary position of a plurality of predetermined sequential stationary positions representing said full range of motion;

b. displaying on said display one object frame representation of said plurality of object frame representations;

c. utilizing said motion capture apparatus to capture real time video representations and data of said subject in real time while said subject is moving to imitate said position of said object in said one object frame representation;

d. processing said captured video representations and data of said subject to generate, in real time, representations of said subject;

e. displaying on said display in real time a composite overlay of one upon the other of each of said real time representations of said subject and said one object frame representation;

f. comparing, in real time, said data from said subject with said data from said object of said one object frame representation to determine positional alignment of said subject relative to each said displayed said object frame representation;

g. said comparing step comprising;

preselecting a threshold of compliance of a chose standard of positional alignment;

calculating compliance between said subject and said object relative to said threshold of compliance; and

determining whether said positional alignment at least meets said threshold of compliance or does not meet said threshold of compliance;

h. said processor automatically displaying next object frame representation in said plurality of object frame representations;

said next object frame representation selected by said processor such that intermediate object frame representations are skipped in response to said positional alignment at least meeting said threshold of compliance, and said next object frame representation selected by said processor without skipping any intermediate object frame representations in response to said positional alignment not meeting said threshold of compliance; and

i. repeating each of steps b. through h. until the last one of said object frame representations of said plurality of object frame representations of said motion has been displayed.

2. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

sequentially displaying all of said of object frame representations of said plurality of object frame representations in sequence to show said object in motion.

3. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

displaying said intermediate object frame representations at a tempo to help said subject raise the compliance level in response to said positional alignment not meeting said threshold of compliance.

4. The computer-program product for teaching a subject to learn a full range of a, motion performed by an object in accordance with claim 3, wherein said method comprises:

displaying said intermediate frames at a first pace and said non-intermediate frames at a second pace, said first pace being slower than said second pace.

5. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

processing said data of said subject in real time to determine at least one of posture or postural stability of said subject.

6. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 5, wherein said method comprises:

capturing a plurality of initial frames of said subject in motion;

utilizing said plurality of captured initial frames as said plurality of object frame representations.

7. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 6, wherein said method comprises:

utilizing said captured initial frames to compute centers of gravity for said subject on a frame-by-frame basis.

8. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 7, wherein said method comprises:

utilizing said centers of gravity for said subject to compute postural stability of said subject.

9. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 5, wherein said method comprises:

calculating sway index angles and sway index positions for said subject.

10. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

scaling of one or both of said real time representation of said subject and said object frame representation.

11. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

calculating an emulation summary, said emulation summary comprises a compilation of one or both of subject object motion compliance and degree of compliance; and

displaying said emulation summary.

12. The computer-program product for teaching a subject to learn a full range of a motion performed by an object in accordance with claim 1, wherein said method comprises:

calculating said compliance for individual frames, series of frames, and the sequence of said frames as a whole; and

displaying said compliance for individual frames, said series of frames and said sequence of frames.

13. A computer-program product to train a subject to learn a full range of motion performed by an object, said product comprising a non-transitory computer-readable medium encoded with computer-executable instructions that, as a result of being executed by a processor comprising a memory, said memory comprising a data base comprising video representations and data representations of said object in motion, said video representations comprising a plurality of object frame representations, said processor coupled to a display and to motion capture apparatus said processor executing said computer executable instructions to execute a method for training said subject to learn said motion performed by said object said method comprising:

a. preselecting a threshold of compliance of a chosen standard of positional alignment;

b. displaying on said display one object frame representation of said plurality of object frame representations, said one object frame representation comprising said object in a time stopped stationary position during said motion such that said subject may move to imitate said time stopped stationary position of said object representation;

c. utilizing said motion capture apparatus to capture video representations and data, of said subject in real time while said subject is moving into position to imitate said object in said one object frame representation;

d. processing said object frame representation and said captured video representations and data of said subject to generate and display, in real time, composite overlays each comprising said captured video representations and said one object frame representation;

e. calculating, in real time, positional alignment compliance between said data from said subject with said data representations of said object;

f. comparing said real time compliance with said threshold of compliance;

g. determining whether said positional alignment at least meets said threshold of compliance or does not meet said threshold of compliance;

h. automatically displaying a next one object frame representation;

i. selecting said next one object frame representation such that intermediate object frame representations are skipped in response to said positional alignment at least meeting said threshold of compliance;

j. selecting said next one object frame representation such that no intermediate object frame representations are skipped in response to said positional alignment not meeting said threshold of compliance; and

k. repeating steps b. through j. for each object frame representation until the last one object frame representation of said plurality of object frame representations.

14. A computer-program product to train a subject to learn a motion performed by an object in accordance with claim 13, wherein said method comprises:

displaying all of said object frame representations of said plurality of object frame representations in sequence to show said object in motion.

15. A computer-program product to train a subject to learn a motion performed by an object in accordance with claim 13, wherein said method comprises:

displaying said intermediate object frame representations at a tempo to help said subject raise the compliance level in response to said positional alignment not meeting said threshold of compliance.

16. A computer-program product to train a subject to learn a motion performed by an object in accordance with claim 15, wherein said method comprises:

calculating said compliance for individual frames, series of frames, and the sequence of said frames as a whole; and

displaying said compliance for individual frames said series of frames and said sequence of frames.

17. A computer-program product to train a subject to learn a motion performed by an object in accordance with claim 13, comprising:

calculating an emulation summary, said emulation summary comprises a compilation of one or both of subject object motion compliance and degree of compliance; and

displaying said emulation summary.