Video instructional system and method for teaching motor skills

• US 7,780,450 B2
• Filed: 12/04/2007
• Issued: 08/24/2010
• Est. Priority Date: 01/05/1999
• Status: Expired due to Fees

• Current Assignee: Personal Pro LLC
• Original Assignee: Personal Pro LLC
• Inventors: Tarry, Robin
• Primary Examiner(s): FERNSTROM, KURT
• Application Number:
  US11/987,693
• Publication Number:
  US 20080090679A1
• Time in Patent Office: 994 Days
• Field of Search: 434/247, 434/252, 434 29- 30, 434/38, 434/43, 434/61, 434/62, 434 65- 66, 434/69, 434/255, 434/257, 463/1, 463/30, 463/43, 473219-226
• US Class Current: 434/247
• CPC Class Codes: A63B 2024/0009 Computerised real time comparison with previous movements or motion sequences of the user
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2071/063 Spoken or verbal instructions
• CPC Class Codes: A63B 2071/0661 arranged on the user
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/807 Photo cameras
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 69/00 Training appliances or apparatus for special sports training of parachutists B64D23/00
• CPC Class Codes: A63B 69/3608 Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: A63B 69/3623 for driving A63B69/3608, A63B69/3658, A63B69/3661, A63B69/3667 and A63B69/3691 take precedence
• CPC Class Codes: G09B 19/0038 Sports

Abstract

A real-time camera image of a student is displayed to the student while the student is performing a physical activity. The student can switch between seeing his natural field of view and the live video image by refocusing his eyes. Additionally, instructional information may be overlaid on the real-time video, thus enhancing the learning process.

Claims

1. A system for providing physical activity instruction to a user, comprising:

a video camera transmitting a real-time video signal of a user performing a physical activity;

a processor for receiving the real-time video signal;

a signal mixer generating a mixed video signal, the mixed video signal comprising the real-time video signal combined with a video of an ideal performance of the physical activity;

a base portion receiving the mixed video signal and splitting the signal into a left eye signal and a right eye signal; and

a head mounted display displaying the left eye signal and the right eye signal on transparent lenses provided for a left eye and a right eye of the user which allow the user to maintain the user'"'"'s natural and unobstructed field of view.

2. The system of claim 1, wherein the head mounted display is a pair of spectacles.

3. The system of claim 1, further comprising:

earphones connected to the head mounted display allowing the user to hear at least one of;

a prerecorded audio representation of the ideal performance of the physical activity, an audible indication of a characteristic describing the user'"'"'s performance of the physical activity, and an audible instruction from an instructor.

4. The system of claim 1, wherein the video camera comprises a three-dimensional lens to capture the real-time video signal in a stereoscopic three-dimensional video image.

5. The system of claim 4, wherein the stereoscopic three-dimensional video image is displayed in the head mounted display and when combined by the user'"'"'s eyes, displays the real-time video signal as a simulated three-dimensional image.

6. A method for providing physical activity instruction to a user, comprising:

capturing a real-time video signal of a user performing a physical activity;

extracting real-time information from the video signal that describes the characteristics of the user'"'"'s performance of the physical activity;

mixing the real-time video signal with a video of an ideal performance of the physical activity to create a mixed video signal;

splitting the mixed video signal into a left eye signal and a right eve signal;

displaying the left eye signal and the right eye signal to allow the user to see the real-time video signal of the user performing the physical activity overlaid with the video of the ideal performance on transparent lenses provided for a left eye and a right eye of the user which allow the user to maintain the user'"'"'s natural field of view.

7. The method of claim 6, further comprising:

comparing the characteristics of the user'"'"'s performance of the physical activity with the ideal performance of the activity and

providing an indication to the user of the degree of difference between the user'"'"'s performance of the physical activity and the ideal performance of the activity.

8. The method of claim 7, wherein the real-time information that describes the characteristics of user'"'"'s performance of the physical activity is at least one of acceleration, angle, deviation from a target location, or speed of a tool used in the physical activity.

9. The method of claim 8, wherein the tool used in the physical activity is a golf club, and the physical activity is a golf swing.

10. The method of claim 6, wherein the real-time video signal is captured as a stereoscopic three-dimensional video image.

11. The method of claim 10, wherein the stereoscopic three-dimensional video image is displayed in the head mounted display and, when combined by the user'"'"'s eyes, displays the real-time video signal as a simulated three-dimensional image.

12. The method of claim 6, wherein the real-time video signal is captured as a sequence of digital frames.

13. A computer-readable storage medium comprising instructions which when executed on a processor cause the processor to perform a method, the method comprising:

capturing a real-time video signal of a user performing a physical activity;

extracting real-time information from the video signal that describes the characteristics of the user'"'"'s performance of the physical activity;

mixing the real-time video signal with a video of an ideal performance of the physical activity to create a mixed video signal;

splitting the mixed video signal into a left eye signal and a right eye signal;

displaying the left eye signal and the right eye signal to allow the user to see the real-time video signal of the user performing the physical activity overlaid with the video of the ideal performance on transparent lenses provided for a left eye and a right eye of the user which allow the user to maintain the user'"'"'s natural field of view.

14. The computer-readable storage medium of claim 13, wherein the processor allows video to be displayed in slow motion, reverse, or freeze frame.

15. The computer-readable storage medium of claim 13, wherein the real-time video signal is recorded in the memory of a computer, accessible for review by the user.

16. The computer-readable storage medium of claim 13, further comprising:

comparing the characteristics of the user'"'"'s performance of the physical activity with the ideal performance of the activity;

providing an indication to the user of the degree of difference between the user'"'"'s performance of the physical activity and the ideal performance of the activity; and

storing the results in the memory of a computer for review by the user.

17. The computer-readable storage medium of claim 16, wherein the real-time information that describes the characteristics of user'"'"'s performance of the physical activity is at least one of acceleration, angle, deviation from a target location, or speed of a tool used in the physical activity and is stored in the memory of a computer for review by the user.

18. The computer-readable storage medium of claim 17, wherein the tool used in the physical activity is a golf club, and the physical activity is a golf swing.

19. The computer-readable storage medium of claim 13, wherein the real-time video signal is captured and stored in the memory of a computer as a stereoscopic three-dimensional video image for review by the user.

20. The computer-readable storage medium of claim 19, wherein the stereoscopic three-dimensional video image is displayed in the head mounted display and when combined by the user'"'"'s eyes, displays the real-time video signal as a simulated three-dimensional image.