Method and system for developing consistency of motion

• US 7,095,388 B2
• Filed: 04/02/2002
• Issued: 08/22/2006
• Est. Priority Date: 04/02/2001
• Status: Active Grant

• Current Assignee: KIIO, Inc.
• Original Assignee: 3-Dac Golf Corporation
• Inventors: Wilson, Don, Truxa, Les
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Nguyen, Kevin M.
• Application Number:
  US10/113,935
• Publication Number:
  US 20030031358A1
• Time in Patent Office: 1,603 Days
• Field of Search: 345 7- 9, 345473-475, 434/247, 434/249, 434/252, 434/262, 434/274, 473/221, 473/257, 473/222
• US Class Current: 345/7
• CPC Class Codes: A63B 2071/0636 3D visualisation
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2225/15 with identification means that can be read by electronic means
• CPC Class Codes: A63B 2225/20 with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 69/00 Training appliances or apparatus for special sports training of parachutists B64D23/00
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G09B 19/0038 Sports

Abstract

A method and system for improving the physical skills of a user performing a given activity. In the method and system, processed images of the user during the performance of the activity are gathered and displayed to the user in real-time using a viewer. Images are generated of an idealized instructional performance of the activity. The generated images are simultaneously displayed with the gathered and processed images, and may be customized to the physical characteristics of the user.

Claims

1. A system for improving the physical skills of a user performing a given activity, comprising:

an imaging device for registering a plurality of performance images of a user during a performance of the given physical activity by the user,

wherein the plurality of performance images are taken from a plurality of viewing perspectives;

a direct-sight viewer for displaying the registered performance images to the user;

a processing station electronically connected to the imaging device and to the direct-sight viewer for receiving the registered performance images from the imaging device, receiving a selection of one of the plurality of viewing perspectives by the user, and relaying the registered performance images taken from the viewing perspective selected by the user to said direct-sight viewer in substantially real-time; and

a plurality of generated images of an instructional performance of the physical activity, wherein the plurality of generated images represent instructional performance from a plurality of viewing perspectives, wherein the processing station superimposes the generated images that represent the instructional performance from a viewing perspective that corresponds to the viewing perspective selected by the user and the registered performance images taken from the viewing perspective selected by the user, wherein the generated images further comprise computer-enhanced images of a three-dimensional model performing the physical activity in an idealized manner, wherein said processing station superimposes said computer-enhanced images over the registered performance images, and wherein the computer-enhanced images are computer-engineered images created by

gathering data at defined time intervals from at least one skeletal point on at least one selected individual performing the activity;

translating the gathered data into positions of a computer-generated skeleton during the physical activity;

establishing ideal positions of the computer-generated skeleton at each of the defined time intervals during the physical activity;

mapping images of the three-dimensional model performing the activity in an idealized manner based on the ideal positions of the computer-generated skeleton;

correcting the mapped images thereby creating a substantially idealized instructional performance of the given activity; and

representing the mapped images with images of a three-dimensional skin corresponding anatomically to the mapped images of the computer-generated skeleton.

2. The system of claim 1, wherein said imaging device comprises at least one digital video recorder.

3. The system of claim 2, wherein said at least one digital video recorder is positioned directly in front of the user.

4. The system of claim 1, wherein the imaging device further comprises a first imaging unit positioned at a first location with respect to the user, and a second imaging unit positioned at a second location with respect to the user.

5. The system of claim 4, wherein the first location and the second location are designated by the user.

6. The system of claim 1, wherein the imaging device further comprises multiple imaging devices for registering performance images from multiple perspectives relative to the user, wherein the direct-sight viewer selectively displays the registered performance images of at least one of said multiple imaging devices.

7. The system of claim 6, further comprising a viewing station electronically connected to the processing station for displaying the registered performance images and the generated images, wherein the viewing station selectively displays the registered performance images of at least one of the multiple recorders.

8. The system of claim 1, wherein the direct-sight viewer comprises at least one video display.

9. The system of claim 8, wherein the direct-sight viewer further comprises virtual reality goggles having at least one built-in video display.

10. The system of claim 1, wherein the direct-sight viewer is mountable on a user'"'"'s body.

11. The system of claim 1, wherein the processing station has replay capabilities.

12. The system of claim 1, wherein the processing station has freeze-frame capabilities.

13. The system of claim 1, wherein the processing station has diagramming capabilities.

14. The system of claim 1, wherein the processing station slightly off-sets the generated images and the registered performance images.

15. The system of claim 1, wherein the processing station further comprises a training module for coordinating and managing the user'"'"'s performance of the physical activity.

16. The system of claim 1, wherein the processing station customizes the generated images in accordance with user specific characteristics.

17. The system of claim 1, further comprising a grid overlaid onto the generated images.

18. The system of claim 1, further comprising a grid overlaid onto the three-dimensional skin images.

19. The system of claim 1, further comprising a viewing station electronically connected to the processing station for displaying the registered performance image and the generated image.

20. The system of claim 19, wherein the viewing station displays the registered performance image and the generated image simultaneously with said direct-sight viewer.

21. The system of claim 1, further comprising a viewing station electronically connected to the processing station for displaying the registered performance images and the computer-enhanced images.

22. The system of claim 21, wherein said viewing station displays the registered performance images and said computer-enhanced images simultaneously with said direct-sight viewer.

23. The system of claim 1, further comprising means for selectively saving and replaying the registered performance images of the user.

24. The system of claim 1, further comprising means for indicating a deviation between the registered performance images and said generated images, wherein said direct-sight viewer provides a visual indication of the deviation.

25. The system of claim 1, wherein the processing station further comprises means for providing audible instructions to the user.

26. The system of claim 1, further comprising at least one tracer positionable on the user for providing a visual cue to the user.

27. The system of claim 26, wherein the at least one tracer has light-emitting capabilities.

28. The system of claim 26, wherein the at least one tracer has light-reflecting capabilities.

29. A machine for improving the physical skills of a user performing a given activity, comprising:

an imaging device for registering a plurality of performance images of the user during the performance of the given activity,

wherein the plurality of performance images are taken from a plurality of viewing perspectives;

a direct-sight viewer for displaying images to the user;

a processing station electronically connected to the imaging device and to the direct-sight viewer for receiving the registered performance images from the imaging device, for receiving a selection of one of the plurality of viewing perspectives by the user, for creating the displayed images from the performance images taken from the viewing perspective selected by the viewer, and for relaying the displayed images to the direct-sight viewer in substantially real-time; and

a plurality of computer-enhanced images of a substantially idealized instructional performance of the activity, wherein the plurality of computer-enhanced images represent the substantially idealized instructional performance of the activity from a plurality of viewing perspectives, wherein said processing station superimposes said computer-enhanced images over the registered performance images, and wherein the computer-enhanced images are computer-engineered images created by

gathering data at defined time intervals from at least one skeletal point on at least one selected individual performing the activity;

translating the gathered data into positions of a computer-generated skeleton during the physical activity;

establishing ideal positions of the computer-generated skeleton at each of the defined time intervals during the physical activity;

mapping images of a three-dimensional model performing the activity in an idealized manner based on the ideal positions of the computer-generated skeleton;

correcting the mapped images thereby creating a substantially idealized instructional performance of the given activity;

representing the mapped images with images of a three-dimensional skin corresponding anatomically to the mapped images of the computer-generated skeleton, and

wherein the displayed images are created by superimposing the computer-enhanced images that represent the substantially idealized instructional performance of the activity from a viewing perspective that corresponds to the viewing perspective selected by the user and the registered performance images taken from the viewing perspective selected by the user.

30. A method for improving the physical skills of a user performing a given activity, comprising:

generating a plurality of computer-enhanced images of an instructional performance of the given activity, wherein the computer-enhanced images are computer-engineered images created by

gathering data at defined time intervals from at least one skeletal point on at least one selected individual performing the activity;

translating the gathered data into positions of a computer-generated skeleton during the physical activity;

establishing ideal positions of the computer-generated skeleton at each of the defined time intervals during the physical activity;

mapping images of a three-dimensional model performing the activity in an idealized manner based on the ideal positions of the computer-generated skeleton;

correcting the mapped images thereby creating a substantially idealized instructional performance of the given activity;

representing the mapped images with images of a three-dimensional skin corresponding anatomically to the mapped images of the computer-generated skeleton,

wherein the plurality of images represent the instructional performance from a plurality of viewing perspectives;

providing the user with a direct-sight viewer;

registering a plurality of performance images of the user performing the given activity using an imaging device,

wherein the plurality of performance images are taken from a plurality of viewing perspectives;

receiving a selection by the user of one of the plurality of viewing perspectives;

superimposing the generated images that represent the instructional performance from a viewing perspective that corresponds to the selected viewing perspective over the registered performance images taken from the selected viewing perspective to create combined images; and

transmitting the combined images to the direct-sight viewer thereby displaying the combined images to the user in substantially real time as the user performs the given activity.

31. The method of claim 30, further comprising customizing the generated images based on user characteristics.

32. The method of claim 30, further comprising customizing the mapped images based on user characteristics.

33. The method of claim 30, further comprising customizing the three-dimensional synthetic skin images based on user characteristics.

34. The method of claim 30, further comprising transmitting the combined images to a viewing station thereby simultaneously displaying the combined images on the viewing station for use by an instructor.

35. The method of claim 30, further comprising providing audible instructions to the user during the performance of the activity.

36. A method for improving the physical skills of a user performing a given activity using a computer generated three-dimensional model, comprising:

equipping the user with a body mounted display;

registering performance images of the user performing the given activity from a viewing perspective selected by the user from a plurality of viewing perspectives;

delivering the performance images to the body mounted display in substantially real time;

generating images of a three-dimensional model performing the activity in a substantially idealized manner from the selected viewing perspective; and

delivering the generated images simultaneously with the performance images, wherein generating images of the three-dimensional model comprises

gathering data at defined time intervals from at least one skeletal point on at least one selected individual performing the activity;

translating the gathered data into positions of a computer-generated skeleton during the physical activity;

establishing ideal positions of the computer-generated skeleton at each of the defined time intervals during the physical activity;

mapping images of the three-dimensional model performing the activity in an idealized manner based on the ideal positions of the computer-generated skeleton;

correcting the mapped images thereby creating a substantially idealized instructional performance of the given activity;

representing the mapped images with images of a three-dimensional skin corresponding anatomically to the mapped images of the computer-generated skeleton.

37. The method of claim 36, further comprising initiating a set-up program for providing the user with a comfort level with the computer generated three-dimensional model.

38. The method of claim 36, further comprising providing the user with multiple lessons involving repetitions of the given activity.

39. The method of claim 36, further comprising indicating to the user where the registered performance images and the generated images deviate from one another.

40. A method for creating computer enhanced images demonstrating a substantially idealized instructional performance of a given activity, comprising:

gathering data from at least one skeletal point on at least one selected individual performing the activity;

mapping images of ideal positions of a computer generated skeleton performing the activity using the gathered data;

correcting the mapped images thereby creating images of a substantially idealized instructional performance of the given activity by the computer generated skeleton; and

representing the mapped images with images of a three-dimensional skin substantially corresponding anatomically to the mapped images of the computer generated skeleton.

41. A method for creating computer generated images demonstrating a substantially idealized instructional performance of a given activity, comprising:

gathering data at defined time intervals from at least one skeletal point on at least one selected individual performing the activity;

translating the gathered data to positions of a computer generated skeleton during the activity;

establishing ideal positions of the computer generated skeleton at each of the defined time intervals during the activity;

mapping images based on the ideal positions of the computer generated skeleton demonstrating a substantially idealized instructional performance of the activity;

correcting the mapped images thereby creating the substantially idealized instructional performance of the given activity; and

representing the mapped images with images of a three-dimensional skin substantially corresponding anatomically to the mapped images of the computer generated skeleton.