Sports simulation system

• US 20060063574A1
• Filed: 08/02/2005
• Published: 03/23/2006
• Est. Priority Date: 07/30/2003
• Status: Abandoned Application

• Current Assignee: Todd E. Richardson, Wayne Dawe, Zuqiang Zhao
• Original Assignee: Todd E. Richardson, Wayne Dawe, Zuqiang Zhao
• Inventors: Zhao, Zuqiang, Dawe, Wayne, Richardson, Todd E.
• Application Number:
  US11/195,017
• Publication Number:
  US 20060063574A1
• Time in Patent Office: Days
• US Class Current: 463/1
• CPC Class Codes: A63B 2024/0031 at the starting point
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2071/0638 Displaying moving images of recorded environment, e.g. virtual environment
• CPC Class Codes: A63B 2071/0691 Maps, e.g. yardage maps or electronic maps
• CPC Class Codes: A63B 2102/32 Golf
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/70 Measuring or simulating ambient conditions, e.g. weather, terrain or surface conditions
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2225/02 Testing, calibrating or measuring of equipment
• CPC Class Codes: A63B 2225/20 with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/74 with powered illuminating means, e.g. lights
• CPC Class Codes: A63B 2243/007 American football
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0084 Exercising apparatus with means for competitions, e.g. virtual races
• CPC Class Codes: A63B 69/0002 for baseball
• CPC Class Codes: A63B 69/002 for football American-football dummies A63B69/34
• CPC Class Codes: A63B 69/0026 : for ice-hockey
• CPC Class Codes: A63B 69/3623 : for driving A63B69/3608, A63B69/3658, A63B69/3661, A63B69/3667 and A63B69/3691 take precedence
• CPC Class Codes: A63B 69/3658 : Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: A63F 13/10 : Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 : comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/45 : Controlling the progress of the video game
• CPC Class Codes: A63F 13/573 : using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/812 : Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1087 : comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/64 : for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/646 : for calculating the trajectory of an object
• CPC Class Codes: A63F 2300/8011 : Ball
• CPC Class Codes: F41J 5/10 : Cinematographic hit-indicating systems cinematographic targets F41J9/14

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. At least one processing stage communicates with the projectile tracking apparatus and is responsive to the data received from camera devices to determine the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity, acceleration and spin are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A projection unit coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

Claims

1. A sports simulation system comprising:

a projectile tracking apparatus including a display surface on which a visually apparent three-dimensional sports scene is presented, and at least one pair of camera devices capturing images of a projectile tracking region disposed in front of said display surface to detect a launched projectile traveling through said projectile tracking region towards said display surface, each camera device including processing capabilities processing captured images to detect the presence of a launched projectile therein; and

at least one processing stage receiving data from the camera devices relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, deceleration/acceleration and spin of a detected projectile traveling through said projectile tracking region, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into said visually apparent three-dimensional sports scene.

2. A sports simulation system according to claim 1 wherein said at least one processing stage uses said calculated trajectory to generate updated image data including a simulation of said launched projectile into said visually apparent three-dimensional sports scene following said calculated trajectory.

3. A sports simulation system according to claim 2 further comprising a projection device coupled to said at least one processing stage, said projection device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface.

4. A sports simulation system according to claim 3 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

5. A sports simulation system according to claim 3 wherein said projectile tracking apparatus includes a frame and at least one pair of camera devices mounted on said frame adjacent opposite top corners thereof, said camera devices having overlapping fields of view looking downwardly, across and in front of said display surface and capturing images of said projectile tracking region.

6. A sports simulation system according to claim 5 wherein said camera devices have generally perpendicular fields of view looking downwardly, across and in front of said display surface from adjacent opposite top corners of said frame.

7. A sports simulation system according to claim 3 wherein each camera device examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

8. A sports simulation system according to claim 7 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

9. A sports simulation system according to claim 3 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

10. A sports simulation system according to claim 3 wherein said three-dimensional sports scene is developed from a combination of ground level and overhead images of a real life sports environment.

11. A sports simulation system according to claim 10 wherein said overhead images include at least one of satellite and aerial photographs.

12. A sports simulation system according to claim 3 wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.

13. A sports simulation system according to claim 12 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

14. A sports simulation system comprising:

a projectile tracking apparatus including a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented;

at least one pair of digital camera devices mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital camera devices including a first processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital camera devices; and

an audio system to broadcast audio accompanying said video sequence;

a host processor communicating with said digital camera devices and said audio system, said host processor calculating a three-dimensional trajectory of said projectile using the two-dimensional projectile coordinates received from each first processor and outputting image data including said calculated three-dimensional trajectory; and

a display unit receiving said image data and presenting said video sequence including a simulation of said calculated trajectory on said display surface.

15. A sports simulation system according to claim 14 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said host processor updating said image data so that said at least one foreground action element responds to the calculated trajectory of said projectile.

16. A sports simulation system according to claim 14 wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the video sequence being consistent with the selected mode.

17. A sports simulation system according to claim 14 wherein each said first processor examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

18. A sports simulation system according to claim 17 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

19. A sports simulation system according to claim 17 wherein said frame encompasses a rectangular region and wherein said digital camera devices are positioned at opposite top corners of said frame.

20. A sports simulation system according to claim 14 wherein the background of said video sequence is developed from a combination of ground level and overhead images of a real life sports environment.

21. A sports simulation system according to claim 20 wherein said overhead images include at least one of satellite and aerial photographs.

22. A sports simulation system according to claim 14 wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.

23. A sports simulation system according to claim 22 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

24. A sports simulation system comprising:

at least one pair of digital camera devices having overlapping fields of view looking across and in front of a display surface;

at least one processing stage processing image data from the camera devices relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through said overlapping fields of view, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into a visually apparent three-dimensional sports scene projected onto said display surface; and

a projection unit presenting said three-dimensional sport scene on said display surface including a simulation of said projectile following said calculated trajectory, said three-dimensional sports scene including image frames developed from a three-dimensional terrain model generated from images of a real life sports environment.

25. A sports simulation system according to claim 24 wherein said three-dimensional terrain model is generated from a combination of ground level and overhead images.

26. A sports simulation system according to claim 25 wherein said overhead photographs include at least one of satellite and aerial photographs.