Sports simulation system

• US 9,381,398 B2
• Filed: 02/27/2012
• Issued: 07/05/2016
• Est. Priority Date: 07/30/2003
• Status: Active Grant

• Current Assignee: Interactive Sports Technologies Inc.
• Original Assignee: Interactive Sports Technologies Inc.
• Inventors: Richardson, Todd E., Dawe, Wayne, Zhao, Zuqiang
• Primary Examiner(s): Harper, Tramar
• Assistant Examiner(s): WONG, JEFFREY KEITH
• Application Number:
  US13/405,748
• Publication Number:
  US 20120220385A1
• Time in Patent Office: 1,590 Days
• Field of Search: 273/317, 273/317.2, 273/340, 273/348, 273/108, 273/108.2, 273/118.R
• US Class Current: 1/1
• CPC Class Codes: A63B 2024/0031 at the starting point
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2071/0638 Displaying moving images of recorded environment, e.g. virtual environment
• CPC Class Codes: A63B 2071/0691 Maps, e.g. yardage maps or electronic maps
• CPC Class Codes: A63B 2102/32 Golf
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/70 Measuring or simulating ambient conditions, e.g. weather, terrain or surface conditions
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2225/02 Testing, calibrating or measuring of equipment
• CPC Class Codes: A63B 2225/20 with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/74 with powered illuminating means, e.g. lights
• CPC Class Codes: A63B 2243/007 American football
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0084 Exercising apparatus with means for competitions, e.g. virtual races
• CPC Class Codes: A63B 69/0002 for baseball
• CPC Class Codes: A63B 69/002 for football American-football dummies A63B69/34
• CPC Class Codes: A63B 69/0026 : for ice-hockey
• CPC Class Codes: A63B 69/3623 : for driving A63B69/3608, A63B69/3658, A63B69/3661, A63B69/3667 and A63B69/3691 take precedence
• CPC Class Codes: A63B 69/3658 : Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: A63F 13/10 : Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 : comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/45 : Controlling the progress of the video game
• CPC Class Codes: A63F 13/573 : using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/812 : Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1087 : comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/64 : for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/646 : for calculating the trajectory of an object
• CPC Class Codes: A63F 2300/8011 : Ball
• CPC Class Codes: F41J 5/10 : Cinematographic hit-indicating systems cinematographic targets F41J9/14

Abstract

A sports simulation system includes a projectile tracker having a display presenting a three-dimensional sports scene. The projectile tracker captures images of a projectile tracking region disposed in front of the display to detect a launched projectile traveling through the tracking region towards the display. A processing stage, in communication with the projectile tracker, is responsive to data received from camera devices to determine three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the tracking region, which are used by the processing stage to calculate a trajectory of the launched projectile into the three-dimensional sports scene.

Claims

1. A sports simulation system comprising:

a projectile tracking apparatus comprising a display surface on which a sports scene is presented, and at least one pair of camera devices aimed into a projectile tracking region from different vantages and having overlapping fields of view at least encompassing said projectile tracking region, said projectile tracking region extending from said display surface to a projectile launch area spaced in front of said display surface, said camera devices configured to capture images of said projectile tracking region, each camera device including processing capabilities and configured to process captured images to detect the presence of a launched projectile therein as the launched projectile travels from its launch position to its contact position with said display surface and then its rebound from said display surface; and

at least one processing stage configured to receive data from the camera devices relating to images in which the launched projectile exists and determine three-dimensional positions, velocity, deceleration/acceleration and spin of the detected projectile traveling within said projectile tracking region, the spin being determined based on impact and rebound angles of the sports projectile with respect to the display surface, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into said presented sports scene.

2. A sports simulation system according to claim 1 wherein said at least one processing stage is configured to use said calculated trajectory to generate updated image data representing a simulation of a flight path of said launched projectile beginning at the display surface contact position and traveling into said sports scene following said calculated trajectory.

3. A sports simulation system according to claim 2 further comprising a projection device coupled to said at least one processing stage, said projection device configured to receive image data from said at least one processing stage and present said sports scene including said simulation on said display surface.

4. A sports simulation system according to claim 3 wherein said sports scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage configured to update said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

5. A sports simulation system according to claim 3 wherein said projectile tracking apparatus includes a frame and wherein said at least one pair of camera devices is mounted on said frame, said camera devices having overlapping fields of view aimed across and in front of said display surface and configured to capture images of said projectile tracking region.

6. A sports simulation system according to claim 5 wherein said camera devices have generally perpendicular fields of view aimed downwardly, across and in front of said display surface from adjacent opposite top corners of said frame.

7. A sports simulation system according to claim 3 wherein each camera device is configured to examine captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

8. A sports simulation system according to claim 7 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

9. A sports simulation system according to claim 3 further comprising an audio system configured to broadcast audio accompanying said sports scene and simulation.

10. A sports simulation system according to claim 3 wherein said sports scene is developed from a combination of ground level and overhead images of a real life sports environment.

11. A sports simulation system according to claim 10 wherein said overhead images include at least one of satellite and aerial photographs.

12. A sports simulation system according to claim 3 wherein during processing, each camera device is configured to use a projectile signature to distinguish a launched projectile from other objects in said captured images.

13. A sports simulation system according to claim 12 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

14. A sports simulation system comprising:

a projectile tracking apparatus configured to track a launched sports projectile comprising a frame about a display surface on which a video sequence portraying a sports scene is presented, said sports scene including image frames developed from a three-dimensional terrain model generated from overhead images of a real life sports environment, said overhead images including at least one of satellite and aerial photographs;

at least one pair of digital camera devices mounted on said frame at spaced locations and having fields of view aimed across and in front of said display surface that overlap and encompass a projectile tracking region extending from a sports projectile launch region in front of said display surface to said display surface, each of said digital camera devices including a first processor configured to process image data and generate two-dimensional projectile coordinates when a sports projectile travels from said sports projectile launch region into contact with said display surface and then its rebound from said display surface and is captured in images acquired by said digital camera devices, the two-dimensional projectile coordinates being generated continuously throughout the travel of the sports projectile; and

an audio system configured to broadcast audio accompanying said video sequence;

a host processor configured to communiate with said digital camera devices and said audio system, said host processor configured to use the two-dimensional projectile coordinates received from each first processor to determine three-dimensional positions, velocity, deceleration/acceleration and spin of the launched sports projectile, the spin being determined based on impact and rebound angles of the sports projectile with respect to the display surface, calculate a three-dimensional realistic trajectory of said sports projectile output image data including said calculated three-dimensional realistic trajectory; and

a display unit configured to receive said image data and present said video sequence on said display surface, said video sequence representing a simulation of a flight path of said sports projectile beginning from the contact location of said sports projectile with said display surface so that the simulation represents a realistic continuance of the travel of the sports projectile beyond the display surface.

15. A sports simulation system according to claim 14 wherein said sports scene includes at least one foreground action element overlying and moveable over a background image, said host processor configured to update said image data so that said at least one foreground action element responds to the calculated three-dimensional realistic trajectory of said sports projectile.

16. A sports simulation system according to claim 14 wherein said host processor is configured to execute sports simulation software including at least two of a training mode, a practice mode and a game play mode, the video sequence being consistent with the selected mode.

17. A sports simulation system according to claim 14 wherein each said first processor is configured to examine captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

18. A sports simulation system according to claim 17 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

19. A sports simulation system according to claim 17 wherein said frame encompasses a rectangular region and wherein said digital camera devices are positioned at opposite corners of said frame.

20. A sports simulation system according to claim 14 wherein during processing, each camera device is configured to use a projectile signature to distinguish a launched projectile from other objects in said captured images.

21. A sports simulation system according to claim 20 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

22. A sports simulation system comprising:

at least one pair of digital camera devices having overlapping fields of view aimed across and in front of a display surface from different vantages and configured to capture images of a launched projectile throughout its travel from a launch position in front of said display surface, to its contact position with said display surface and then its rebound from said display surface;

at least one processing stage configured to process image data from the camera devices relating to images in which the launched projectile exists and determine three-dimensional positions, velocity, acceleration and spin of the detected projectile traveling within said overlapping fields of view, the spin being determined based on impact and rebound angles of the sports projectile with respect to the display surface, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a realistic trajectory of said launched projectile into a sports scene projected onto said display surface; and

a projection unit configured to present said sports scene on said display surface including a simulation of said projectile following said calculated realistic trajectory, said sports scene including image frames developed from a three-dimensional terrain model generated from images of a real life sports environment.

23. A sports simulation system according to claim 22 wherein said three-dimensional terrain model is generated from a combination of ground level and overhead images.

24. A sports simulation system according to claim 23 wherein said overhead photographs include at least one of satellite and aerial photographs.

25. A golf simulator comprising:

a display surface on which a golf scene is presented;

imaging devices having fields of view encompassing a region extending from said display surface to a golf ball launch area in front of said display surface and configured to capture images of said region; and

processing structure configured to receive image data from said imaging devices and process said image data to detect a launched golf ball as the launched golf ball travels from its launch position within said launch area to its contact position with said display surface and then its rebound from said display surface, said processing structure further configured to process said image data to determine three-dimensional positions, velocity, deceleration/acceleration and spin of the detected launched golf ball traveling within said region, the spin being determined based on impact and rebound angles of the golf ball with respect to the display surface, the three-dimensional positions, velocity, deceleration/acceleration and spin being used by said processing structure to calculate a realistic trajectory of said launched golf ball into said golf scene, wherein said processing structure is configured to use said calculated realistic trajectory to generate updated image data representing a simulation of a flight path of said launched golf ball beginning at the display surface contact position and traveling into said golf scene following said calculated realistic trajectory so that said simulation represents a realistic continuance of the travel of said golf ball beyond the display surface.

26. A golf simulator according to claim 25 further comprising a display device coupled to said processing structure, said display device configured to receive image data from said processing structure and present said golf scene including said simulation on said display surface.

27. A golf simulator according to claim 26 wherein said golf scene includes at least one foreground action element overlying and moveable over a background image, said processing structure configured to update said image data so that said at least one foreground action element responds to the simulation of said launched golf ball.

28. A golf simulator according to claim 27 wherein said golf scene includes a plurality of foreground action elements independently moveable over said background image.

29. A golf simulator according to claim 28 wherein said foreground action elements, background image and launched golf ball simulation are non-destructive overlay image planes that are combined seamlessly to complete said golf scene.

30. A golf simulator according to claim 27 wherein said at least one foreground action element, background image and launched golf ball simulation are non-destructive overlay image planes that are combined seamlessly to complete said golf scene.

31. A golf simulator according to claim 26 comprising at least one pair of imaging devices, said imaging devices having overlapping fields of view aimed across and in front of said display surface and configured to capture images of said region.

32. A golf simulator according to claim 31 wherein said imaging devices have generally perpendicular fields of view aimed across and in front of said display surface.

33. A golf simulator according to claim 31 wherein said golf scene includes at least one foreground action element overlying and moveable over a background image, said processing structure configured to update said image data so that said at least one foreground action element responds to the simulation of said launched golf ball.

34. A golf simulator according to claim 31 wherein said processing structure is configured to process said image data to detect pixel clusters resembling a characteristic signature thereby to detect said golf ball in said captured images.

35. A golf simulator according to claim 31 further comprising an audio system configured to broadcast audio.