Sports simulation system

• US 7,544,137 B2
• Filed: 07/30/2003
• Issued: 06/09/2009
• Est. Priority Date: 07/30/2003
• Status: Active Grant

• Current Assignee: Interactive Sports Technologies Inc.
• Original Assignee: Todd E. Richardson
• Inventors: Richardson, Todd E.
• Primary Examiner(s): Laneau; Ronald
• Application Number:
  US10/629,945
• Publication Number:
  US 20050023763A1
• Time in Patent Office: 2,141 Days
• Field of Search: 473/415, 473/131, 273/317.1, 273/317.2, 273/317.7, 273/317.8, 273/317.9, 273/329, 273/330, 463/1, 463/2, 463/4, 463/5
• US Class Current: 473/415
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2243/007 American football
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/0002 for baseball
• CPC Class Codes: A63B 69/002 for football American-football dummies A63B69/34
• CPC Class Codes: A63B 69/0026 for ice-hockey
• CPC Class Codes: A63B 69/3658 Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/646 for calculating the trajectory of an object
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: F41J 5/00 Target indicating systems; Target-hit or score detecting systems for shooting or hurling games A63F9/0204; devices for measuring projectile velocity using optical means G01P3/685

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. At least one processing stage communicates with the projectile tracking apparatus and is responsive to the image data to determine the three-dimensional positions, velocity and deceleration/acceleration of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity and deceleration/acceleration are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A display device coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

Claims

1. A sports simulation system comprising:

a projectile tracking apparatus comprising a display surface on which a visually apparent three-dimensional sports scene is presented, said projectile tracking apparatus capturing and processing images of a projectile tracking region disposed in front of said display surface to detect a launched sports projectile generally continuously from its launch position, throughout its travel through said projectile tracking region and to its contact position with said display surface; and

at least one processing stage receiving image data from said projectile tracking apparatus and determining the three-dimensional positions, velocity and deceleration/acceleration of the detected launched sports projectile traveling through said projectile tracking region, the three-dimensional positions, velocity and deceleration/acceleration being used by said at least one processing stage to calculate a trajectory of said launched sports projectile into said visually apparent three-dimensional sports scene, wherein said at least one processing stage uses said calculated trajectory to generate updated image data representing a simulation of the flight path of said launched sports projectile beginning substantially at the display surface contact position and traveling into said visually apparent three-dimensional sports scene following said calculated trajectory so that said simulation represents a realistic continuance of the travel of said sports projectile beyond the display surface.

2. A sports simulation system according to claim 1 further comprising a display device coupled to said at least one processing stage, said display device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface.

3. A sports simulation system according to claim 2 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

4. A sports simulation system according to claim 2 wherein said projectile tracking apparatus includes a frame and at least one pair of imaging devices mounted on said frame, said imaging devices having overlapping fields of view looking across and in front of said display surface and capturing images of said projectile tracking region.

5. A sports simulation system according to claim 4 wherein said imaging devices have generally perpendicular fields of view looking across and in front of said display surface from adjacent opposite corners of said frame.

6. A sports simulation system according to claim 5 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

7. A sports simulation system according to claim 6 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

8. A sports simulation system according to claim 5 wherein each of said imaging devices includes a first processor constituting one processing stage, each said first processor generating two-dimensional projectile position data as said projectile travels through said projectile tracking region, said two-dimensional projectile position data being conveyed to a host processor constituting a second processing stage, said host processor using the two-dimensional projectile position data received from each first processor to generate three-dimensional projectile position data and to calculate the velocity and deceleration/acceleration of said projectile.

9. A sports simulation system according to claim 8 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

10. A sports simulation system according to claim 8 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

11. A sports simulation system according to claim 2 wherein said at least one processing stage executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

12. A sports simulation system according to claim 11 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sports module including at least two of a training mode, a practice mode and a game play mode.

13. A sports simulation system according to claim 12 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

14. A sports simulation system according to claim 9 wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

15. A sports simulation system according to claim 14 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sports module including at least two of a training mode, a practice mode and a game play mode.

16. A sports simulation system according to claim 15 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

17. A sports simulation system according to claim 16 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

18. A sports simulation system according to claim 3 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

19. A sports simulation system according to claim 3 wherein said at least one foreground action element, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

20. A sports simulation system according to claim 18 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

21. A sports simulation system comprising:

a projectile tracking apparatus for tracking a launched sports projectile, said apparatus comprising;

a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented;

at least one pair of digital cameras mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region extending generally between said display surface and a projectile launch area, each of said digital cameras including a first processor for processing image data and generating two-dimensional projectile coordinates generally continuously as the launched sports projectile travels generally from its launch point, through said projectile tracking region to its contact point with said display surface; and

an audio system to broadcast audio accompanying said video sequence;

a host processor communicating with said digital cameras and said audio system, said host processor processing the two-dimensional projectile coordinates received from each first processor to determine the velocity and acceleration/deceleration of said projectile and using the determined projectile velocity and acceleration/deceleration to calculate a realistic three-dimensional trajectory of said sports projectile and outputting image data representing said calculated three-dimensional trajectory; and

a display unit receiving said image data and presenting said video sequence on said display surface, said video sequence representing a simulation of the flight path of said sports projectile following said calculated trajectory beginning from the contact point of said sports projectile with said display surface so that said simulation represents a realistic continuance of the travel of said sports projectile beyond the display surface.

22. A sports simulation system according to claim 21 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said host processor updating said image data so that said at least one foreground action element responds to the calculated trajectory of said projectile.

23. A sports simulation system according to claim 22 wherein said frame is readily assembled and disassembled

24. A sports simulation system according to claim 22 wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

25. A sports simulation system according to claim 24 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sport module including at least two of a training mode, a practice mode and a game play mode.

26. A sports simulation system according to claim 25 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

27. A sports simulation system according to claim 21 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

28. A sports simulation system according to claim 27 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

29. A sports simulation system according to claim 22 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

30. A sports simulation system according to claim 22 wherein said at least one foreground action element, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

31. A sports simulation system according to claim 29 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

32. A sports simulation system according to claim 22 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

33. A sports simulation system according to claim 32 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

34. A sports simulation system according to claim 33 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

35. A projectile tracking apparatus for a sports simulation system comprising:

a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented;

at least one pair of digital cameras mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region extending between said display surface and a projectile launch area, each of said digital cameras including a processor for processing image data and generating two-dimensional projectile coordinates generally continuously a at least when a sports projectile is launched from said launch area, travels through said projectile tracking region to its contact point with the display surface;

a host processor communicating with said digital cameras, said host processor processing the two-dimensional projectile coordinates received from the digital camera processors to determine the velocity and acceleration/deceleration of said sports projectile and using the determined projectile velocity and acceleration/deceleration to calculate a three-dimensional trajectory of said sports projectile and modifying the video sequence so that the video sequence shows the sports projectile traveling into the sports scene beginning from its contact point with the display surface following said calculated three-dimensional trajectory so that said video sequence represents a realistic continuance of the travel of said sports projectile beyond the display surface; and

an audio system to broadcast audio accompanying said video sequence.

36. A projectile tracking apparatus according to claim 35 wherein each said processor stores a projectile characteristic signature that is compared with captured images to detect the presence of a projectile therein.

37. A projectile tracking apparatus according to claim 36 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

38. A projectile tracking apparatus according to claim 37 further comprising a mirror associated with each digital camera to direct the field of view thereof across and in front of said display surface.

39. A golf simulator comprising:

a display surface on which a golf scene is presented;

imaging devices capturing images of a region in front of said display surface; and

processing structure receiving image data from said imaging devices and processing said image data to detect a launched golf ball generally continuously from its launch position, throughout its travel through said region and to its contact position with said display surface, said processing structure further processing said image data to determine the three-dimensional positions, velocity and deceleration/acceleration of the detected launched golf ball traveling through said region, the three-dimensional positions, velocity and deceleration/acceleration being used by said processing structure to calculate a trajectory of said launched golf ball into said golf scene, wherein said processing structure uses said calculated trajectory to generate updated image data representing a simulation of the flight path of said launched golf ball beginning substantially at the display surface contact position and traveling into said golf scene following said calculated trajectory so that said simulation represents a realistic continuance of the travel of said golf ball beyond the display surface.

40. A golf simulator according to claim 39 further comprising a display device coupled to said processing structure, said display device receiving image data from said processing structure and presenting said golf scene including said simulation on said display surface.

41. A golf simulator according to claim 40 wherein said golf scene includes at least one foreground action element overlying and moveable over a background image, said processing structure updating said image data so that said at least one foreground action element responds to the simulation of said launched golf ball.

42. A golf simulator according to claim 40 comprising at least one pair of imaging devices, said imaging devices having overlapping fields of view looking across and in front of said display surface and capturing images of said region.

43. A golf simulator according to claim 42 wherein said imaging devices have generally perpendicular fields of view looking across and in front of said display surface.

44. A golf simulator according to claim 42 wherein said golf scene includes at least one foreground action element overlying and moveable over a background image, said processing structure updating said image data so that said at least one foreground action element responds to the simulation of said launched golf ball.

45. A golf simulator according to claim 42 wherein said processing structure processes said image data to detect pixel clusters resembling a characteristic signature thereby to detect said golf ball in said captured images.

46. A golf simulator according to claim 42 further comprising an audio system to broadcast audio.

47. A golf simulator according to claim 41 wherein said golf scene includes a plurality of foreground action elements independently moveable over said background image.

48. A golf simulator according to claim 41 wherein said at least one foreground action element, background image and launched golf ball simulation are non-destructive overlay image planes that are combined seamlessly to complete said golf scene.

49. A golf simulator according to claim 47 wherein said foreground action elements, background image and launched golf ball simulation are non-destructive overlay image planes that are combined seamlessly to complete said golf scene.