Sports simulation system

• US 20050023763A1
• Filed: 07/30/2003
• Published: 02/03/2005
• Est. Priority Date: 07/30/2003
• Status: Active Grant

• Current Assignee: Interactive Sports Technologies Inc.
• Original Assignee: Todd E. Richardson
• Inventors: Richardson, Todd E.
• Granted Patent: US 7,544,137 B2
• Time in Patent Office: Days
• US Class Current: 273/348
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2243/007 American football
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/0002 for baseball
• CPC Class Codes: A63B 69/002 for football American-football dummies A63B69/34
• CPC Class Codes: A63B 69/0026 for ice-hockey
• CPC Class Codes: A63B 69/3658 Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/646 for calculating the trajectory of an object
• CPC Class Codes: A63F 2300/8011 Ball
• CPC Class Codes: F41J 5/00 Target indicating systems; Target-hit or score detecting systems for shooting or hurling games A63F9/0204; devices for measuring projectile velocity using optical means G01P3/685

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. At least one processing stage communicates with the projectile tracking apparatus and is responsive to the image data to determine the three-dimensional positions, velocity and deceleration/acceleration of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity and deceleration/acceleration are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A display device coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

Claims

1. A sports simulation system comprising:

a projectile tracking apparatus including a display surface on which a visually apparent three-dimensional sports scene is presented, said projectile tracking apparatus capturing images of a projectile tracking region disposed in front of said display surface to detect a launched projectile traveling through said projectile tracking region towards said display surface; and

at least one processing stage receiving the image data and determining the three-dimensional positions, velocity and deceleration/acceleration of a detected projectile traveling through said projectile tracking region, the three-dimensional positions, velocity and deceleration/acceleration being used by said at least one processing stage to calculate a trajectory of said launched projectile into said visually apparent three-dimensional sports scene.

2. A sports simulation system according to claim 1 wherein said at least one processing stage uses said calculated trajectory to generate updated image data including a simulation of said launched projectile into said visually apparent three-dimensional sports scene following said calculated trajectory.

3. A sports simulation system according to claim 2 further comprising a display device coupled to said at least one processing stage, said display device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface.

4. A sports simulation system according to claim 3 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

5. A sports simulation system according to claim 3 wherein said projectile tracking apparatus includes a frame and at least one pair of imaging devices mounted on said frame, said imaging devices having overlapping fields of view looking across and in front of said display surface and capturing images of said projectile tracking region.

6. A sports simulation system according to claim 5 wherein said imaging devices have generally perpendicular fields of view looking across and in front of said display surface from adjacent opposite corners of said frame.

7. A sports simulation system according to claim 6 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

8. A sports simulation system according to claim 7 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.

9. A sports simulation system according to claim 6 wherein each of said imaging devices includes a first processor constituting one processing stage, each said first processor generating two-dimensional projectile position data as said projectile travels through said projectile tracking region, said two-dimensional projectile position data being conveyed to a host processor constituting a second processing stage, said host processor using the two-dimensional projectile position data received from each first processor to generate three-dimensional projectile position data and to calculate the velocity and deceleration/acceleration of said projectile.

10. A sports simulation system according to claim 9 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

11. A sports simulation system according to claim 9 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

12. A sports simulation system according to claim 3 wherein said at least one processing stage executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

13. A sports simulation system according to claim 12 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sports module including at least two of a training mode, a practice mode and a game play mode.

14. A sports simulation system according to claim 13 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

15. A sports simulation system according to claim 10 wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

16. A sports simulation system according to claim 15 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sports module including at least two of a training mode, a practice mode and a game play mode.

17. A sports simulation system according to claim 16 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

18. A sports simulation system according to claim 17 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

19. A sports simulation system according to claim 4 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

20. A sports simulation system according to claim 4 wherein said at least one foreground action element, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

21. A sports simulation system according to claim 19 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

22. A sports simulation system comprising:

a projectile tracking apparatus including a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented;

at least one pair of digital cameras mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital cameras including a first processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital cameras; and

an audio system to broadcast audio accompanying said video sequence;

a host processor communicating with said digital cameras and said audio system, said host processor calculating a three-dimensional trajectory of said projectile using the two-dimensional projectile coordinates received from each first processor and outputting image data including said calculated three-dimensional trajectory; and

a display unit receiving said image data and presenting said video sequence including a simulation of said calculated trajectory on said display surface.

23. A sports simulation system according to claim 22 wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said host processor updating said image data so that said at least one foreground action element responds to the calculated trajectory of said projectile.

24. A sports simulation system according to claim 23 wherein said frame is readily assembled and disassembled

25. A sports simulation system according to claim 23 wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the visually apparent three-dimensional sports scene being consistent with the selected mode.

26. A sports simulation system according to claim 25 wherein said sports simulation software includes a plurality of selectable sports modules each relating to a different sport that can be simulated, each sport module including at least two of a training mode, a practice mode and a game play mode.

27. A sports simulation system according to claim 26 wherein said sports modules include a football module, a soccer module, a hockey module, a baseball module and a golf module.

28. A sports simulation system according to claim 22 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

29. A sports simulation system according to claim 28 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

30. A sports simulation system according to claim 23 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

31. A sports simulation system according to claim 23 wherein said at least one foreground action element, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

32. A sports simulation system according to claim 30 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

33. A sports simulation system according to claim 23 wherein each said first processor examines captured images to detect pixel clusters resembling a characteristic projectile signature thereby to detect said projectile in said captured images.

34. A sports simulation system according to claim 33 wherein said visually apparent three-dimensional sports scene includes a plurality of foreground action elements independently moveable over said background image.

35. A sports simulation system according to claim 34 wherein said foreground action elements, background image and launched projectile simulation are non-destructive overlay image planes that are combined seamlessly to complete said visually apparent three-dimensional sports scene.

36. A projectile tracking apparatus for a sports simulation system comprising:

a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented;

at least one pair of digital cameras mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital cameras including a processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital cameras; and

an audio system to broadcast audio accompanying said video sequence.

37. A projectile tracking apparatus according to claim 36 wherein each said processor stores a projectile characteristic signature that is compared with captured images to detect the presence of a projectile therein.

38. A projectile tracking apparatus according to claim 37 wherein said frame encompasses a rectangular region and wherein said projectile tracking apparatus includes four imaging devices, each having a field of view looking across and in front of said display surface from a different corner of said rectangular region, said fields of view overlapping in a generally perpendicular manner.

39. A projectile tracking apparatus according to claim 38 further comprising a mirror associated with each digital camera to direct the field of view thereof across and in front of said display surface.