Sports simulation system

• US 20070238539A1
• Filed: 03/30/2006
• Published: 10/11/2007
• Est. Priority Date: 03/30/2006
• Status: Abandoned Application

• Current Assignee: Interactive Sports Technologies Inc.
• Original Assignee: Interactive Sports Technologies Inc.
• Inventors: Zhao, Zuqiang, Dawe, Wayne, Richardson, Todd
• Application Number:
  US11/394,004
• Publication Number:
  US 20070238539A1
• Time in Patent Office: Days
• US Class Current: 473/131
• CPC Class Codes: A63B 2024/0028 Tracking the path of an object, e.g. a ball inside a soccer pitch
• CPC Class Codes: A63B 2024/0031 at the starting point
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0636 3D visualisation
• CPC Class Codes: A63B 2071/0638 Displaying moving images of recorded environment, e.g. virtual environment
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/16 Angular positions
• CPC Class Codes: A63B 2220/20 Distances or displacements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/807 Photo cameras
• CPC Class Codes: A63B 2225/74 with powered illuminating means, e.g. lights
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/3658 Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63B 71/06 Indicating or scoring devices for games or players , or for other sports activities
• CPC Class Codes: G06T 2207/30224 : Ball; Puck
• CPC Class Codes: G06T 7/292 : Multi-camera tracking

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. A projectile launch area sensing unit captures images of the projectile launch area. At least one processing stage communicates with the projectile tracking apparatus and the projectile launch area sensing unit and is responsive to the data received therefrom to determine the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity, acceleration and spin are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A projection unit coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

Claims

1. A sports simulation system comprising:

a projectile tracking apparatus including a display surface on which a visually apparent three-dimensional sports scene is presented, and at least one pair of camera devices capturing images of a projectile tracking region disposed in front of said display surface to detect a launched projectile traveling through said projectile tracking region towards said display surface;

a launch area sensing unit capturing images of a region in which contact with said projectile is made; and

at least one processing stage receiving data from the camera devices and said launch area sensing unit and determining the three-dimensional positions, velocity, acceleration and spin of a detected launched projectile traveling through said projectile tracking region, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into said visually apparent three-dimensional sports scene.

2. A sports simulation system according to claim 1 wherein said at least one processing stage uses said calculated trajectory to generate updated image data including a simulation of said launched projectile into said visually apparent three-dimensional sports scene following said calculated trajectory.

3. A sports simulation system according to claim 2 further comprising a projection device coupled to said at least one processing stage, said projection device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface.

4. A sports simulation system according to claim 3 wherein said projectile tracking apparatus includes a frame and at least one pair of camera devices mounted on said frame adjacent opposite top corners thereof, said camera devices having overlapping fields of view looking downwardly, across and in front of said display surface and capturing images of said projectile tracking region.

5. A sports simulation system according to claim 4 wherein said camera devices have generally perpendicular fields of view looking downwardly, across and in front of said display surface from adjacent opposite top corners of said frame.

6. A sports simulation system according to claim 3 wherein each camera device examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

7. A sports simulation system according to claim 6 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

8. A sports simulation system according to claim 3 further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.

9. A sports simulation system according to claim 3 wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.

10. A sports simulation system according to claim 9 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

11. A sports simulation system according to claim 2 wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched towards said display surface.

12. A sports simulation system according to claim 11 wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area.

13. A sports simulation system according to claim 2 wherein said at least one processing stage processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made.

14. A sports simulation system according to claim 13 wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched towards said display surface.

15. A sports simulation system according to claim 14 wherein said launch area sensing unit is above and looks down onto said launch area.

16. A sports simulation system according to claim 15 wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said at least one processing stage.

17. A sports simulation system comprising:

a projectile tracking apparatus including a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented; and

at least one pair of digital camera devices mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital camera devices including a first processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital camera devices;

a launch area sensing unit capturing images of a region in which contact with said projectile is made;

a host processor communicating with said digital camera devices and said launch area sensing unit, said host processor calculating a three-dimensional trajectory of said projectile taking into account projectile spin using the two-dimensional projectile coordinates received from each first processor and the image data output of said launch area sensing unit and outputting image data including said calculated three-dimensional trajectory; and

a display unit receiving said image data and presenting said video sequence including a simulation of said calculated trajectory on said display surface.

18. A sports simulation system according to claim 17 wherein each said first processor examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.

19. A sports simulation system according to claim 18 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

20. A sports simulation system according to claim 18 wherein said frame encompasses a rectangular region and wherein said digital camera devices are positioned at opposite top corners of said frame.

21. A sports simulation system according to claim 17 wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.

22. A sports simulation system according to claim 21 wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.

23. A sports simulation system according to claim 17 wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched toward said display surface.

24. A sports simulation system according to claim 23 wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area.

25. A sports simulation system according to claim 23 wherein said host processor processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made.

26. A sports simulation system according to claim 23 wherein said launch area sensing unit is above and looks down onto said launch area.

27. A sports simulation system according to claim 26 wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said host processor.

28. A sports simulation system comprising:

at least one pair of digital camera devices having overlapping fields of view looking across and in front of a display surface;

a launch area sensing unit capturing images of the region in which contact with said projectile is mode;

at least one processing stage processing image data from the camera devices and said launch area sensing unit relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, acceleration and spin of a detected launched projectile traveling through said overlapping fields of view, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into a visually apparent three-dimensional sports scene projected onto said display surface; and

a projection unit presenting said three-dimensional sport scene on said display surface including a simulation of said projectile following said calculated trajectory.

29. A sports simulation system according to claim 28 wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched toward said display surface.

30. A sports simulation system according to claim 29 wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area.

31. A sports simulation system according to claim 30 wherein said at least one processing stage processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made.

32. A sports simulation system according to claim 29 wherein said launch area sensing unit is above said launch area.

33. A sports simulation system according to claim 32 wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said at least one processing stage.