TRAJECTORY DETECTION AND FEEDFACK SYSTEM FOR TENNIS

• US 20080200287A1
• Filed: 01/10/2008
• Published: 08/21/2008
• Est. Priority Date: 01/10/2007
• Status: Abandoned Application

• Current Assignee: Pillar Vision Incorporated
• Original Assignee: Pillar Vision Incorporated
• Inventors: Marty, Alan W., Edwards, Thomas A.
• Application Number:
  US11/972,553
• Publication Number:
  US 20080200287A1
• Time in Patent Office: Days
• US Class Current: 473/459
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/38 for tennis A63B61/006, A63B69/0073 and A63B69/0097 take precedence

Abstract

A system for capturing and analyzing a trajectory of a tennis ball or other object associated with a play of a game of tennis and providing feedback is described. The system may be designed to capture and analyze a trajectory of a tennis ball during various activities related to the play of a game of tennis including serves and ground-strokes. The system may be configured to provide immediate feedback that may be utilized by a player to improve their performance as well as provide entertainment value above and beyond what is normally associated with the play of a game of tennis. The analysis and feedback system may be portable. Further, the system may be operable for use in an area where tennis is normally played during normal playing activities, such as player playing a game or practicing on an outdoor tennis court. The system may be operable to account for factors associated with its ambient environment, such as wind, temperature and humidity.

Claims

1. A device for analyzing a trajectory of a tennis ball, the device comprising:

one or more cameras for recording video frame data used to characterize a trajectory of a tennis ball generated by a player during a tennis related activity;

a logic device designed or configured to i) receive the video frame data, ii) identify the tennis ball in the video frame data, iii) generate trajectory parameters that characterize one or more states of the tennis ball along its trajectory and iv) generate feedback information using the trajectory parameters; and

at least one output mechanism for providing the feedback information to the player in real-time.

2. The device of claim 1, wherein the device includes two cameras.

3. The device of claim 1, wherein the device includes a stereoscopic camera.

4. The device of claim 1, wherein the tennis related activity is a toss of the tennis ball for a serve and wherein the logic device is further designed or configured to determine the trajectory of the tennis ball during the toss and prior to impact with a racquet.

5. The device of claim 4, wherein the feedback information is related to the trajectory of the tennis ball during the toss.

6. The device of claim 4, wherein the logic device is further designed or configured to determine the trajectory of the tennis ball after impact with the racquet and wherein the feedback information is related to the trajectory of tennis ball after the impact of the racquet.

7. The device of claim 6, wherein the feedback information includes information related to the trajectory of the tennis ball during the toss and information related to the trajectory of the tennis ball after impact with the racquet.

8. The device of claim 1, wherein the feedback information includes one or more of the following 1) a height of a serve toss, 2) a lean of the serve toss, 3) a spin of the serve toss, 4) a consistency of a plurality of serve tosses, 5) an impact position height of a serve, 6) an impact position lean of the serve, 7) a consistency of an impact position of a plurality of serves, 8) an initial speed of the serve, 9) an initial angle of the serve, 10) an initial direction of the serve, 11) an initial spin of the serve, 12) a consistency of the initial speed of the plurality of serves, 13) a consistency of the angle of serve of the plurality of serves, 14) a consistency of the direction of the plurality of serves, 15) a consistency of the spin of the plurality of serves, 16) a calculated speed of the serve, 17) a consistency of the calculated speed of the plurality of serves, 18) a calculated landing speed of the serve, 19) a location of the serve at landing, 20) a spin of the serve at landing, 21) a direction vector of the serve at landing, 22) a consistency of the calculated landing speed for the plurality of serves, 23) a consistency of the location at landing of the plurality of server, 24) a consistency of the spin at landing of the plurality of serves, 25) a consistency of the direction vector of the plurality of serves, 26) a measured landing speed of the serve, 27) a measured location of the serve, 28) a measured spin of the serve, 29) a measured direction vector of the serve, 30) a consistency of the measured landing speed of the plurality of serves, 31) a consistency of the measured location of the plurality of serves, 32) a consistency of the spin measured for the plurality of serves, 33) a consistency of the direction vector measured for the plurality of serves, 34) a height above or below a net of the tennis ball, 35) a location of the crossing point of the net of the tennis ball, 36) a release location of the serve toss and 37) combinations thereof.

9. The device of claim 1, wherein the feedback information is derived from a simulated trajectory of the tennis ball.

10. The device of claim 1, wherein the activity associated with the game of tennis is a ground-stroke and wherein the logic device is further designed or configured to determine one or more of the trajectory of the tennis ball prior to impact with a racquet, the trajectory of the tennis ball during impact with the racquet, the trajectory of the tennis ball after impact with the racquet or combinations thereof and to provide feedback information related to one or more of the trajectories.

11. The device of claim 1, wherein the device is portable.

12. The device of claim 1, wherein the logic device is further designed or configured to identify a boundary line associated with a tennis court in the video frame data.

13. The device of claim 12, wherein the logic device is further designed or configured to determine a position of the device relative to the tennis court using information associated with the identified boundary line for calibration purposes.

14. The device of claim 12, wherein the logic device is further designed or configured to determine the position of the tennis ball relative to the boundary line.

15. The device of claim 12, wherein the logic device is further designed or configured to identify a position of a body element of the player participating in the tennis related activity in the video frame data and to determine the position of the body element relative to the boundary line.

16. The device of claim 1, wherein the logic device is further designed or configured to identify a net associated with a tennis court including an upper edge of said net in the video frame data.

17. The device of claim 16, wherein the logic device is further designed or configured to determine a position of the device relative to the net for calibration purposes.

18. The device of claim 16, wherein the logic device is further designed or configured to determine a position of the tennis ball relative to the upper edge of said net.

19. The device of claim 1, wherein the logic device is further designed or configured to determine whether a tennis ball hit by a player on a tennis court is inside of or outside of one or more boundary lines associated with the tennis court.

20. The device of claim 19, wherein the logic device is further designed or configured to output feedback information to the player indicating whether the tennis ball is insider or outside of the one or more boundary lines with the feedback information generated using the trajectory parameters.

21. The device of claim 1, wherein the logic device is further designed or configured to determine the trajectory parameters associated with a two-dimensional trajectory for the tennis ball.

22. The device of claim 1, wherein the logic device is further designed or configured to determine the trajectory parameters associated with a three-dimensional trajectory for the tennis ball.

23. The device of claim 1, wherein the logic device is further designed or configured to determine one or more of a spin rate, a spin direction or combinations thereof of the tennis ball for at least one point along its trajectory.

24. The device of claim 1, wherein the logic device is further designed or configured to identify a racquet in the video frame data.

25. The device of claim 24, wherein the logic device is further designed or configured to determine a position of the racquet, a velocity of the racquet, an orientation of the racquet as a function of time or combinations thereof as a function of time.

26. The device of claim 1, wherein the logic device is further designed or configured to identify a body element of the player participating in the tennis related activity in the video frame data.

27. The device of claim 26, wherein the logic device is further designed or configured to determine a position of the body element, an orientation of the body element, a velocity of the body element or combinations thereof, as a function of time and provide feedback information related to one or more of the position of the body element, the orientation of the body element or the velocity of the body element.

28. The device of claim 1, wherein the logic device is further designed or configured to determine, for the purposes of calibration, a distance from the device to one or more of the tennis ball, a racquet, a boundary line on the tennis court, a net on the tennis court, a vertical surface against which the tennis ball is being hit or a player hitting the tennis ball.

29. The device of claim 1, further comprising one or more sensors for determining an orientation of the device.

30. The device of claim 29, wherein the one or more sensors comprise accelerometers or tilt sensors.

31. The device of claim 1, wherein the activity associated with the game of tennis is a ground-stroke and wherein the logic device is further designed or configured to determine one or more of the trajectory of the tennis ball prior to impact with a racquet, the trajectory of the tennis ball during impact with the racquet, the trajectory of the tennis ball after impact with the racquet or combinations thereof and to provide feedback information related to one or more of the trajectories.

32. The device of claim 1, wherein the output mechanism is a wireless interface for outputting the feedback information to one or more remote devices.

33. The device of claim 32, wherein the remote device is worn by a player participating in the activity associated with game of tennis.

34. The device of claim 1, wherein the output mechanism is an audio device coupled to the display.

35. The device of claim 1, further comprising:

a housing for the one or more cameras, the logic device, and the at least one output mechanism, the housing having a weight and form factor which facilitate one or more of transport, storage, unobtrusive set-up, calibration, or operation of the device.

36. The device of claim 35, wherein a portion of the housing comprises a bag.

37. The device of claim 1, further comprising an input mechanism.

38. The device of claim 37, wherein the input mechanism is a touch screen display.

39. The device of claim 37, wherein the input mechanism is a wireless interface for receiving input from a remote device.

40. The device of claim 1, wherein the device is portable.

41. The device of claim 1, wherein the logic device is a general purpose computer comprising:

a processor, a data storage device, RAM, operating system software, device interfaces, device drivers and trajectory analysis software.

42. The device of claim 1, wherein the device is capable of one of autonomous set-up, autonomous calibration, autonomous operation or combinations thereof.

43. The device of claim 1, wherein after manual input of data by a user, a confirmation of data determined by the device, the logic device is further designed or configured to complete a calibration procedure.

44. The device of claim 1, further comprising:

a memory storage device for storing trajectory session information wherein the trajectory session information comprises one or more of

     1) digitized video frame data, trajectory information and feedback information generated for a plurality of trajectories,

     2) a trajectory session time,

     3) a trajectory session date,

     4) a trajectory session location and combinations thereof.

45. The device of claim 1, wherein the device is designed to determine for a plurality of related trajectories captured by the device a consistency for at least one of the trajectory parameters generated for each of the plurality of related trajectories.

46. The device of claim 45, wherein the consistency is determined by calculating a statistical deviation.

47. The device of claim 1, wherein the logic device is further designed or configured to store data related to one or the trajectory of the tennis ball, movements of the player, movements of a racquet captured in the video frame data for use in a video simulation related to tennis.

48. The device of claim 47, a video simulation of the player is generated using the stored data.

49. A device for analyzing a trajectory of a tennis ball, the device comprising:

one or more cameras for recording video frame data used to characterize a trajectory of a tennis ball generated by a player during a tennis related activity;

a logic device designed or configured to i) receive the video frame data, ii) identify the tennis ball in the video frame data, iii) generate trajectory parameters that characterize one or more states of the tennis ball along its trajectory and iv) generate feedback information using the trajectory parameters; and

at least one output mechanism for providing the feedback information to the player in real-time;

a housing supporting or enclosing the one or more cameras, a logic device, and the at least the output mechanism wherein the housing and components supported or enclosed by the housing having a form factor and a weight factor that allow the device to be transported by the player.

50. The device of claim 49, wherein the device is designed to be securable to a fence by the player for operation.

51. A device for analyzing a trajectory of a tennis ball during a serve, the device comprising:

one or more cameras for recording video frame data used to characterize a trajectory of a tennis ball generated by a player during a serve toss, after the tennis ball is impacted by a racquet or combinations thereof;

a logic device designed or configured to i) receive the video frame data, ii) identify the tennis ball in the video frame data, iii) generate trajectory parameters that characterize one or more states of the tennis ball along a) a trajectory of the serve toss, b) a trajectory after impact by the racquet or combinations thereof, and iv) generate feedback information using the trajectory parameters; and

at least one output mechanism for providing the feedback information to the player in real-time related to the serve.