Method and apparatus for evaluating athletes in competition

• US 6,710,713 B1
• Filed: 05/17/2002
• Issued: 03/23/2004
• Est. Priority Date: 05/17/2002
• Status: Expired due to Fees

• Current Assignee: Patricia Scandling, Tom Russo
• Original Assignee: Patricia Scandling, Tom Russo
• Inventors: Russo, Gaetano Tom
• Primary Examiner(s): Mullen, Thomas J
• Application Number:
  US10/150,860
• Time in Patent Office: 676 Days
• Field of Search: 340/573.1, 340/815.4, 340/815.65, 340/323.R, 340/309.16, 348/157, 348/169, 700/91, 701/213, 702/182, 482/8, 482/9, 482/901, 482/902, 600/300
• US Class Current: 340/573.1
• CPC Class Codes: A63B 2024/0025 Tracking the path or location of one or more users, e.g. players of a game
• CPC Class Codes: A63B 2220/12 Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 71/0605 Decision makers and devices using detection means facilitating arbitration
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

The present invention provides a method and apparatus for tracking athletes during team competition, analyzing the performance of the athletes, and displaying motion picture images of the athletes along with selected measured and derived data about the motion of the athletes. In one embodiment, graphical icons representing movement parameters are superimposed upon the video images of a plurality of athletes during athletic play. In another embodiment, the motion data of a particular athlete are analyzed for a plurality of playing environments, including teammates and opponents, to determine the conditions under which the particular athlete excels or fails. In yet another embodiment, combinations of moving picture images of athletes and athlete motion data are provided to sports commentators for display to television audiences. In a particular embodiment, the images and data are provided to sports fans at locations remote from the game.

Claims

1. A method for manipulating data for evaluating performance in athletic competition, the method comprising the steps of:

tracking a plurality of athletes to produce athlete tracking data for each tracked athlete;

processing the athlete tracking data for each tracked athlete to produce athlete motion data;

controlling a plurality of digital video cameras, responsive to at least one of the athlete tracking data and the athlete motion data, to record digital images of at least a portion of the tracked athletes in motion, the images for each recorded, tracked, athlete comprising a temporally ordered, time-tagged, sequence of digital image frames;

generating at least one graphical icon representing at least one of the athlete motion data and data derived from the athlete motion data for each athlete tracked;

correlating the recorded digital image frames for each tracked, recorded athlete with at least one graphical icon for that tracked, recorded athlete;

superimposing the at least one graphical icon at least one of on and near the image of the at least one athlete whose motion is represented by the at least one icon; and

displaying the superimposed images.

2. The method of claim 1 wherein the step of tracking a plurality of athletes comprises the steps of:

creating the athlete tracking data in at least one personal motion data collector moving with each tracked athlete, the athlete tracking data comprising;

up to three position coordinates;

a time-tag indicating the time at which the athlete was at the position indicated by the coordinates; and

a unique identifier for each athlete;

transmitting the athlete tracking data from at least one transmitter in the at least one personal motion data collector, the transmitter responsive to the creation of the athlete tracking data to transmit the athlete tracking data; and

receiving the transmitted athlete tracking data in at least one receiver coupled to at least one data processor.

3. The method of claim 1 wherein the step of tracking a plurality of athletes comprises the steps of:

passively tracking each of a plurality of athletes'"'"' uniforms to produce athlete tracking data, the uniforms configured to be cooperatively tracked, one uniform moving with each athlete tracked;

determining the athlete tracking data for each athlete from the passive tracking data in at least one processor located off the field of play, the athlete tracking data comprising;

at least one position coordinate;

a time-tag indicating the time at which the athlete was at the position; and

a unique identifier for each athlete; and

sorting the athlete tracking data.

4. The method of claim 1 wherein the step of processing the athlete tracking data comprises the steps of:

converting the at least one position coordinate for each athlete tracked from a tracking system reference frame into a common inertial reference frame;

receiving analyst input data;

forming a data structure containing the transformed position coordinates, time-tags, identifiers, and analyst input data; and

providing access to the data structure for at least one of storage, analysis, and display.

5. The method of claim 1 wherein the step of generating at least one digital graphical icon comprises:

creating a digital graphical icon comprising at least one of;

a vector representation of at least one parameter of the athlete'"'"'s motion;

an iconic base;

the numeral from the tracked athlete'"'"'s uniform;

a bar graph representation of at least one parameter of the athlete'"'"'s motion; and

a line graph representation of at least one parameter of the athlete'"'"'s motion; and

storing the graphical icon in a data structure.

6. The method of claim 1 wherein the step of correlating further comprises the steps of:

encoding each digital image frame with camera position, orientation, and focal data at the time the digital image frame was recorded;

encoding each digital image frame with an item of the athlete motion data for a tracked athlete whose image is recorded in that digital image frame, wherein a time element of the athlete motion datum and a time-tag of the digital image frame differ by no more than a predetermined tolerance;

encoding an athlete motion datum in a data structure, the data structure containing the digital graphical icon representing at least one of the athlete motion data and data derived from the athlete motion data;

comparing the encoding in the digital image frame to the encoding in the digital graphical icon data structure to identify matched sets, wherein a matching set comprises a digital image frame and a digital graphical icon having the same encoding;

storing each matched set of a digital image frame and a digital graphical icon in a data structure;

transforming an icon, wherein the image of the icon is transformed into a perspective of the digital video camera that recorded the digital image frame having matching encoding, as if the icon was located at the coordinates of the athlete at the time the athlete was there; and

storing each matched set of a digital image frame and a transformed digital graphical icon in a data structure.

7. The method of claim 1 wherein the step of superimposing comprises the steps of:

determining which pixels in the digital image frame correspond to pixels of a digital graphical icon; and

changing a portion of the pixels of the digital image frame to a color selected for the icon.

8. The method of claim 7 wherein the step of changing comprises at least one of:

changing to a color selected for the icon only those digital image frame pixels representing both the icon and the field of play;

changing to a color selected for the icon all digital image frame pixels representing the icon; and

changing to a color selected for the icon all digital image frame pixels representing the playing field, the icon, and not the tracked athlete.

9. A system for evaluating athletes comprising:

at least one athlete tracking subsystem, operative to simultaneously collect tracking data on a plurality of athletes;

at least one tracking data processing subsystem, operative to process the tracking data to produce athlete motion data;

at least one analyst subsystem, operative to allow at least one analyst to input data to the system;

at least one database, operable to store and retrieve data records comprising at least one of the athlete tracking data, the athlete motion data, derived data, and the analyst-input data;

at least one athlete motion analysis processing subsystem, operative to process the data records, and responsive to the analyst inputs to provide derived data; and

at least one display subsystem, operative to visually display at least one of;

at least one of the data records;

at least one graphical representation of the at least one of the data records;

video data associated with the at least one of the data records; and

system status and configuration.

10. The system of claim 9, wherein the athlete tracking subsystem comprises a cooperative tracking subsystem.

11. The system of claim 10, wherein each of the plurality of athletes wears a uniform, the uniform comprising a personal motion data collector.

12. The system of claim 11, wherein a personal motion data collector comprises a navigation receiver and a data transmitter.

13. The system of claim 12, wherein the navigation data receiver is a Global Positioning System receiver.

14. The system of claim 9, wherein the at least one database is a plurality of databases, at least one of which is configured to be inaccessible to at least one group of system users.

15. The system of claim 9, wherein the tracking data processing subsystem comprises:

at least one receiver, the receiver accepting the athlete tracking data in sensor coordinates and responsive to produce the athlete tracking data formatted for a processor;

at least one processor, the processor responsive to the input of the athlete tracking data in sensor coordinates to;

produce the athlete motion data in common coordinates;

accept the analyst input data; and

combine the athlete motion data in common coordinates and the analyst input data into at least one athlete motion data record; and

at least one communications link, the communications link operative to send the at least one athlete motion data record to at least one of storage, analysis and display.

16. The system of claim 9, wherein the at least one analyst subsystem further comprises a subsystem responsive to the analyst input to reconfigure the tracking data subsystem.

17. The system of claim 9, wherein the at least one analyst subsystem is a plurality of analyst subsystems, at least one of which provides data to a database that is inaccessible to at least one group of system users.

18. The system of claim 9, wherein the at least one analyst subsystem further comprises a subsystem operative to select athletes for tracking.

19. The system of claim 9, wherein the at least one analyst subsystem further comprises a subsystem operative to perform analysis of stored athlete motion data and derived data.

20. The system of claim 9, wherein the at least one display subsystem is a plurality of display systems, at least one of which provides displays at least one of that is inaccessible to at least one opposing team.

21. The system of claim 9, further comprising at least one digital video camera, the digital video further comprising a camera controller, the camera controller responsive to at least one of the athlete tracking data and the athlete motion data to maintain an athlete being tracked within the field of view of the digital video camera.

22. The system of claim 21 wherein the at least one display subsystem comprises at least one screen displaying both digital video images and graphical representations of at least one of the athlete motion data and the derived data.

23. The system of claim 22 wherein the at least one of the athlete motion data and the derived data is displayed as graphical icons superimposed on the digital video images.

24. The system of claim 22 wherein the data is displayed exclusively in a first area of the screen and the digital video image is displayed exclusively in a second area of the screen.

25. The system of claim 9, wherein non-athletes are tracked, the non-athlete comprising at least one of a ball and an official.

26. The system of claim 9, wherein athletes comprise a plurality of persons engaging in a physical activity within a defined space.

27. An apparatus for evaluating athletes, the apparatus having an athlete motion analysis processing subsystem comprising:

a first software component, responsive to a query, operative to obtain and correlate data for a plurality of athletes;

a second software component, responsive to the correlated data for the plurality of athletes, operative to calculate derived data from at least one of athlete motion data, stored derived data, and analyst input data; and

a third software component, operative to evaluate the calculated derived data and to format the results for at least one of storage, analysis, and display.

28. A method for displaying a graphical icon correlated with a video image of an athlete, the method comprising:

collecting tracking data of the athlete'"'"'s motion;

controlling a digital video camera to maintain the athlete in a field of view of the digital video camera;

recording a digital video image of the athlete in motion;

generating a data structure, data, and an image for an icon in a computer, wherein;

the icon represents a feature of the athlete'"'"'s motion; and

the image of the icon is created in a perspective of the digital video camera that recorded the video image, as if the icon was located near the coordinates of the athlete at the time the athlete was there; and

superimposing the image of the icon onto the recorded video image.

29. The method of claim 28 wherein the step of controlling a digital video camera comprises the steps of:

optically tracking the athlete; and

recording the position, orientation, and focal data of the camera on at least one recorded video frame.

30. The method of claim 29 wherein the step of recording camera data on at least one recorded video frame comprises recording camera data on each frame recorded immediately after a change in camera position, orientation, or focal data.

31. The method of claim 28 wherein the step of controlling a digital video camera comprises the steps of:

transforming athlete tracking data into camera coordinates;

formatting a camera command from the transformed tracking data, the command operative to move the camera to view the athlete being tracked; and

recording the position, orientation, and focal data of the camera on each recorded video frame.