Method and apparatus for determination and visualization of player field coverage in a sporting event

• US 6,141,041 A
• Filed: 06/22/1998
• Issued: 10/31/2000
• Est. Priority Date: 06/22/1998
• Status: Expired due to Term

• Current Assignee: RPX Corporation
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Jean, Yves D., Carlbom, Ingrid B., Pingali, Sarma V G K
• Primary Examiner(s): Le, Vu
• Application Number:
  US09/100,943
• Time in Patent Office: 862 Days
• Field of Search: 348/169, 348/699, 348/700, 348/416.1, 348/417.1, 348/418.1, 348/157, 348/161, 382/190, 382/174, 382/181
• US Class Current: 348/169
• CPC Class Codes: A63B 2024/0025 Tracking the path or location of one or more users, e.g. players of a game
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/14 Geo-tagging, e.g. for correlating route or track location data with specific information related to that specific location
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 71/00 Games or sports accessories not covered in groups A63B1/00 - A63B69/00 starting appliances A63K3/02
• CPC Class Codes: A63B 71/06 Indicating or scoring devices for games or players , or for other sports activities
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A method and apparatus for deriving an occupancy map reflecting an athlete'"'"'s coverage of a playing area based on real time tracking of a sporting event. The method according to the present invention includes a step of obtaining a spatio-temporal trajectory corresponding to the motion of an athlete and based on real time tracking of the athlete. The trajectory is then mapped over the geometry of the playing area to determine a playing area occupancy map indicating the frequency with which the athlete occupies certain areas of the playing area, or the time spent by the athlete in certain areas of the playing area. The occupancy map is preferably color coded to indicate different levels of occupancy in different areas of the playing area, and the color coded map is then overlaid onto an image (such as a video image) of the playing area. The apparatus according to the present invention includes a device for obtaining the trajectory of an athlete, a computational device for obtaining the occupancy map based on the obtained trajectory and the geometry of the playing area, and devices for transforming the map the a camera view, generating a color (or other visually differentiable) coded version of the occupancy map, and overlaying the color coded map on a video image of the playing area. In particular, the spatio-temporal trajectory may be obtained by an operation on a video image of the sporting event, in which motion regions in the image are identified, and feature points on the regions are tracked as they move, thereby defining feature paths. The feature paths, in turn, are associated in clusters, which clusters generally correspond to the motion of some portion of the athlete (e.g., arms, legs, etc.). The collective plurality of clusters (i.e., the trajectory) corresponds with the motion of the athlete as a whole.

Claims

1. A method for deriving an occupancy map for an athlete participating in a sporting event taking place on a playing area, comprising the steps of:

determining a spatio-temporal trajectory corresponding to motion of an athlete on the playing area;

computing an occupancy map based on the trajectory with respect to time and a geometry of the playing area;

transforming the occupancy map to the plane of the playing area;

generating a color coded occupancy map, the color coding representing various levels of occupancy relative to various areas of the playing area; and

overlaying the color coded occupancy map over an image of the playing area.

2. The method of claim 1, wherein the color coded occupancy map is coded with a plurality of colors, each color corresponding to a respective frequency or range of frequencies with which the athlete occupies respective regions of the playing area.

3. The method of claim 1, wherein the color coded occupancy map is coded with a plurality of colors, each color corresponding to a respective time or range of times that the athlete occupies respective regions of the playing area.

4. The method according to claim 1, wherein said determining step comprises the steps of:

obtaining a real time video image of the sporting event, the video image including a current frame and previous frames;

identifying a region of motion in the video image corresponding to motion of an athlete participating in the sporting event;

identifying a local feature of the region of motion;

matching the local feature in the current frame with a corresponding local feature in a previous frame to define a feature path; and

matching the feature path with a cluster of feature paths selected from among a plurality of clusters of feature paths, the plurality of clusters collectively representing the motion of the athlete, wherein a candidate cluster for matching with said feature path is closest in distance to the feature path.

5. The method of claim 4, further comprising the step of updating the cluster matched with the feature path in accordance with the characteristics of the feature path.

6. The method of claim 4, wherein said transforming step comprises coupling the trajectory with positioning parameters from a video camera by which the real time video image is obtained and mapping the occupancy map onto a playing area where the sporting event is taking place, from the perspective of the video camera.

7. The method according to claim 4, comprising the step of deciding whether a cluster is active or inactive, and, if inactive, destroying that cluster.

8. An apparatus for deriving an occupancy map for an athlete participating in a sporting event taking place on a playing area, comprising:

a device for obtaining a spatio-temporal trajectory based on the tracking of the motion of an athlete participating in the sporting event;

a computational device constructed and arranged to derive an occupancy map based on said trajectory over time and a geometry of the playing area;

a transforming device constructed and arranged to transform said occupancy map onto the plane of the playing area;

a color generator for generating a color coded version of said occupancy map;

a device constructed and arranged to electronically overlay said color coded version of said occupancy map over an image of the playing area.