Detecting contacts during sporting activities etc

• US 8,348,276 B2
• Filed: 03/01/2007
• Issued: 01/08/2013
• Est. Priority Date: 03/01/2006
• Status: Expired due to Fees

• Current Assignee: Brennan Broadcast Group Pty Limited, Broadcast Group Pty., Ltd.
• Original Assignee: Brennan Broadcast Group Pty Limited
• Inventors: Brennan, Warren
• Primary Examiner(s): Hall, Arthur O.
• Application Number:
  US12/281,202
• Publication Number:
  US 20090017919A1
• Time in Patent Office: 2,140 Days
• Field of Search: 463 1- 9, 463/20, 463/23, 463/25, 463 30- 32, 463/34, 463 36- 37, 463 40- 43, 463 46- 47, 463/50, 463/53, 463/56, 273/108.1, 273/108.3, 273/108.4, 273/118.R, 273/150, 273/244, 273/244.1, 273/247, 273/259, 273/317.1, 273/317.3, 273/317.4, 273/317.5, 273/317.6, 273/359, 273/406, 273/440.1, 273460-461, 340/323.R, 340/323.B, 377 4- 5, 446/415, 473/451, 473/468, 473498-499, 473/504, 473564-565, 473/598, 473/600, 473/FOR.102, 473/FOR.135, 473/FOR.169, 473/FOR.192
• US Class Current: 273/118.R
• CPC Class Codes: A63B 2024/0025 Tracking the path or location of one or more users, e.g. players of a game
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2102/02 Tennis
• CPC Class Codes: A63B 2102/18 Baseball, rounders or similar games
• CPC Class Codes: A63B 2102/182 Softball
• CPC Class Codes: A63B 2102/20 Cricket
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/807 Photo cameras
• CPC Class Codes: A63B 2243/0037 Basketball
• CPC Class Codes: A63B 2243/0095 Volleyball
• CPC Class Codes: A63B 2244/102 Boxing
• CPC Class Codes: A63B 2244/22 Dancing
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/00 Training appliances or apparatus for special sports training of parachutists B64D23/00
• CPC Class Codes: A63B 71/0605 Decision makers and devices using detection means facilitating arbitration
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and an apparatus are described for determining parameters of a contact between bodies occurring within an activity. A digital camera directed towards a target area during the activity captures image frames including infra red image data. Structure for comparing image data for multiple temporally spaced frames with image data of a reference datum records any localized infra red emission appearing in at least one incident frame. The image data for at least one of the incident frames is analyzed to determine at least one parameter of the contact, and the image data for the incident frame is recorded. Visual display means displays the incident frames including the image data in the IR spectrum to enable visual inspection of the activity in the target area at the time of the incident frame and that gave rise to the contact producing the infra red emission.

Claims

1. A method of determining parameters of a contact between physical bodies occurring within a sporting, game, recreational or entertainment activity, the method comprising the steps of:

directing a digital image capture apparatus towards a target area during the course of the activity and capturing image frames of the target area including image data in the infra red region of the spectrum, said image data in the infra red region of the spectrum including localised infra red emission appearing in at least one incident frame, the localised infra red emission being indicative of heat having been generated by the contact which has occurred in the target area and which has generated heat, including at least one of friction between the bodies or by deformation of at least one of the bodies involved in the contact;

recording the image data for the at least one incident frame;

selectively displaying the at least one incident frame by visual display including the image data in the infra red region of the spectrum by presenting infra red image data in a visible display of a scene captured for the at least one incident frame to enable visual inspection of the activity in the target area at the time of the at least one incident frame and that gave rise to the contact producing the infra red emission; and

analysing the image data for at least one of the at least one incident frames to determine at least one parameter of the parameters of the contact, and wherein the analysing the image data step includes verification of each incident frame as being indicative of a legitimate event in the activity giving rise to the contact by analysing at least one parameter of the localised infra red emission as recorded in the infra red image data, including at least one of;

analysing at least one of a shape and a size of the target area exhibiting emissions in the infra red part of the spectrum and represented by contiguous pixels of the captured image frame;

analysing an infra red signature indicative of contact consisting of the localised infra red emission characteristics indicative of a pre-determined temperature change;

analysing a duration of decay of the localised infra red emission in the cluster of contiguous pixels; and

analysing the location of contiguous pixels having a predetermined amount of infra red emissions within the target area of the activity.

2. The method as claimed in claim 1, wherein the method includes the further step of comparing the image data for multiple temporally spaced frames with the image data of a reference datum so as to detect any localised infra red emission indicative of heat having been generated by contact by recording any increase of a predetermined amount in the intensity value of the localised infra red emission within at least one corresponding pixel of successive frames.

3. The method as claimed claim 1, wherein the step of comparing image data for multiple frames with image data of a reference datum comprises comparing the image data with corresponding image data captured for preceding frames of the same target area so that the image data of the reference datum relates to the target area immediately or shortly before the contact generating the infra red emission.

4. The method as claimed in claim 1, wherein the step of recording the image data for the at least one incident frame comprises recording the image data for several frames preceding the incident frame or preceding each incident frame or preceding the first of a number of successive incident frames, the step of displaying the incident frames being preceded by displaying images from the preceding recorded frames so that a sequence of frames leading up to and including the at least one incident frame is displayed to the user.

5. The method as claimed in claim 1, wherein the step of displaying the at least one incident frame by visual display is carried out in response to user initiation of a display command.

6. The method as claimed in claim 1, wherein the step of analysing the image data to determine at least one parameter of the contact is used to initiate generation of a signal indicative of a predetermined parameter of the contact.

7. The method as claimed in claim 1, wherein the activity is a tennis game, the target area comprises at least part of a tennis court including boundaries defined by outer sidelines and base lines and wherein the contact causing the localised infra red emission comprises impact of a tennis ball with a surface of at least part of the tennis court and wherein the step of analysing the image data to determine at least one parameter of the impact of the tennis ball comprises determination of the existence of an impact of the tennis ball with the surface of at least part of the tennis court.

8. The method as claimed in claim 7, wherein the step of analysing the image data to determine at least one parameter includes determination of the location of the contact or impact of the tennis ball with the surface of at least part of the tennis court in relation to tennis court line markings delineating legitimate zones of play.

9. The method as claimed in claim 1, wherein the activity comprises a cricket game, the target area comprises at least part of a cricket pitch where a batsman is stationed and wherein the contact causing localised infra red emission comprises contact involving a cricket ball, the contact also involving at least one of the following objects within the target area:

a cricket bat, apparel being worn by the batsman, accessories being worn by the batsman including protective pads, gloves and helmet, and parts of the body of the batsman; and

wherein the step of analysing the image data to determine at least one parameter of the contact of the cricket ball comprises at least determination of the existence of contact of the cricket ball with at least one of the objects.

10. The method as claimed in claim 1, wherein the activity comprises a game which involves a player who uses an implement to strike a projectile, wherein the target area comprises at least an area where the player is stationed when using the implement to strike the projectile, and wherein the contact causing localised infra red emission comprises a contact of the implement with the projectile, and wherein the step of analysing the image data to determine at least one parameter of the contact comprises at least determination of the location on the implement where contact with the projectile occurs.