Play sequence visualization and analysis

• US 11,049,526 B2
• Filed: 11/16/2015
• Issued: 06/29/2021
• Est. Priority Date: 07/20/2009
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: House, Gregory, Akin, Ilke Levent
• Primary Examiner(s): Miller, John W
• Assistant Examiner(s): Sanders, Justin B
• Application Number:
  US14/942,579
• Publication Number:
  US 20160071548A1
• Time in Patent Office: 2,052 Days
• Field of Search: 725131
• CPC Class Codes: A63B 2024/0028 Tracking the path of an object, e.g. a ball inside a soccer pitch
• CPC Class Codes: A63B 2024/0031 at the starting point
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2024/0056 for statistical or strategic analysis
• CPC Class Codes: A63B 2024/0065 Evaluating the fitness, e.g. fitness level or fitness index
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2102/18 Baseball, rounders or similar games
• CPC Class Codes: A63B 2102/22 Field hockey
• CPC Class Codes: A63B 2220/12 Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/20 Distances or displacements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2225/20 with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2243/0025 Football American football A63B2243/007
• CPC Class Codes: A63B 2243/0037 Basketball
• CPC Class Codes: A63B 2243/0066 Rugby; American football
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: G11B 27/036 : Insert-editing
• CPC Class Codes: G11B 27/13 : the information being derived from movement of the record carrier, e.g. using tachometer
• CPC Class Codes: G11B 27/28 : by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/2187 : Live feed
• CPC Class Codes: H04N 21/23418 : involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/43072 : of multiple content streams on the same device
• CPC Class Codes: H04N 21/47 : End-user applications
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8146 : involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 5/2624 : for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/2625 : for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188

Abstract

A method for visualizing plays in a sporting event may include receiving a video stream of the sporting event and a measurement stream, asynchronous to the video stream, associated with objects in the sporting event. The method may further include displaying a synchronized presentation of the video stream and the measurement stream. The synchronization may be performed near the time of the displaying. Another method for visualizing plays in a sporting event may include receiving measurement information related to actions from one or more sporting events. The method may also include identifying plays from the actions using the measurement information and displaying a representation of the identified plays. A system for visualizing plays in a sporting event may include an integrated server and a synchronization mechanism. Another method for visualizing plays in a sporting event may include displaying a video of a play selected from a representation.

Claims

1. A system for visualizing an action in a sporting event comprising:

an integrated server configured to;

receive a planned play sequence related to at least one player and the sporting event, the planned play sequence comprising a predefined sequence of a plurality of sporting actions, wherein a beginning of the predefined sequence is represented by a spatial position of the at least one player relative to a region of the sporting event and an end of the predefined sequence is represented by a specific sporting action;

receive a video stream of an actual play sequence in the sporting event;

receive a measurement stream from one of a plurality of tracking sources including positional measurements for at least one object in the actual play sequence;

receive a user selected type of a comparison to be made between the planned play sequence and the actual play sequence;

determine at least one spatial difference between the planned play sequence and one of the video stream of the actual play sequence based on the user selected type of comparison; and

a synchronization mechanism configured to display a synchronized presentation of the video stream and a graphical representation of the at least one spatial difference.

2. The system of claim 1, wherein the integrated server is further configured to identify the planned play sequence based on the actual play sequence.

3. The system of claim 1, wherein the integrated server is further configured to evaluate a performance of the at least one object based on the at least one spatial difference.

4. The system of claim 1, wherein the integrated server is further configured to evaluate a performance of a team of players including the at least one object based on the at least one spatial difference.

5. The system of claim 1, wherein the planned play sequence further comprises at least one of a head position, a torso position or a pose position of the at least player,

wherein the measurement stream further comprises at least one of a head measurement, a torso measurement or a pose measurement of the at least one object, and

wherein the at least one spatial difference includes at least one of a difference between the head position of the at least one player and the head measurement of the at least one object, a difference between the torso position of the at least one player and the torso measurement of the at least one object, or a difference between the pose position of the at least one player and the pose measurement of the at least one object.

6. The system of claim 1, wherein the integrated server is further configured to receive an annotation from a user and the synchronization mechanism is further configured to display the annotation within the synchronized presentation.

17. The method of claim 1, wherein the at least one spatial difference includes differences between the spatial location of the plurality of sporting actions and the positional measurements of the at least one object.

7. A computer-implemented method for visualizing plays in a sporting event comprising:

receiving a planned play sequence related to at least one player and the sporting event, the planned play sequence comprising a predefined sequence of a plurality of sporting actions, wherein a beginning of the predefined sequence is represented by a spatial position of the at least one player relative to a region of the sporting event and an end of the predefined sequence is represented by a specific sporting action;

receiving a video stream of an actual play sequence in the sporting event;

receiving a measurement stream from one of a plurality of tracking sources including positional measurements for one or more objects in the actual play sequence;

receive a user selected type of a comparison to be made between the planned play sequence and the actual play sequence;

determine at least one spatial difference between the planned play sequence and one of the video stream of the actual play sequence based on the user selected type of comparison; and

displaying a synchronized presentation of the video stream and a graphical representation of the at least one spatial difference.

8. The method of claim 7, wherein displaying the synchronized presentation includes identifying the planned play sequence based on the actual play sequence.

9. The method of claim 7, wherein displaying the synchronized presentation includes evaluating a performance of the at least one object based on the at least one spatial difference.

10. The method of claim 7, wherein displaying the synchronized presentation includes evaluating a performance of a team of players including the at least one object based on the at least one spatial difference.

11. The method of claim 7, wherein displaying the synchronized presentation includes an animated view having a three-dimensional viewing angle.

12. The method of claim 7, wherein displaying the synchronized presentation includes a time-line view having time-line controls and a time-line representation of at least a portion of the sporting event.

13. The method of claim 7, further comprising:

receiving an annotation from a user; and

displaying the annotation within the synchronized presentation.

14. A computer-implemented method for identifying plays in a sporting event comprising:

receiving a planned play sequence, wherein the planned play sequence comprises a predefined sequence of a plurality of sporting actions, wherein a beginning of the predefined sequence is represented by a spatial position of at least one player relative to a region of a sporting event and an end of the predefined sequence is represented by a specific sporting action;

receiving a video sequence containing at least one actual play sequence of the sporting event;

identifying the planned play sequence based on the at least one actual play sequence;

determining a portion of the video sequence associated with the at least one actual play sequence;

extracting at least one action sequence measurement of at least one object in the at least one actual play sequence based on automatically analyzing at least part of the portion of the video sequence;

storing the at least one action sequence measurement for the at least one actual play sequence;

receive a user selected type of a comparison to be made between the planned play sequence and the at least one actual play sequence;

determine at least one spatial difference between the planned play sequence and the video sequence containing the at least one actual play sequence based on the user selected type of comparison; and

displaying a synchronized presentation of the video sequence and a graphical representation of the at least one spatial difference.

15. The method of claim 14, further including:

annotating the synchronized presentation with play set labels based on the planned play sequence.

16. The method of claim 14, further including:

linking the video sequence with one or more associated video sequences, wherein the associated video sequences are based on one of the planned play sequence, a play type, a play result, a player, and a team of players.