Systems and methods for tracking dribbling in sporting environments

• US 9,886,624 B1
• Filed: 06/03/2016
• Issued: 02/06/2018
• Est. Priority Date: 06/03/2016
• Status: Active Grant

• Current Assignee: Pillar Vision Incorporated
• Original Assignee: Pillar Vision Incorporated
• Inventors: Marty, Alan W., Carter, John, Lucey, Simon
• Primary Examiner(s): Azarian, Seyed
• Application Number:
  US15/173,245
• Time in Patent Office: 613 Days
• Field of Search: 382100, 382103, 382106-107, 382162, 382168, 382173, 382181, 382189, 382192, 382209, 382219, 382232, 382254, 382274, 382276, 382286-295, 382305, 382312, 382321, 473447, 1 1, 463 37, 700 91, 348 46
• CPC Class Codes: G06T 2207/30224 Ball; Puck
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/42 of sport video content
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Systems and methods are provided for tracking a dribbling motion associated with a person engaged in either a training session for a sporting event or the live play of the sporting event. In sporting events, a dribbling motion can be associated with a repetitive movement or a short trajectory sequence between changes of direction of a ball, puck or other object used in the sporting event. The repetitive movement or short trajectory sequence used for dribbling can involve an up-and-down movement such as in basketball or a back-and-forth movement such as in soccer or hockey. The system can use one or more cameras to capture images of a person dribbling an object and at least one processor to analyze the images to determine and evaluate one or more characteristics associated with the dribbling motion.

Claims

1. A system for tracking dribbling, comprising:

at least one camera configured to capture images of a player dribbling an object at the sporting event;

memory;

at least one processor configured to receive image data defining the images from the at least one camera, the at least one processor configured to identify the object within the images and to identify a plurality of dribbles of the object by the player based on the images, wherein the at least one processor, for each of the plurality of dribbles, is configured to identify which hand of the player is used for dribbling the object and to determine at least one parameter indicative of dribble performance for the identified hand, wherein the at least one processor is configured to determine whether a defender is guarding the player based on an orientation of the defender relative to the player, and wherein the at least one processor is configured to store the at least one parameter for each of the plurality of dribbles in the memory and to calculate, based on the stored at least one parameter and whether the defender is determined to be guarding the player, at least one value characterizing a dribble performance for one hand of the player during the plurality of dribbles; and

an output interface configured to provide, based on the at least one value, an output indicative of dribble performance of the player for the plurality of dribbles.

2. The system of claim 1, wherein the at least one processor is configured to estimate a trajectory of the object when the object is occluded in the images.

3. The system of claim 1, wherein the output includes the at least one value characterizing the dribble performance and indicates that the at least one value is correlated with the one hand.

4. A system for tracking dribbling, comprising:

at least one camera configured to capture images of a player dribbling a basketball;

at least one processor configured to receive image data defining the images from the at least one camera, the at least one processor configured to identify the basketball within the images and to identify a plurality of dribbles of the basketball by the player based on the images, wherein the at least one processor, for at least one of the plurality of dribbles, is configured to determine at least one parameter indicative of dribble performance, wherein the at least one processor is configured to determine whether a defender is guarding the player based on a distance between the player and the defender, and wherein the at least one processor is configured to determine a value characterizing a dribble performance of the player based on the at least one parameter and whether the defender is determined to be guarding the player during the at least one of the plurality of dribbles; and

an output interface configured to provide an output indicative of the dribble performance of the player based on the at least one parameter, wherein the output includes the value and indicates that the value is correlated with the defender.

5. The system of claim 4, wherein the at least one processor is configured to estimate a trajectory of the basketball when the basketball is occluded in the images.

6. The system of claim 4, further comprising memory, wherein the at least one processor is configured to store a plurality of parameters in the memory, each of the plurality of parameters characterizing a dribble performance of the player for a respective one of the plurality of dribbles, wherein the output is based on each of the plurality of parameters.

7. The system of claim 4, wherein the output includes a value characterizing a dribble performance of the player for the plurality of dribbles, and wherein the output indicates that the value is correlated with at least one defender guarding the player.

8. The system of claim 4, further comprising memory, wherein the at least one processor is configured to identify the defender, and wherein the at least one processor is configured to store the at least one parameter in the memory and to correlate the at least one parameter with an identifier that identifies the defender.

9. The system of claim 4, wherein the at least one processor is configured to determine an orientation of the defender relative to the player based on the images, and wherein the at least one processor is configured to determine whether the defender is guarding the player during the at least one of the plurality of dribbles based on the orientation.

10. The system of claim 4, wherein the at least one processor is configured to identify which hand of the player is used for dribbling the basketball during the at least one of the plurality of dribbles.

11. The system of claim 10, wherein the at least one processor is configured to determine, based on the identified plurality of dribbles, a first parameter indicative of a dribbling performance of the player with his or her left hand and a second parameter indicative of a dribbling performance of the player with his or her right hand.

12. The system of claim 10, further comprising memory, wherein the at least one processor is configured to store the at least one parameter in the memory and to correlate the at least one parameter with the identified hand.

13. The system of claim 4, wherein the at least one processor is configured to identify at least one body part of the player in the images and to determine a location of the body part based on the images, and wherein the at least one processor is configured to determine a dribble type for the at least one dribble based on the location of the at least one body part.

14. The system of claim 13, further comprising memory, wherein the at least one processor is configured to store the at least one parameter in the memory and to correlate the at least one parameter with the dribble type.

15. The system of claim 4, wherein the at least one processor is configured to determine an orientation of the defender relative to the player based on the images, and wherein the at least one processor is configured to determine whether the defender is guarding the player during the at least one of the plurality of dribbles based on the orientation.

16. A system for tracking dribbling, comprising:

at least one camera configured to capture images of a player dribbling a basketball;

memory;

at least one processor configured to receive image data defining the images from the at least one camera, the at least one processor configured to identify the basketball within the images and to identify a plurality of dribbles of the basketball by the player based on the images, wherein the at least one processor, for at least one of the plurality of dribbles, is configured to determine at least one parameter indicative of dribble performance, wherein the at least one processor is configured to identify a defender and to determine whether the defender is guarding the player, wherein the at least one processor is configured to determine a value characterizing a dribble performance of the player based on the at least one parameter and whether the defender is determined to be guarding the player during the at least one of the plurality of dribbles, and wherein the at least one processor is configured to store the at least one parameter in the memory and to correlate the at least one parameter with an identifier that identifies the defender; and

an output interface configured to provide an output indicative of the value,

wherein the output includes the value, and wherein the output indicates that the value is correlated with the defender.

17. A system for tracking dribbling event, comprising:

at least one camera configured to capture images of a player dribbling a basketball;

at least one processor configured to receive image data defining the images from the at least one camera, the at least one processor configured to identify the basketball within the images and to identify a plurality of dribbles of the basketball by the player based on the images, wherein the at least one processor, for at least one of the plurality of dribbles, is configured to determine at least one parameter indicative of dribble performance and to determine whether a defender is guarding the player based on an orientation of the defender relative to the player, wherein the at least one processor is further configured to determine a value characterizing a dribble performance of the player for the plurality of dribbles based on the at least one parameter and whether the defender is determined to be guarding the player; and

an output interface configured to provide an output indicative of the dribble performance of the player based on the at least one parameter, wherein the output includes the value and indicates that the value is correlated with the defender.

18. A method for tracking dribbling, comprising:

capturing images of a player dribbling a basketball with at least one camera;

receiving image data defining the images from the at least one camera;

identifying the basketball within the images with at least one processor;

identifying a plurality of dribbles of the basketball by the player based on the identified basketball within the images;

for the at least one of the identified dribbles, determining with the at least one processor which hand of the player is used for dribbling the basketball;

for the at least one of the identified dribbles, determining with the at least one processor at least one parameter indicative of dribble performance for one hand of the player based on the images;

determining with the at least one processor whether a defender is guarding the player based on an orientation of the defender relative to the player;

calculating with the at least one processor a value characterizing a dribble performance for the one hand based on the at least parameter and the determining whether the defender is guarding the player; and

providing, via an output interface, an output indicative of dribble performance of the player for the plurality of dribbles based on the value.

19. The method of claim 18, further comprising:

identifying the basketball in a plurality of frames of the image data;

determining a respective location of the basketball for each of the plurality of frames; and

estimating a trajectory of the basketball between the at least two of the plurality of frames when the basketball is occluded in the images based on the determined locations of the basketball for the plurality of frames.

20. The method of claim 18, further comprising:

storing, in memory, the at least one parameter; and

correlating the at least one parameter in the memory with an identifier identifying the defender.

21. The method of claim 18, further comprising

identifying at least one body part of the player in the images with the at least one processor;

determining a dribble type with the at least one processor based on the trajectory of the basketball relative to a location of the at least one body part;

storing, in memory, the at least one parameter; and

correlating the at least one parameter in the memory with an identifier identifying the dribble type.

22. The method of claim 18, further

comprising determining, with the at least one processor based on the identified plurality of dribbles, a first parameter indicative of a dribbling performance of the player with his or her left hand and a second parameter indicative of a dribbling performance of the player with his or her right hand.

23. A method for tracking dribbling, comprising:

capturing images of a player dribbling a basketball with at least one camera;

receiving image data defining the images from the at least one camera;

identifying the basketball within the images with at least one processor;

identifying a plurality of dribbles of the basketball by the player based on the identified basketball within the images;

for the at least one of the identified dribbles, determining at least one parameter indicative of dribble performance for the player based on the images with the at least one processor;

providing, via an output interface, an output indicative of the dribble performance based on the at least one parameter;

determining with the at least one processor whether a defender is guarding the player during at least one of the identified dribbles based on the images, wherein the at least one parameter is based on the determining whether the defender is guarding the player;

storing, in memory, the at least one parameter; and

correlating the at least one parameter in the memory with an identifier identifying the defender; and

determining a distance between the player and the defender with the at least one processor based on the images, wherein the determining whether the defender is guarding the player is based on the distance.

24. A system for tracking dribbling, comprising:

at least one camera configured to capture images of a player dribbling a basketball;

at least one processor configured to receive image data defining the images from the at least one camera, the at least one processor configured to identify the basketball within the images and to identify a plurality of dribbles of the basketball by the player based on the images, wherein the at least one processor is configured to identify which hand of the player is used for each of the identified plurality of dribbles, wherein the at least one processor is configured to determine, based on the identified plurality of dribbles, a first parameter indicative of a dribbling performance of the player with his or her left hand and a second parameter indicative of a dribbling performance of the player with his or her right hand, and wherein the at least one processor is configured to determine whether a defender is guarding the player based on an orientation of the defender relative to the player; and

an output interface configured to provide an output based on at least one of the first parameter and the second parameter and based on whether the defender is determined to be guarding the player.

25. A method for tracking dribbling, comprising:

capturing images of a player dribbling a basketball with at least one camera;

receiving image data defining the images from the at least one camera;

identifying the basketball within the images with at least one processor;

identifying a plurality of dribbles of the basketball by the player based on the identified basketball within the images;

for the at least one of the identified dribbles, determining at least one parameter indicative of dribble performance for the player based on the images with the at least one processor;

determining with the at least one processor an orientation of a defender relative to the player based on the images;

determining with the at least one processor whether the defender is guarding the player during the at least one of the identified dribbles based on the orientation;

determining with the at least one processor a value indicative of dribble performance of the player based on the at least one parameter and the determining whether the defender is guarding the player; and

providing an output indicative of the value via an output interface.

26. The method of claim 25, further comprising:

determining with the at least one processor a distance between the player and the defender based on the images; and

wherein the determining whether the defender is guarding the player is based on the determining the distance.