SYSTEMS AND METHODS FOR MONITORING OBJECTS AT SPORTING EVENTS

• US 20170161561A1
• Filed: 02/21/2017
• Published: 06/08/2017
• Est. Priority Date: 10/05/2015
• Status: Active Grant

• Current Assignee: Pillar Vision Incorporated
• Original Assignee: Pillar Vision Incorporated
• Inventors: Marty, Alan W., Carter, John
• Granted Patent: US 11,263,461 B2
• Time in Patent Office: Days
• CPC Class Codes: A63B 2220/807 Photo cameras
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 2207/30224 Ball; Puck
• CPC Class Codes: G06T 2207/30228 Playing field
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G06V 20/42 of sport video content
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A system for monitoring objects at sporting events or other types of events uses a wearable drone that has at least one camera or other sensor for capturing or otherwise sensing data. When the drone is to be used for monitoring, such as monitoring an object at a sporting event, the wearable drone may be detached from its user, and it may hover or otherwise fly within a certain position of an object to be monitored. While flying, the drone'"'"'s sensor may be used to capture information, such as performance data or images, of the object during the sporting event.

Claims

1. A system for monitoring player performance at sporting events, comprising:

a drone configured to identify and track a player at a sporting event, the drone configured to fly to a predefined position for observing a sporting activity performed by the player at the sporting event, wherein the player launches or dribbles an object while performing the sporting activity, and wherein the drone has at least one sensor for sensing movement of the object or player while the player is launching or dribbling the object, and wherein the at least one sensor is configured to provide sensor data indicative of the movement; and

at least one processor configured to determine, based on the sensor data, a first parameter indicative of a performance of the player in launching or dribbling the object; and

an output device configured to provide feedback indicative of the performance of the player in launching or dribbling the object based on the first parameter.

2. The system of claim 1, wherein the drone is a wearable drone worn by the player.

3. The system of claim 1, wherein the at least one processor resides on the drone.

4. The system of claim 1, wherein the object is one of a group including a football, a soccer ball, a baseball, a volleyball, a hockey puck, and a basketball.

5. The system of claim 1, wherein the predefined position is relative to the player.

6. The system of claim 5, wherein the drone is configured to move with the player during the sporting activity based on the sensor data such that the drone substantially remains at the predefined position relative to the player as the player moves.

7. The system of claim 5, wherein the drone is configured to move with the player during the sporting activity based on the sensor data.

8. The system of claim 7, wherein the predefined position is behind the player.

9. The system of claim 7, wherein the at least one sensor is configured to capture an image of the player, and wherein the drone is configured to identify the player based on the captured image.

10. The system of claim 9, wherein the drone is configured to identify the player based on a jersey worn by the player.

11. The system of claim 1, wherein the drone is configured to operate in a first operational mode for determining at least the first parameter, wherein the drone is configured to operate in a second operational mode for determining at least a second parameter indicative of a performance of the player in performing a sporting activity at the sporting event, and wherein the drone is configured to observe gameplay for the sporting event and to transition from the first operational mode to the second operational mode based on the gameplay.

12. The system of claim 11, wherein the first parameter is an offensive parameter, and wherein the second parameter is a defensive parameter.

13. The system of claim 1, wherein the at least one processor is configured to determine a trajectory of the object based on the sensor data, and wherein the first parameter is based on the trajectory of the object.

14. The system of claim 1, wherein the at least one sensor is configured to capture an image, wherein the at least one processor is configured to convert the image from a viewpoint relative to a location of the at least one sensor to a viewpoint relative to a location of a head-mounted display, and wherein the at least one processor is configured to transmit the converted image to the head-mounted display.

15. The system of claim 1, wherein the at least one sensor is configured to capture a first image, wherein the at least one processor is configured to receive the first image and a second image captured by at least one sensor of a second drone, and wherein the at least one processor is configured to stitch the first image and the second image to form a composite image.

16. The system of claim 1, wherein the drone is configured to sense an event indicating that monitoring of the sporting activity with the drone is to stop, and wherein the drone is configured to fly to a predefined location is response to the sensed event.

17. The system of claim 1, further comprising a multi-lens camera positioned on the player, the multi-lens camera having a plurality of lens, wherein the at least one processor is configured to receive images captured by the multi-lens camera and to stitch the images, thereby providing a composite image.

18. The system of claim 17, wherein the composite image defines a 360 degree view around the player.

19. A method, comprising:

flying a drone to a predefined position for observing a sporting activity performed by a player at a sporting event;

tracking the player with a drone;

sensing movement of the object or player with at least one sensor of the drone while the player is launching or dribbling an object during the sporting activity;

receiving sensor data indicative of the movement from the at least one sensor;

determining, based on the sensor data, a first parameter indicative of a performance of the player in launching or dribbling the object; and

outputting feedback indicative of the performance of the player in launching or dribbling the object based on the first parameter.

20. The method of claim 19, further comprising wearing the drone by the player.

21. The method of claim 19, wherein the predefined position is relative to the player.

22. The method of claim 21, further comprising moving the drone with the player during the sporting activity based on the sensor data.

23. The method of claim 19, further comprising:

operating the drone in a first operational mode for determining at least the first parameter;

operating the drone in a second operational mode for determining at least a second parameter indicative of a performance of the player in performing a sporting activity at the sporting event;

observing gameplay for the sporting event with the drone; and

transitioning the drone from the first operational mode to the second operational mode based on the gameplay.

24. The method of claim 23, wherein the first parameter is an offensive parameter, and wherein the second parameter is a defensive parameter.

25. The method of claim 19, further comprising:

capturing an image with the at least one sensor;

converting the image from a viewpoint relative to a location of the at least one sensor to a viewpoint relative to a location of a head-mounted display; and

displaying the converted image with the head-mounted display.

26. The method of claim 19, further comprising:

capturing a first image with the at least one sensor;

capturing a second image with at least one sensor of a second drone; and

stitching the first image and the second image to form a composite image.

27. The method of claim 19, further comprising:

sensing an event indicating that monitoring of the sporting activity with the drone is to stop; and

flying the drone to a predetermined location in response to the sensed event.

28. The method of claim 19, further comprising:

capturing a plurality of images using a multi-lens camera positioned on the player; and

stitching the plurality of images, thereby defining a composite image.