Systems and methods to control camera operations

• US 10,659,672 B2
• Filed: 02/15/2019
• Issued: 05/19/2020
• Est. Priority Date: 02/17/2015
• Status: Active Grant

• Current Assignee: AlpineReplay, Inc.
• Original Assignee: AlpineReplay, Inc.
• Inventors: Lokshin, David J., Lokshin, Anatole M.
• Primary Examiner(s): Cutler, Albert H
• Application Number:
  US16/277,596
• Publication Number:
  US 20190182417A1
• Time in Patent Office: 459 Days
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

Systems and methods to control operations of a camera based on one or more sensors attached to one or more actors. Sensor data collected from the sensors is analyzed to identify a state of an actor. The state of the actor is used to determine an operation parameter of the camera, such as the zoom level of the camera and/or the direction of the camera, and control the operation of the camera. For example, an actor who is in a state about to perform an interesting action can be selected from a plurality of actors; and the direction and the zoom level of the camera can be adjusted to focus on the selected actor in capture one or more subsequent images.

Claims

1. A system comprising:

at least one microprocessor; and

a memory storing instructions configured to instruct the at least one microprocessor to;

receive sensor data from one or more sensors attached to a first actor of a plurality of actors;

determine a motion of the first actor based on the sensor data received from the one or more sensors;

identify the first actor as an actor of focus from the plurality of actors based on motions of the actors;

control a camera based on the motion of the first actor determined based on the sensor data;

receive second sensor data from one or more sensors attached to a second actor;

determine a motion of the second actor based on the second sensor data;

compare the motion of the first actor and the motion of the second actor; and

select an operation parameter for the camera based on the comparing of the motion of the first actor and the motion of the second actor.

2. The system of claim 1, wherein the operation parameter is one of:

a zoom level of the camera, and a direction of the camera.

3. The system of claim 1, wherein the actor of focus is selected based at least in part on performances of the plurality of actors measured using the sensors attached to the actors.

4. The system of claim 1, wherein the actor of focus is selected based at least in part on a prediction, based on the motions of the actors, that the actor of focus is about to perform an action of interest.

5. A method, comprising:

receiving, by a computing device, sensor data from one or more sensors attached to a first actor;

determining, by the computing device, a motion of the first actor based on the sensor data received from the one or more sensors;

identifying, by the computing device, the first actor as an actor of focus from a plurality of actors based on motions of the actors;

controlling a camera based on the motion of the first actor determined based on the sensor data;

receiving, by the computing device, second sensor data from one or more sensors attached to a second actor;

determining, by the computing device, a motion of the second actor based on the second sensor data;

comparing the motion of the first actor and the motion of the second actor; and

selecting an operation parameter for the camera based on the comparing of the motion of the first actor and the motion of the second actor.

6. The method of claim 5, wherein the controlling of the camera includes:

determining an operation parameter of the camera; and

adjusting the camera based on the operation parameter.

7. The method of claim 6, wherein the operation parameter includes a zoom level of the camera.

8. The method of claim 6, wherein the operation parameter includes a direction of the camera.

9. The method of claim 5, wherein the selecting of the operation parameter includes:

selecting the first actor from a plurality of actors including the first actor and the second actor, based on comparing the motion of the first actor and the motion of the second actor; and

determining the operation parameter based on an identification of the first actor selected based on the comparing.

10. The method of claim 9, wherein the operation parameter is selected to increase a percentage of an image of the first actor within an image captured by the camera.

11. The method of claim 10, wherein the operation parameter is selected to reduce a percentage of an image of the second actor within the image captured by the camera.

12. The method of claim 9, wherein the operation parameter is selected based on a location of the first actor.

13. The method of claim 5, wherein the one or more sensors are attached to a piece of athletic equipment of the actor.

14. The method of claim 5, wherein the one or more sensors include at least one of:

a GPS device, an inertial sensor, a magnetic sensor, and a pressure sensor.

15. The method of claim 5, further comprising:

causing the camera to capture one or more images based on the controlling of the camera.

16. The method of claim 15, further comprising:

overlaying data derived from the sensor data on the one or more images.

17. The method of claim 15, further comprising:

tagging the one or more images with information derived from the sensor data; and

storing the tagged images in a database, wherein the tagged images are retrievable via the tagged information.

18. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, cause the computing device to perform a method, the method comprising:

receiving sensor data from one or more sensors attached to a first actor;

determining a motion of the first actor based on the sensor data received from the one or more sensors;

identifying the first actor as an actor of focus from a plurality of actors based on motions of the actors;

controlling a camera based on the motion of the first actor determined based on the sensor data;

receiving second sensor data from one or more sensors attached to a second actor;

determining a motion of the second actor based on the second sensor data;

comparing the motion of the first actor and the motion of the second actor; and

selecting an operation parameter for the camera based on the comparing of the motion of the first actor and the motion of the second actor.

19. A method, comprising:

receiving, by a computing device, sensor data from one or more sensors attached to a first actor;

processing, by the computing device, the sensor data to generate information indicative of a motion of the first actor;

identifying, by the computing device, the first actor as an actor of focus from a plurality of actors based on motions of the actors;

presenting, by the computing device, the information on a user interface to allow a human operator to select the actor of focus;

receiving, by the computing device, second sensor data from one or more sensors attached to a second actor;

determining, by the computing device, a motion of the second actor based on the second sensor data;

comparing the motion of the first actor and the motion of the second actor; and

selecting an operation parameter for the camera based on the comparing of the motion of the first actor and the motion of the second actor.