Storage and editing of video and sensor data from athletic performances of multiple individuals in a venue

• US 9,679,607 B2
• Filed: 01/04/2016
• Issued: 06/13/2017
• Est. Priority Date: 01/23/2013
• Status: Active Grant

• Current Assignee: Fleye, Inc.
• Original Assignee: Fleye, Inc.
• Inventors: Miner, Cameron
• Primary Examiner(s): ADAMS, EILEEN M
• Application Number:
  US14/986,751
• Publication Number:
  US 20160260459A1
• Time in Patent Office: 526 Days
• Field of Search: None
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Video and sensor data from multiple locations in a venue, in which multiple individuals are engaged in athletic performances, is stored and edited to create individualized video programs of athletic performances of individuals. Each camera provides a video feed that is continuously stored. Each video feed is stored in a sequence of data files in computer storage, which data files are created in regular time intervals. Each file is accessible using an identifier of the camera and a time interval. Similarly, data from sensors is continuously received and stored in a database. The database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor and the time at which the individual was detected. Each sensor is associated with one or more cameras.

Claims

1. A computer system for generating an edited video program for an individual from a set of individuals participating in an event in a venue, wherein the venue includes a plurality of cameras that capture video of the individuals and a plurality of sensors, each sensor associated with one or more cameras of the plurality of cameras, each of the sensors at least detecting proximity of an individual near the sensor, the computer system comprising:

a processing unit, a computer storage medium and a database, and interfaces connected to receive data from the plurality of sensors and to receive video data from the plurality of cameras;

the processing unit executing computer program instructions to be operative to;

continuously receive the video data from the plurality of cameras during periods of time during the event;

store the received video data for each camera in a sequence of data files in the computer storage, each data file in the sequence being created in regular time intervals, each data file having as associated time interval and including video data from the camera for a period of time during the event in the associated time interval, each data file in the sequence being accessible using an identifier of the camera providing the received video data and data representing the time interval;

continuously receive the data from the plurality of sensors during periods of time during the event, the received data, from each sensor, being indicative of individuals and times at which proximity of the individuals to the sensor is detected by the sensor;

store the received data from each sensor in the database such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

receive an indication of an individual;

access, from the database, the stored data from the sensors, using the indication of the individual, to retrieve times from the database at which the individual was detected in the proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors;

access the stored video data from the computer storage to retrieve clips of the stored video data received from cameras associated with the one or more sensors, according to the retrieved times from the database at which the individual was detected in the proximity of one or more sensors by the one or more of the sensors.

3. The computer system of claim 1, wherein to access the stored video data, the processing unit is operative to:

determine, for each time of the retrieved times for the individual, a time interval corresponding to the time;

determine, for each identifier of the retrieved identifiers of the one or more sensors, an identifier of the camera associated with the sensor; and

access the data file using the determined identifier of the camera and the determined time interval.

2. A computer system for generating an edited video program for an individual using video captured from a plurality of cameras and sensor data captured from a plurality of sensors, the computer system comprising:

a processing unit, a computer storage medium and a database, and interfaces connected to receive data from the plurality of sensors and to receive video data from the plurality of cameras;

the processing unit executing computer program instructions to be operative to;

receive and store the video data from the plurality of cameras, the received video data received from each camera being stored in a sequence of data files, each data file in the sequence being created in regular time intervals, each data file having as associated time interval and including video data from the camera for a period of time in the associated time interval, each data file in the sequence being accessible using an identifier of the camera providing the received video data and data representing the time interval;

receive and store the sensor data from the plurality of sensors during periods of time, the received data, from each sensor, being stored in a database and being indicative of times at which proximity of the individual to the sensor is detected, such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

access, from the database, the stored sensor data, using an indication of the individual, to retrieve times from the database, at which the individual was detected in the proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors;

based on at least the identifiers of the one or more of the sensors, identify cameras associated with each of the one or more of the sensors;

access the stored video data received from the identified cameras to retrieve clips of the stored video data received from the identified cameras according to the retrieved times at which the individual was in the proximity of the one or more of the sensors associated with the identified cameras.

4. The computer system of claim 2, wherein to access the stored video data, the processing unit is operative to:

determine, for each time of the retrieved times for the individual, a time interval corresponding to the time;

access the data file storing video data received from the identified camera according to the determined time interval.

5. A computer system for generating a video program for an individual from a set of individuals participating in an event in a venue, wherein the venue includes a plurality of cameras, each camera being configured to capture video of the individuals, and wherein the venue further includes a plurality of sensors, each sensor associated with one or more cameras of the plurality of cameras, each sensor being configured to detect at least proximity of an individual near the sensor, the computer system comprising:

a processing unit, a computer storage medium and a database, and interfaces connected to receive data from the plurality of sensors and to receive video data from the plurality of cameras;

the processing unit executing computer program instructions to be operative to;

continuously store video data in computer storage from each camera of the plurality of cameras, during periods of time during the event, the stored video data being accessible using an identifier of the camera and data representing a time interval;

continuously receive data from the plurality of sensors during the event, the received data, from each sensor, being indicative of individuals and times at which proximity of the individuals to the sensor is detected by the sensor;

store the received data from each sensor in a database such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

identify, using a time at which an individual is detected in proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors, the one or more cameras associated with the one or more of the sensors, and access the stored video data from the computer storage to retrieve clips of the stored video data from the one or more cameras, corresponding to the times at which the individual was detected in the proximity of one or more sensors by the one or more of the sensors; and

compile a sequence of the retrieved clips of the individual.

6. The computer system of claim 5, wherein to access the stored video data, the processing unit is operative to:

determine, for a time at which the individual was detected in the proximity of one or more sensors by the one or more of the sensors, a time interval corresponding to the time;

access the data file storing video data received from the identified camera according to the determined time interval.