Storage and editing of video and sensor data from athletic performances of multiple individuals in a venue

• US 9,230,599 B2
• Filed: 01/22/2014
• Issued: 01/05/2016
• Est. Priority Date: 01/23/2013
• Status: Active Grant

• Current Assignee: Fleye, Inc.
• Original Assignee: Fleye, Inc.
• Inventors: Miner, Cameron
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): Adams, Eileen
• Application Number:
  US14/160,677
• Publication Number:
  US 20140219628A1
• Time in Patent Office: 713 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Video and sensor data from multiple locations in a venue, in which multiple individuals are engaged in athletic performances, is stored and edited to create individualized video programs of athletic performances of individuals. Each camera provides a video feed that is continuously stored. Each video feed is stored in a sequence of data files in computer storage, which data files are created in regular time intervals. Each file is accessible using an identifier of the camera and a time interval. Similarly, data from sensors is continuously received and stored in a database. The database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor and the time at which the individual was detected. Each sensor is associated with one or more cameras.

Claims

1. A computer-implemented process for generating an edited video program for an individual from a set of individuals participating in an event in a venue, wherein the venue includes a plurality of cameras that capture video of the individuals and a plurality of sensors, each sensor associated with one or more cameras of the plurality of cameras, each of the sensors at least detecting proximity of an individual near the sensor, comprising:

continuously receiving video data from the plurality of cameras during periods of time during the event;

storing the received video data for each camera in a sequence of data files, each data file in the sequence being created in regular time intervals, each data file having as associated time interval and including video data from the camera for a period of time during the event in the associated time interval, each data file in the sequence being accessible using an identifier of the camera providing the received video data and data representing the time interval;

continuously receiving data from the plurality of sensors during periods of time during the event, the received data, from each sensor, being indicative of individuals and times at which proximity of the individuals to the sensor is detected by the sensor;

storing the received data from each sensor in a database such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

receiving an indication of an individual;

accessing, from the database, the stored data from the sensors, using the indication of the individual, to retrieve times from the database at which the individual was detected in the proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors;

accessing the stored video data to retrieve clips of the stored video data received from cameras associated with the one or more sensors, according to the retrieved times from the database at which the individual was detected in the proximity of one or more sensors by the one or more of the sensors.

3. The computer-implemented process of claim 1, wherein accessing the stored video data comprises:

for each time of the retrieved times for the individual, determining a time interval corresponding to the time;

for each identifier of the retrieved identifiers of the one or more sensors, determining an identifier of the camera associated with the sensor; and

accessing the data file using the determined identifier of the camera and the determined time interval.

2. A computer-implemented process for generating an edited video program for an individual using video captured from a plurality of cameras and data captured from a plurality of sensors, comprising:

receiving and storing video data from the plurality of cameras, the received video data received from each camera being stored in a sequence of data files, each data file in the sequence being created in regular time intervals, each data file having as associated time interval and including video data from the camera for a period of time in the associated time interval, each data file in the sequence being accessible using an identifier of the camera providing the received video data and data representing the time interval;

receiving and storing sensor data from the plurality of sensors during periods of time, the received data, from each sensor, being stored in a database and being indicative of times at which proximity of the individual to the sensor is detected, such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

accessing, from the database, the stored sensor data, using an indication of the individual, to retrieve times from the database, at which the individual was detected in the proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors;

based on at least the identifiers of the one or more of the sensors, identifying cameras associated with each of the one or more of the sensors;

accessing the stored video data received from the identified cameras to retrieve clips of the stored video data received from the identified cameras according to the retrieved times at which the individual was in the proximity of the one or more of the sensors associated with the identified cameras.

4. The computer-implemented process of claim 2, wherein accessing the stored video data comprises:

for each time of the retrieved times for the individual, determining a time interval corresponding to the time;

accessing the data file storing video data received from the identified camera according to the determined time interval.

5. A computer-implemented process for generating a video program for an individual from a set of individuals participating in an event in a venue, wherein the venue includes a plurality of cameras, each camera being configured to capture video of the individuals, and wherein the venue further includes a plurality of sensors, each sensor associated with one or more cameras of the plurality of cameras, each sensor being configured to detect at least proximity of an individual near the sensor, the process comprising:

each camera of the plurality of cameras continuously storing video data during periods of time during the event, the stored video data being accessible using an identifier of the camera and data representing a time interval;

continuously receiving data from the plurality of sensors during the event, the received data, from each sensor, being indicative of individuals and times at which proximity of the individuals to the sensor is detected by the sensor;

storing the received data from each sensor in a database such that the database stores, for each sensor, an identifier of each individual detected in the proximity of the sensor by the sensor, and a time at which the individual was detected in the proximity of the sensor by the sensor;

using a time at which an individual is detected in proximity of one or more of the sensors by the one or more of the sensors, and identifiers of the one or more of the sensors, identifying the one or more cameras associated with the one or more of the sensors, and accessing the stored video data to retrieve clips of the stored video data from the one or more cameras, corresponding to the times at which the individual was detected in the proximity of one or more sensors by the one or more of the sensors; and

compiling a sequence of the retrieved clips of the individual.