Method and system for automatic television production

• US 10,262,692 B2
• Filed: 03/31/2015
• Issued: 04/16/2019
• Est. Priority Date: 04/03/2014
• Status: Active Grant

• Current Assignee: Pixellot Ltd.
• Original Assignee: Pixellot Ltd.
• Inventors: Tamir, Miki, Oz, Gal, Ridnik, Tal
• Primary Examiner(s): Zhao, Daquan
• Application Number:
  US15/300,291
• Publication Number:
  US 20170178687A1
• Time in Patent Office: 1,477 Days
• Field of Search: 386278, 386280, 386282, 386285, 386228
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/0733 for distributing synchronisation pulses to different TV cameras
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

It is provided a method for a computerized, server autonomously producing a TV show of a sports game in a scene. The method includes receiving from several video cameras a stream of video images of the scene for capturing a panoramic view of the scene, analyzing the stream of video images for allowing definition of several frame streams, determining location data of the frame streams accordingly, and rendering an active frame stream with images imaging a respective portion of the panoramic view of the scene. The method includes also transmitting for broadcasting a stream of image frames imaging the respective portion of the panoramic view. The step of analyzing the stream of video images includes identifying a playing object, tracking the playing, object and identifying players. The method also includes calibrating the cameras using points in the playing field. The method may include analyzing the stream of video images for identifying an event in the scene for switching between the active frame stream and a different frame stream. Also, the method may include directing a directed sensor to a region of interest in accordance with location data of the active, frame stream.

Claims

1. A method comprising:

capturing a scene comprising a sport event using a plurality of video cameras, to yield combined frame streams of video images covering together the sport event in its entirety;

analyzing the combined stream of video images to detect one or more objects associated with a playing object associated with the sport event;

deriving current and estimated position of the detected one or more objects and of the playing object;

generating a video production of the sport event by automatically selecting a sequence of portions of the combined stream of video images, wherein the selection is carried out based on predefined video production rules associated with a type of said sport event and further based on the current and estimated position of the detected one or more objects and the playing object;

estimating, upon losing said playing object by one of said objects, a region occupying said playing object in accordance with previous location thereof, and

modifying a frame stream of said one or more frame streams to include said region occupying said playing object.

2. The method according to claim 1, wherein the method further includes calibrating said one or more video cameras using points contained within said scene, said points comprising at least one of:

corners of the playing field;

crossings of two field lines;

11 m penalty kick point;

beacon points deployed in the playing field and having locations determined by one or more geodic devices; and

a bench related point.

3. The method according to claim 1, wherein said generating of the video production further comprises determining a parameter set defining a frame stream of said one or more frame streams, by three or more parameters selected from group of parameters consisting a left angle, a right angle, a bottom angle, a top angle, a central angular coordinate, a central location coordinate, an aspect ratio, a frame width, a current time flag, a start timestamp, a final timestamp, a frame rate, a resolution parameter;

a fixed zoom parameter, an equation defining a dependence of a zoom parameter on a timestamp, and a table of zoom parameter versus a timestamp.

4. The method according to claim 3, wherein said frame width, is determined by at least one parameter of a ground of parameters consisting of predetermined widths a predetermined number of players in the frame, a prohibition flag related to exceeding playing field boundaries, a demand flag related to including a key static object in the frame.

5. The method according to claim 1, wherein the method includes validating an identification of said playing object at a certain time and in certain location by estimating a probability of a playing object presence thereof in view of a playing object orbit before said certain time.

6. The method according to claim 1, wherein the method includes determining a frame center in accordance with at least one variable comprising at least one of:

a playing object location, and;

a center of mass of said objects locations.

7. The method according to claim 1, wherein the method includes:

smoothing a playing object orbit;

determining a center frame in accordance with the smoothed playing object orbit, for preventing jerky movement of a frame center orbit.

8. The method according to claim 1, wherein the method includes:

identifying a last break in a basketball game;

estimating a playing object speed; and

determining frame location of blocking a player group in a front side of the last break or in rear side thereof in accordance with said playing object speed.

9. The method according to claim 1, wherein the method includes determining frames of at least one frame stream using a rectangle blocking predetermined portion of the players.