Method of extracting attack scene from sports footage

• US 9,892,320 B2
• Filed: 03/10/2015
• Issued: 02/13/2018
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Oguchi, Atsushi, Endo, Susumu, Baba, Takayuki, Fujita, Sokichi, Muramatsu, Tatsuma
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): BEG, SAMAH A
• Application Number:
  US14/642,943
• Publication Number:
  US 20150262015A1
• Time in Patent Office: 1,071 Days
• Field of Search: None
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

An extraction device includes a processor that executes a procedure. The procedure includes: from captured images obtained by capturing a sports game having a match style of attack toward a goal provided in territory of an opposing team, identifying a portion of captured images in which the captured images change over time toward a direction of one or other goal; and extracting a scene in which one or other team is attacking based on the portion of captured images.

Claims

1. A non-transitory recording medium storing an extraction program that causes a computer to execute a process, the process comprising:

based on captured images obtained by capturing a sports game having a match style of attack toward a goal provided in a territory of an opposing team, identifying captured images corresponding to a period in which a parallel translation amount exceeds a predetermined threshold, wherein the parallel translation amount is calculated as an average of horizontal translation amounts derived for each of a plurality of imaging subjects included in the captured images moving toward the goal, based on inter-frame pixel differences;

acquiring predetermined information that indicates the directions of the goals in which respective teams attack based on a game time of the captured sports game;

extracting a scene in which a team is attacking based on the direction of the goal and a direction of movement of imaging subjects derived from the identified captured images, wherein the extracting is performed by comparing the calculated parallel translation amount to a positive or a negative threshold which respectively indicate a direction of movement of the imaging subject towards the goal or another goal;

identifying the attacking team based on the direction of the goal, the direction of movement of the imaging subjects, and the acquired predetermined information;

generating a video file based on the extracted scene;

indicating the generated video file is of the identified attacking team; and

transmitting the generated video file to a distribution device,

wherein the extracted scene includes a group of the identified captured images.

2. The non-transitory recording medium of claim 1, the process further comprising:

detecting a frame capturing a goal area from each of a plurality of frames included in the captured images, wherein

when extracting the scene in which the team is attacking, in cases in which the frame capturing the goal area is included in a group of frames corresponding to a timing at which movement toward the direction of a goal or another of the goals was detected, the group of frames is extracted as the scene in which the team is attacking.

3. The non-transitory recording medium of claim 2, wherein, in the process, when extracting the scene in which the team is attacking, a group of frames in which a direction of movement toward the direction of a goal or another of the goals, and a detection direction of the goal area in the frame capturing the goal area, match each other is extracted as the scene in which the team is attacking.

4. The non-transitory recording medium of claim 2, wherein in the process, the extraction of the scene in which the team is attacking is performed by detecting, as the frame capturing the goal area, a frame in which an image characteristic extracted from the frame resembles a characteristic predetermined as a characteristic of a frame capturing the goal area.

5. The non-transitory recording medium of claim 1, wherein in the process, a leading frame of a group of frames corresponding to a timing at which movement toward the direction of a goal or another of the goals was detected is set as a frame associated with time data of a specific number of seconds before the timing.

6. The non-transitory recording medium of claim 1, wherein the acquired predetermined information further indicates the direction of the goal in which the respective teams attack in a first half and a second half.

7. A non-transitory recording medium storing an extraction program that causes a computer to execute a process, the process comprising:

based on historical data of movement during image capture by a camera that has captured a sports game having a match style of attack toward a goal provided in a territory of an opposing team, identifying captured images corresponding to a period in which a parallel translation amount exceeds a predetermined threshold, wherein the parallel translation amount is calculated as an average of horizontal translation amounts derived for each of a plurality of imaging subjects included in the captured images moving toward the goal, based on inter-frame pixel differences; and

acquiring predetermined information that indicates the directions of the goals in which respective teams attack based on a game time of the captured sports game;

extracting a scene in which a team is attacking based on the direction of the goal and a direction of movement of imaging subjects derived from the identified captured images, wherein the extracting is performed by comparing the calculated parallel translation amount to a positive or a negative threshold which respectively indicate a direction of movement of the imaging subject towards the goal or another goal;

identifying the attacking team based on the direction of the goal, the direction of movement of the imaging subjects, and the acquired predetermined information;

generating a video file based on the extracted scene;

indicating the generated video file is of the identified attacking team; and

transmitting the generated video file to a distribution device,

wherein the extracted scene includes a group of the identified captured images.

8. A non-transitory recording medium storing an extraction program that causes a computer to execute a process, the process comprising:

based on captured images obtained by capturing a sports game having a match style of attack toward a goal provided in a territory of an opposing team, identifying captured images corresponding to a period in which a parallel translation amount exceeds a predetermined threshold, wherein the parallel translation amount is calculated as an average of horizontal translation amounts derived for each of a plurality of imaging subjects included in the captured images moving toward the goal, based on inter-frame pixel differences; and

acquiring predetermined information that indicates the directions of the goals in which respective teams attack based on a game time of the captured sports game;

extracting a scene in which a team is attacking based on the direction of the goal and a direction of movement of an imaging subject derived from the identified captured images, wherein the extracting is performed by comparing the calculated parallel translation amount to a positive or a negative threshold which respectively indicate a direction of movement of the imaging subject towards the goal or another goal;

identifying the attacking team based on the direction of the goal, the direction of movement of the imaging subject, and the acquired predetermined information;

generating a video file based on the extracted scene;

indicating the generated video file is of the identified attacking team; and

transmitting the generated video file to a distribution device,

wherein the extracted scene includes a group of the identified captured images.

9. The non-transitory recording medium of claim 8, wherein in the process, the imaging subject is one player or a plurality of players in the sports game, or a ball used in the sports game, or both.

10. The non-transitory recording medium of claim 9, wherein in the process, an effect of movement of a camera that has captured the game is excluded and the imaging subject is detected.