Image generation system and image generation method

• US 10,462,448 B2
• Filed: 11/09/2015
• Issued: 10/29/2019
• Est. Priority Date: 11/09/2015
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Corporation
• Original Assignee: Mitsubishi Electric Corporation
• Inventors: Kato, Yoshiyuki
• Primary Examiner(s): Mikeska, Neil R
• Application Number:
  US15/760,186
• Publication Number:
  US 20180278914A1
• Time in Patent Office: 1,450 Days
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Image generation apparatuses (10) are provided so as to correspond to areas (62), respectively, into which a target area (60) is divided, and each image generation apparatus (10) has a plurality of imaging apparatuses (50) connected thereto that each capture a corresponding area which is an area (62) corresponding to the image generation apparatus (10). Each image generation apparatus (10) generates, as partial image data (72), downward view image data for its corresponding area from imaging data (71) captured by the plurality of imaging apparatuses (50). An image integration apparatus (20) allows each of image generation apparatuses (10) provided so as to correspond to areas (62), respectively, that are included in a display area (61), to generate as partial image data (72) for its corresponding area, and combines the partial image data (72) to generate integrated image data (73) which is downward view image data for the display area (61).

Claims

1. An image generation system comprising:

image generation apparatuses provided so as to correspond to areas, respectively, into which a target area is divided, the generation apparatuses each being connected to a plurality of imaging apparatuses each capturing a corresponding area being an area that corresponds, and the image generation apparatuses each generating downward view image data for the corresponding area from imaging data captured by the plurality of imaging apparatuses connected; and

an image integration apparatus, when a display area has been specified again by scrolling the display area for which display is requested, to predict, as a predicted area, a location serving as the display area in future, by predicting, from an angle and a distance at which the scrolling is performed, a direction in which scrolling is performed in future, allow each of image generation apparatuses to generate, as partial image data before the predicted area is specified as the display area, downward view image data for a corresponding area of the image generation apparatus, and combine the generated partial image data to generate integrated image data, the image generation apparatuses being provided so as to correspond to areas, respectively, the areas each including at least a part of the predicted area, the integrated image data being downward view image data for the display area.

2. The image generation system according to claim 1, wherein the image integration apparatus predicts the direction in which scrolling is performed in future, by dividing a sum of products of angles and distances at which scrolling is performed in past by a sum of the distances.

3. An image generation method comprising:

when a display area has been specified again by scrolling the display area for which display is requested, predicting, as a predicted area, a location serving as the display area in future, by predicting, from an angle and a distance at which the scrolling is performed, a direction in which scrolling is performed in future, by an image integration apparatus;

of image generation apparatuses provided so as to correspond to areas, respectively, into which a target area is divided, causing each of image generation apparatuses provided so as to correspond to areas, respectively, each including at least a part of the predicted area, to generate, as partial image data before the predicted area is specified as the display area, downward view image data for a corresponding area from imaging data captured by a plurality of imaging apparatuses, the plurality of imaging apparatuses capturing the corresponding area, and the corresponding area being an area corresponding to the image generation apparatus, by the image integration apparatus; and

combining the generated partial image data to generate integrated image data, the integrated image data being downward view image data for the display area, by the image integration apparatus.