Method for selecting cameras and image distribution system capable of appropriately selecting cameras

• US 10,171,794 B2
• Filed: 03/21/2016
• Issued: 01/01/2019
• Est. Priority Date: 04/29/2015
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Matsunobu, Toru, Sugio, Toshiyasu, Koyama, Tatsuya, Yoshikawa, Satoshi
• Primary Examiner(s): Luo, Kate H
• Application Number:
  US15/075,220
• Publication Number:
  US 20160323559A1
• Time in Patent Office: 1,016 Days
• Field of Search: None
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307

Abstract

In a method, M (M is a natural number smaller than N) cameras capturing images to be displayed are selected from N (N is a natural number equal to or larger than 2) cameras capturing images of a same scene. The method includes obtaining positions and image capture angles of the N cameras and selecting M cameras from the N cameras on the basis of the obtained positions and image capture angles of the N cameras.

Claims

1. A method, comprising:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images by using a processor based on the positions and the image capture angles of the cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining;

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

2. The method according to claim 1,

wherein, in the selecting, cameras whose images hardly overlap with one another and whose images include a target space most comprehensively are selected as the second number of the cameras based on the positions and the image capture angles of the cameras.

3. The method according to claim 1,

wherein, in the selecting, cameras capturing images of a target space or a subject from a plurality of angles at regular intervals are selected as the second number of the cameras based on the positions and the image capture angles of the cameras.

4. The method according to claim 1,

wherein, in the obtaining, the positions and the image capture angles of the cameras are calculated by performing three-dimensional reconfiguration using the images captured by the cameras.

5. The method according to claim 1,

wherein, in the obtaining, the positions and the image capture angles of the cameras are calculated using information obtained by the sensors included in the cameras and transmitted from the cameras.

6. The method according to claim 1,

wherein, in the obtaining, focal distances of the cameras are also obtained, and

in the selecting, the second number of the cameras is selected based on the positions, the image capture angles, and the focal distances of the cameras.

7. The method according to claim 1,

wherein, in the determining, a subject is tracked over frames and, when tracking of the subject fails, the at least one of the second number of the cameras is determined to be switched in accordance with the first time and the second time.

8. The method according to claim 7,

wherein, in the determining, three-dimensional models of the subject are associated with one another between the frames, the associated three-dimensional models of the subject are projected onto a present frame, and, when the subject is not included in an obtained frame, the tracking of the subject fails.

9. The method according to claim 1, further comprising:

determining whether to perform the selecting again in the frame after the selecting; and

selecting, when the selecting is determined to be performed again, the second number of the cameras again based on the positions and the image capture angles of the cameras.

10. The method according to claim 1,

wherein the selecting includes:

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

11. An image distribution system, comprising:

a processor; and

a memory including a program, the program causing the processor to execute operations including;

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining;

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

12. A method, comprising:

obtaining positions and image capture angles of a first number of cameras capturing images of a same scene;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the N cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining;

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

13. A method, comprising:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images by using a processor based on the positions and the image capture angles of the cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes;

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

14. An image distribution system, comprising:

a processor; and

a memory including a program, the program causing the processor to execute operations including;

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the cameras;

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes;

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

15. A method, comprising:

obtaining positions and image capture angles of a first number of cameras capturing images of a same scene; and

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes;

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.