Image processing system, image generation apparatus, and image generation method

• US 10,104,287 B2
• Filed: 02/05/2016
• Issued: 10/16/2018
• Est. Priority Date: 02/06/2015
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Satoh, Tetsuya
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dhillon, Peet
• Application Number:
  US15/016,991
• Publication Number:
  US 20160234438A1
• Time in Patent Office: 984 Days
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

An image processing system, an image generation apparatus, and an image generation method are provided. The image processing system includes a switching unit configured to switch an operating mode of the image processing system between at least a first mode and a second mode, a detection unit configured to detect a joining position among a plurality of input images to generate a detection result, and a joining unit configured to join the plurality of input images to generate an output image. When the mode is switched to the first mode, the joining unit joins the plurality of input images based on the detection result of the detection unit to generate the output image. When the mode is switched to the second mode, the joining unit joins the plurality of input images to generate the output image, without causing the detection unit to generate the detection result.

Claims

1. An image processing system comprising:

process selection circuitry configured to select an operating process of the image processing system from among at least a first process and a second process;

detection circuitry configured to detect a joining position among a plurality of image data to generate a detection result; and

joining circuitry configured to join the plurality of image data to generate an output image,

wherein;

when the operating process is selected to be the first process, the joining circuitry joins the plurality of image data based on the detection result of the detection circuitry to generate the output image, and

when the operating process is selected to be the second process, the joining circuitry joins the plurality of image data to generate the output image, without causing the detection circuitry to generate the detection result.

2. The image processing system according to claim 1, wherein:

the joining circuitry in the first process joins the plurality of image data using conversion data that reflects the detection result of the detection circuitry, and

the joining circuitry in the second process joins the plurality of image data using a prescribed conversion data.

3. The image processing system according to claim 1, further comprising:

extraction circuitry configured to extract at least one of the plurality of image data to generate the output image,

wherein the operating process further includes a third process in which the extraction circuitry extracts the at least one of the plurality of image data as the output image, without causing the detection circuitry to generate the detection result and without causing the joining circuitry to join the plurality of image data.

4. The image processing system according to claim 1, wherein the detection circuitry in the first process detects an amount of displacement among a plurality of corresponding points in an overlapping area existing among the plurality of image data.

5. The image processing system according to claim 1, wherein

the detection circuitry in the first process

detects a joining position among a plurality of images in a spherical coordinate system obtained by converting the plurality of image data, and

generates conversion data for generating the output image from the plurality of image data based on an inclination detection result obtained by an inclination sensor and the joining position detected among the plurality of image data in the spherical coordinate system.

6. The image processing system according to claim 5, wherein

the joining circuitry

converts the plurality of image data into a plurality of images in a spherical coordinate system, respectively, based on the conversion data, and

combines the plurality of image data in the spherical coordinate system to generate the output image.

7. The image processing system according to claim 1, further comprising:

monitor-image generation circuitry configured to display a monitor image on a display based on the output image joined according to the operating process which has been selected.

8. The image processing system according to claim 1, wherein the detection circuitry and the joining circuitry are implemented by hardware.

9. The image processing system according to claim 1, wherein the circuitry is further configured to implement:

image acquisition circuitry configured to obtain a partial-view image from a plurality of imaging units each of which includes a lens optical system and imaging element and captures an image of different direction to generate each one of the plurality of image data.

10. The image processing system according to claim 9, wherein

the plurality of imaging units each have prescribed angles of view,

the angles of view of the plurality of imaging units are joined together to meet a solid angle of 4π

steradian, and

the output image generated by the joining circuitry is an omnidirectional image.

11. An image generation apparatus comprising:

determination circuitry configured to determine whether or not to detect a joining position of first image data and second image data; and

image generation circuitry configured to join the first image data and the second image data at a prescribed position when the determination circuitry determines not to detect the joining position.

12. The image generation apparatus according to claim 11, further comprising:

a detection circuitry configured to detect the joining position when the determination circuitry determines to detect the joining position; and

a generation circuitry configured to join the first image data and the second image data based on the joining position to generate an image.

13. A method of generating an image, the method comprising:

determining whether or not to detect a joining position of first image data and second image data; and

joining the first image data and the second image data at a prescribed position when the determining determines not to detect the joining position, to generate an image.