Image pickup apparatus and image pickup method

• US 20050237631A1
• Filed: 04/14/2005
• Published: 10/27/2005
• Est. Priority Date: 04/16/2004
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ohki, Mitsuharu, Shioya, Hiroyuki
• Application Number:
  US11/108,010
• Publication Number:
  US 20050237631A1
• Time in Patent Office: Days
• US Class Current: 359/770
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A whole image showing the entire range of the object of shooting is generated by picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction, cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up in the image pickup step, so as to produce overlapping areas and sequentially and partly superposing the image region. The noise components of the image regions are uniformized to improve the image quality by cutting out image regions as to make two or more than two image regions overlap each other in average for the position of each unit image of the whole image to be generated.

Claims

1. An image pickup apparatus comprising:

image pickup means for picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction;

image cutting out means for cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up by the image pickup means, so as to produce overlapping areas; and

whole image generation means for sequentially and partly superposing the image regions cut out by the image cutting out means to generate a whole image of the whole scenic range.

2. The apparatus according to claim 1, wherein the image pickup means picks up the next unit image when the image cutting out means cuts out an image region.

3. The apparatus according to claim 1, wherein the image cutting out means cuts out the image regions so as to make two or more than two image regions overlap each other in average for the position of each unit image of the whole image to be generated.

4. The apparatus according to claim 1, further comprising:

identification means for identifying the lightness of the object of shooting to be shot by the image pickup means;

the image cutting out means being adapted to determine the size of the image regions according to the aperture value and the exposure time of the image pickup operation of the image pickup means in addition to the lightness identified by the identification means.

5. The apparatus according to claim 1, wherein the whole image generation means is adapted to uniformize the luminance components of the image regions to be superposed in a direction perpendicular to the image pickup direction and make the positions of the unit images according to the unformized distribution of the luminance components.

6. The apparatus according to claim 1, wherein the image pickup means is adapted to shift the image pickup direction at an angular velocity that monotonously decreases relative to the exposure time of the image pickup operation.

7. The apparatus according to claim 1, wherein the image pickup means is adapted to shift the image pickup direction at an angular velocity that is inversely proportional to the exposure time of the image pickup operation.

8. The apparatus according to claim 1, further comprising:

detection means for detecting an operation signal generated according to a depressing operation of the user;

the image pickup means being adapted to perform the image pickup operation when an operation signal is detected by the detection means and stops the image pickup operation when the operation signal is no longer detected by the detection means.

9. The apparatus according to claim 8, wherein, when a new unit image is picked up after the image pickup operation is stopped by the image pickup means, the whole image generation means generates the whole image by bonding the unit images to the image regions.

10. The apparatus according to claim 1, further comprising:

display means for displaying the whole image generated by the whole image generation means on the display screen thereof;

the display means being adapted to display the newly superposed image region with priority when the generated whole image overflows from the display screen.

11. The apparatus according to claim 1, wherein the whole image generation means is adapted to perform the operation of superposing an image region each time the image pickup means picks up an image and discard the image region after the superposing operation.

12. The apparatus according to claim 1, wherein the whole image generation means is adapted to constitute each pixel of the generated whole image by a denominator data and a numerator data.

13. The apparatus according to claim 12, wherein the whole image generation means is adapted to use the sum of the pixel values of the pixels of the superposed image regions located at a same pixel position as the numerator data and the number of superposed image regions at the same pixel position as the denominator data.

14. The apparatus according to claim 1, wherein the whole image generation means is adapted to execute an anisotropic filtering process on the images of the image regions cut out by the image cutting out means.

15. The apparatus according to claim 1, wherein the whole image generation means is adapted to execute an anisotropic filtering process on the generated whole image.

16. The apparatus according to claim 14, wherein the anisotropic filtering process is a filtering process for emphasizing only a high band in the direction in which the image pickup means is driven to rotate or move.

40. The apparatus according to claim 15, wherein the anisotropic filtering process is a filtering process for emphasizing only a high band in the direction in which the image pickup means is driven to rotate or move.

17. An image pickup apparatus comprising:

a first cabinet containing at least image pickup means for picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction and an image cutting out means for cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up by the image pickup means, so as to produce overlapping areas and capable of rotating around a rotary shaft linked thereto so as to sequentially shift the image pickup direction of the image pickup means;

whole image generation means for sequentially and partly superposing the image regions cut out by the image cutting out means to generate a whole image of the whole scenic range;

display means for displaying the whole image generated by the whole image generation means;

drive means for driving the rotary shaft to rotate;

specifying means for specifying the timing of starting an image pickup operation and that of ending the image pickup operation of the image pickup means;

a battery for activating the above components; and

a second cabinet linked to the first cabinet by way of the rotary shaft and adapted to be held by the user by a single hand;

the second cabinet containing one or more than one of the whole image generation means, the display means, the drive means, the specifying means and the battery.

18. The apparatus according to claim 17, wherein the drive means includes a control mechanism for limiting the rotary angle of the rotary shaft within a predetermined range.

19. An image pickup apparatus comprising:

a first cabinet containing at least image pickup means for picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction and capable of rotating around a rotary shaft linked thereto so as to sequentially shift the image pickup direction of the image pickup means;

whole image generation means for sequentially pasting the unit images picked up by the image pickup means to generate a whole image of the whole scenic range;

display means for displaying the whole image generated by the whole image generation means;

drive means for driving the rotary shaft to rotate;

specifying means for specifying the timing of starting an image pickup operation and that of ending the image pickup operation of the image pickup means;

a battery for activating the above components; and

a second cabinet linked to the first cabinet by way of the rotary shaft and adapted to be held by the user by a single hand;

the second cabinet containing one or more than one of the whole image generation means, the display means, the drive means, the specifying means and the battery.

20. The apparatus according to claim 19, wherein the drive means includes a control mechanism for limiting the rotary angle of the rotary shaft within a predetermined range.

21. An image pickup method comprising:

an image pickup step of picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction;

an image cutting out step of cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up in the image pickup step, so as to produce overlapping areas; and

a whole image generation step of sequentially and partly superposing the image regions cut out in the image cutting out step to generate a whole image of the whole scenic range.

22. The method according to claim 21, wherein the next unit image is picked up in the image pickup step when an image region is cut out in the image cutting out step.

23. The method according to claim 21, wherein the image regions are cut out in the image cutting out step so as to make two or more than two image regions overlap each other in average for the position of each unit image of the whole image to be generated.

24. The method according to claim 21, further comprising:

an identification step of identifying the lightness of the object of shooting to be shot in the image pickup step;

the image cutting out step being adapted to determine the size of the image regions according to the aperture value and the exposure time of the image pickup operation in the image pickup step in addition to the lightness identified in the identification step.

25. The method according to claim 21, wherein the whole image generation step is adapted to uniformize the luminance components of the image regions to be superposed in a direction perpendicular to the image pickup direction and make the positions of the unit images according to the unformized distribution of the luminance components.

26. The method according to claim 21, wherein the image pickup step is adapted to shift the image pickup direction at an angular velocity that monotonously decreases relative to the exposure time of the image pickup operation.

27. The method according to claim 21, wherein the image pickup step is adapted to shift the image pickup direction at an angular velocity that is inversely proportional to the exposure time of the image pickup operation.

28. The method according to claim 21, further comprising:

a detection step of detecting an operation signal generated according to a depressing operation of the user;

the image pickup step being adapted to perform the image pickup operation when an operation signal is detected in the detection step and stops the image pickup operation when the operation signal is no longer detected in the detection step.

29. The method according to claim 25, wherein, when a new unit image is picked up after the image pickup operation is stopped in the image pickup step, the whole image is generated in the whole image generation step by bonding the unit images to the image regions.

30. The method according to claim 21, further comprising:

a display step of displaying the whole image generated in the whole image generation step on a display screen;

the display step being adapted to display the newly superposed image region with priority when the generated whole image overflows from the display screen.

31. The method according to claim 21, wherein the whole image generation step is adapted to perform the operation of superposing an image region each time an image is picked up in the image pickup step and discard the image region after the superposing operation.

32. The method according to claim 21, wherein the whole image generation step is adapted to constitute each pixel of the generated whole image by a denominator data and a numerator data.

33. The method according to claim 21, wherein the whole image generation step is adapted to use the sum of the pixel values of the pixels of the superposed image regions located at a same pixel position as the numerator data and the number of superposed image regions at the same pixel position as the denominator data.

34. The method according to claim 21, wherein the whole image generation step is adapted to execute an anisotropic filtering process on the images of the image regions cut out in the image cutting out step.

35. The method according to claim 21, wherein the whole image generation step is adapted to execute an anisotropic filtering process on the generated whole image.

36. The method according to claim 34, wherein the anisotropic filtering process is a filtering process for emphasizing only a high band in the rotating direction or the moving direction.

37. An image pickup apparatus comprising:

image pickup section picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction;

image cutting out section cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up by the image pickup section, so as to produce overlapping areas; and

whole image generation section sequentially and partly superposing the image regions cut out by the image cutting out section to generate a whole image of the whole scenic range.

38. An image pickup apparatus comprising:

a first cabinet containing at least image pickup section picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction and an image cutting out section cutting out image regions of a predetermined size, each constituting a part of each of the unit images picked up by the image pickup section, so as to produce overlapping areas and capable of rotating around a rotary shaft linked thereto so as to sequentially shift the image pickup direction of the image pickup section;

whole image generation section sequentially and partly superposing the image regions cut out by the image cutting out section to generate a whole image of the whole scenic range;

display section displaying the whole image generated by the whole image generation section;

drive section driving the rotary shaft to rotate;

specifying section specifying the timing of starting an image pickup operation and that of ending the image pickup operation of the image pickup section;

a battery for activating the above components; and

a second cabinet linked to the first cabinet by way of the rotary shaft and adapted to be held by the user by a single hand;

the second cabinet containing one or more than one of the whole image generation section, the display section, the drive section, the specifying section and the battery.

39. An image pickup apparatus comprising:

a first cabinet containing at least image pickup section picking up unit images, each constituting a part of the scenic range to be imaged, by sequentially shifting the image pickup direction and capable of rotating around a rotary shaft linked thereto so as to sequentially shift the image pickup direction of the image pickup section;

whole image generation section sequentially pasting the unit images picked up by the image pickup section to generate a whole image of the whole scenic range;

display section displaying the whole image generated by the whole image generation section;

drive section driving the rotary shaft to rotate;

specifying section specifying the timing of starting an image pickup operation and that of ending the image pickup operation of the image pickup section;

a battery for activating the above components; and

a second cabinet linked to the first cabinet by way of the rotary shaft and adapted to be held by the user by a single hand;

the second cabinet containing one or more than one of the whole image generation section, the display section, the drive section, the specifying section and the battery.