IMAGE RECORDING AND PLAYBACK DEVICE, AND IMAGE RECORDING AND PLAYBACK METHOD

• US 20090273688A1
• Filed: 04/29/2009
• Published: 11/05/2009
• Est. Priority Date: 05/03/2008
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Imaging Corporation (Olympus Corporation)
• Inventors: Kageyama, Naohiro, Nonaka, Osamu
• Granted Patent: US 8,199,212 B2
• Time in Patent Office: Days
• US Class Current: 348/222.100
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

An image processing device of the present invention comprises a storage section for storing first image data obtained by imaging in front of the imaging device body or using a telephoto lens, and second image data obtained by imaging behind the imaging device body or using a wide-angle lens; a movement pattern detection section for processing the first image data to detect a movement pattern of the first image represented by the first image data; a movement pattern determination section determining whether or not the movement pattern of the first image is unstable movement; and an image processing section for rewriting a part of the first image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first image is unstable, using the second image data.

Claims

1. An image storage and playback device comprising:

an imaging section for taking a first image in front of an imaging device body and a second image behind the imaging device body, and respectively converting to first image data and second image data;

a storage section for storing the first image data and the second image data;

a movement pattern detection section for processing the first image data to detect a movement pattern of the first image represented by the first image data;

a movement pattern determination section for determining whether or not the movement pattern of the first image is unstable movement;

an image processing section for replacing a part of the first image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first image is unstable, using the second image data; and

an image display section for displaying the first image that has been processed by the image processing section, or the second image.

2. The image storage and playback device of claim 1, wherein:

the imaging section for imaging the second image forms the second image when it has been determined, in the movement pattern detection section, that the movement pattern of the first image is unstable movement.

3. The image storage and playback device of claim 2, wherein:

determination of whether or not the movement pattern is unstable movement by the movement pattern detection section is determination as to whether or not change in the first image is extensive, and when it has been determined that the movement pattern is unstable movement a still image of the second image is stored.

4. The image storage and playback device of claim 1, wherein:

the imaging section for imaging the second image takes the second image simultaneously and in parallel with imaging of the first image by the imaging section.

5. An image recording and playback method comprising:

taking a first image in front of an imaging device body and a second image behind the imaging device body, and respectively converting to first image data and second image data;

storing the first image data and the second image data;

processing the first image data to detect a movement pattern of the first image represented by the first image data;

determining whether or not the movement pattern of the first image is unstable movement;

replacing a part of the first image data, for which it has been determined, that the movement pattern of the first image is unstable, using the second image data; and

displaying the first image that has been processed or the second image.

6. An image processing device comprising:

a storage section for respectively storing the first image data and the second image data;

a movement pattern detection section for processing the first image data to detect a movement pattern of the first image represented by the first image data;

a movement pattern determination section for determining whether or not the movement pattern of the first image is unstable movement; and

an image processing section for replacing a part of the first image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first image is unstable, using the second image data.

7. An image processing method comprising:

storing first image data and second image data;

processing the first image data to detect a movement pattern of the first image represented by the first image data;

determining whether or not the movement pattern of the first image is unstable movement; and

replacing a part of the first image data, for which it has been determined that the movement pattern of the first image is unstable, using the second image data.

8. An image playback device comprising:

a storage section for storing first image data and second image data respectively converted from a first image and a second image;

a movement pattern detection section for processing the first image data to detect a movement pattern of the first image represented by the first image data;

a movement pattern determination section for determining whether or not the movement pattern of the first image is unstable movement;

an image processing section for replacing a part of the first image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first image is unstable, using the second image data; and

an image display section for displaying the first image that has been processed by the image processing section, or the second image.

9. A computer readable storage medium storing a program, which when executed by a computer causes the computer to perform playback, comprising:

storing first image data and second image data;

processing the first image data to detect a movement pattern of the first image represented by the first image data;

determining whether or not the movement pattern of the first image is unstable movement;

rewriting a part of the first image data, for which it has been determined, in an image processing section, that the movement pattern of the first image is unstable, using the second image data; and

displaying the first image or the second image based on the first image data or the second image data that has been replaced.

10. An imaging device comprising:

an imaging section for generating first image data representing a first image of a first shooting range, and second image data representing a second image of a second shooting range that is wider than the first shooting range;

a storage section for storing the first image data and the second image data;

a determination section for determining whether or not movement of the first image is unstable; and

an image data synthesis section for filling in gaps in the first image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second image data.

11. The imaging device of claim 10, wherein

the image synthesis section performs control so that for segments of image data, within the first image data, which the determination section has determined as unstable, second image data corresponding to these segments is stored in the image data storage section.

12. The imaging device of claim 10, wherein

the image data storage section stores the first image data and the second image data simultaneously and in parallel, and the image data synthesis section performs control so that image data for segments of image data, within the first image data, which have determined as unstable by the determination section, are replaced by second image data corresponding to these segments.

13. The imaging device of claim 10, wherein

the imaging section has a first imaging section provided with a first zoom section, and a second imaging section provided with a second zoom section with a different angle of view to the first imaging section.

14. The imaging device of claim 13, wherein

a shooting angle of view that can be adjusted by the first zoom section, and a shooting angle of view that can be adjusted by the second zoom section, do not overlap with each other.

15. The imaging device of claim 10, wherein

the determination section determines that movement of the first is unstable when the first image moves at greater than or equal to a specified speed.

16. The imaging device of claim 10, further comprising a shake detection section for detecting an amount of shake of the first image, and wherein the determination section determines that movement of the first image is unstable when amount of shake of the first image is greater than or equal to a specified amount.

17. An imaging method comprising:

generating first image data representing a first image of a first shooting range, and second image data representing a second image of a second shooting range that is wider than the first shooting range;

storing the first image data and the second image data;

determining whether or not movement of the first image is unstable; and

filling in gaps in the first image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second image data.

18. An image processing device comprising:

an image data storage section for storing first image data representing a first image of a first shooting range, and second image data representing a second image of a second shooting range that is wider than the first shooting range;

a determining section for determining whether or not movement of the first image is unstable; and

an image data synthesis section for filling in gaps in the first image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second image data.

19. The image processing device of claim 18, wherein

the image data synthesis section performs control so that image data for segments of image data, within the first image data, which have determined as unstable by the determination section, are replaced by second image data corresponding to these segments.

20. The image processing device of claim 18, wherein

the determination section determines that movement of the first is unstable when the first image moves at greater than or equal to a specified speed.

21. The image processing device of claim 18, wherein

the determination section determines that movement of the first is unstable when amount of shake of the first image is greater than or equal to a specified value.

22. An image processing method, comprising:

recording first image data and second image data;

determining whether or not movement of the first image data is unstable; and

filling in gaps in the first image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second image data.

23. An imaging comprising:

a first lens formed with a first fixed focal length;

a first image sensor arranged the vicinity of the imaging plane of the first lens;

a first imaging section for changing effective range of image data of the first image sensor to carry out electronic zooming;

a second lens formed with a second fixed focal length that is different form the first fixed focal length;

a second image sensor arranged in the vicinity of the imaging plane of the second lens; and

a second imaging section for changing the effective range of image data of the second imaging section to carry out electronic zooming, wherein

a focal length range that can be changed by the first imaging section and a focal length range that can be changed by the second imaging section do not overlap.

24. The imaging device of claim 23, further comprising zoom operation members, and wherein focal length is change at discrete focal lengths according to operation of the zoom operation members.

25. The imaging device of claim 24, wherein the zoom operation members are a wide-angle zoom operation member for issuing an instruction to zoom to the wide-angle side, and a telephoto zoom operation member for issuing an instruction to zoom to the telephoto side, and focal lengths that are changed by the command to zoom to the wide-angle side and the command to zoom to the telephoto side are different.

26. A computer readable storage medium storing a program, which when executed by a computer causes the computer to perform an image playback, comprising:

storing first image data and second image data;

determining whether or not movement of the first image data is unstable; and

filling in gaps in the first image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second image data.