Image recording and playback device, and image recording and playback method

• US 8,199,212 B2
• Filed: 04/29/2009
• Issued: 06/12/2012
• Est. Priority Date: 05/03/2008
• Status: Expired due to Fees

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Imaging Corporation (Olympus Corporation)
• Inventors: Nonaka, Osamu, Kageyama, Naohiro
• Primary Examiner(s): Ho, Tuan
• Assistant Examiner(s): WANG, KENT F
• Application Number:
  US12/432,350
• Publication Number:
  US 20090273688A1
• Time in Patent Office: 1,140 Days
• Field of Search: 3482081-20816, 348/208.99, 348/222.1, 396/52, 396/55
• US Class Current: 348/222.1
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

An image processing device of the present invention comprises a storage section for storing first image data obtained by imaging in front of the imaging device body or using a telephoto lens, and second image data obtained by imaging behind the imaging device body or using a wide-angle lens; a movement pattern detection section for processing the first image data to detect a movement pattern of the first image represented by the first image data; a movement pattern determination section determining whether or not the movement pattern of the first image is unstable movement; and an image processing section for rewriting a part of the first image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first image is unstable, using the second image data.

Claims

1. An image processing device comprising:

a storage section for respectively storing first moving image data and second moving image data of a field of view that is different from the first moving image data;

a movement pattern detection section for processing the first moving image data to detect a movement pattern of a first moving image represented by the first moving image data;

a movement pattern determination section for determining whether or not the movement pattern of the first moving image is unstable; and

an image processing section for replacing an image of an unstable period of the first moving image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first moving image is unstable, using the second moving image data.

2. An image processing method comprising:

storing first moving image data and second moving image data of a field of view that is different from the first moving image data;

processing the first moving image data to detect a movement pattern of a first moving image represented by the first moving image data;

determining whether or not the movement pattern of the first moving image is unstable; and

replacing an image of an unstable period of the first moving image data, for which it has been determined that the movement pattern of the first moving image is unstable, using the second moving image data.

3. An image playback device comprising:

a storage section for storing first moving image data and second moving image data respectively converted from a first moving image and a second moving image;

a movement pattern detection section for processing, when the first moving image data stored in the storage section is read out and played back, the first moving image data to detect a movement pattern of the first moving image represented by the first moving image data;

a movement pattern determination section for determining whether or not the movement pattern of the first moving image is unstable;

an image processing section for replacing an image of an unstable period of the first moving image data, for which it has been determined by the movement pattern determination section that the movement pattern of the first moving image is unstable, using the second moving image data; and

an image display section for displaying the first moving image that has been processed by the image processing section, or the second moving image.

4. A non-transitory computer readable storage medium storing a program, which when executed by a computer causes the computer to perform playback, comprising:

storing first moving image data and second moving image data;

when the stored first moving image data is read out and played back, processing the first moving image data to detect a movement pattern of a first moving image represented by the first moving image data;

determining whether or not the movement pattern of the first moving image is unstable;

rewriting an image of an unstable period of the first moving image data, for which it has been determined, in an image processing section, that the movement pattern of the first moving image is unstable, using the second moving image data; and

displaying the first moving image or a second moving image represented by the second moving image data based on the first moving image data or the second moving image data that has been rewritten.

5. An imaging device comprising:

an imaging section for generating first moving image data representing a first moving image of a first shooting range, and second moving image data representing a second moving image of a second shooting range that is wider than the first shooting range;

a storage section for storing the first moving image data and the second moving image data;

a determination section for determining whether or not movement of the first moving image is unstable; and

an image data synthesis section for filling in gaps in image data at sections, in the first moving image data, that have been determined by the determination section to be unstable, using the second moving image data taken at a time corresponding to the sections.

6. The imaging device of claim 5, wherein

the image synthesis section performs control so that for segments of image data, within the first image data, which the determination section has determined as unstable, second image data corresponding to these segments is stored in the image data storage section.

7. The imaging device of claim 5, wherein

the image data storage section stores the first moving image data and the second moving image data simultaneously and in parallel, and the image data synthesis section performs control so that image data for segments of image data, within the first moving image data, which have determined as unstable by the determination section, are replaced by second moving image data corresponding to these segments.

8. The imaging device of claim 5, wherein

the imaging section has a first imaging section provided with a first zoom section, and a second imaging section provided with a second zoom section with a different angle of view to the first imaging section.

9. The imaging device of claim 8, wherein

a shooting angle of view that can be adjusted by the first zoom section, and a shooting angle of view that can be adjusted by the second zoom section, do not overlap with each other.

10. The imaging device of claim 5, wherein

the determination section determines that movement of the first is unstable when the first image moves at greater than or equal to a specified speed.

11. The imaging device of claim 5, further comprising a shake detection section for detecting an amount of shake of the first image, and wherein the determination section determines that movement of the first image is unstable when amount of shake of the first image is greater than or equal to a specified amount.

12. An imaging method comprising:

generating first moving image data representing a first moving image of a first shooting range, and second moving image data representing a second moving image of a second shooting range that is wider than the first shooting range;

storing the first moving image data and the second moving image data;

determining whether or not movement of the first moving image is unstable; and

filling in gaps in moving image data at sections, in the first moving image data, that have been determined by the determination section to be unstable, using the second moving image data taken at a time corresponding to the sections.

13. An image processing device comprising:

an image data storage section for storing first moving image data representing a first moving image of a first shooting range, and second moving image data representing a second moving image of a second shooting range that is wider than the first shooting range;

a determining section for determining whether or not movement of the first moving image is unstable; and

an image data synthesis section for filling in gaps in moving, image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second moving image data taken at a time corresponding to the sections.

14. The image processing device of claim 13, wherein

the determination section determines that movement of the first is unstable when the first image moves at greater than or equal to a specified speed.

15. The image processing device of claim 13, wherein

the determination section determines that movement of the first is unstable when amount of shake of the first image is greater than or equal to a specified value.

16. An image processing method, comprising:

storing first moving image data and second moving image data;

determining whether or not movement of the first moving image data is unstable; and

filling in gaps in image data at sections, in the first image data, that have been determined by the determination section to be unstable, using the second moving image data taken at a time corresponding to the sections.

17. A non-transitory computer readable storage medium storing a program, which when executed by a computer causes the computer to perform an image playback, comprising:

storing first moving image data and second moving image data;

when the stored first moving data is read out and played back, determining whether or not movement of the first moving image data is unstable; and

filling in gaps in moving image data at sections, in the first moving image data, that have been determined by the determination section to be unstable, using the second moving image data taken at a time corresponding to the sections.