IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM

• US 20140285677A1
• Filed: 03/21/2014
• Published: 09/25/2014
• Est. Priority Date: 03/22/2013
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: FUJITA, Ken, SUZUKI, Maho
• Granted Patent: US 9,628,712 B2
• Time in Patent Office: Days
• US Class Current: 348/208.6
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

When interval capturing by an imaging section is performed, a CPU acquires a blur state at a capture timing from the detection result by an acceleration sensor, and performs pre-processing (camera-shake processing: trimming processing in consideration of a blur) on the captured image corresponding to the blur state. Also, when the blur is larger than a predetermined value, the CPU further performs post-processing (camera-shake processing: trimming processing in consideration of a blur) also on images captured at capture timings preceding to and subsequent to the capture timing for capturing the image based on the blur state (more specifically, processing lighter in load than the pre-processing at the capture timing).

Claims

1. An image processing device comprising:

an acquiring section which acquires a blur at imaging in a captured moving image;

a first setting section which sets, for a moving image in a predetermined period where a blur is acquired by the acquiring section among the captured moving images, a first correction range based on the blur of the moving image; and

a second setting section which sets, for a moving image in at least either one of predetermined periods preceding and subsequent to the predetermined period where the blur is acquired by the acquiring section among the captured moving images, a second correction range based on the blur of the moving image in the predetermined period where the blur is acquired by the acquiring section.

2. The image processing device according to claim 1, wherein the second correction range is smaller than the first correction range.

3. The image processing device according to claim 1, wherein a change of a correction margin of an effective imaging range is included settings of the first correction range and the second correction range.

4. The image processing device according to claim 1, wherein the second setting section sets the second correction range when the first correction range set by the first setting section is larger than a predetermined range.

5. The image processing device according to claim 4, wherein the first correction range includes an effective imaging range.

6. The image processing device according to claim 1, wherein the first correction range and the second correction range include a condition in which a resolution of the moving image is decreased in a stepwise manner.

7. The image processing device according to claim 1, further comprising:

an imaging section; and

an imaging control section which controls the imaging section such that the imaging section images at predetermined time intervals,

wherein the acquiring section detects and acquires a blur at imaging by the imaging control section.

8. The image processing device according claim 1 further comprising a correcting section which corrects the blur of the moving image in the predetermined period according to the first correction range and the second correction range.

9. The image processing device according to claim 1, further comprising:

a blur amount acquiring section which acquires a blur amount of the blur acquired by the acquiring section,

wherein the first setting section sets, when the blur amount acquired by the blur amount acquiring section is equal to or larger than a first threshold set in advance, the first correction range based on the blur amount for the moving image in the predetermined period where the blur is acquired by the acquiring section among the captured moving images, and

wherein the second setting section sets the second correction range based on the blur amount acquired by the blur amount acquiring section for the moving image in at least either one of the predetermined periods preceding and subsequent to the predetermined period where the blur is acquired by the acquiring section.

10. The image processing device according to claim 9, further comprising a third setting section which sets a third correction range determined in advance for a moving image in a predetermined period where the blur acquired by the acquiring section and the blur amount is smaller than the first threshold.

11. The image processing device according to claim 9, further comprising a generating section which generates a moving image corresponding to the moving image in the predetermined period where the blur is acquired by the acquiring section among the captured moving images, by discarding a moving image in a predetermined period where the blur amount acquired by the blur amount acquiring section is equal to or larger than a second threshold which is larger than the first threshold, and interpolating, for the discarded moving image, each frame in a moving image in at least either one of predetermined periods preceding and subsequent to the predetermined period where the moving image is discarded.

12. The image processing device according to claim 9, further comprising a changing section which changes, according to the blur amount acquired by the blur amount acquiring section, length of either one of the predetermined periods preceding and subsequent to the predetermined period where the blur is acquired by the acquiring section.

13. The image processing device according to claim 1, wherein the second setting section sets the second correction range for the moving image in at least either one of the predetermined periods preceding or subsequent to the predetermined period where the blur is acquired by the acquiring section such that the second correction range gradually increases as being closer to the predetermined period where the blur is acquired by the acquiring section and gradually decreases as being far away from the predetermined period where the blur is acquired by the acquiring section.

14. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured in a predetermined period at predetermined intervals,

wherein the first setting section sets, for a moving image in the predetermined period where the blur is acquired by the acquiring section among the plurality of moving images stored in the storage section, the first correction range based on the blur of the moving image.

15. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured in a predetermined period at predetermined intervals,

wherein the second setting section sets, for a moving image in at least either one of the predetermined periods preceding and subsequent to the predetermined period where the blur is acquired by the acquiring section among the plurality of moving images stored in the storage section, the second correction range based on the blur of a moving image in the predetermined period where the blur is acquired by the acquiring section.

16. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured in a predetermined period at predetermined intervals,

wherein the first setting section and the second setting section perform setting for a moving image to be corrected when entire data of the plurality of moving images is replayed.

17. The image processing device according to claim 16, further comprising a temporary storage section which temporarily stores the plurality of moving images captured in the predetermined period at the predetermined intervals,

wherein the first setting section and the second setting section perform setting for a moving image to be corrected, which is stored in the temporary storage section, when the entire data of the plurality of moving images is stored in the storage section.

18. An image processing device comprising:

a storage section which stores a plurality of continuous images continuously captured at predetermined intervals as one set;

an acquiring section which acquires a blur at continuous capturing;

a first setting section which sets, for a set of continuous images in a continuous capturing period where a blur is acquired by the acquiring section among sets of the continuous images stored in the storage section, a first correction range based on the blur of the set of continuous images; and

a second setting section which sets, for a set of continuous images in at least either one of periods preceding and subsequent to the continuous capturing period where the blur is acquired by the acquiring section among the sets of the continuous images stored by the storage section, a second correction range based on the blur of the set of continuous images in the continuous capturing period where the blur is acquired by the acquiring section.

19. An image processing method comprising:

an acquiring step of acquiring a blur at imaging of a captured moving image;

a first setting step of setting, for a moving image in a predetermined period where the blur is acquired in the acquiring step among the captured moving images, a first correction range based on the blur of the moving image; and

a second setting step of setting, for a moving image in the predetermined period where the blur is acquired in the acquiring step for a moving image in at least either one of predetermined periods preceding and subsequent to the predetermined period where the blur is acquired in the acquiring step among the captured moving images, a second correction range based on the blur of the moving image in the predetermined period where the blur is acquired in the acquiring step.

20. An image processing method comprising:

a storage step of storing a plurality of continuous images continuously captured at predetermined intervals as one set;

an acquiring step of acquiring a blur at continuous capturing;

a first setting step of setting, for a set of continuous images in a continuous capturing period where a blur is acquired in the acquiring step among sets of the continuous images stored in the storage step, a first correction range based on the blur of the set of continuous images; and

a second setting step of setting, for a set of continuous images in at least either one of periods preceding and subsequent to the continuous capturing period where the blur is acquired in the acquiring step among the sets of the continuous images stored in the storage step, a second correction range based on the blur of the set of continuous images in the continuous capturing period where the blur is acquired in the acquiring step.

21. A non-transitory computer-readable storage medium having stored thereon a program that is executable by a computer included in an image processing device, the program being executable by the computer to perform functions comprising:

acquisition processing for acquiring a blur at imaging of a captured moving image;

first setting processing for setting, for a moving image in a predetermined period where the blur is acquired by the acquisition processing among the captured moving images, a first correction range based on the blur of the moving image; and

second setting processing for setting, for a moving image in the predetermined period where the blur is acquired by the acquisition processing for a moving image in at least either one of predetermined periods preceding and subsequent to the predetermined period where the blur is acquired in the acquisition processing among the captured moving images, a second correction range based on the blur of the moving image in the predetermined period where the blur is acquired by the acquisition processing.

22. A non-transitory computer-readable storage medium having stored thereon a program that is executable by a computer included in an image processing device, the program being executable by the computer to perform functions comprising:

storage processing for storing a plurality of continuous images continuously captured at predetermined intervals as one set;

acquisition processing for acquiring a blur at continuous capturing;

first setting processing for setting, for a set of continuous images in a continuous capturing period where a blur is acquired by the acquisition processing among sets of the continuous images stored by the storage processing, a first correction range based on the blur of the set of continuous images; and

second setting processing for setting, for a set of continuous images in at least either one of periods preceding and subsequent to the continuous capturing period where the blur is acquired by the acquiring processing among the sets of the continuous images stored by the storage processing, a second correction range based on the blur of the set of continuous images in the continuous capturing period where the blur is acquired by the acquiring processing.