Image processing device, image processing method, and storage medium

• US 9,628,712 B2
• Filed: 03/21/2014
• Issued: 04/18/2017
• Est. Priority Date: 03/22/2013
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Suzuki, Maho, Fujita, Ken
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): Bhuiyan, Fayez
• Application Number:
  US14/222,515
• Publication Number:
  US 20140285677A1
• Time in Patent Office: 1,124 Days
• Field of Search: 3482086
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

When interval capturing by an imaging section is performed, a CPU acquires a blur state at a capture timing from the detection result by an acceleration sensor, and performs pre-processing (camera-shake processing: trimming processing in consideration of a blur) on the captured image corresponding to the blur state. Also, when the blur is larger than a predetermined value, the CPU further performs post-processing (camera-shake processing: trimming processing in consideration of a blur) also on images captured at capture timings preceding to and subsequent to the capture timing for capturing the image based on the blur state (more specifically, processing lighter in load than the pre-processing at the capture timing).

Claims

1. An image processing device comprising:

an acquiring section which acquires a blur at imaging in a captured moving image;

a first setting section which sets, for a first moving image in a first predetermined period in which a blur is acquired by the acquiring section among captured moving images, a first correction range based on the blur of the first moving image;

a second setting section which sets, for a second moving image in a second predetermined period preceding the first predetermined period in which the blur is acquired by the acquiring section among the captured moving images, a second correction range based on the blur of the first moving image in the first predetermined period in which the blur is acquired by the acquiring section; and

a processing unit which performs predetermined processing on the first moving image and the second moving image using the first correction range and the second correction range, respectively.

2. The image processing device according to claim 1, wherein the second correction range is smaller than the first correction range.

3. The image processing device according to claim 1, wherein a change of a correction margin of an effective imaging range is included in settings of the first correction range and the second correction range.

4. The image processing device according to claim 1, wherein the second setting section sets the second correction range when the first correction range set by the first setting section is larger than a predetermined range.

5. The image processing device according to claim 4, wherein the first correction range includes an effective imaging range.

6. The image processing device according to claim 1, wherein the first correction range and the second correction range include a condition in which a resolution of the moving images is decreased in a stepwise manner.

7. The image processing device according to claim 1, further comprising:

an imaging section; and

an imaging control section which controls the imaging section such that the imaging section images at predetermined time intervals,

wherein the acquiring section detects and acquires a blur at imaging by the imaging control section.

8. The image processing device according claim 1, further comprising a correcting section which corrects the blur of the first and second moving images in the first and second predetermined periods according to the first correction range and the second correction range.

9. The image processing device according to claim 1, further comprising:

a blur amount acquiring section which acquires a blur amount of the blur acquired by the acquiring section,

wherein the first setting section sets, when the blur amount acquired by the blur amount acquiring section is equal to or larger than a first threshold set in advance, the first correction range based on the blur amount for the first moving image in the first predetermined period in which the blur is acquired by the acquiring section among the captured moving images, and

wherein the second setting section sets the second correction range, based on the blur amount acquired by the blur amount acquiring section, for the second moving image in the second predetermined period preceding the first predetermined period in which the blur is acquired by the acquiring section.

10. The image processing device according to claim 9, further comprising a third setting section which sets a third correction range determined in advance for a moving image in a predetermined period in which the blur is acquired by the acquiring section and in which the blur amount is smaller than the first threshold.

11. The image processing device according to claim 9, further comprising a generating section which generates a moving image corresponding to the first moving image in the first predetermined period in which the blur is acquired by the acquiring section among the captured moving images, by discarding a moving image in a predetermined period in which the blur amount acquired by the blur amount acquiring section is equal to or larger than a second threshold which is larger than the first threshold, and interpolating, for the discarded moving image, each frame in a moving image in at least one of predetermined periods preceding and subsequent to the predetermined period in which the moving image is discarded.

12. The image processing device according to claim 9, further comprising a changing section which changes, according to the blur amount acquired by the blur amount acquiring section, a length of one of the predetermined periods preceding and subsequent to the first predetermined period in which the blur is acquired by the acquiring section.

13. The image processing device according to claim 1, wherein the second setting section sets the second correction range for moving images in the second predetermined period preceding the first predetermined period in which the blur is acquired by the acquiring section such that the second correction range gradually increases as the moving images become closer to the first predetermined period in which the blur is acquired by the acquiring section and gradually decreases as the moving images become farther away from the first predetermined period in which the blur is acquired by the acquiring section.

14. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured at predetermined intervals,

wherein the first setting section sets, for the first moving image in the first predetermined period in which the blur is acquired by the acquiring section among the plurality of moving images stored in the storage section, the first correction range based on the blur of the moving image.

15. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured at predetermined intervals,

wherein the second setting section sets, for the second moving image in the second predetermined period preceding the first predetermined period in which the blur is acquired by the acquiring section among the plurality of moving images stored in the storage section, the second correction range based on the blur of the first moving image in the first predetermined period in which the blur is acquired by the acquiring section.

16. The image processing device according to claim 1, further comprising a storage section which stores a plurality of moving images captured at predetermined intervals,

wherein the first setting section and the second setting section perform setting for a moving image to be corrected when all data of the plurality of moving images is replayed.

17. The image processing device according to claim 16, further comprising a temporary storage section which temporarily stores the plurality of moving images captured at the predetermined intervals,

wherein the first setting section and the second setting section perform setting for the moving image to be corrected, which is stored in the temporary storage section, when all the data of the plurality of moving images is stored in the storage section.

23. The image processing device according to claim 1, wherein the first moving image is captured after the second moving image in time series, and the second predetermined period precedes the first predetermined period with respect to time.

18. An image processing device comprising:

a storage section which stores a plurality of continuous images continuously captured at predetermined intervals as one set;

an acquiring section which acquires a blur at continuous capturing;

a first setting section which sets, for a first set of continuous images in a first continuous capturing period in which a blur is acquired by the acquiring section among sets of the continuous images stored in the storage section, a first correction range based on the blur of the first set of continuous images;

a second setting section which sets, for a second set of continuous images in a second period preceding the first continuous capturing period in which the blur is acquired by the acquiring section among the sets of the continuous images stored by the storage section, a second correction range based on the blur of the first set of continuous images in the first continuous capturing period in which the blur is acquired by the acquiring section; and

a processing unit which performs predetermined processing on the first set of continuous images and the second set of continuous images using the first correction range and the second correction range, respectively.

19. An image processing method comprising:

acquiring a blur at imaging of a captured moving image;

setting, for a first moving image in a first predetermined period in which the blur is acquired in the acquiring among captured moving images, a first correction range based on the blur of the first moving image;

setting, for a second moving image in a second predetermined period preceding the first predetermined period in which the blur is acquired in the acquiring among the captured moving images, a second correction range based on the blur of the first moving image in the first predetermined period in which the blur is acquired in the acquiring step; and

performing predetermined processing on the first moving image and the second moving image using the first correction range and the second correction range, respectively.

20. An image processing method comprising:

acquiring a blur at continuous capturing;

setting, for a first set of continuous images in a first continuous capturing period in which a blur is acquired in the acquiring among sets of continuous images stored in a storage section in which a plurality of continuous images continuously captured at predetermined intervals are stored as one set, a first correction range based on the blur of the first set of continuous images;

setting, for a second set of continuous images in a second period preceding the first continuous capturing period in which the blur is acquired in the acquiring among the sets of the continuous images, a second correction range based on the blur of the first set of continuous images in the first continuous capturing period in which the blur is acquired in the acquiring step; and

performing predetermined processing on the first set of continuous images and the second set of continuous images using the first correction range and the second correction range, respectively.

21. A non-transitory computer-readable storage medium having stored thereon a program that is executable by a computer included in an image processing device, the program being executable by the computer to perform functions comprising:

acquisition processing for acquiring a blur at imaging of a captured moving image;

first setting processing for setting, for a first moving image in a first predetermined period in which the blur is acquired by the acquisition processing among the captured moving images, a first correction range based on the blur of the first moving image;

second setting processing for setting, for a second moving image in a second predetermined period preceding the first predetermined period in which the blur is acquired in the acquisition processing among the captured moving images, a second correction range based on the blur of the first moving image in the first predetermined period in which the blur is acquired by the acquisition processing; and

performing predetermined processing on the first moving image and the second moving image using the first correction range and the second correction range, respectively.

22. A non-transitory computer-readable storage medium having stored thereon a program that is executable by a computer included in an image processing device, the program being executable by the computer to perform functions comprising:

acquisition processing for acquiring a blur at continuous capturing;

first setting processing for setting, for a first set of continuous images in a first continuous capturing period in which a blur is acquired by the acquisition processing among sets of the continuous images stored in a storage section in which a plurality of continuous images continuously captured at predetermined intervals are stored as one set, a first correction range based on the blur of the first set of continuous images;

second setting processing for setting, for a second set of continuous images in a second period preceding the first continuous capturing period in which the blur is acquired by the acquiring processing among the sets of the continuous images stored by the storage processing, a second correction range based on the blur of the first set of continuous images in the first continuous capturing period in which the blur is acquired by the acquiring processing; and

performing predetermined processing on the first set of continuous images and the second set of continuous images using the first correction range and the second correction range, respectively.