Image stabilization device, image stabilization method, and program

• US 9,143,685 B2
• Filed: 05/24/2011
• Issued: 09/22/2015
• Est. Priority Date: 06/07/2010
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ogawa, Nobuhiro, Sakaguchi, Tatsumi, Watanabe, Shinji
• Primary Examiner(s): HERNANDEZ, NELSON D
• Application Number:
  US13/114,576
• Publication Number:
  US 20110298937A1
• Time in Patent Office: 1,582 Days
• Field of Search: 348/208.3, 348/208.6
• US Class Current: 1/1
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

Provided is an image stabilization device including a motion sensor for detecting motion data, an image data display unit for displaying image data, a shake coefficient calculation unit for calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor, and a motion correction unit for performing control on the image data display unit to move the image data in a direction of cancelling the shaking in a case the shake coefficient calculated by the shake coefficient calculation unit becomes less than a predetermined first threshold.

Claims

1. An image stabilization device comprising:

a motion sensor that detects motion data of the image stabilization device;

an image data display that displays image data; and

a computer configured to;

calculate a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

perform control of the image data display, in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated by the computer becomes less than a predetermined first threshold, to move an entire area of the image data in a direction of cancelling the shaking; and

end the control to move the entire area of the image data in the direction of cancelling the shaking in a case that the shake coefficient calculated by the computer becomes less than a predetermined second threshold that is less than the predetermined first threshold.

2. The image stabilization device according to claim 1,

wherein the computer performs control of moving the entire area of the image data in such a way that a degree of cancellation of the shaking gradually increases as the shake coefficient becomes less than the predetermined first threshold, and performs control of moving the entire area of the image data in such a way that the degree of cancellation of the shaking gradually decreases as the shake coefficient nears the predetermined second threshold.

3. The image stabilization device according to claim 2, wherein the computer performs control of moving the entire area of the image data within a range allowing display of a protected area set in the image data.

4. The image stabilization device according to claim 3, wherein the computer is configured to:

calculate a maximum movement amount of the image data based on a relationship between a frame position of a display screen on which the image data is displayed and a frame position of the protected area; and

perform control of moving the entire area of the image data within a range that does not exceed the maximum movement amount calculated by the circuitry computer.

5. The image stabilization device according to claim 4,

wherein, when a predetermined time has elapsed in a state where the shake coefficient calculated by the computer is less than the predetermined first threshold, the computer performs the control of moving the entire area of the image data in the direction of cancelling the shaking after performing scaling on the image data.

6. The image stabilization device according to claim 3,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the computer performs control of moving each layer forming the entire area of the image data according to the degree of cancellation of the shaking set for the use of each layer.

7. The image stabilization device according to claim 1, wherein the computer is configured to:

estimate, from motion data detected by the motion sensor at present and in a past, motion data to be detected at a next time point;

determine a degree of cancellation of the shaking based on the motion data estimated by the computer; and

perform control of moving the entire area of the image data according to the degree of cancellation of the shaking determined by the computer.

8. The image stabilization device according to claim 1,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the computer performs control of moving each layer forming the entire area of the image data according to the degree of cancellation of the shaking set for the use of each layer.

9. The image stabilization device according to claim 1,

wherein, when a predetermined time has elapsed in a state where the shake coefficient calculated by the computer is less than the predetermined first threshold, the computer performs the control of moving the entire area of the image data in the direction of cancelling the shaking after performing scaling on the image data.

10. The image stabilization device according to claim 1,

wherein the computer sets the predetermined first threshold so that a range of the shaking indicated by the shake coefficient when the shake coefficient is the predetermined first threshold is about 10% of a size of the entire area of the image data display, and the computer sets the predetermined second threshold so that a range of the shaking indicated by the shake coefficient when the shake coefficient is the predetermined second threshold is about 1% of the size of the entire area of the image data display.

11. The image stabilization device according to claim 1,

wherein the computer does not perform the control of the image data display to move the entire area of the image data in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.

12. An image stabilization method of an image stabilization device, the image stabilization method comprising:

detecting motion data of the image stabilization device;

displaying image data;

calculating, using a computer, a shake coefficient indicating intensity of shaking based on time-series motion data detected in the detecting, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

moving, using the computer, an entire area of the image data displayed in the displaying in a direction of cancelling the shaking in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated in the calculating becomes less than a predetermined first threshold; and

ending, using the computer, the moving in a case that the shake coefficient calculated in the calculating becomes less than a predetermined second threshold that is less than the predetermined first threshold.

13. The image stabilization method according to claim 12,

wherein the computer does not move the entire area of the image data displayed in the displaying in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.

14. A non-transitory computer readable medium including executable instructions, which when executed by a computer cause the computer to execute an image stabilization method of an image stabilization device, the image stabilization method comprising:

detecting motion data of the image stabilization device;

displaying image data;

calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected in the detecting, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

moving an entire area of the image data in a direction of cancelling the shaking in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated in the calculating becomes less than a predetermined first threshold; and

ending the moving in a case that the shake coefficient calculated in the calculating becomes less than a predetermined second threshold that is less than the predetermined first threshold.

15. The non-transitory computer readable medium according to claim 14,

wherein the entire area of the image data is not moved in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.