IMAGE STABILIZATION DEVICE, IMAGE STABILIZATION METHOD, AND PROGRAM

• US 20110298937A1
• Filed: 05/24/2011
• Published: 12/08/2011
• Est. Priority Date: 06/07/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: OGAWA, Nobuhiro, Sakaguchi, Tatsumi, Watanabe, Shinji
• Granted Patent: US 9,143,685 B2
• Time in Patent Office: Days
• US Class Current: 348/208.4
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

Provided is an image stabilization device including a motion sensor for detecting motion data, an image data display unit for displaying image data, a shake coefficient calculation unit for calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor, and a motion correction unit for performing control on the image data display unit to move the image data in a direction of cancelling the shaking in a case the shake coefficient calculated by the shake coefficient calculation unit becomes less than a predetermined first threshold.

Claims

1. An image stabilization device comprising:

a motion sensor for detecting motion data;

an image data display unit for displaying image data;

a shake coefficient calculation unit for calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor; and

a motion correction unit for performing control on the image data display unit, in a case the shake coefficient calculated by the shake coefficient calculation unit becomes less than a predetermined first threshold, to move the image data in a direction of cancelling the shaking.

2. The image stabilization device according to claim 1,

wherein the motion correction unit ends the control of moving the image data in the direction of cancelling the shaking in a case the shake coefficient calculated by the shake coefficient calculation unit becomes less than a predetermined second threshold that is less than the predetermined first threshold.

3. The image stabilization device according to claim 2,

wherein the motion correction unit performs control of moving the image data in such a way that a degree of cancellation of the shaking gradually increases as the shake coefficient becomes less than the predetermined first threshold, and performs control of moving the image data in such a way that the degree of cancellation of the shaking gradually decreases as the shake coefficient nears the predetermined second threshold.

4. The image stabilization device according to claim 2, further comprising:

a motion estimation unit for estimating, from motion data detected by the motion sensor at present and in a past, motion data to be detected at a next time point; and

a cancellation degree determination unit for determining a degree of cancellation of the shaking based on the motion data estimated by the motion estimation unit,

wherein the motion correction unit performs control of moving the image data according to the degree of cancellation of the shaking determined by the cancellation degree determination unit.

5. The image stabilization device according to claim 3,

wherein the motion correction unit performs control of moving the image data within a range allowing display of a protected area set in the image data.

6. The image stabilization device according to claim 5, further comprising:

a maximum movement amount calculation unit for calculating a maximum movement amount of the image data based on a relationship between a frame position of a display screen on which the image data is displayed and a frame position of the protected area,

wherein the motion correction unit performs control of moving the image data within a range that does not exceed the maximum movement amount calculated by the maximum movement amount calculation unit.

7. The image stabilization device according to claim 1,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the motion correction unit performs control of moving each layer forming the image data according to the degree of cancellation of the shaking set for the use of each layer.

8. The image stabilization device according to claim 5,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the motion correction unit performs control of moving each layer forming the image data according to the degree of cancellation of the shaking set for the use of each layer.

9. The image stabilization device according to claim 1,

wherein, in a case a predetermined time has elapsed in a state where the shake coefficient calculated by the shake coefficient calculation unit is less than the predetermined first threshold, the motion correction unit performs the control of moving the image data in the direction of cancelling the shaking after performing scaling on the image data.

10. The image stabilization device according to claim 6,

wherein, in a case a predetermined time has elapsed in a state where the shake coefficient calculated by the shake coefficient calculation unit is less than the predetermined first threshold, the motion correction unit performs the control of moving the image data in the direction of cancelling the shaking after performing scaling on the image data.

11. An image stabilization method comprising the steps of:

detecting motion data;

displaying image data;

calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected in the step of detecting; and

moving the image data displayed in the step of displaying in a direction of cancelling the shaking in a case the shake coefficient calculated in the step of calculating becomes less than a predetermined first threshold.

12. A program for causing a computer to realize:

a motion sensor function of detecting motion data;

an image data display function of displaying image data;

a shake coefficient calculation function of calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor function; and

a motion correction function of performing, in relation to the image data display function, control of moving the image data in a direction of cancelling the shaking in a case the shake coefficient calculated by the shake coefficient calculation function becomes less than a predetermined first threshold.