Shake correction device, filming device, moving image display device, shake correction method and recording medium

• US 20070140674A1
• Filed: 11/22/2006
• Published: 06/21/2007
• Est. Priority Date: 11/25/2005
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Sano, Megumi, NOMURA, Kazuo, HOSODA, Tatsuya, NAGAISHI, Michihiro
• Granted Patent: US 7,688,352 B2
• Time in Patent Office: Days
• US Class Current: 396/52
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations

Abstract

A filming device according to the invention includes a filming unit which imports a plurality of frames configuring a moving image at a prescribed sampling rate, a shake amount detection unit which detects a shake amount of each of the frames, a frame position calculation unit which calculates a frame position of each frame based on the shake amount, a reference frame position determination unit which determines a reference frame position to be a reference of a display subject frame, and a frame selection and transmission unit which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position.

Claims

1. A shake correction device, comprising:

a shake amount detection unit which detects a shake amount of each of a plurality of frames configuring a moving image;

a frame position calculation unit which calculates a frame position of each frame of the plurality of frames based on the shake amount;

a reference frame position determination unit which determines a reference frame position; and

a frame selection and transmission unit which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position.

2. The shake correction device according to claim 1, wherein:

the reference frame position determination unit makes a frame position of a leading frame of the plurality of frames configuring the moving image the reference frame position.

3. The shake correction device according to claim 2, wherein:

the reference frame position determination unit updates the reference frame position at least at one of;

every time a prescribed time elapses from a display time of the leading frame; and

every prescribed number of frames from the leading frame.

4. The shake correction device according to claim 3, wherein:

when updating the reference frame position, the reference frame position determination unit makes a position in which at least one of;

a frame position of each frame lying within the prescribed time; and

a frame position of each frame belonging to the prescribed number of frames;

is concentrated on the reference frame position.

5. The shake correction device according to claim 1, wherein:

the frame selection and transmission unit selects a next frame, regardless of a frame position of the next frame and transmits it, if at least one of;

a display time between frames to be selected exceeds a prescribed time; and

a number of frames between the frames to be selected exceeds a prescribed number.

6. A filming device, comprising:

a filming unit which imports a plurality of frames configuring a moving image at a prescribed sampling rate;

a shake amount detection unit which detects a shake amount of each of the frames;

a frame position calculation unit which calculates a frame position of each frame of the plurality of frames based on the shake amount;

a reference frame position determination unit which determines a reference frame position; and

a frame selection and transmission unit which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position.

7. The filming device according to claim 6, wherein:

the shake amount detection unit includes;

a velocity detector which detects at least one of an acceleration and an angular velocity occurring in a device main body, in synchronization with the importing of the frames, and detects the shake amount based on the at least one of the acceleration and the angular velocity.

8. The filming device according to claim 6, further comprising:

a tolerance range setting unit which, based on a shake tolerance range tolerated for a moving image display frame, sets an angular velocity tolerance range corresponding to the shake tolerance range as the prescribed range;

wherein the shake amount detection unit detects an angular velocity indicating the shake amount for every frame; and

the frame selection and transmission unit selects and sequentially transmits frames of which the angular velocity is within the angular velocity tolerance range.

9. The filming device according to claim 8, wherein:

the tolerance range setting unit changes the angular velocity tolerance range in accordance with a focal distance of the filming unit.

10. The filming device according to claim 8, further comprising:

an angular velocity sampling unit which, prior to the importing of the frames by the filming unit, samples the angular velocity detected by the shake amount detection unit for a prescribed time; and

a tolerance range change unit which changes the angular velocity tolerance range based on the sampled angular velocity.

11. The filming device according to claim 10, wherein:

the shake amount detection unit has an X axis angular velocity detector which detects an X axis angular velocity of an X axis direction in an orthogonal coordinate system, and a Y axis angular velocity detector which detects a Y axis angular velocity of a Y axis direction, and the angular velocity sampling unit samples and transmits the X axis angular velocity and the Y axis angular velocity;

the tolerance range change unit specifies an X axis angular velocity component range and a Y axis angular velocity component range of which the sampled X axis angular velocity and Y axis angular velocity both lie in the angular velocity tolerance range; and

the frame selection and transmission unit selects and sequentially transmits only frames, of the frames imported by the filming unit, having the X axis angular velocity and Y axis angular velocity respectively in the X axis angular velocity component range and the Y axis angular velocity component range.

12. The filming device according to claim 11, wherein:

if all of the sampled X axis angular velocities and Y axis angular velocities are approximately zero, the frame selection and transmission unit sequentially transmits all of the frames imported by the filming unit.

13. The filming device according to claim 11, wherein:

if not all of the sampled X axis angular velocities and Y axis angular velocities are within the angular velocity tolerance range,

the range change unit;

changes the angular velocity tolerance range corresponding to the X axis angular velocity in accordance with an average value of the sampled X axis angular velocities; and

changes the angular velocity tolerance range corresponding to the Y axis angular velocity in accordance with an average value of the sampled Y axis angular velocities.

14. The filming device according to claim 13, wherein:

if not all of the sampled X axis angular velocities and Y axis angular velocities are within an angular velocity tolerance range changed by the tolerance range change unit,

the frame selection and transmission unit;

selects and sequentially transmits only frames of the X axis angular velocity that or the Y axis angular velocity that has more points with a zero value in the angular velocity tolerance range.

15. The filming device according to claim 10, wherein:

the shake amount detection unit includes;

a Z axis angular velocity detector which detects a Z axis angular velocity of a Z axis direction in the orthogonal coordinate system;

the range change unit specifies the X axis angular velocity component range, the Y axis angular velocity component range and a Z axis angular velocity component range, of which the sampled X axis angular velocity, Y axis angular velocity and Z axis angular velocity are all in the angular velocity tolerance range; and

the frame selection and transmission unit selects and sequentially transmits only frames, of the frames imported by the filming unit, having the X axis angular velocity, Y axis angular velocity and Z axis angular velocity respectively in the X axis angular velocity component range, the Y axis angular velocity component range and the Z axis angular velocity component range.

16. The filming device according to claim 11, further comprising:

a history storage unit which stores sampled angular velocity information.

17. A moving image display device, comprising:

a display unit which sequentially displays a plurality of frames to display a moving image;

a shake amount detection unit which detects a shake amount of each of a plurality of frames configuring the moving image;

a frame position calculation unit which calculates a frame position of each frame based on the shake amount;

a reference frame position determination unit which determines a reference frame position; and

a frame selection and transmission unit which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position to the display unit.

18. A shake correction method, comprising:

detecting a shake amount of each of a plurality of frames configuring a moving image;

calculating a frame position of each frame of the plurality of frames based on the shake amount;

determining a reference frame position; and

selecting and sequentially transmitting frames positioned within a prescribed range centered on the reference frame position.

19. A computer readable recording medium in which a shake correction program is recorded for causing a computer to function as:

shake amount detection means which detects a shake amount of each of a plurality of frames configuring a moving image;

frame position calculation means which calculates a frame position of each frame based on the shake amount;

reference frame position determination means which determines a reference frame position; and

frame selection and transmission means which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position.