Shake correction device, filming device, moving image display device, shake correction method and recording medium

• US 7,688,352 B2
• Filed: 11/22/2006
• Issued: 03/30/2010
• Est. Priority Date: 11/25/2005
• Status: Expired due to Fees

• Current Assignee: NVIDIA Corporation
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Nagaishi, Michihiro, Nomura, Kazuo, Sano, Megumi, Hosoda, Tatsuya
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Peterson; Christopher K
• Application Number:
  US11/562,596
• Publication Number:
  US 20070140674A1
• Time in Patent Office: 1,224 Days
• Field of Search: 34820899-20816
• US Class Current: 348/208.11
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations

Abstract

A filming device includes a filming unit which imports a plurality of frames configuring a moving image at a prescribed sampling rate, a shake amount detection unit which detects a shake amount of each of the frames, a frame position calculation unit which calculates a frame position of each frame based on the shake amount, a reference frame position determination unit which determines a reference frame position to be a reference of a display subject frame, and a frame selection and transmission unit which selects and sequentially transmits frames positioned within a prescribed range centered on the reference frame position.

Claims

1. A filming device, comprising:

a filming unit that imports a plurality of frames of a moving image at a prescribed sampling rate;

an angular velocity detecting unit that detects an angular velocity indicating a shake amount corresponding to each of the plurality of frames in each of three mutually orthogonal axes;

an angular velocity sampling unit that, prior to the importing of the frames by the filming unit, samples the angular velocity detected by the angular velocity detecting unit for a prescribed time in each of the three mutually orthogonal axes;

a tolerance range setting unit that, based on a shake tolerance range, sets an angular velocity tolerance range in each of the three mutually orthogonal axes;

a shake tendency specifying unit that specifies a shake tendency based on the sampled angular velocity and the angular velocity tolerance range;

an algorithm determination unit that determines an algorithm for selecting the frame based on the shake tendency; and

a frame selection and transmission unit that selects frames of the plurality of frames based on the determined algorithm, and that sequentially transmits only the selected frames;

wherein the shake tendency specifying unit specifies;

a first shake tendency when the sampled angular velocities in the three mutually orthogonal axes are zero,

a second shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in all of the three mutually orthogonal axes are within the angular velocity tolerance range, and

a third shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in only two of the three mutually orthogonal axes are within the angular velocity tolerance range;

wherein the algorithm determination unit sets the determined algorithm to be;

a first algorithm when the first shake tendency is specified,

a second algorithm when the second shake tendency is specified, and

a third algorithm when the third shake tendency is specified;

wherein the frame selection and transmission unit selects;

all of the plurality of frames, when the first algorithm is set as the determined algorithm,

frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in all of the three mutually orthogonal axes, when the second algorithm is set as the determined algorithm, and

frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in two of the three mutually orthogonal axes, when the third algorithm is set as the determined algorithm.

2. A method of operating a filming device, the method comprising:

importing a plurality of frames of a moving image at a prescribed sampling rate, using a filming unit;

detecting an angular velocity indicating a shake amount corresponding to each of the plurality of frames in each of three mutually orthogonal axes, using an angular velocity detecting unit;

prior to importing of the frames, sampling the angular velocity for a prescribed time in each of the three mutually orthogonal axes;

setting an angular velocity tolerance range in each of the three mutually orthogonal axes based on a shake tolerance range;

specifying a shake tendency based on the sampled angular velocity and the angular velocity tolerance range, comprising;

specifying a first shake tendency when the sampled angular velocities in the three mutually orthogonal axes are zero,

specifying a second shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in all of the three mutually orthogonal axes are within the angular velocity tolerance range, and

specifying a third shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in only two of the three mutually orthogonal axes are within the angular velocity tolerance range;

determining an algorithm for selecting the frame based on the shake tendency, comprising;

determining a first algorithm when the first shake tendency is specified,

determining a second algorithm when the second shake tendency is specified, and

determining a third algorithm when the third shake tendency is specified;

selecting frames of the plurality of frames based on the determined algorithm, comprising;

selecting all of the plurality of frames, when the first algorithm is set as the determined algorithm,

selecting frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in all of the three mutually orthogonal axes, when the second algorithm is set as the determined algorithm, and

selecting frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in two of the three mutually orthogonal axes, when the third algorithm is set as the determined algorithm; and

sequentially transmitting only the selected frames.

3. A computer-readable recording medium storing a computer program to cause a camera to perform the following:

importing a plurality of frames of a moving image at a prescribed sampling rate, using a filming unit;

detecting an angular velocity indicating a shake amount corresponding to each of the plurality of frames in each of three mutually orthogonal axes, using an angular velocity detecting unit;

prior to importing of the frames, sampling the angular velocity for a prescribed time in each of the three mutually orthogonal axes;

setting an angular velocity tolerance range in each of the three mutual orthogonal axes based on a shake tolerance range;

specifying a shake tendency based on the sampled angular velocity and the angular velocity tolerance range, comprising;

specifying a first shake tendency when the sampled angular velocities in the three mutually orthogonal axes are zero,

specifying a second shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in all of the three mutually orthogonal axes are within the angular velocity tolerance range, and

specifying a third shake tendency when all of the sampled angular velocities in the three mutually orthogonal axes are non-zero and the sampled angular velocities in only two of the three mutually orthogonal axes are within the angular velocity tolerance range;

determining an algorithm for selecting the frame based on the shake tendency, comprising;

determining a first algorithm when the first shake tendency is specified,

determining a second algorithm when the second shake tendency is specified, and

determining a third algorithm when the third shake tendency is specified;

selecting frames of the plurality of frames based on the determined algorithm, comprising;

selecting all of the plurality of frames, when the first algorithm is set as the determined algorithm,

selecting frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in all of the three mutually orthogonal axes, when the second algorithm is set as the determined algorithm, and

selecting frames whose corresponding sampled angular velocities are within the angular velocity tolerance range in two of the three mutually orthogonal axes, when the third algorithm is set as the determined algorithm; and

sequentially transmitting only the selected frames.