Image processing apparatus and method, recording medium, and program

• US 8,081,225 B2
• Filed: 03/26/2010
• Issued: 12/20/2011
• Est. Priority Date: 01/22/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Inaba, Seijiro, Tanaka, Kenji, Kinoshita, Masaya
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): DAGNEW, MEKONNEN D
• Application Number:
  US12/732,609
• Publication Number:
  US 20100177200A1
• Time in Patent Office: 634 Days
• Field of Search: 34820899-20816, 348/154, 348/16, 348/317, 348/320, 348 52- 55, 348/218.1, 396 52- 55, 359554-557
• US Class Current: 348/208.99
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/689 Motion occurring during a rolling shutter mode

Abstract

The present invention relates to an image processing apparatus and method enabling to correct for camera shake given in image capturing, a recording medium, and a program. Discrete data pieces indicating shifts are obtained. The discrete data pieces are interpolated to obtain data indicating a shift every line. By the interpolation, a correction is calculated every line on the basis of the corresponding shift. On the basis of the corrections, pixel data read positions are determined. Pixel data is read based on the determined read positions. When a pixel to be read overlaps two pixels, pixel data of the pixel to be read is produced (interpolated) from pixel data pieces. In this manner, the effects of camera shake are corrected. The present invention is applicable to video cameras.

Claims

1. An image processing apparatus for capturing and processing an image, comprising:

an X-Y addressing solid-state imaging device having differences in exposure time between lines;

a camera shake detecting unit to detect camera shake information;

a correction calculating unit to calculate on a line by line basis a correction based on intermediate information pieces of camera shake information pieces obtained for exposure time of respective lines, the intermediate information pieces for calculating the correction of respective lines including camera shake information obtained corresponding to a time sequence during an exposure time of a corresponding line; and

a correcting unit to correct the image captured by the X-Y addressing solid-state imaging device according to the correction and to output a corrected image.

2. The image processing apparatus according to claim 1, wherein the correction calculating unit further includes:

a shift calculating sub unit to calculate a shift based on the intermediate information pieces of the camera shake information pieces; and

a correction calculating sub unit to calculate the correction based on the shift.

3. An image processing apparatus for capturing and processing an image, comprising:

an X-Y addressing solid-state imaging device having differences in exposure time between lines;

a camera shake detecting unit to detect camera shake information;

a correction calculating unit to calculate on a line by line basis a correction based on the camera shake information pieces except for both ends thereof,

wherein the intermediate information pieces for calculating the correction of respective lines includes camera shake information obtained corresponding to a time sequence during an exposure time of a corresponding line during an exposure time of respective lines; and

a correcting unit to correct the image captured by the X-Y addressing solid-state imaging device according to the correction and to output a corrected image.

4. The image processing apparatus according to claim 3, wherein the correction calculating unit further includes:

a shift calculating sub unit to calculate a shift based on the camera shake information pieces; and

a correction calculating sub unit to calculate the correction based on the shift.

5. An image processing method of an image processing apparatus for capturing and processing an image, wherein the image processing apparatus comprises an X-Y addressing solid-state imaging device having differences in exposure time between lines, the image processing method comprising the steps of:

detecting camera shake information;

calculating on a line by line basis a correction based on intermediate information pieces of camera shake information pieces obtained for exposure time of respective lines, the intermediate information pieces for calculating the correction of respective lines including camera shake information obtained corresponding to a time sequence during an exposure time of a corresponding line;

correcting the image captured by the X-Y addressing solid-state imaging device according to the correction; and

outputting a corrected image.

6. The image processing method according to claim 5, wherein the correction calculating step further includes the steps of:

calculating a shift based on the intermediate information pieces of the camera shake information pieces; and

calculating the correction based on the shift.

7. An image processing method of an image processing apparatus for capturing and processing an image, wherein the image processing apparatus comprises an X-Y addressing solid-state imaging device having differences in exposure time between lines, the image processing method comprising the steps of:

detecting camera shake information;

calculating on a line by line basis a correction based on camera shake information pieces except for both ends thereof,

wherein the intermediate information pieces for calculating the correction of respective lines includes camera shake information obtained corresponding to a time sequence during an exposure time of respective lines; and

correcting the image captured by the X-Y addressing solid-state imaging device according to the correction; and

outputting a corrected image.

8. The image processing method according to claim 7, wherein the correction calculating steps further includes:

calculating a shift based on the camera shake information pieces; and

calculating the correction based on the shift.