Image-capturing apparatus

• US 7,421,091 B2
• Filed: 04/22/2004
• Issued: 09/02/2008
• Est. Priority Date: 05/20/2003
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Satoh, Hiroshi
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US10/829,383
• Publication Number:
  US 20040233300A1
• Time in Patent Office: 1,594 Days
• Field of Search: 382/103, 382/104, 382106-107, 382/168, 382/181, 382190-194, 382/232, 382/255, 382/260, 382/274, 382/275, 382/286, 382/291, 382/295, 382/312, 250/221, 250/208.1, 280/735, 700/83, 396/55, 348/208.99, 348/208.1
• US Class Current: 382/103
• CPC Class Codes: H04N 25/46 by combining or binning pixels
• CPC Class Codes: H04N 3/155 Control of the image-sensor operation, e.g. image processing within the image-sensor

Abstract

Outputs of pixels present around a given pixel at an image-capturing unit having a plurality of pixels disposed two-dimensionally are added to the output of the given pixel. During this process, the addition pattern with which the pixel outputs are added together is determined in correspondence to a specific type of image processing to be executed at a subsequent stage, and an image is generated by adding together the pixel outputs constituting image signals output from the image-capturing unit based upon the addition pattern. The image resulting from the addition then undergoes the image processing and the processed image is output.

Claims

1. An image-capturing apparatus comprising:

an image-capturing unit having a plurality of pixels disposed two-dimensionally;

an addition pattern generating unit configured to specify an addition pattern;

an adding unit configured to generate an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at the image-capturing unit to an output of the given pixel, wherein the selected pixels are chosen according to the addition pattern; and

an image processing unit configured to process the image resulting from addition executed by the adding unit according to a type of image processing;

wherein;

the addition pattern generating unit specifies different addition patterns corresponding to different types of image processing; and

when the image processing unit switches from a first type of image processing to a second type of image processing;

the addition pattern generating unit changes the specified addition pattern from an addition pattern corresponding to the first type of image processing to an addition pattern corresponding to the second type of image processing; and

the adding unit switches from the addition pattern corresponding to the first type of image processing to the addition pattern corresponding to the second type of image processing when adding outputs of selected pixels.

2. An image-capturing apparatus according to claim 1, wherein:

when the image processing unit is to execute image processing for detecting an edge in the image, the addition pattern generating unit generates the addition pattern in correspondence to a type of edge to be detected by the image processing unit.

3. An image-capturing apparatus according to claim 2, wherein:

when the image processing unit changes the type of edge to be detected for each captured image frame, the addition pattern generating unit generates the addition pattern in correspondence to the type of edge to be detected which is altered for the each captured image frame.

4. An image-capturing apparatus according to claim 2, wherein:

a number of pixels the outputs of which are added together with the addition pattern generated by the addition pattern generating unit in correspondence to the type of edge to be detected is adjusted in conformance to one of a frame rate and a length of exposure time set for the image-capturing unit.

5. An image-capturing apparatus according to claim 1, wherein:

when the image processing unit is to execute image processing for detecting a predetermined target object, the addition pattern generating unit generates the addition pattern in correspondence to the target object to be detected by the image processing unit.

6. An image-capturing apparatus according to claim 5, wherein:

a number of pixels the outputs of which are added together with the addition pattern generated by the addition pattern generating unit in correspondence to the target object to be detected is adjusted in conformance to one of a frame rate and a length of exposure time set for the image-capturing unit.

7. An image-capturing apparatus according to claim 1, wherein:

when the image processing unit changes the type of image processing for each captured image frame, the addition pattern generating unit generates the addition pattern in correspondence to the type of image processing for the each captured image frame.

8. An image-capturing apparatus according to claim 1, wherein:

p1 a number of pixels the outputs of which are added together with the addition pattern generated by the addition generating unit in correspondence to the type of image processing is adjusted in conformance to one of a frame rate and a length of exposure time set for the image-capturing unit.

9. An image-capturing apparatus according to claim 1, further comprising:

an A/D converter that converts an analog image signal to a digital image signal, wherein;

a number of bits output from the A/D converter is set to a value obtained by adding log₂ (number of pixels used for addition) to a number of bits output from the adding unit.

10. An image-capturing apparatus comprising:

an image-capturing unit having a plurality of pixels disposed two-dimensionally;

an addition pattern generating unit configured to specify an addition pattern according to a vehicular behavior detected by a vehicular behavior detection device;

an adding unit configured to generate an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at the image-capturing unit to an output of the given pixel, wherein the selected pixels are chosen according to the addition pattern; and

an image processing unit configured to process the image resulting from addition executed by the adding unit;

wherein;

the addition pattern generating unit specifies different addition patterns corresponding to different types of vehicular behaviors; and

when the detected vehicular behavior changes from a first type of vehicular behavior to a second type of vehicular behavior;

the addition pattern generating unit changes the specified addition pattern from an addition pattern corresponding to the first type of vehicular behavior to an addition pattern corresponding to the second type of vehicular behavior; and

the adding unit switches from the addition pattern corresponding to the first type of vehicular behavior to the addition pattern corresponding to the second type of vehicular behavior when adding outputs of selected pixels.

11. An image-capturing apparatus according to claim 10, further comprising:

an A/D converter that converts an analog image signal to a digital image signal, wherein;

a number of bits output from the A/D converter is set to a value obtained by adding log₂ (number of pixels used for addition) to a number of bits output from the adding unit.

12. An image-capturing apparatus comprising:

an image-capturing unit having a plurality of pixels disposed two-dimensionally;

an addition pattern generating unit configured to specify an addition pattern according to a type of vibration of the image-capturing apparatus detected by a vibration detection unit;

an adding unit configured to generate an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at an image-capturing unit having a plurality of pixels disposed two-dimensionally to an output of the given pixels, wherein the selected pixels are chosen according to the addition pattern; and

an image processing unit configured to process the image resulting from addition executed by the adding unit;

wherein;

the addition pattern generating unit specifies different addition patterns corresponding to different types of vibration of the image-capturing apparatus; and

when the detected vibration of the image-capturing apparatus changes from a first type of vibration to a second type of vibration;

an addition pattern generating unit changes the specified addition pattern from an addition pattern corresponding to the first type of vibration to an addition pattern corresponding to the second type of vibration; and

the adding unit switches from the addition pattern corresponding to the first type of vibration to the addition pattern corresponding to the second type of vibration when adding outputs of selected pixels.

13. An image-capturing apparatus according to claim 12, further comprising:

an A/D converter that converts an analog image signal to a digital image signal, wherein;

a number of bits output from the A/D converter is set to a value obtained by adding log₂ (number of pixels used for addition) to a number of bits output from the adding unit.

14. An image-capturing apparatus comprising:

image-capturing means, having a plurality of pixels disposed two-dimensionally;

for capturing images;

an addition pattern generating means for generating an addition pattern;

adding means for generating an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at the image-capturing means to an output of the given pixels, wherein the selected pixels are chosen according to the addition pattern; and

image processing means for processing the image resulting from addition executed by the adding means, according to a type of image processing;

wherein;

the addition pattern generating means specifies different addition patterns corresponding to different types of image processing; and

when the image processing means switches from a first type of image processing to a second type of image processing;

the addition pattern generating means changes the specified addition pattern from an addition pattern corresponding to the first type of image processing to an addition pattern corresponding to the second type of image processing; and

the adding means switches from the addition pattern corresponding to the first type of image processing to the addition pattern corresponding to the second type of image processing when adding outputs of selected pixels.

15. An image-capturing apparatus comprising:

image-capturing means, having a plurality of pixels disposed two-dimensionally, for generating images;

addition pattern generating means for specifying an addition pattern according to a vehicular behavior detected by a vehicular behavior detection device;

adding means for generating an image by adding according to the addition pattern, outputs of pixels present around a given pixel at the image-capturing means to an output of the given pixel, wherein the selected pixels are chosen according to the addition pattern; and

an image processing means for processing the image resulting from addition executed by the adding means;

wherein;

the addition pattern generating means specifies different addition patterns corresponding to different types of vehicular behaviors; and

when the detected vehicular behavior changes from a first type of vehicular behavior to a second type of vehicular behavior;

the addition pattern generating means changes the specified addition pattern from an addition pattern corresponding to the first type of vehicular behavior to an addition pattern corresponding to the second type of vehicular behavior; and

the adding means switches from the addition pattern corresponding to the first type of vehicular behavior to the addition pattern corresponding to the second type of vehicular behavior when adding outputs of selected pixels.

16. An image-capturing apparatus comprising:

an image-capturing means, having a plurality of pixels disposed two-dimensionally, for capturing images;

an addition pattern generating means for specifying an addition pattern according to a type of vibration of the image-capturing means detected by a vibration detection unit;

adding means for generating an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at an image-capturing means having a plurality of pixels disposed two-dimensionally to an output of the given pixels, wherein the selected pixels are chosen according to the specified addition pattern; and

image processing means for processing the image resulting from addition executed by the adding means;

wherein;

the addition pattern generating means specifies different addition patterns corresponding to different types of vibration of the image-capturing apparatus; and

when the detected vibration of the image-capturing apparatus means changes from a first type of vibration to a second type of vibration;

the addition pattern generating means changes the specified addition pattern from an addition pattern corresponding to the first type of vibration to an addition pattern corresponding to the second type of vibration; and

the adding means switches from the addition pattern corresponding to the first type of vibration to the addition pattern corresponding to the second type of vibration when adding outputs of selected pixels.

17. An image-capturing apparatus comprising:

generating an addition pattern according to a type of image processing;

generating an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at the image-capturing unit having a plurality pixels disposed two-dimensional to an output of the given pixel, wherein the selected pixels are chosen according to the addition pattern, and different addition patterns are generated corresponding to different types of image processing; and

processing the image resulting form addition of pixel outputs, according to the type of image processing;

wherein when the image processing the image switches from a first type of image processing to a second type of image processing;

the addition pattern is changes from an addition pattern corresponding to the first type of image processing to an addition pattern corresponding to the second type of image processing; and

the adding of the outputs of selected pixels is changed for utilizing the addition pattern corresponding to the first type of image processing to utilizing the addition pattern corresponding to the second type of image processing.

18. An image-capturing apparatus comprising:

generating an addition pattern according to a detected vehicular behavior, wherein different addition patterns corresponding to different types of vehicular behaviors;

generating an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at the image-capturing unit having a plurality of pixels disposed two-dimensionally to an output of the given pixel, wherein the selected pixels are chosen according to the addition pattern;

processing the image resulting from addition of pixel output;

wherein;

when the detected vehicular behavior changes from a first type of vehicular behavior to a second type of vehicular behavior;

the addition pattern is changed from an addition pattern corresponding to the first type of vehicular behavior to an addition pattern corresponding to the second type of vehicular behavior; and

the adding of the outputs of selected pixels is changed from utilizing the addition pattern corresponding to the first type of vehicular behavior to utilizing the addition pattern corresponding to the second type of vehicular behavior.

19. An image-capturing apparatus comprising:

generating an addition pattern according to a type of vibration of the an image-capturing apparatus, wherein different addition patterns are generated corresponding to different types of vibration of the image-capturing apparatus;

generating an image by adding according to the addition pattern, outputs of selected pixels present around a given pixel at an image-capturing unit having a plurality of pixels disposed two-dimensionally to an output of the given pixels, wherein the selected pixels are chosen according to the addition pattern; and

processing the image resulting from addition of pixel output;

wherein;

when the detected vibration of the image-captured apparatus changes from a first types of vibration to a second type of vibration;

the generated addition pattern is changed from an addition pattern corresponding to the first type of vibration to an addition pattern corresponding to the second type of vibration; and

the adding of the outputs of selected pixels is changed from utilizing the addition pattern corresponding to the first type of vibration to utilizing the addition pattern corresponding to the second type of vibration when adding outputs of selected pixels.