Image processing apparatus that can provide image data of high quality without deterioration in picture quality

• US 5,585,856 A
• Filed: 10/26/1994
• Issued: 12/17/1996
• Est. Priority Date: 10/27/1993
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Okada, Atsushi, Fukui, Kazuhiko, Nakaya, Mitsuyoshi, Yasuda, Yasushi
• Primary Examiner(s): Kostak, Victor R.
• Application Number:
  US08/329,339
• Time in Patent Office: 783 Days
• Field of Search: 348/441, 348/443-446, 348/448, 348/450-454, 345/132, 345/154
• US Class Current: 348/441
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 5/14 Picture signal circuitry for video frequency region cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 7/01 Conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level
• CPC Class Codes: H04N 7/0135 involving interpolation processes interpolation-based image scaling G06T3/4007; interpolation for video coding H04N19/587, H04N19/59

Abstract

Digital image data obtained by A/D converting an output signal from an image sensing device by an A/D conversion circuit is converted into image data corresponding to a predetermined image format by a digital process of an image conversion circuit. Therefore, an image of higher quality without deterioration in the picture can be provided in comparison with the case where digital image data obtained by A/D converting an output signal from an image sensing device is first converted into analog video data and then into A/D data. Further format conversion can be performed using a series of controllable image converters. The image converters and a signal processing unit can be selectively programmed to perform a variety of format conversions and image-type specific signal processing, respectively. Programming can be performed manually or automatically according to the type of input device or the type of information in the image.

Claims

1. An image processing apparatus comprising:

image signal output means for converting sensed light incident from an object into a digital video signal,

signal processing means for applying a signal process on said digital video signal to output a digital video signal,

first conversion means for converting said digital video signal into image data having a first image format,

second conversion means for converting said image data of the first format into image data of a second format, the second format being a modified version of the first format,

conversion control means, responsive to a format specification signal that specifies a format conversion, for selecting and controlling the operation of only said first conversion means to convert the image data into the first format and for selecting and controlling the operation of both the first and second conversion means to convert the image data into the second format, and

output means, connected to each of the first and second conversion means, for outputting the converted image data in one of the first and second formats.

2. The image processing apparatus according to claim 1, further comprising:

detection means for detecting a feature of an image from said digital video signal,

wherein said conversion control means selects at least one of the first and second conversion means for performance of at least one of a plurality of image format conversions according to the feature detected by said detection means.

3. The image processing apparatus according to claim 1, wherein said

first conversion means converts said digital video signal into image data corresponding to a CIF format of 352 pixels×

288 lines, and

said second conversion means receives said image data corresponding to the CIF format output from said first conversion means and converts said image data corresponding to the CIF format into image data corresponding to another format,

and said conversion control means selectively provides said converted image data to the output means, corresponding to one of the CIF format from the first conversion means and corresponding to the another format from the second conversion means.

4. The image processing apparatus according to claim 3, wherein said second conversion means comprises 1/2 conversion means for converting said image data corresponding to the CIF format into image data that is reduced by 1/2 in a horizontal direction and a vertical direction to generate image data corresponding to a QCIF format of 176 pixels×

144 lines.

5. The image processing apparatus according to claim 1, further comprising:

third conversion means for converting said image data of the second format into image data of a third format, the third format being a modified version of the second format, wherein the conversion control means, responsive to a format specification signal that specifies a format conversion, further selects and controls the operation of each of said first, second and third conversion means to convert the image data into the third format and wherein the output means is further connected to the third conversion means and outputs the converted image data in one of the first, second and third formats.

6. The image processing apparatus according to claim 5, wherein at least one of said first, second and third conversion means includes,

vertical conversion means for receiving said digital video signal and for carrying out conversion in the vertical direction of said image data corresponding to the predetermined image format, and wherein at least one of said first, second and third conversion means includes,

horizontal conversion means connected in series with said vertical conversion means for carrying out conversion in the horizontal direction of said image data corresponding to the predetermined image format,

wherein said vertical conversion means generates expanded image data having scanning lines expanded by interpolating said digital video signal and provides an expanded data control signal for indicating a valid timing of said expanded image data when the number of scanning lines of said digital video signal is smaller than that of said image data corresponding to the predetermined image format.

7. The image processing apparatus according to claim 5, wherein at least one of said first, second and third conversion means includes,

vertical conversion means for receiving said digital video signal and for carrying out conversion in the vertical direction of said image data corresponding to the predetermined image format, and wherein at least one of said first, second and third conversion means includes,

horizontal conversion means connected in series with said vertical conversion means for carrying out conversion in the horizontal direction of said image data corresponding to the predetermined image format,

wherein said horizontal conversion means provides compressed image data having said digital video signal compressed in the horizontal direction and provides a compressed data control signal indicating the valid timing of said compressed image data when the number of dots of said digital video signal in the horizontal direction is greater than that of said image data corresponding to the predetermined image format.

8. The image processing apparatus according to claim 7, further comprising:

data control means responsive to said compressed data control signal for sequentially storing said compressed image data and providing said stored compressed image data when one line of said compressed image data is obtained.

9. The image processing apparatus according to claim 5, wherein said first conversion means comprises square pixel conversion means for converting said digital video signal into image data of a first format corresponding to a square pixel.

10. The image processing apparatus according to claim 9, wherein said

first conversion means converts said digital video signal output from said signal processing means into image data of a first format corresponding to said square pixel,

second conversion means converts said image data of the first format into image data of a second format in which the number of lines and the number of pixels in the second format are reduced by 1/2 with respect to the first format, and

third conversion means converts said image data of the second format into image data of a third format in which the number of lines and the number of pixels in the third format are reduced by 1/2 with respect to the second format, and

conversion control means responsive to a format specification signal for specifying a conversion format for controlling the conversion operation of said first, second and third conversion means.

11. The image processing apparatus according to claim 10, wherein said square pixel conversion means further comprises contour enhancement means for enhancing the contour of converted image data.

12. The image processing apparatus according to claim 10, wherein said signal processing means outputs said digital video signal in synchronization with a predetermined clock signal,

wherein said first conversion means further comprises

first data conversion means for converting said digital video signal input in synchronization with said predetermined clock signal into image data of said first format, and outputting said image data of the first format in synchronization with said predetermined clock signal, and

first timing signal generation means for generating a first timing signal indicating the valid timing of said image data of the first format,

wherein said second conversion means further comprises

second data conversion means for converting said image data of the first format input in synchronization with said predetermined clock signal into image data of the second format, and outputting said image data of the second format in synchronization with said predetermined clock signal, and

second timing signal generation means for generating a second timing signal indicating the valid timing of said image data of the second format, and

wherein said third conversion means further comprises

third data conversion means for converting said image data of the second format input in synchronization with said predetermined clock signal into image data of the third format, and outputting said image data of the third format in synchronization with said predetermined clock signal, and

third timing signal generation means for generating a third timing signal indicating the valid timing of said image data of the third format.

13. The image processing apparatus according to claim 12, wherein said second data conversion means selects image data of one of an odd number and an even number field of said image data of the first format, for converting the number of lines to 1/2 the number of lines in the first format,

wherein said third data conversion means comprises horizontal calculation means for converting the number of pixels in the horizontal direction of said image data of the second format to 1/2 the number of pixels in the second format by a calculation process,

wherein said horizontal calculation means selects either image data of two adjacent pixels or image data of two pixels spaced apart by 1 pixel.

14. The image processing apparatus according to claim 12, wherein said third data conversion means further comprises:

horizontal calculation means for converting the number of pixels in the horizontal direction of said image data of the second format to 1/2 the number of pixels in the second format by a calculation process,

a line memory for storing image data having the number of pixels in the horizontal direction converted to 1/2 the number of pixels in the second format by said horizontal calculation means, and

vertical calculation means for converting the number of lines in the vertical direction of said image data of the second format to 1/2 the number of the lines in the second format by carrying out a calculation process on the image data output from said horizontal calculation means and said line memory.

15. The image processing apparatus according to claim 14, wherein said first format comprises a VGA format with a resolution of 640×

480 pixels.

16. The image processing apparatus according to claim 1, wherein one of said conversion means further comprises:

programmable image conversion logic means, and

programming means for programming a predetermined logic in said programmable image conversion logic means,

wherein said programmable image conversion logic means converts said digital video signal into image data corresponding to a predetermined image format according to said predetermined logic programmed by said programming means, and outputs said image data corresponding to the predetermined image format.

17. The image processing apparatus according to claim 16, further comprising:

detection means for detecting a feature of an image from said digital video signal,

wherein said programming means determines an image format conversion process according to said detected feature for programming a predetermined logic that realizes said image format conversion process in said programmable image conversion logic means,

wherein said programmable image conversion logic means carries out said image format conversion process on said digital ideo signal output from said signal processing means according to said predetermined logic programmed by said programming means, and outputs said image data corresponding to said image format.

18. The image processing apparatus according to claim 16, wherein said signal processing means further comprises programmable signal processing logic means,

wherein said programming means programs a predetermined logic in said programmable signal processing logic means and said programmable image conversion logic means according to an externally input control data.

19. The image processing apparatus according to claim 18, wherein said image signal output means further comprises image sensing means having a predetermined resolution,

wherein said control data comprises data concerning the resolution of said image sensing means,

wherein said programming means programs a predetermined logic according to the resolution of said image sensing means in said programmable signal processing logic means and said programmable image conversion logic means,

wherein said programmable signal processing logic means carries out a signal process according to the resolution of said image sensing means, and

wherein said programmable image conversion logic means carries out an image format conversion process according to the resolution of said image sensing means.

20. The image processing apparatus according to claim 16, wherein said image signal output means further comprises:

still picture output means for providing a digital image signal of a still picture, and

a moving picture output means for providing a digital video signal of a moving picture, and

wherein said image processing means further comprises

select means for selectively outputting one of said digital image signal of a moving picture output from said moving picture output means and said digital image signal of a still picture output from said still picture output means, and

wherein said signal processing means is a programmable signal processing means,

wherein said image processing apparatus further comprises control means for;

controlling said select means such that said digital video signal of a still picture provided from said still picture output means is output,

controlling said programming means such that a signal process and an image format conversion process that suits said digital image signal of a still picture output from said still picture output means are programmed in said programmable signal process logic means and said programmable image conversion logic means when said digital video signal of a moving picture output from said moving picture output means attains a blanking period,

controlling said select means such that said digital image signal of a moving picture output from said moving picture output means is output, and

controlling said program means such that a signal process and an image format conversion process that suits said digital image signal of a moving picture output from said moving picture output means are programmed in said programmable signal process logic means and said programmable image conversion logic means.

21. The image processing apparatus according to claim 16, further comprising:

memory means for storing signal process program data corresponding to a predetermined video system and image conversion program data corresponding to a predetermined image conversion system,

wherein said signal processing means is a programmable signal processing means,

wherein said image processing apparatus is separated into an image sensing unit including said image signal output means and said memory means, and a signal processing unit including said programmable signal processing means, said programmable image conversion logic means, and said program means,

wherein said image processing apparatus further comprises;

transfer means for transferring said program data from said image sensing unit to said programmable signal processing unit,

wherein said programmable signal processing means has a predetermined logic programmed according to said signal processing program data stored in said memory means for converting said digital image signal into a digital video signal corresponding to a predetermined video system and outputting said digital video signal,

wherein said programmable image conversion logic means has a predetermined logic programmable by said conversion program data stored in said memory means for converting said digital video signal output from said programmable signal processing means into image data of a format corresponding to said predetermined image conversion system.