Charge-coupled device video camera with raw data format output and software implemented camera signal processing

• US 6,285,398 B1
• Filed: 04/21/1998
• Issued: 09/04/2001
• Est. Priority Date: 11/17/1997
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Carter, Ken, Yukelson, Michael, Milenky, Leonid, Shinsky, Michael
• Primary Examiner(s): Garber, Wendy R.
• Assistant Examiner(s): Vu, Ngoc-Yen, VU, NGOC YEN T
• Application Number:
  US09/063,813
• Time in Patent Office: 1,232 Days
• Field of Search: 348/13, 348/20, 348/24, 348/211-213, 348/220-224, 348/228, 348/229, 348/239, 348/254-256, 348/272, 348/273, 348/279, 348/333, 348/362-365, 348/552, 348/576, 348/577, 348/655, 345/154, 345/429-432, 396/211, 396/374, 396/429
• US Class Current: 348/223.1
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls

Abstract

A CCD video camera is coupled to a host system. The CCD video camera captures image data representing elements in its field of view. The video camera does not include a digital signal processing circuit for processing the raw video data into the appropriate video format. The raw video data is processed and converted into the appropriate video format for display by the host computer system after it is received from the video camera. Necessary gain adjustments and control signals are calculated within the host computer and provided to the video camera or used during the digital signal processing of the video data to adjust the parameters of the data before the video images are displayed. A histogram is generated in order to continually monitor and adjust the exposure and gain of the system and thereby appropriately change the necessary control signals for optimal performance. Through a graphical user interface a user can view the video images, set a proper white balance for the images by selecting a white area within the picture and view the histogram. A higher resolution scan mode is also used when capturing still images.

Claims

1. A video camera for capturing and transmitting raw video data to a receiving device comprising:

a. an imaging device to capture frame images; and

b. an interface circuit coupled to the imaging device to receive the frame images and configured for coupling to the receiving device to transmit the frame images to the receiving device, wherein the receiving device is separate from the video camera and the frame images are transmitted as raw data from the interface circuit and processing of the frame images into a video format is performed by the receiving device, the interface circuit further configured to receive control signals from the receiving device, wherein the receiving device is configured to calculate values for control signals and to transmit the control signals to the video camera wherein the control signals include a shutter control signal and an automatic gain control signal.

2. The video camera as claimed in claim 1 wherein the imaging device is a charge-coupled device.

3. The video camera according to claim 1 wherein the values calculated by the receiving device comprise data calculated through an automatic exposure algorithm.

4. The video camera according to claim 1 wherein the calculated values for the control signals are derived from information being transmitted from the video camera to the receiving device.

5. The video camera according to claim 1 wherein the receiving device is a computer system.

6. A video image capturing apparatus for capturing, processing and displaying video images comprising:

a. a video camera including;

i. an imaging device to capture frame images; and

ii. a camera interface circuit coupled to the imaging device to receive the frame images; and

b. a host receiving device not included within the video camera including;

i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera; and

ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals wherein the control signals include a shutter control signal and an automatic gain control signal.

7. The video image capturing apparatus as claimed in claim 6 further comprising a display device coupled to the processing circuit to receive and display the video format of the frame images.

8. The video image capturing apparatus as claimed in claim 7 wherein the video camera has a high resolution still picture mode used when capturing still images and further wherein the video camera transmits frame images one vertical line at a time when in the high resolution still picture mode.

9. The video image capturing apparatus as claimed in claim 7 wherein a histogram is developed by the processing circuit in order to continually adjust the control signals.

10. The video image capturing apparatus as claimed in claim 9 wherein the histogram is used to determine a gain change ratio.

11. The video image capturing apparatus as claimed in claim 10 wherein the gain change ratio is multiplied by a current total gain value to derive appropriate shutter control, automatic gain control and gain adjustment signals.

12. The video image capturing apparatus as claimed in claim 7 further comprising a graphical user interface displayed on the display device, wherein the graphical user interface includes a video window through which the video format of the frame images is displayed.

13. The video image capturing apparatus as claimed in claim 12 wherein the graphical user interface further includes a histogram window through which a histogram developed by the processing circuit in order to continually adjust the control signals is displayed.

14. The video image capturing apparatus as claimed in claim 13 wherein contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface can be adjusted.

15. The video image capturing apparatus as claimed in claim 14 wherein a white balance of the video format of the frame images displayed on the display can be set by selection of a desired white object within the video window.

16. The video image capturing apparatus as claimed in claim 15 wherein the processing circuit adjusts the video format to display the desired white object as white, and further wherein the processing circuit also scales contrasting color components according to the desired white object, using a color adjustment matrix.

17. The video image capturing apparatus as claimed in claim 16 wherein the processing circuit adjusts the control signals according to the color adjustment matrix.

18. A graphical user interface including a video window for displaying video images and a white balance control wherein color and contrast of the video images is controlled by selection of a desired white object within the video window,

wherein the video window is displayed on a host system including a display and an input device,

wherein raw data representing the video images is received from a video camera,

and wherein the host system further includes a processing circuit which processes the raw data and adjust the video images to display the desired white object as white and further wherein the processing circuit also scales contrasting color components according to the desired white object, using a color adjustment matrix.

19. The graphical user interface as claimed in claim 18 wherein the processing circuit provides control signals to the video camera adjusted according to the color adjustment matrix.

20. A video image capturing apparatus for capturing, processing and displaying video images comprising:

a. a video camera including;

i. an imaging device to capture frame images; and

ii. a camera interface circuit coupled to the imaging device to receive the frame images; and

b. a host receiving device separate from the video camera including;

i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera;

ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals;

iii. a display device coupled to the processing circuit to receive and display the video format of the frame images; and

iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed wherein the control signals include a shutter control signal and an automatic gain control signal.

21. The video image capturing apparatus as claimed in claim 20 wherein a histogram is developed by the processing circuit in order to continually adjust the control signals and further wherein the graphical user interface includes a histogram window through which the histogram is displayed.

22. The video image capturing apparatus as claimed in claim 21 wherein the histogram is used to determine a gain change ratio.

23. The video image capturing apparatus as claimed in claim 22 wherein a user can manually adjust contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface.

24. The video image capturing apparatus as claimed in claim 23 wherein a white balance of the video format of the frame images displayed on the display is set by selecting a desired white object within the video window.

25. The video image capturing apparatus as claimed in claim 24 wherein the processing circuit adjusts the video format to display the desired white object as white, and further wherein the processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.

26. A video image capturing apparatus for capturing, processing and displaying video images comprising:

a. a video camera including;

i. an imaging device to capture frame images; and

ii. a camera interface circuit coupled to the imaging device to receive the frame images; and

b. a host receiving device not included within the video camera including;

i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera, wherein the control signals include a shutter control signal and an automatic gain control signal;

ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals; and

iii. a display device coupled to the processing circuit to receive and display the video format of the frame images and to determine appropriate vales of the control signals;

wherein a histogram is developed by the processing circuit in order to continually adjust the control signals and to determine a gain change ratio.

27. The image video capturing apparatus as claimed in claim 26 wherein the gain change ratio is multiplied by a current total gain value to derive appropriate shutter control, automatic gain control and gain adjustment signals.

28. A video image capturing apparatus for capturing, processing and displaying video images comprising:

a. a video camera including;

i. an imaging device to capture frame images; and

ii. a camera interface circuit coupled to the imaging device to receive the frame images; and

b. a host receiving device separate from the video camera including;

i. a host interface circuit coupled to the camera interface circuit to receive the frame images in a raw data format and to transmit control signals to the video camera;

ii. a processing circuit coupled to the host interface circuit to receive the frame images in the raw data format, convert the frame images into a video format and to determine appropriate values of the control signals;

iii. a display device coupled to the processing circuit to receive and display the video of the frame images; and

iv. a graphical user interface displayed on the display device including a video window through which the video format of the frame images is displayed;

wherein a histogram is developed by the processing circuit to determine a gain change ratio and to continually adjust the control signals and further wherein the graphical user interface includes a histogram window through which the histogram is displayed.

29. The video image capturing apparatus as claimed in claim 28 wherein a user can manually adjust contrast, brightness and hue of the video format of the frame images displayed on the display device through the graphical user interface.

30. The video image capturing apparatus as claimed in claim 28 wherein a white balance of the video format of the frame images displayed on the display is set by selecting a desired white object within the video window wherein the processing circuit adjusts the video format to display the desired white object as white.

31. The video image capturing apparatus as claimed in claim 28 wherein the processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.

32. A video image capturing apparatus for capturing, processing and displaying video images comprising:

a. a histogram used to determine a gain change ratio; and

b. a current total gain value multiplied by the gain change ratio to derive appropriate shutter control, automatic gain control and gain adjustment signals;

wherein a user can manually adjust contrast, brightness and hue of a video format of frame images displayed on a display device through a graphical user interface, and further wherein a white balance of the video format of the frame images displayed on the display device is set by selecting a desired white object within a video window of the display device, and a processing circuit also scales contrasting color components and adjusts the control signals according to the desired white object, using a color adjustment matrix.