Adaptive video processing circuitry and techniques

• US 8,379,147 B2
• Filed: 06/04/2010
• Issued: 02/19/2013
• Est. Priority Date: 06/24/2009
• Status: Expired due to Fees

• Current Assignee: Telegent Systems, Inc. (Tsinghua Holdings Co., Ltd.)
• Original Assignee: Telegent Systems, Inc. (Tsinghua Holdings Co., Ltd.)
• Inventors: Chang, Edward, Huang, Herbert
• Primary Examiner(s): KOSTAK, VICTOR R
• Application Number:
  US12/794,683
• Publication Number:
  US 20100328468A1
• Time in Patent Office: 991 Days
• Field of Search: 348/448, 348/452, 348/607, 348618-620, 348/700, 348/701, 348/606, 348/625, 382298-300, 375/240.26
• US Class Current: 348/448
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403

Abstract

Video processing circuitry to adaptively process input video data which corresponds to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum. In one aspect, the video processing circuitry includes spatial adaptation circuitry to generate and output spatially adapted video data corresponding to the plurality of video frames, temporal adaptation circuitry to generate and output temporally adapted video data corresponding to the plurality of video frames, and video manipulation circuitry, coupled to the spatial adaptation circuitry and the temporal adaptation circuitry, to generate output video data corresponding to the plurality of video frames, using the input video data, the spatially adapted video data and the temporally adapted video data. Methods of adaptively processing input video data which corresponds to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum are also disclosed.

Claims

1. A video processing circuitry to adaptively process input video data which corresponds to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum, the video processing circuitry comprising:

spatial adaptation circuitry to generate and output spatially adapted video data corresponding to the plurality of video frames, including spatially adapted video data corresponding to a given video frame using video data of a video frame which is related to the given video frame;

temporal adaptation circuitry to generate and output temporally adapted video data corresponding to the plurality of video frames, including temporally adapted video data corresponding to the given video frame using video data which is temporally related to the given video frame; and

video manipulation circuitry, coupled to the spatial adaptation circuitry and the temporal adaptation circuitry, to generate output video data corresponding to the plurality of video frames of the selected channel of the broadcast spectrum, using the input video data, the spatially adapted video data and the temporally adapted video data, wherein;

the video manipulation circuitry includes summer circuitry to generate output video data corresponding to the given video frame by summing, on a pixel-by-pixel, (i) the input video data corresponding to the given video frame, (ii) the spatially adapted video data which corresponds to the given video frame and (iii) the temporally adapted video data which corresponds to the given video frame.

2. The video processing circuitry of claim 1 wherein spatial adaptation circuitry generates each pixel of the given video frame by applying the input video data which corresponds to the given video frame to a spatially defocusing or blurring filter.

3. The video processing circuitry of claim 1 wherein spatial adaptation circuitry generates each pixel of the given video frame by applying the input video data which corresponds to the given video frame to a finite impulse response filter.

4. The video processing circuitry of claim 1 wherein temporal adaptation circuitry generates temporally adapted video data corresponding to the given video frame using video data which is representative of a sum, on a pixel-by-pixel, of video data of a plurality of video frames that temporally precede the given video frame.

5. The video processing circuitry of claim 1 further including a scaling circuit, coupled to the output of the temporal adaptation circuitry, to scale the temporally adapted video data.

6. The video processing circuitry of claim 1 further including a scaling circuit, coupled to the output of the spatial adaptation circuitry, to scale the spatially adapted video data.

7. The video processing circuitry of claim 6 wherein the amount of scaling of the spatially adapted video data by the scaling circuit is programmable.

8. The video processing circuitry of claim 6 wherein the amount of scaling of the spatially adapted video data by the scaling circuit is programmable during operation of the video processing circuitry.

9. The video processing circuitry of claim 6 wherein the amount of scaling by the scaling circuit of the spatially adapted video data corresponding to the given video frame is responsive to motion in the input video data corresponding to the given video frame.

10. The video processing circuitry of claim 6 further including motion detection circuitry, coupled to the scaling circuit, to generate a scale control signal which is representative of the amount of scaling applied by the scaling circuit to the spatially adapted video data corresponding to the given video frame.

11. The video processing circuitry of claim 1 further including:

a first scaling circuit, electrically coupled to an input of the video manipulation circuitry to scale the input video data used by the video manipulation circuitry, to generate output video data corresponding to the plurality of video frames;

a second scaling circuit, electrically coupled to an input of the video manipulation circuitry, to scale the spatially adapted video data used by the video manipulation circuitry to generate output video data corresponding to the plurality of video frames; and

a third scaling circuit, electrically coupled to an input of the video manipulation circuitry, to scale the temporally adapted video data used by the video manipulation circuitry to generate output video data corresponding to the plurality of video frames.

12. The video processing circuitry of claim 11 wherein:

the amount of scaling by the first scaling circuit is programmable during operation of the video processing circuitry;

the amount of scaling by the second scaling circuit is programmable during operation of the video processing circuitry; and

the amount of scaling by the third scaling circuit IS programmable during operation of the video processing circuitry.

13. The video processing circuitry of claim 12 further including adaptation correlation circuitry, coupled to the first, second and third scaling circuits, to generate a scale control signal, during operation of the video processing circuitry, which is representative of the amount of scaling applied by each of the scaling circuits.

14. A method of adaptively processing input video data which corresponds to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum, the method comprising:

generating spatially adapted video data corresponding to the plurality of video frames;

generating temporally adapted video data corresponding to the plurality of video frames;

generating the output video data for each video frame of the plurality of video frames by summing, on a pixel-by-pixel basis, (i) the input video data, (ii) the spatially adapted video data and (iii) the temporally adapted video data of each video frame of the plurality of video frames; and

outputting the output video data which corresponds to a plurality of video frames of the selected channel of the broadcast spectrum.

15. The method of claim 14 wherein generating the spatially adapted video data corresponding to the plurality of video frames includes generating the spatially adapted video data for each frame of the plurality of video frames by spatially defocusing or blurring the input video data of the plurality of video frames on a pixel-by-pixel basis.

16. The method of claim 14 wherein generating temporally adapted video data corresponding to the plurality of video frames includes generating temporally adapted video data for each video frame of the plurality of video frames by summing, on a pixel-by-pixel, video data of a video frame with one or more temporally preceding video frames.

17. The method of claim 14 further including scaling the spatially adapted video data, wherein generating output video data corresponding to the plurality of video frames uses a scaled version of the spatially adapted video data.

18. The method of claim 17 wherein the amount of scaling the spatially adapted video data is programmable during operation.

19. The method of claim 14 further including:

scaling the input video data, wherein generating output video data corresponding to the plurality of video frames uses a scaled version of the input video data;

scaling the temporally adapted video data, wherein generating output video data corresponding to the plurality of video frames uses a scaled version of the temporally adapted video data; and

determining an amount of scaling of the spatially adapted video data and the temporally adapted video data based on detecting motion in the video of the input video data.

20. A method of testing video processing circuitry which adaptively processes input video data corresponding to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum, the method comprising:

applying signals to spatial adaptation circuitry to generate and output spatially adapted video data corresponding to the plurality of video frames;

applying signals to the temporal adaptation circuitry to generate and output temporally adapted video data corresponding to the plurality of video frames;

applying signals to video manipulation circuitry to generate output video data by summing, on a pixel-by-pixel basis, (i) the input video data, (ii) the spatially adapted video data and (iii) the temporally adapted video data of each video frame of the plurality of video frames; and

outputting the output video data which corresponds to a plurality of video frames of the selected channel of the broadcast spectrum.

21. A method of simulating video processing circuitry which adaptively processes input video data corresponding to a plurality of video frames of a selected channel which is one of a plurality of channels of a broadcast spectrum, the method comprising:

generating spatially adapted video data corresponding to the plurality of video frames;

generating temporally adapted video data corresponding to the plurality of video frames;

generating the output video data for each video frame of the plurality of video frames by summing, on a pixel-by-pixel basis, (i) the input video data, (ii) the spatially adapted video data and (iii) the temporally adapted video data of each video frame of the plurality of video frames; and

outputting the output video data corresponding to the selected channel of the broadcast spectrum.