System and method for processing multimedia data using an audio-video link

• US 8,212,924 B2
• Filed: 05/12/2009
• Issued: 07/03/2012
• Est. Priority Date: 05/12/2009
• Status: Active Grant

• Current Assignee: Himax Technologies Ltd. (Himax Technologies Incorporated)
• Original Assignee: Himax Technologies Ltd. (Himax Technologies Incorporated)
• Inventors: Wang, Tzung-ren
• Primary Examiner(s): Kincaid, Kristine
• Assistant Examiner(s): MONTOYA, OSCHTA I
• Application Number:
  US12/464,356
• Publication Number:
  US 20100289953A1
• Time in Patent Office: 1,148 Days
• Field of Search: None
• US Class Current: 348/515
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: H04N 5/60 for the sound signals
• CPC Class Codes: H04N 9/643 Hue control means, e.g. flesh tone control
• CPC Class Codes: H04N 9/68 for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86

Abstract

A multimedia processor includes an audio processor configured to process an audio input signal to generate an audio output signal and an assistant signal, and a video processor coupled with the audio processor and configured to process video input signal and the assistant signal to generate a video output signal simultaneously according to the video input signal and the assistant signal. Provided with the assistant signal, the video processor acquires more video processing-related information for rendering video content in a more realistic manner. Mal-motion detection can thus be prevented, and video quality can be improved.

Claims

1. A multimedia processor, comprising:

an audio processor configured to process an audio input signal to generate an audio output signal and an assistant signal; and

a video processor coupled with the audio processor, wherein the video processor is configured to

process a video input signal and the assistant signal for generating a video output signal simultaneously according to the video input signal and the assistant signal; and

temporarily stop generating motion vector information when the received assistant signal indicates the occurrence of explosion graphics.

2. The multimedia processor of claim 1, wherein the assistant signal includes audio cue information extracted based on the audio input signal.

3. The multimedia processor of claim 2, wherein the audio processor extracts the audio cue information based on the information carried by at least one of an audio header and audio packets within the audio input signal.

4. The multimedia processor of claim 1, wherein the audio processor generates the assistant signal according to statuses or flags that are set in processing the audio input signal to generate the audio output signal.

5. The multimedia processor of claim 1, wherein the audio processor comprises:

an audio decoder configured to decode the audio input signal to form a decoded audio signal;

an audio processing unit configured to convert the decoded audio signal to the audio output signal; and

an audio cue information extractor configured to generate the assistant signal by extracting audio cue information within the audio input signal.

6. The multimedia processor of claim 1, wherein the audio processor comprises:

an audio processing unit configured to convert the audio input signal to the audio output signal; and

an audio cue information extractor configured to generate the assistant signal by extracting audio cue information within the audio input signal.

7. The multimedia processor of claim 1, wherein the video processor further generate a second assistant signal, and the audio processor further receives and processes the second assistant signal to generate the audio output signal simultaneously according to the audio output signal and the second assistant signal.

8. The multimedia processor of claim 1, wherein the assistant signal comprises at least one of content type information, frequency information, amplitude information, tempo information, and tone information carried by the audio input signal.

9. The multimedia processor of claim 1, wherein the assistant signal comprises content type information and the video processor is further configured to adjust a flesh tone of the video output signal according to the content type information.

10. The multimedia processor of claim 1, wherein the assistant signal comprises amplitude information for different channels, and the video processor is further configured to generate motion vectors according to the amplitude information for the different channels.

11. A multimedia processing method comprising:

processing an audio input signal;

generating an assistant signal and an audio output signal from the processed audio input signal;

processing a video input signal and the assistant signal; and

generating a video output signal simultaneously according to the video input signal and the assistant signal, wherein the step of generating the video output signal includes temporarily stopping generating motion vector information when the received assistant signal indicates the occurrence of explosion graphics.

12. The multimedia processing method of claim 11, wherein the step of generating the assistant signal comprises extracting audio cue information based on the audio input signal.

13. The multimedia processing method of claim 12, wherein the step of extracting the audio cue information is based on the information carried by at least one of an audio header and audio packets within the audio input signal.

14. The multimedia processing method of claim 11, wherein the assistant signal is generated according to statuses or flags that are set during processing of the audio input signal.

15. The multimedia processing method of claim 11, wherein the step of processing the audio input signal comprises:

decoding the audio input signal to form a decoded audio signal;

converting the decoded audio signal to the audio output signal; and

extracting audio cue information from the audio input signal.

16. The multimedia processing method of claim 11, wherein the step of processing the audio input signal comprises:

converting the audio input signal to the audio output signal; and

extracting audio cue information from the audio input signal.

17. The multimedia processing method of claim 11, further comprising generating a second assistant signal, and wherein the step of generating the audio output signal is performed simultaneously according to the audio output signal and the second assistant signal.

18. The multimedia processing method of claim 11, wherein the assistant signal comprises at least one of content type information, frequency information, amplitude information, tempo information, and tone information carried by the audio input signal.

19. The multimedia processing method of claim 11, wherein the assistant signal comprises content type information and generation of the video output signal further comprises adjusting flesh tone of the video output signal according to the content type information.