Integrated circuit for video/audio processing

• US 8,811,470 B2
• Filed: 04/01/2005
• Issued: 08/19/2014
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: Socionext Inc.
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Kimura, Kozo, Kiyohara, Tokuzo, Mizuno, Hiroshi, Michiyama, Junji, Kitamura, Tomohiko, Yamaguchi, Ryoji, Kuroda, Manabu, Yamada, Nobuhiko, Ohgose, Hideyuki, Yamana, Akifumi
• Primary Examiner(s): TORRENTE, RICHARD T
• Application Number:
  US10/599,494
• Publication Number:
  US 20070286275A1
• Time in Patent Office: 3,427 Days
• Field of Search: 375/240.01
• US Class Current: 375/240.01
• CPC Class Codes: G06F 13/4027 using bus bridges G06F13/4022 takes precedence
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 9/7921 for more than one processing mode
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

An integrated circuit for video/audio processing in which design resources obtained by development of video/audio devices can also be used for other types of video/audio devices. The integrated circuit includes a microcomputer that includes a CPU, a stream input/output for inputting/outputting a video and audio stream to and from an external device, a media processor that executes the media processing including at least one compressing and decompressing the video and audio stream inputted to the stream input/output, an AV input/output that converts the video and audio stream subjected to the media processing by the media processor into video and audio signals and outputting these signals to the external device. A memory interface controls a data transfer between the microcomputer, the stream input/output, the media processor and the AV input/output and an external memory.

Claims

1. An integrated circuit for video/audio processing that processes a video and audio signal, comprising:

a microcomputer including a CPU (central processor unit);

a stream input/output operable to receive/output a video and audio stream to/from an external device, under a control of said microcomputer;

a media processor operable to execute a media processing including at least one of compression and decompression of the video and audio stream inputted to said stream input/output or outputted from said stream input/output under a control of said microcomputer;

an AV input/output operable to convert the video and audio stream subjected to the media processing in said media processor and output the video and audio stream to a first external apparatus, or acquire the video and audio signal from a second external apparatus and convert the video and audio signal into a video and audio stream subjected to the media processing in said media processor, under the control of said microcomputer; and

a memory interface operable to control a data transfer between a memory and said stream input/output, said media processor and said AV input/output, under a control of said microcomputer, wherein

said stream input/output, said media processor and said AV input/output are connected to said memory interface by plural data buses, and

when a video and audio stream is exchanged between any two of said stream input/output, said media processor and said AV input/output, said video and audio stream is exchanged therebetween through said memory interface by using said memory, and

wherein said data buses comprise respective plural dedicated data buses;

each of said stream input/output, said media processor and said AV input/output is connected to said memory interface by each of respective plural dedicated data buses; and

each of the respective plural dedicated data buses is associated to one of said stream input/output, said media processor and said AV input/output.

2. The integrated circuit for video/audio processing according to claim 1, wherein said memory interface is operable to relay the data transfer so that the data transfer between said memory and said microcomputer, said stream input/output, said media processor and said AV input/output is made in parallel.

3. The integrated circuit for video/audio processing according to claim 1, wherein said microcomputer, said stream input/output, said media processor and said AV input/output have no buffer memory for buffering the video and audio stream.

4. The integrated circuit for video/audio processing according to claim 1, wherein said microcomputer, said stream input/output, said media processor and said AV input/output store the video and audio stream in said memory and notifies remaining ones of said microcomputer, said stream input/output, said media processor and said AV input/output.

5. The integrated circuit for video/audio processing according to claim 1,

wherein said stream input/output includes an interface operable to transmit and receive the video and audio stream to and from said external device, an encryption processor operable to encrypt or decrypt the transmitted and received video and audio stream, and a first direct memory access controller operable to transfer data between said external device and said memory,

said media processor including an instruction parallel processor which executes plural signal processing instructions in parallel, an accelerator which executes an arithmetic operation, and a second direct memory access controller operable to control the data transfer with said memory,

said AV input/output includes a graphics engine which executes graphics processing of image data, and a format converter operable to convert the format of the video signal, and

said memory interface includes plural ports connected to said microcomputer, said stream input/output, said media processor and said AV input/output, and has a memory scheduler which adjusts timing of data transfer at each of said plural ports.

6. The integrated circuit for video/audio processing according to claim 5, wherein said microcomputer further includes at least one of a clock controller operable to turn on/off a supply of a clock to said CPU and a power supply controller operable to turn on/off the power supply.

7. The integrated circuit for video/audio processing according to claim 5, wherein said media processor further includes a data parallel processor which executes an arithmetic operation on plural pieces of data in parallel.

8. The integrated circuit for video/audio processing according to claim 1, further comprising:

a signal line which connects said stream input/output and said media processor,

wherein said media processor is operable to execute media processing of the video and audio stream inputted from said stream input/output through said signal line or the video and audio stream to be outputted to said stream input/output through said signal line.

9. The integrated circuit for video/audio processing according to claim 1,

wherein circuit elements and wiring between said microcomputer, said stream input/output, said media processor, said AV input/output and said memory interface are formed on a circuit layer and a first wiring layer, respectively, on a semiconductor substrate;

and

said data buses are formed on a second wiring layer located above said first wiring layer.

10. The integrated circuit for video/audio processing according to claim 1,

wherein a structure of said integrated circuit is included in each of plural different system LSI (large-scale integration) corresponding to each of plural different devices;

and

the plural different devices include at least two among a digital television, a digital video recorder, a video camera and a portable telephone.

11. The integrated circuit for video/audio processing according to claim 10,

wherein assuming that one of said plural different devices is designated as a first device and another as a second device and a process is shared by said integrated circuit for video/audio processing for the first device and said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by said microcomputer of said integrated circuit for video/audio processing for the first device, the process is executed by said microcomputer of said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by said stream input/output of said integrated circuit for video/audio processing for the first device, the process is executed by said stream input/output of said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by said media processor of said integrated circuit for video/audio processing for the first device, the process is executed by said media processor of said integrated circuit for video/audio processing for the second device; and

in the case where the process is executed by said AV input/output of said integrated circuit for video/audio processing for the first device, the process is executed by said AV input/output of said integrated circuit for video/audio processing for the second device.

12. The integrated circuit for video/audio processing according to claim 10,

wherein in the case where one of the plural different devices is designated as a first device and another as a second device,

the CPU of said integrated circuit for video/audio processing for the first device and the CPU of said integrated circuit for video/audio processing for the second device have instruction sets partially compatible with each other.

13. The integrated circuit for video/audio processing according to claim 10,

wherein said media processing includes an instruction parallel processor which executes plural signal processing instructions in parallel;

and

in the case where one of the plural different devices is designated as a first device and another as a second device,

the instruction parallel processor of said integrated circuit for video/audio processing for the first device and the instruction parallel processor of said integrated circuit for video/audio processing for the second device have instruction sets partially compatible with each other.

14. The integrated circuit for video/audio processing according to claim 10,

wherein said media processor includes an instruction parallel processor which executes plural signal processing instructions in parallel;

and

in the case where one of the plural different devices is designated as a first device and another as a second device,

a core of the CPU of said integrated circuit for video/audio processing for the first device and a core of the CPU of said integrated circuit for video/audio processing for the second device have a same logic connection, and

a core of the instruction parallel processor of said integrated circuit for video/audio processing for the first device and a core of the instruction parallel processor of said integrated circuit for video/audio processing for the second device have a same logic connection.

15. The integrated circuit for video/audio processing according to claim 10,

wherein said media processor includes an instruction parallel processor which executes plural signal processing instructions in parallel;

and

in the case where one of the plural different devices is designated as a first device and another as a second device,

a core of the CPU of said integrated circuit for video/audio processing for the first device and a core of the CPU of said integrated circuit for video/audio processing for the second device have a same mask layout, and

a core of the instruction parallel processor of said integrated circuit for video/audio processing for the first device and a core of the instruction parallel processor of said integrated circuit for video/audio processing for the second device have a same mask layout.

16. The integrated circuit for video/audio processing according to claim 10,

wherein in the case where one of the plural different devices is designated as a first device and another one is designated as a second device,

an address of a first control register for said stream input/output, said media processor, said AV input/output and said memory interface on a memory map of the CPU in said integrated circuit for video/audio processing for the first device is identical to an address of a second control register for said stream input/output, said media processor, said AV input/output and said memory interface on a memory map of the CPU in said integrated circuit for video/audio processing for the second device.

17. A method of designing and developing devices using the integrated circuit for video/audio processing according to claim 10, wherein the plural different devices include a digital television, a digital video recorder, a video camera and a portable telephone.

18. The integrated circuit for video/audio processing according to claim 1,

wherein said AV input/output is further operable to generate a recording video signal by converting a resolution of the video signal converted from a video stream subjected to media processing by said media processor or acquired from said second external apparatus, as well as generating field feature information indicating at least one of in-field total and inter-field difference of video fields indicated by the recording video signal;

and

said media processor is further operable to access the field feature information and convert the recording video signal into a recording video stream.

19. The integrated circuit for video/audio processing according to claim 18, further comprising:

a signal line which connects said media processor and said AV input/output,

wherein the field feature information is exchanged between said media processor and said AV input/output through said signal line.

20. The integrated circuit for video/audio processing according to claim 1, wherein said media processor executes, by time division, a multiplexing or demultiplexing process for the video and audio stream, a video data compressing or decompressing process, and an audio data compressing or decompressing process for one video/audio multiplex stream, as well as prohibiting the multiplexing or demultiplexing process.

21. The integrated circuit for video/audio processing according to claim 20,

wherein said media processor includes a virtual multiprocessor functioning as plural logical processors by time division;

the multiplexing or demultiplexing process for said video and audio stream, the compressing or decompressing process for said video data, and the compressing or decompressing process for said audio data are executed by different logical processors, respectively, which are a function of said virtual multiprocessor; and

a logical processor for executing the multiplexing or demultiplexing process for said video and audio stream sleeps until an expiration of a time on a predetermined timer after completion of the processing of a predetermined unit of said video and audio stream.

22. The method of designing and developing devices according to claim 17, wherein the design and development is performed in such a manner that:

assuming that one of the plural different devices is designated as a first device and another of the plural different devices is designated as a second device and a process is shared by said integrated circuit for video/audio processing for the first device and said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by a microcomputer of said integrated circuit for video/audio processing for the first device, the process is executed by a microcomputer of said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by a stream input/output of said integrated circuit for video/audio processing for the first device, the process is executed by a stream input/output of said integrated circuit for video/audio processing for the second device;

in the case where the process is executed by a media processor of said integrated circuit for video/audio processing for the first device, said process is executed by a media processor of said integrated circuit for video/audio processing for the second device; and

in the case where the process is executed by an AV input/output of said integrated circuit for video/audio processing for the first device, the process is executed by an AV input/output of said integrated circuit for video/audio processing for the second device.

23. The integrated circuit for video/audio processing according to claim 1,

wherein said data buses comprise a first data bus and a second data bus which are different from each other;

and

each of said AV input/output and said media processor is connected to said memory interface by said first data bus and said second data bus respectively.

24. The integrated circuit for video/audio processing according to claim 1,

wherein said data buses comprise a first data bus and a second data bus which are different from each other;

and

each of said AV input/output and said stream input/output is connected to said memory interface by said first data bus and said second data bus respectively.

25. The integrated circuit for video/audio processing according to claim 1,

wherein said data buses comprise a first data bus and a second data bus which are different from each other;

and

each of said AV input/output and said microcomputer is connected to said memory interface by said first data bus and said second data bus respectively.

26. The integrated circuit for video/audio processing according to claim 1, wherein said video and audio stream is exchanged therebetween through a corresponding two of said plural data buses and said memory interface by using said memory.