Integrated circuit, an encoder/decoder architecture, and a method for processing a media stream

• US 20080120676A1
• Filed: 11/22/2006
• Published: 05/22/2008
• Est. Priority Date: 11/22/2006
• Status: Abandoned Application

• Current Assignee: DigitalOptics Corporation International (Adeia, Inc.)
• Original Assignee: Horizon Semiconductors Ltd.
• Inventors: Austerlitz, Ofer, Yavits, Leonid, Khrapkovsky, Michael, Morad, Amir, Oxman, Gedalia
• Application Number:
  US11/603,199
• Publication Number:
  US 20080120676A1
• Time in Patent Office: Days
• US Class Current: 725/127
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 21/42607 for processing the incoming bitstream

Abstract

An integrated circuit for pre-processing, encoding, decoding, transcoding, indexing, blending, post-processing and display of media streams, in accordance with a variety of compression algorithms, DRM schemes and related industry standards and recommendations such as OCAP, ISMA, DLNA, MPAA etc. The integrated circuit comprises an input interface configured for receiving the media streams from content sources, a plurality of processing units, system CPU, and sophisticated switch and memory controller, electronically connected to the input interface and directly connected to each one of the processing units. The integrated circuit further comprises an output interface that is operatively connected to the switch and configured for outputting the simultaneously processed media streams.

Claims

1. An integrated circuit for processing a media stream, comprising:

an input interface configured for receiving said media stream from a content source;

a plurality of processing units;

a switch, electronically connected to said input interface and directly connected to each said processing unit, said switch configured for allowing two said processing units to simultaneously receive said media stream, thereby allowing simultaneous processing of said media stream by said processing units; and

an output interface, operatively connected to said switch, configured for outputting said simultaneously processed media stream.

2. The integrated circuit of claim 1, wherein said integrated circuit comprises a secured memory interface configured for encrypting data transfer to and from an external memory device.

3. The integrated circuit of claim 1, wherein said integrated circuit comprises a secured memory interface configured for operating, encryption, and decryption of the entire information flow to and from an external memory device.

4. The integrated circuit of claim 2, wherein said encrypting is carried out according to a DRM scheme, wherein DRM keys are generated using at least one of the group comprising a pseudo-random number generator and a true random number generator, or said keys are stored in one member of the group comprising:

a secure embedded one-time programmable memory, a software application, and an external device.

5. The integrated circuit of claim 2, wherein said encrypting is carried out according to a plurality of secure DRM keys.

6. The integrated circuit of claim 1, wherein said input interface comprises at least one member of the group consisting of:

an Ethernet connection, a universal serial bus (USB) connection, a ieee1394 (Firewire) connection, a standard product interface (SPI), a serial signal interface (SSI), an advanced technology attachment (ATA) drive, an ATA packet interface (ATAPI) drive, integrated drive electronics (IDE) drive, a serial ATA (SATA) drive, and a general purpose input/output (GPIO).

7. The integrated circuit of claim 1, wherein said plurality of processing units are configured to receive said media stream from said input interface via said switch.

8. The integrated circuit of claim 2, wherein said switch is coupled with a secured memory interface comprising a storage device.

9. The integrated circuit of claim 8, wherein one of said plurality of processing units comprises an embedded central processing unit (CPU) that comprises a secure boot loader module.

10. The integrated circuit of claim 1, wherein said plurality of processing units are configured for simultaneously processing said media stream according to at least two of the members of the group consisting of:

encoding, pre-processing, de-interlacing, decoding, post-processing, transcoding, blending, encrypting, and decrypting.

11. The integrated circuit of claim 1, wherein at least one of said plurality of processing units comprises a security element.

12. The integrated circuit of claim 1, wherein said switch is configured for allowing each one of said plurality of processing units to communicate with another of said plurality of processing units.

13. The integrated circuit of claim 1, wherein said media stream comprises a member of a group consisting of:

an audio stream, a video stream, a still image, a graphical object, and a text section.

14. The integrated circuit of claim 1, wherein said input interface is configured for receiving a plurality of media streams.

15. The integrated circuit of claim 1, wherein said switch having structure and capacity to allow two or more of said processing units to simultaneously receive at least two different media streams from different processing units.

16. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured for generating a composite video stream according to said media stream.

17. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to compress said media stream according to a compression algorithm.

18. The integrated circuit of claim 17, wherein said compression algorithm is a member of a group consisting of:

an MPEG1 compression algorithm, an MPEG2 compression algorithm, an MPEG4 compression algorithm, an audio visual component (AVC) compression algorithm, a society of motion picture and television engineers (VC-1) compression algorithm, an audio video subsystem (AVS) compression algorithm, and an H.263 compression algorithm.

19. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to decompress said media stream according to a decompression algorithm.

20. The integrated circuit of claim 12, wherein at least one of said plurality of processing units is configured for preprocessing said media stream before it is compressed.

21. The integrated circuit of claim 20, wherein said preprocessing comprises implementing a member of a group consisting of:

decreasing scaling, spatial filtering, temporal filtering, linear filtering, non-linear filtering, and reducing noise of said media stream.

22. The integrated circuit of claim 12, wherein at least one of said plurality of processing units is a rate distortion optimization (RDO) processor, said RDO processor configured to choose said compression algorithm.

23. The integrated circuit of claim 12, wherein at least one of said plurality of processing units is configured to obtain a prediction of rate distortion based upon said media stream and to select a number of compression parameters to minimize the rate distortion of said media stream.

24. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to multiplex said media stream.

25. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to demultiplex said media stream.

26. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to generate at least one layer of graphical objects, said composite video stream combines said at least one layer of graphical objects.

27. The integrated circuit of claim 1, said switch having an external device connection, said switch being configured to receive an additional media stream via said external device connection.

28. The integrated circuit of claim 27, wherein said external device connection is connected to a member of a group consisting of:

a hard disk drive (HDD), a secure memory device, and a client equipment (CE) appliance.

29. The integrated circuit of claim 28, said member being connected to said external device connection via secure peripheral equipment.

30. The integrated circuit of claim 27, at least one of said plurality of processing units being configured for processing said additional media stream.

31. The integrated circuit of claim 30, said processing comprising blending said additional media stream with said media stream.

32. The integrated circuit of claim 1, wherein said switch is configured for allowing simultaneous communication between two or more of said plurality of processing units and another of said processing units.

33. The integrated circuit of claim 30, wherein said switch is configured for allowing said simultaneous communication by time division multiplexing outputs of said two or more of said plurality of processing units.

34. The integrated circuit of claim 1, wherein one of said processing units is a memory device.

35. The integrated circuit of claim 1, at least one of said plurality of processing units being configured for encrypting said media stream.

36. The integrated circuit of claim 1, at least one of said plurality of processing units being configured for decrypting said media stream.

37. The integrated circuit of claim 1, at least one of said plurality of processing units being configured for postprocessing said media stream, said postprocessing comprising implementing a member of a group consisting of:

image processing frames from said media stream, increasing the scaling of frames from said media stream, decreasing the scaling of frames from said media stream, enhancing the values of frames from said media stream, converting the color values of frames from said media stream, enhancing the edge of frames from said media stream, reducing noise from said media stream, deblocking said media stream, deringing said media stream, and deinterlacing said media stream.

38. The integrated circuit of claim 1, wherein said plurality of processing units comprises a member of a group consisting of:

an audio/video (AV) preprocessor, an encoding/decoding (ENDEC) processor, an entropy CODEC, a data multiplexor/demultiplexor, a data encryption/decryption processor, an audio ENDEC processor, a motion estimation processor, a still image ENDEC processor, an embedded CPU, a 2D/3D graphics engine/blender, an AV postprocessor, and a rate distortion optimization (RDO) processor.

39. The integrated circuit of claim 1, wherein said output interface is configured for adding a protection tag onto said media stream.

40. The integrated circuit of claim 1, wherein at least one of said plurality of processing units is configured to transcode said media stream according to a predefined algorithm.

41. The integrated circuit of claim 1, configured for integration into a media-handling device.

42. A method for providing a media stream, comprising:

a) receiving said media stream from a content source;

b) simultaneously providing said media stream to a plurality of processing units by allowing communication between any two of said plurality of processing units; and

c) outputting said simultaneously processed media stream.

43. The method of claim 42, wherein each one of said plurality of processing units is configured to communicate with another of said plurality of processing units via a switch having the capacity and configuration to handle a plurality of media streams simultaneously.

44. The method of claim 42, wherein said step of receiving comprises a step of receiving a plurality of media streams from at least one content source.

45. The method of claim 42, wherein said step of simultaneously providing comprises a step of simultaneously providing said plurality of media streams.

46. The method of claim 45, further comprising a step between steps (b) and (c) of generating a composite video stream according to at least two of said plurality of media streams.

47. The method of claim 42, further comprising a step between steps (b) and (c) of compressing said media stream according to a compression algorithm.

48. The method of claim 42, further comprising a step between steps (b) and (c) of decompressing said media stream according to a decompression algorithm.

49. The method of claim 42 further comprising a step between steps (b) and (c) of preprocessing said media stream using at least one of said plurality of processing units.

50. The method of claim 48, wherein said preprocessing comprises a step of a group consisting of:

decreasing scaling, spatial filtering, temporal filtering, linear filtering, nonlinear filtering, and reducing noise of said media stream.

51. The method of claim 42, further comprising a step between steps (b) and (c) of compressing said media stream using a compression algorithm.

52. The method of claim 42, further comprising a step between steps (b) and (c) of choosing said compression algorithm.

53. The method of claim 42, further comprising a step between steps (b) and (c) of multiplexing said media stream.

54. The method of claim 42, further comprising a step between steps (b) and (c) of demultiplexing said media stream.

55. The method of claim 42, further comprising a step between steps (b) and (c) of transcoding said media stream.

56. The method of claim 42, further comprising a step between steps (b) and (c) of:

generating at least one layer of graphical objects; and

combining said at least one layer of graphical objects with said media stream.

57. The method of claim 42, further comprising a step between steps (b) and (c) of:

receiving an additional media stream from an external device; and

combining said additional media stream with said media stream.

58. The method of claim 42, further comprising a step between steps (b) and (c) of:

generating a time multiplexed stream according to outputs of two or more of said plurality of processing units; and

transferring said time multiplexed stream to another of said plurality of processing units, thereby allowing said two or more of said plurality of processing units to simultaneously communicate with said other of said plurality of processing units.

59. The method of claim 42 further comprising a step between steps (b) and (c) of postprocessing said media stream using at least one of said plurality of processing units.

60. The method of claim 59, wherein said step of postprocessing comprises one member of the group consisting of:

image processing frames from said media stream, increasing the scaling of frames from said media stream, decreasing the scaling of frames from said media stream, enhancing the values of frames from said media stream, converting the color values of frames from said media stream, enhancing the edges of frames from said media stream, reducing noise from said media stream, deblocking said media stream, deringing said media stream, and deinterlacing said media stream.

61. The method of claim 42 further comprising a step of adding a protection tag onto said media stream.

62. The method of claim 42 further comprising a step between steps (b) and (c) of decrypting said media stream using at least one of said plurality of processing units.

63. The method of claim 42 further comprising a step between steps (b) and (c) of encrypting said media stream using at least one of said plurality of processing units.

64. A home gateway for processing a media stream, comprising:

an input interface configured for receiving said media stream;

a plurality of tuners, electronically connected to said input interface, each one of said tuners being configured for a different channel of said media stream;

an encoding/decoding unit, electronically connected to said tuners, configured for simultaneously processing said different channels; and

an output interface, operatively connected to said encoding/decoding unit, configured for outputting said simultaneously processed different channels.

65. The home gateway of claim 64, wherein said encoding/decoding unit comprises a plurality of processing units, said encoding/decoding unit being configured to perform said processing by allowing communication between any two of said plurality of processing units.

66. The home gateway of claim 64, wherein said input and output interfaces are connected to a storage device, wherein said storage device is configured to receive said processed different channels and to transmit said media stream respectively via said output and input interfaces.

67. The home gateway of claim 64, wherein said processing comprises a member of the following group:

de-multiplexing, decrypting, decoding, indexing, transcoding post-processing, blending, storing, and rendering.

68. The home gateway of claim 64, wherein said encoding/decoding unit is configured to transcode said media stream from a first resolution to a second resolution, said second resolution being different from said first resolution.

69. A camcorder having a processing unit for processing a captured media stream, said camcorder comprising:

at least one image sensor for capturing a sequence of images and generating a media stream based thereupon;

a plurality of processing units;

a switch, electronically connected to said at least one image sensor and directly connected to each said processing unit, said switch configured for allowing two said processing units to simultaneously receive said media stream, thereby allowing simultaneous processing of said media stream by said processing units; and

an output interface, operatively connected to said switch, configured for outputting said simultaneously processed media stream.

70. The camcorder of claim 69, wherein said processing comprises a member of the group consisting of at least two of the following actions:

encoding, decoding, multiplexing, demultiplexing, indexing, pre processing, post processing, and blending.

71. The camcorder of claim 69, further comprises an external media streams input electronically connected to said switch, said external media streams configured for receiving a additional media stream, said switch configured for allowing two said processing units to simultaneously receive said additional media stream.

72. The camcorder of claim 69, wherein said output interface is connected to at least one member of the following group:

an integrated display screen, a storage device, an external display screen, and a communication interface.

73. A digital television having an encoding/decoding unit, said digital television comprising:

a display unit;

a personal video recorder unit configured for generating a first media stream;

an input interface configured for receiving a second media stream;

a plurality of tuners, electronically connected to said input interface, each one of said tuners being configured for a different channel of said second media stream; and

an encoding/decoding unit, electronically connected to said tuners and to said personal video recorder, configured for simultaneously processing said different channels and said first and second media streams for outputting said simultaneously processed different channels to said display unit.

74. The digital television of claim 73, wherein said personal video recorder is configured to store said simultaneously processed different channels.

75. The digital television of claim 73, wherein said encoding/decoding unit is configured for simultaneously processing said different channels by blending with still images

76. The digital television of claim 73, wherein said encoding/decoding unit is configured for simultaneously processing said different channels with at least one graphic plane stored in said personal video recorder unit.

77. The digital television of claim 73, wherein said encoding/decoding unit is configured to generate a composite stream based upon at least two of said simultaneously processed different channels.

78. The digital television of claim 73, wherein said encoding/decoding unit is configured for decoding said first and second media streams and which television is further configured to store said decoded media streams in said personal video recorder.

79. A method for enabling a media stream for use with video transport controls, the method comprising:

a) receiving said media stream from a content source;

b) tagging frames of said media stream, each said frame being tagged according to its characteristics;

c) receiving a command for a given transport control;

d) selecting frames according to corresponding tags, said selecting being determined by the given transport control; and

e) playing said selected frames.

80. The method of claim 79, wherein said selecting comprises selecting frames sharing a common tag.

81. The method of claim 79, wherein said transport controls comprise a member of the following group:

instant replay, rewind, fast forward, and fast backward.

82. The method of claim 79, wherein said characteristics comprise a member of the following group:

frame type, frame encoding type, a frame number, a depicted object, and a feature-set.

83. The method of claim 79, further comprising a stage between a) and b) of evaluating the motion of various video objects depicted in said media stream, wherein said tagging is based on said evaluation.

84. The method of claim 83, wherein said evaluation comprises detecting at least one of the following group:

a substantial movement and a sudden scene change.