Carriage systems encoding or decoding JPEG 2000 video

• US 8,599,932 B2
• Filed: 12/14/2010
• Issued: 12/03/2013
• Est. Priority Date: 12/18/2009
• Status: Active Grant

• Current Assignee: ARRIS Enterprises LLC (CommScope Holding Company, Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: Narasimhan, Mandayam A.
• Primary Examiner(s): Pe, Geepy
• Application Number:
  US12/967,748
• Publication Number:
  US 20110310981A1
• Time in Patent Office: 1,085 Days
• Field of Search: 375/240.26, 375/24.01, 348/384.1, 348/425.1, 348/432.1
• US Class Current: 375/240.26
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4343 Extraction or processing of packetized elementary streams [PES]
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8451 using Advanced Video Coding [AVC]
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A system configured to decode video data in a packetized elementary stream (PES) including frames of image data. The system includes a processor configured to receive a transport stream including control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data. The processor is also configured to receive the PES including the frames of image data in video access units. The processor is configured to retrieve and decode the retrieved video access units using the control information to form a signal including the frames of image data. The system also includes a storage device configured to store the frames of image data and the control information.

Claims

1. A system configured to encode frames of image data from an incoming signal into video data in a packetized elementary stream (PES), the system comprising:

a processor configured to

receive a signal including the frames of image data and control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data,

encode the frames of image data to form video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data,

map the video access units into PES packets using the PTS in the PES header of the respective video access units, and

order the PES packets in a monotonic order using the PTS in the PES packets to form a PES in a transport stream including the control information; and

a storage device configured to store

the frames of image data, and

the control information.

2. The encoding system of claim 1, wherein the PES is a JPEG 2000 Part 1 (J2K) video elementary stream and the video access units are J2K video access units.

3. The encoding system of claim 2, wherein the PES is a J2K video sequence consisting of J2K video access units having one or more matching image data metadata parameters in the ELSM header of the J2K video access units.

4. The encoding system of claim 1, wherein the control information is encoded in a video descriptor including video component parameters configured to enable a high level acquisition of a video component.

5. The encoding system of claim 4, wherein the video component parameters are configured to associate the video component with a program in the transport stream.

6. The encoding system of claim 1, wherein the video metadata parameters comprise a parameter identifying a profile and level associated with each video access unit.

7. The encoding system of claim 1, wherein the video metadata parameters include a parameter identifying a time code associated with each video access unit.

8. The encoding system of claim 1, wherein the video metadata parameters include a parameter identifying a frame count associated with each video access unit.

9. The encoding system of claim 1, wherein the video metadata parameters comprise a parameter identifying whether the video data is interlaced video.

10. The encoding system of claim 1, wherein the packets in the PES have an MPEG-2 Part 1 container format.

43. The encoding system of claim 1, wherein the application specific functions include a display application associated with at least one of 3DTV systems, IPTV systems, digital cinema, imaging systems, cable video distribution and internet video distribution.

47. The encoding system of claim 1, wherein the video metadata parameters comprise a parameter identifying whether the video data is formatted 3D content.

11. A method of encoding video data in a packetized elementary stream (PES) including frames of image data, the method comprising:

receiving a signal including the frames of image data and control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data;

encoding the frames of image data to form video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data;

mapping the video access units into PES packets using the PTS in the PES header of the respective video access units; and

ordering the PES packets in a monotonic order using the PTS in the PES packets to form a PES in a transport stream including the control information.

12. The encoding method of claim 11, wherein the PES is a JPEG 2000 Part 1 (J2K) video elementary stream consisting of J2K video access units.

13. The encoding method of claim 12, wherein the PES is a J2K video sequence consisting of J2K video access units having one or more matching image data metadata parameters in the ELSM header of the J2K video access units.

14. The encoding method of claim 11, wherein the control information is encoded in a video descriptor including video component parameters configured to enable a high level acquisition of a video component.

15. The encoding method of claim 14, wherein the video component parameters are configured to associate the video component with a program in the transport stream.

16. The encoding method of claim 11, wherein the video metadata parameters include a parameter identifying a profile and level associated with each access unit.

17. The encoding method of claim 11, wherein the video metadata parameters include a parameter identifying a time code associated with each video access unit.

18. The encoding method of claim 11, wherein the video metadata parameters include a parameter identifying a frame count associated with each video access unit.

19. The encoding method of claim 11, wherein the video metadata parameters include a parameter identifying whether the video data is interlaced video.

20. The encoding method of claim 11, wherein the packets in the PES have an MPEG-2 Part 1 container format.

44. The encoding method of claim 11, wherein the application specific functions include a display application associated with at least one of 3DTV systems, IPTV systems, digital cinema, imaging systems, cable video distribution and internet video distribution.

48. The encoding method of claim 11, wherein the video metadata parameters comprise a parameter identifying whether the video data is formatted 3D content.

21. A non-transitory computer readable medium storing computer readable instructions that when executed by a computer system perform a method of encoding video data in a packetized elementary stream (PES) from frames of image data, the method comprising:

receiving a signal including the frames of image data and control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data;

encoding the frames of image data to form video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data;

mapping the video access units into PES packets using the PTS in the PES header of the respective video access units; and

ordering the PES packets in a monotonic order using the PTS in the PES packets to form a PES in a transport stream including the control information.

22. A system configured to decode video data in a packetized elementary stream (PES) including frames of image data, the system comprising:

a processor configured to receive

a transport stream including control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data and

the PES, wherein the PES includes the frames of image data in video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data,

retrieve each video access unit present according to a monotonic order determined from the PTS in the PES header of the video access unit, and

decode the retrieved video access unit using the control information to form a signal including the frames of image data; and

a storage device configured to store

the frames of image data, and

the control information.

23. The decoding system of claim 22, wherein the PES is a JPEG 2000 Part 1 (J2K) video elementary stream consisting of J2K video access units.

24. The decoding system of claim 23, wherein the PES is a J2K video sequence consisting of J2K video access units having one or more matching image data metadata parameters in the ELSM header of the J2K video access units.

25. The decoding system of claim 22, wherein the control information is encoded in a video descriptor including video component parameters configured to enable a high level acquisition of a video component.

26. The decoding system of claim 25, wherein the video component parameters are configured to associate the video component with a program in the transport stream.

27. The decoding system of claim 22, wherein the video metadata parameters include a parameter identifying a profile and level associated with each video access unit.

28. The decoding system of claim 22, wherein the video metadata parameters include a parameter identifying a time code associated with each video access unit.

29. The decoding system of claim 22, wherein the video metadata parameters include a parameter identifying a frame count associated with each video access unit.

30. The decoding system of claim 22, wherein the video metadata parameters include a parameter identifying whether the video data is interlaced video.

31. The decoding system of claim 22, wherein the packets in the PES have an MPEG-2 Part 1 container format.

45. The decoding system of claim 22, wherein the application specific functions include a display application associated with at least one of 3DTV systems, IPTV systems, digital cinema, imaging systems, cable video distribution and internet video distribution.

49. The decoding system of claim 22, wherein the video metadata parameters comprise a parameter identifying whether the video data is formatted 3D content.

32. A method of decoding video data in a packetized elementary stream (PES) including frames of image data, the method comprising:

receiving a transport stream including

control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data and

the PES, wherein the PES includes the frames of image data in video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data;

retrieving each video access unit present in a monotonic order associated with the PTS in the PES header of the video access unit; and

decoding the retrieved video access unit using the control information to form a signal including the frames of image data.

33. The decoding method of claim 32, wherein the PES is a JPEG 2000 Part 1 (J2K) video elementary stream consisting of J2K video access units.

34. The decoding method of claim 33, wherein the PES is a J2K video sequence consisting of J2K video access units having one or more matching image data metadata parameters in the ELSM header of the J2K video access units.

35. The decoding method of claim 32, wherein the control information is encoded in a video descriptor including video component parameters configured to enable a high level acquisition of a video component.

36. The decoding method of claim 35, wherein the video component parameters are configured to associate the video component with a program in the transport stream.

37. The decoding method of claim 32, wherein the video metadata parameters include a parameter identifying a profile and level associated with each video access unit.

38. The decoding method of claim 32, wherein the video metadata parameters include a parameter identifying a time code associated with each video access unit.

39. The decoding method of claim 32, wherein the video metadata parameters include a parameter identifying a frame count associated with each video access unit.

40. The decoding method of claim 32, wherein the video metadata parameters include a parameter identifying whether the video data is interlaced video.

41. The decoding method of claim 32, wherein the packets in the PES have an MPEG-2 Part 1 container format.

46. The decoding method of claim 32, wherein the application specific functions include a display application associated with at least one of 3DTV systems, IPTV systems, digital cinema, imaging systems, cable video distribution and internet video distribution.

50. The decoding method of claim 32, wherein the video metadata parameters comprise a parameter identifying whether the video data is formatted 3D content.

42. A non-transitory computer readable medium storing computer readable instructions that when executed by a computer system perform a method of decoding video data in a packetized elementary stream (PES) including frames of image data, the method comprising:

receiving a transport stream including

control information associated with the image data including video metadata parameters associated with application specific functions applicable to the image data and

the PES, wherein the PES includes the frames of image data in video access units, each video access unit including

an elementary stream (ELSM) header including image data metadata parameters associated with decoding and displaying the image data,

a PES header including timing reference information including a presentation time stamp (PTS), and

one or more codestreams associated with a frame of the image data;

retrieving each video access unit present in a monotonic order associated with the PTS in the PES header of the video access unit; and

decoding the retrieved video access unit using the control information to form a signal including the frames of image data.