Image signal multiplexing apparatus and methods, image signal demultiplexing apparatus and methods, and transmission media

• US 6,567,427 B1
• Filed: 03/18/1999
• Issued: 05/20/2003
• Est. Priority Date: 07/18/1997
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Suzuki, Teruhiko, Yagasaki, Yoichi
• Primary Examiner(s): Jung, Min
• Application Number:
  US09/272,238
• Time in Patent Office: 1,524 Days
• Field of Search: 370/485, 370/535, 370/537, 370/542, 370/522, 345/581, 345/582, 345/419
• US Class Current: 370/535
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

In an image signal demultiplexing apparatus, a scene descriptor, object descriptors and respective bitstreams are separated by a demultiplexer circuit, and the respective bitstreams are decoded by decoders. Within output data from the decoders, output data associated with the same object descriptor (output data composing the same object) are mixed by a mixer circuit. Subsequently, the mixed output data is supplied to an object synthesizer circuit of a synthesizer circuit which is supplied with a corresponding node. Then, the object synthesizer circuit corresponds one image to one object to perform texture mapping. An image signal multiplexing apparatus multiplexes the scene descriptor, respective bitstreams, and information related to the bitstreams.

Claims

1. An image signal multiplexing apparatus comprising:

selecting means for selecting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, and for selecting bitstreams constituting said predetermined scene from among a plurality of layers of bitstreams having different qualities;

producing means for producing information related to said selected bitstreams; and

multiplexing means for multiplexing said selected scene descriptor, said selected bitstreams, and said produced information related to said selected bitstreams to output a multiplexed information.

2. An image signal multiplexing apparatus according to claim 1, wherein

said information related to said selected bitstreams includes at least one of a flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams.

3. An image signal multiplexing method comprising the steps of:

selecting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, and for selecting bitstreams constituting said predetermined scene from among a plurality of layers of bitstreams having different qualities;

producing information related to said selected bitstreams; and

multiplexing said selected scene descriptor, said selected bitstreams, and said produced information related to said selected bitstreams to output a multiplexed information.

4. An image signal multiplexing method according to claim 3, wherein

said information related to said selected bitstreams includes at least one of a flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams.

5. A transmission medium for transmitting a program for multiplexing image signals, the program comprising the steps of:

selecting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, and for selecting bitstreams constituting said predetermined scene from among a plurality of layers of bitstreams having different qualities;

producing information related to said selected bitstreams; and

multiplexing said selected scene descriptor, said selected bitstreams, and said produced information related to said selected bitstreams to output a multiplexed information.

6. An image signal multiplexing apparatus comprising:

outputting means for outputting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said bitstreams composing said predetermined scene, and information related to said bitstreams including at least dependency information representative of a dependency relationship between different bitstreams; and

multiplexing means for multiplexing said outputted scene descriptor, plurality of layers of bitstreams, and information related to said bitstreams to output a multiplexed information.

7. An image signal multiplexing apparatus according to claim 6, wherein

said information related to said bitstreams includes at least one of a flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams, and wherein said dependency information is at least one of a flag for identifying one of said bitstreams and a flag representing whether or not another bitstream is required to recover said scene.

8. An image signal multiplexing method comprising the steps of:

outputting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said bitstreams composing said predetermined scene, and information related to said bitstreams including at least dependency information representative of a dependency relationship between different bitstreams; and

multiplexing said outputted scene descriptor, plurality of layers of bitstreams, and information related to said bitstreams to output a multiplexed information.

9. An information signal multiplexing method according to claim 8, wherein

said information related to said bitstreams includes at least one of a flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams, and wherein said dependency information is at least one of a flag for identifying one of said bitstreams and a flag representing whether or not another bitstream is required to recover said scene.

10. A transmission medium for transmitting a program for multiplexing image signals, the program comprising the steps of:

outputting a scene descriptor, which is spatial configuration information for describing a predetermined scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said bitstreams composing said predetermined scene, and information related to said bitstreams including at least dependency information representative of a dependency relationship between different bitstreams; and

multiplexing said outputted scene descriptor, plurality of layers of bitstreams, and information related to said bitstreams to output a multiplexed information.

11. An image signal demultiplexing apparatus for separating a multiplexed image signal into respective signals, comprising:

separating means for separating from a multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and information related to said bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams, respectively;

analyzing means for analyzing said scene descriptor;

decoding means for decoding said plurality of layers of bitstreams;

mixing means for mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstruction means for reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.

12. An image signal demultiplexing apparatus according to claim 11, wherein

said information related to said bitstreams includes at least one flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams.

13. An image signal demultiplexing method for separating a multiplexed image signal into respective signals, comprising the steps of:

separating from a multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and information related to said bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams, respectively;

analyzing said scene descriptor;

decoding said plurality of layers of bitstreams;

mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.

14. An image signal demultiplexing method according to claim 13, wherein

said information related to said bitstreams includes at least one flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams.

15. A transmission medium for transmitting a program for separating a multiplexed image signal into respective signals, the program comprising the steps of:

separating from a multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and information related to said bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams, respectively;

analyzing said scene descriptor;

decoding said plurality of layers of bitstreams;

mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.

16. An image signal demultiplexing apparatus for separating a multiplexed image signal into respective signals, comprising:

separating means for separating from a transmitted multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and information related to said bitstreams, and dependency information indicative of a dependency relationship of information between said different bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams;

control means for controlling said separating means to select said scene descriptor and said plurality of layers of bitstreams composing said scene based on said dependency information;

analyzing means for analyzing said selected scene descriptor;

decoding means for decoding said plurality of layers of bitstreams;

mixing means for mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstruction means for reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.

17. An image signal demultiplexing apparatus according to claim 16, wherein

said information related to said bitstreams includes at least one flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams, and wherein said dependency information is at least one of a flag for identifying one of said bitstreams and a flag representing whether or not another bitstream is required to recover said scene.

18. An image signal demultiplexing method for separating a multiplexed image signal into respective signals, the method comprising the steps of:

separating from a transmitted multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and dependency information indicative of a dependency relationship of information between said different bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams;

controlling said separating means to select said scene descriptor and said plurality of layers of bitstreams composing said scene based on said dependency information;

analyzing said selected scene descriptor;

decoding said plurality of layers of bitstreams;

mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.

19. An image signal demultiplexing method according to claim 18, wherein

said information related to said bitstreams includes at least one flag indicative of said scene descriptor, a flag indicative of the number of bitstreams, and information required to decode the bitstreams, and wherein said dependency information is at least one of a flag for identifying one of said bitstreams and a flag representing whether or not another bitstream is required to recover said scene.

20. A transmission medium for transmitting a program for separating a multiplexed image signal into respective signals, the program comprising the steps of:

separating from a transmitted multiplexed bitstream having multiplexed therein a scene descriptor, which is spatial configuration information for describing a scene of two-dimensions or three-dimensions, a plurality of layers of bitstreams having different qualities, said plurality of bitstreams composing said scene, and dependency information indicative of a dependency relationship of information between said different bitstreams, said scene descriptor, said plurality of layers of bitstreams composing said scene, and said information related to said bitstreams;

controlling said separating means to select said scene descriptor and said plurality of layers of bitstreams composing said scene based on said dependency information;

analyzing said selected scene descriptor;

decoding said plurality of layers of bitstreams;

mixing output signals corresponding to said bitstreams within said decoded output signals; and

reconstructing an image signal from said analyzed scene descriptor and said mixed output signals based on said information related to said bitstreams.