Information processing method and apparatus

• US 20010028725A1
• Filed: 12/29/2000
• Published: 10/11/2001
• Est. Priority Date: 01/05/2000
• Status: Active Grant

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Maeda, Mitsuru, Nakagawa, Toshiyuki, Ohira, Tadashi
• Granted Patent: US 6,810,131 B2
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0064 for copy protection or copy management, e.g. CGMS, copy only once, one-time copy
• CPC Class Codes: Y10S 283/902 Anti-photocopy

Abstract

In an image encoding apparatus for receiving and encoding an image signal, the input image signal is encoded in units of blocks in accordance with an encoding parameter via a DCT device, quantizer, and variable-length encoder. The encoded codes are multiplexed together with information indicating the presence/absence of scrambling, authentication data, a quantization parameter used in the quantizer, and a quantization parameter obtained by converting this quantization parameter. A copyrighted image signal is scrambled upon encoding, an image decoding apparatus of an authentic viewer normally plays back, and an image decoding apparatus of an unauthentic viewer plays back an image with which the viewer can recognize its outline.

Claims

1. An image processing apparatus for receiving and encoding an image signal, comprising:

encoding means for encoding an input image signal in units of blocks in accordance with an encoding parameter, and outputting encoded codes;

conversion means for converting the encoding parameter in accordance with scramble information indicating the presence/absence of scrambling;

authentication data input means for inputting authentication data; and

multiplexing means for multiplexing and outputting at least the encoded codes output from said encoding means, the encoding parameter converted by said conversion means, the scramble information, and the authentication data.

2. The apparatus according to

claim 1

, wherein said block encoding means comprises:

DCT means for computing discrete cosine transforms of the input image signal;

quantization means for quantizing DCT coefficients obtained by said DCT means in accordance with the encoding parameter; and

encoding means for encoding quantization results of said quantization means by variable-length coding.

3. The apparatus according to

claim 1

, wherein the scramble information indicates the presence/absence of scrambling in units of blocks.

4. The apparatus according to

claim 1

, wherein said conversion means comprises:

acquisition means for receiving the encoding parameter and acquiring a converted encoding parameter; and

selection means for selecting one of the encoding parameter and the converted encoding parameter in accordance with the scramble information.

5. The apparatus according to

claim 4

, wherein said acquisition means has a table for receiving the encoding parameter and outputting the converted encoding parameter.

6. The apparatus according to

claim 2

, wherein the encoding parameter is a quantization matrix, and

said conversion means changes values of the quantization matrix.

7. The apparatus according to

claim 6

, wherein said conversion means inverts bits of quantization coefficient values corresponding to DCT coefficients of not less than a predetermined spatial frequency.

8. The apparatus according to

claim 1

, wherein said encoding means executes inter-frame predictive coding.

9. An image processing apparatus for receiving and decoding an encoded image signal, comprising:

authentication data input means for inputting authentication data;

discrimination means for discriminating if the authentication data input by said authentication data input means matches authentication data input together with the image signal;

parameter conversion means for converting an encoding parameter input together with the image signal on the basis of scramble information indicating the presence/absence of scrambling, which is input together with the image signal, and a discrimination result of said discrimination means; and

decoding means for decoding the encoded image signal in units of blocks in accordance with the encoding parameter output from said parameter conversion means.

10. The apparatus according to

claim 9

, wherein said parameter conversion means outputs the encoding parameter input together with the image signal without any conversion to said decoding means when the scramble information indicates the presence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match.

11. The apparatus according to

claim 9

, wherein said decoding means comprises:

variable-length decoding means for decoding the encoded image signal by variable-length decoding;

dequantization means for dequantizing data decoded by said variable-length decoding means in accordance with the encoding parameter output from said parameter conversion means; and

inverse DCT means for computing an inverse DCT of the dequantization result of said dequantization means.

12. The apparatus according to

claim 9

, further comprising:

image selection means for selecting and outputting one of a playback image of said decoding means and a specific image, and

wherein the specific image is selected when the scramble information indicates the absence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match.

13. An image processing apparatus for receiving and decoding an image signal that has undergone inter-frame predictive coding, comprising:

authentication data input means for inputting authentication data;

discrimination means for discriminating if the authentication data input by said authentication data input means matches authentication data input together with the image signal;

parameter conversion means for converting an encoding parameter input together with the image signal on the basis of scramble information indicating the presence/absence of scrambling, which is input together with the image signal;

first decoding means for decoding the image signal, that has undergone inter-frame predictive coding, in units of blocks in accordance with the encoding parameter output from said parameter conversion means;

second decoding means for decoding the image signal, that has undergone inter-frame predictive coding, using the encoding parameter input together with the image signal and inter-frame prediction information obtained from said first decoding means; and

output means for selecting and outputting one of playback images of said first and second decoding means on the basis of a discrimination result of said discrimination means.

14. The apparatus according to

claim 13

, wherein said output means

selects and outputs the playback image of said first decoding means when the scramble information indicates the presence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data match,

selects and outputs the playback image of said second decoding means when the scramble information indicates the presence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match,

selects and outputs the playback image of either said first or second decoding means when the scramble information indicates the absence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data match, and

outputs a specific image when the scramble information indicates the absence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match.

15. An image processing apparatus for receiving and encoding an image signal, comprising:

encoding means for encoding an input image signal in units of blocks in accordance with an encoding parameter;

conversion means for converting sign information of codes encoded by said encoding means in accordance with scramble information indicating the presence/absence of scrambling;

authentication data input means for inputting authentication data; and

multiplexing means for multiplexing and outputting at least the codes encoded by said encoding means, the scramble information, and the authentication data, the sign information of the codes being output from said conversion means.

16. The apparatus according to

claim 15

, wherein the scramble information indicates the presence/absence of scrambling in units of blocks.

17. The apparatus according to

claim 15

, wherein said block encoding means comprises:

DCT means for computing a discrete cosine transform of the input image signal;

quantization means for quantizing a DCT coefficient obtained by said DCT means in accordance with the encoding parameter; and

encoding means for encoding a quantization result of said quantization means by variable-length coding.

18. The apparatus according to

claim 15

, wherein said conversion means inverts sign bits of the codes output from said encoding means.

19. The apparatus according to

claim 15

, wherein said conversion means inverts sign bits of codes corresponding to a component of not less than a predetermined frequency of codes output from said encoding means.

20. The apparatus according to

claim 15

, wherein said encoding means executes inter-frame predictive coding.

22. The apparatus according to

claim 20

, wherein said decoding means comprises:

variable-length decoding means for decoding the encoded image signal by variable-length decoding;

dequantization means for dequantizing data decoded by said variable-length decoding means; and

inverse DCT means for computing an inverse DCT of the dequantization result of said dequantization means.

21. An image processing apparatus for receiving and decoding an encoded image signal, comprising:

authentication data input means for inputting authentication data;

discrimination means for discriminating if the authentication data input by said authentication data input means matches authentication data input together with the image signal;

conversion means for converting a sign of the encoded image signal on the basis of scramble information indicating the presence/absence of scrambling, which is input together with the image signal, and a discrimination result of said discrimination means; and

decoding means for decoding the image signal containing sign information converted by said conversion means.

23. An image processing apparatus for receiving and decoding an image signal that has undergone inter-frame predictive coding, comprising:

authentication data input means for inputting authentication data;

discrimination means for discriminating if the authentication data input by said authentication data input means matches authentication data input together with the image signal;

conversion means for converting sign information contained in the encoded image signal on the basis of scramble information indicating the presence/absence of scrambling, which is input together with the image signal;

first decoding means for decoding the image signal containing the sign information obtained by converting by said conversion means the image signal that has undergone inter-frame predictive coding;

second decoding means for decoding the input image signal, that has undergone inter-frame predictive coding, using inter-frame prediction information obtained from said first decoding means; and

output means for selecting and outputting one of playback images of said first and second decoding means on the basis of a discrimination result of said discrimination means.

24. The apparatus according to

claim 23

, wherein said output means

selects and outputs the playback image of said first decoding means when the scramble information indicates the presence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data match,

selects and outputs the playback image of said second decoding means when the scramble information indicates the presence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match,

selects and outputs the playback image of either said first or second decoding means when the scramble information indicates the absence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data match, and

outputs a specific image when the scramble information indicates the absence of scrambling, and the discrimination result of said discrimination means indicates that the two authentication data do not match.

25. An image encoding apparatus comprising:

separation means for separating input image data into a plurality of layers;

block encoding means for encoding in units of blocks image data of respective layers separated by said separation means;

scramble means for scrambling blocks encoded by said block encoding means in one or a plurality of layers;

copyright data input means for inputting copyright data;

copyright data encoding means for encoding the copyright data; and

multiplexing means for multiplexing and outputting codes encoded by said block encoding means, the copyright data encoded by said copyright data encoding means, and codes of the blocks scrambled by said scramble means.

26. The apparatus according to

claim 25

, wherein said separation means down-samples the input image data in two-dimensional spatial directions.

27. The apparatus according to

claim 25

, wherein said separation means assigns frames of the input image data in units of layers.

28. The apparatus according to

claim 25

, wherein said scramble means replaces a bitstream encoded by said block encoding means by another code having an identical code length.

29. The apparatus according to

claim 25

, wherein said block encoding means comprises:

orthogonal transformation means for computing orthogonal transforms of blocks;

quantization means for quantizing coefficients transformed by said orthogonal transformation means; and

variable-length encoding means for encoding quantization results of said quantization means by variable-length coding.

30. The apparatus according to

claim 25

, wherein said multiplexing means further multiplexes information indicating whether or not blocks scrambled by said scramble means are contained.

31. An image decoding apparatus comprising:

demultiplexing means for receiving an encoded bitstream, and demultiplexing the bitstream into a copyright code and one or a plurality of layers;

copyright code decoding means for decoding the copyright code demultiplexed by said demultiplexing means;

authentication data input means for receiving external authentication data;

authentication means for checking if the authentication data matches a decoding result of said copyright code decoding means;

descramble means for descrambling one or a plurality of layers on the basis of an authentication result of said authentication means;

decoding means for decoding the output from said demultiplexing means or the output from said descramble means; and

image output means for outputting an image decoded by said decoding means.

32. The apparatus according to

claim 31

, wherein said image output means assigns and outputs frames of an image in units of layers in a playback order.

33. The apparatus according to

claim 31

, wherein said image output means selects and outputs images from layers selected in units of frames.

34. The apparatus according to

claim 31

, wherein said descramble means replaces the bitstream by another code having an identical code length.

35. The apparatus according to

claim 31

, wherein said decoding means comprises:

input means for inputting a bitstream descrambled by said descramble means;

variable-length decoding means for decoding encoded codes in units of blocks by variable-length decoding;

dequantization means for dequantizing the decoding results of said variable-length decoding means; and

inverse orthogonal transformation means for computing inverse orthogonal transforms of dequantization results of said dequantization means.

36. A data processing apparatus for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, and reconstructing, compositing, and outputting the object streams, comprising:

discrimination means for discriminating if playback of the plurality of object streams is permitted;

determination means for determining playback quality of a predetermined object stream on the basis of a discrimination result of said discrimination means; and

playback control means for playing back the predetermined object stream with the playback quality determined by said determination means upon playing back the plurality of object streams.

37. The apparatus according to

claim 36

, wherein information in the predetermined object stream has undergone high-efficiency coding.

38. The apparatus according to

claim 37

, wherein said playback control means controls the playback quality of the predetermined object stream by processing decoded data of the information that has undergone high-efficiency coding.

39. The apparatus according to

claim 36

, wherein said playback control means controls the playback quality of the predetermined object stream in accordance with an intellectual property management stream included in the plurality of object streams.

40. The apparatus according to

claim 39

, wherein said determination means determines a control method of said playback control means that pertains to the playback quality on the basis of a type of the intellectual property management stream.

41. The apparatus according to

claim 39

, wherein said determination means determines a control method of said playback control means, that pertains to the playback quality, on the basis of a type of the intellectual property management stream when said discrimination means discriminates that playback is not permitted.

42. The apparatus according to

claim 36

, wherein the plurality of object streams are MPEG-4 bitstreams.

43. The apparatus according to

claim 36

, wherein said control means controls the playback quality of the predetermined object stream by managing multi-thread processes in units of streams.

44. A data processing apparatus for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, scene description information used to composite information contained in the plurality of object streams, and a management stream having management information used to manage a copyright of the information, reconstructing the information, and compositing and outputting playback data on the basis of the scene description information, comprising:

discrimination means for discriminating if playback of the plurality of object streams is permitted;

determination means for determining playback quality of a predetermined object stream on the basis of a discrimination result of said discrimination means; and

playback control means for playing back the predetermined object stream with the playback quality determined by said determination means upon playing back the plurality of object streams.

45. An image processing method for receiving and encoding an image signal, comprising:

the encoding step of encoding an input image signal in units of blocks in accordance with an encoding parameter, and outputting encoded codes;

the conversion step of converting the encoding parameter in accordance with scramble information indicating the presence/absence of scrambling;

the authentication data input step of inputting authentication data; and

the multiplexing step of multiplexing and outputting at least the encoded codes output from the encoding step, the encoding parameter converted in the conversion step, the scramble information, and the authentication data.

46. The method according to

claim 45

, wherein the block encoding step comprises:

the DCT step of computing discrete cosine transforms of the input image signal;

the quantization step of quantizing DCT coefficients obtained in the DCT step in accordance with the encoding parameter; and

the encoding step of encoding quantization results of the quantization step by variable-length coding.

47. The method according to

claim 45

, wherein the scramble information indicates the presence/absence of scrambling in units of blocks.

48. The method according to

claim 45

, wherein the conversion step comprises:

the acquisition step of receiving the encoding parameter and acquiring a converted encoding parameter; and

the selection step of selecting one of the encoding parameter and the converted encoding parameter in accordance with the scramble information.

49. The method according to

claim 48

, wherein the acquisition step has a table for receiving the encoding parameter and outputting the converted encoding parameter.

50. The method according to

claim 46

, wherein the encoding parameter is a quantization matrix, and

the conversion step includes the step of changing values of the quantization matrix.

51. The method according to

claim 50

, wherein the conversion step includes the step of inverting bits of quantization coefficient values corresponding to DCT coefficients of not less than a predetermined spatial frequency.

52. The method according to

claim 45

, wherein the encoding step includes the step of executing inter-frame predictive coding.

53. An image processing method for receiving and decoding an encoded image signal, comprising:

the authentication data input step of inputting authentication data;

the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

the parameter conversion step of converting an encoding parameter, input together with the image signal, on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal, and a discrimination result of the discrimination step; and

the decoding step of decoding the encoded image signal in units of blocks in accordance with the encoding parameter output from the parameter conversion step.

54. The method according to

claim 53

, wherein the parameter conversion step includes the step of outputting the encoding parameter input together with the image signal without any conversion to the decoding step when the scramble information indicates the presence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match.

55. The method according to

claim 53

, wherein the decoding step comprises:

the variable-length decoding step of decoding the encoded image signal by variable-length decoding;

the dequantization step of dequantizing data, decoded in the variable-length decoding step, in accordance with the encoding parameter output from the parameter conversion step; and

the inverse DCT step of computing an inverse DCT of the dequantization result of the dequantization step.

56. The method according to

claim 53

, further comprising:

the image selection step of selecting and outputting one of a playback image of the decoding step and a specific image, and

wherein the specific image is selected when the scramble information indicates the absence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match.

57. An image processing method for receiving and decoding an image signal that has undergone inter-frame predictive coding, comprising:

the authentication data input step of inputting authentication data;

the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

the parameter conversion step of converting an encoding parameter, input together with the image signal, on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal;

the first decoding step of decoding the image signal, that has undergone inter-frame predictive coding, in units of blocks in accordance with the encoding parameter output from the parameter conversion step;

the second decoding step of decoding the image signal, that has undergone inter-frame predictive coding, using the encoding parameter input together with the image signal and inter-frame prediction information obtained from the first decoding step; and

the output step of selecting and outputting one of playback images of the first and second decoding steps on the basis of a discrimination result of the discrimination step.

58. The method according to

claim 57

, wherein the output step includes the steps of:

selecting and outputting the playback image of said first decoding step when the scramble information indicates the presence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data match;

selecting and outputting the playback image of said second decoding step when the scramble information indicates the presence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match;

selecting and outputting the playback image of either said first or second decoding step when the scramble information indicates the absence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data match; and

outputting a specific image when the scramble information indicates the absence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match.

59. An image processing method for receiving and encoding an image signal, comprising:

the encoding step of encoding an input image signal in units of blocks in accordance with an encoding parameter;

the conversion step of converting sign information of codes encoded in the encoding step in accordance with scramble information indicating the presence/absence of scrambling;

the authentication data input step of inputting authentication data; and

the multiplexing step of multiplexing and outputting at least the codes encoded in the encoding step, the scramble information, and the authentication data, the sign information of the codes being output from the conversion step.

60. The method according to

claim 59

, wherein the scramble information indicates the presence/absence of scrambling in units of blocks.

61. The method according to

claim 59

, wherein the block encoding step comprises:

the DCT step of computing a discrete cosine transform of the input image signal;

the quantization step of quantizing a DCT coefficient obtained in the DCT step in accordance with the encoding parameter; and

the encoding step of encoding a quantization result of the quantization step by variable-length coding.

62. The method according to

claim 59

, wherein the conversion step includes the step of inverting sign bits of the codes output from the encoding step.

63. The method according to

claim 59

, wherein the conversion step includes the step of inverting sign bits of codes corresponding to a component of not less than a predetermined frequency of codes output from the encoding step.

64. The method according to

claim 59

, wherein the encoding step includes the step of executing inter-frame predictive coding.

65. An image processing method for receiving and decoding an encoded image signal, comprising:

the authentication data input step of inputting authentication data;

the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

the conversion step of converting a sign of the encoded image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal, and a discrimination result of the discrimination step; and

the decoding step of decoding the image signal containing sign information converted in the conversion step.

66. The method according to

claim 65

, wherein the decoding step comprises:

the variable-length decoding step of decoding the encoded image signal by variable-length decoding;

the dequantization step of dequantizing data decoded in the variable-length decoding step; and

the inverse DCT step of computing an inverse DCT of the dequantization result of the dequantization step.

67. An image processing method for receiving and decoding an image signal that has undergone inter-frame predictive coding, comprising:

the authentication data input step of inputting authentication data;

the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

the conversion step of converting sign information contained in the encoded image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal;

the first decoding step of decoding the image signal containing the sign information obtained by converting in the conversion step the image signal that has undergone inter-frame predictive coding;

the second decoding step of decoding the input image signal, that has undergone inter-frame predictive coding, using inter-frame prediction information obtained from the first decoding step; and

the output step of selecting and outputting one of playback images of the first and second decoding steps on the basis of a discrimination result of the discrimination step.

68. The method according to

claim 67

, wherein said output step includes the steps of:

selecting and outputting the playback image of said first decoding step when the scramble information indicates the presence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data match;

selecting and outputting the playback image of said second decoding step when the scramble information indicates the presence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match;

selecting and outputting the playback image of either said first or second decoding step when the scramble information indicates the absence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data match; and

outputting a specific image when the scramble information indicates the absence of scrambling, and the discrimination result of the discrimination step indicates that the two authentication data do not match.

69. An image encoding method comprising:

the separation step of separating input image data into a plurality of layers;

the block encoding step of encoding in units of blocks image data of respective layers separated in the separation step;

the scramble step of scrambling blocks encoded in the block encoding step in one or a plurality of layers;

the copyright data input step of inputting copyright data;

the copyright data encoding step of encoding the copyright data; and

the multiplexing step of multiplexing and outputting codes encoded in the block encoding step, the copyright data encoded in the copyright data encoding step, and codes of the blocks scrambled in the scramble step.

70. The method according to

claim 69

, wherein the separation step includes the step of down-sampling the input image data in two-dimensional spatial directions.

71. The method according to

claim 69

, wherein the separation step includes the step of assigning frames of the input image data in units of layers.

72. The method according to

claim 69

, wherein the scramble step includes the step of replacing a bitstream encoded in the block encoding step by another code having an identical code length.

73. The method according to

claim 69

, wherein the block encoding step comprises:

the orthogonal transformation step of computing orthogonal transforms of blocks;

the quantization step of quantizing coefficients transformed in the orthogonal transformation step; and

the variable-length encoding step of encoding quantization results of the quantization step by variable-length coding.

74. The method according to

claim 69

, wherein the multiplexing step includes the step of further multiplexing information indicating whether or not blocks scrambled in the scramble step are contained.

75. An image decoding method comprising:

the demultiplexing step of receiving an encoded bitstream, and demultiplexing the bitstream into a copyright code and one or a plurality of layers;

the copyright code decoding step of decoding the copyright code demultiplexed in the demultiplexing step;

the authentication data input step of receiving external authentication data;

the authentication step of checking if the authentication data matches a decoding result of the copyright code decoding step;

the descramble step of descrambling one or a plurality of layers on the basis of an authentication result of the authentication step;

the decoding step of decoding the output from the demultiplexing step or the output from the descramble step; and

the image output step of outputting an image decoded in the decoding step.

76. The method according to

claim 75

, wherein the image output step includes the step of assigning and outputting frames of an image in units of layers in a playback order.

77. The method according to

claim 75

, wherein the image output step includes the step of selecting and outputting images from layers selected in units of frames.

78. The method according to

claim 75

, wherein the descramble step includes the step of replacing the bitstream by another code having an identical code length.

79. The method according to

claim 75

, wherein the decoding step comprises:

the input step of inputting a bitstream descrambled in the descramble step;

the variable-length decoding step of decoding encoded codes in units of blocks by variable-length decoding;

the dequantization step of dequantizing the decoding results of the variable-length decoding step; and

the inverse orthogonal transformation step of computing inverse orthogonal transforms of dequantization results of the dequantization step.

80. A data processing method for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, and reconstructing, compositing, and outputting the object streams, comprising:

the discrimination step of discriminating if playback of the plurality of object streams is permitted;

the determination step of determining playback quality of a predetermined object stream on the basis of a discrimination result of the discrimination step; and

the playback control step of playing back the predetermined object stream with the playback quality determined in the determination step upon playing back the plurality of object streams.

81. The method according to

claim 80

, wherein information in the predetermined object stream has undergone high-efficiency coding.

82. The method according to

claim 81

, wherein the playback control step includes the step of controlling the playback quality of the predetermined object stream by processing decoded data of the information that has undergone high-efficiency coding.

83. The method according to

claim 80

, wherein the playback control step includes the step of controlling the playback quality of the predetermined object stream in accordance with an intellectual property management stream included in the plurality of object streams.

84. The method according to

claim 83

, wherein the determination step determines a control method of the playback control step, that pertains to the playback quality, on the basis of a type of the intellectual property management stream.

85. The method according to

claim 83

, wherein the determination step determines a control method of the playback control step, that pertains to the playback quality, on the basis of a type of the intellectual property management stream when it is discriminated in the discrimination step that playback is not permitted.

86. The method according to

claim 80

, wherein the plurality of object streams are MPEG-4 bitstreams.

87. The method according to

claim 80

, wherein the control step includes the step of controlling the playback quality of the predetermined object stream by managing multi-thread processes in units of streams.

88. A data processing method for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, scene description information used to composite information contained in the plurality of object streams, and a management stream having management information used to manage a copyright of the information, reconstructing the information, and compositing and outputting playback data on the basis of the scene description information, comprising:

the discrimination step of discriminating if playback of the plurality of object streams is permitted;

the determination step of determining playback quality of a predetermined object stream on the basis of a discrimination result of the discrimination step; and

the playback control step of playing back the predetermined object stream with the playback quality determined in the determination step upon playing back the plurality of object streams.

89. A computer readable memory that stores a control program for making a computer encode an image signal, said control program comprising:

a code of the encoding step of encoding an input image signal in units of blocks in accordance with an encoding parameter, and outputting encoded codes;

a code of the conversion step of converting the encoding parameter in accordance with scramble information indicating the presence/absence of scrambling;

a code of the authentication data input step of inputting authentication data; and

a code of the multiplexing step of multiplexing and outputting at least the encoded codes output from the encoding step, the encoding parameter converted in the conversion step, the scramble information, and the authentication data.

90. A computer readable memory that stores a control program for making a computer decode an image signal, said control program comprising:

a code of the authentication data input step of inputting authentication data;

a code of the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

a code of the parameter conversion step of converting an encoding parameter input together with the image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal, and a discrimination result of the discrimination step; and

a code of the decoding step of decoding the encoded image signal in units of blocks in accordance with the encoding parameter output from the parameter conversion step.

91. A computer readable memory that stores a control program for making a computer decode an image signal that has undergone inter-frame coding, said control program comprising:

a code of the authentication data input step of inputting authentication data;

a code of the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

a code of the parameter conversion step of converting an encoding parameter input together with the image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal;

a code of the first decoding step of decoding the image signal, that has undergone inter-frame predictive coding, in units of blocks in accordance with the encoding parameter output from the parameter conversion step;

a code of the second decoding step of decoding the image signal, that has undergone inter-frame predictive coding, using the encoding parameter input together with the image signal and inter-frame prediction information obtained from the first decoding step; and

a code of the output step of selecting and outputting one of playback images of the first and second decoding steps on the basis of a discrimination result of the discrimination step.

92. A computer readable memory that stores a control program for making a computer encode an image signal, said control program comprising:

a code of the encoding step of encoding an input image signal in units of blocks in accordance with an encoding parameter;

a code of the conversion step of converting sign information of codes encoded in the encoding step in accordance with scramble information indicating the presence/absence of scrambling;

a code of the authentication data input step of inputting authentication data; and

a code of the multiplexing step of multiplexing and outputting at least the codes encoded in the encoding step, the scramble information, and the authentication data, the sign information of the codes being output from the conversion step.

93. A computer readable memory that stores a control program for making a computer decode an image signal, said control program comprising:

a code of the authentication data input step of inputting authentication data;

a code of the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

a code of the conversion step of converting a sign of the encoded image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal, and a discrimination result of the discrimination step; and

a code of the decoding step of decoding the image signal containing sign information converted in the conversion step.

94. A computer readable memory that stores a control program for making a computer decode an image signal that has undergone inter-frame predictive coding, said control program comprising:

a code of the authentication data input step of inputting authentication data;

a code of the discrimination step of discriminating if the authentication data input in the authentication data input step matches authentication data input together with the image signal;

a code of the conversion step of converting sign information contained in the encoded image signal on the basis of scramble information which indicates the presence/absence of scrambling and is input together with the image signal;

a code of the first decoding step of decoding the image signal containing the sign information obtained by converting in the conversion step the image signal that has undergone inter-frame predictive coding;

a code of the second decoding step of decoding the input image signal, that has undergone inter-frame predictive coding, using inter-frame prediction information obtained from the first decoding step; and

a code of the output step of selecting and outputting one of playback images of the first and second decoding steps on the basis of a discrimination result of the discrimination step.

95. A computer readable memory that stores a control program for making a computer encode an image signal, said control program comprising:

a code of the separation step of separating input image data into a plurality of layers;

a code of the block encoding step of encoding image data of respective layers separated in the separation step in units of blocks;

a code of the scramble step of scrambling blocks encoded in the block encoding step in one or a plurality of layers;

a code of the copyright data input step of inputting copyright data;

a code of the copyright data encoding step of encoding the copyright data; and

a code of the multiplexing step of multiplexing and outputting codes encoded in the block encoding step, the copyright data encoded in the copyright data encoding step, and codes of the blocks scrambled in the scramble step.

96. A computer readable memory that stores a control program for making a computer decode an image signal, said control program comprising:

a code of the demultiplexing step of receiving an encoded bitstream, and demultiplexing the bitstream into a copyright code and one or a plurality of layers;

a code of the copyright code decoding step of decoding the copyright code demultiplexed in the demultiplexing step;

a code of the authentication data input step of receiving external authentication data;

a code of the authentication step of checking if the authentication data matches a decoding result of the copyright code decoding step;

a code of the descramble step of descrambling one or a plurality of layers on the basis of an authentication result of the authentication step;

a code of the decoding step of decoding the output from the demultiplexing step or the output from the descramble step; and

a code of the image output step of outputting an image decoded in the decoding step.

97. A computer readable memory that stores a control program for making a computer execute a data process for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, and reconstructing, compositing, and outputting the object streams, said control program comprising:

a code of the discrimination step of discriminating if playback of the plurality of object streams is permitted;

a code of the determination step of determining playback quality of a predetermined object stream on the basis of a discrimination result of the discrimination step; and

a code of the playback control step of playing back the predetermined object stream with the playback quality determined in the determination step upon playing back the plurality of object streams.

98. A computer readable memory that stores a control program for making a computer execute a data process for demultiplexing object streams from a data stream which contains a plurality of object streams each having predetermined information, scene description information used to composite information contained in the plurality of object streams, and a management stream having management information used to manage a copyright of the information, reconstructing the information, and compositing and outputting playback data on the basis of the scene description information, said control program comprising:

a code of the discrimination step of discriminating if playback of the plurality of object streams is permitted;

a code of the determination step of determining playback quality of a predetermined object stream on the basis of a discrimination result of the discrimination step; and

a code of the playback control step of playing back the predetermined object stream with the playback quality determined in the determination step upon playing back the plurality of object streams.