GRAPHIC IMAGE PROCESSING METHOD AND APPARATUS

• US 20110298797A1
• Filed: 08/16/2011
• Published: 12/08/2011
• Est. Priority Date: 02/17/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jung, Kil-Soo, Park, Sung-Wook, Lee, Dae-Jong, Jun, Hye-Young
• Granted Patent: US 8,497,858 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

Provided are a method and apparatus for processing a graphic stream. The method may include determining whether a graphic picture is reproducible as a three-dimensional (3D) image by assigning different depth values according to graphic objects or by assigning the same depth value to the graphic picture, using 3D capability information.

Claims

1. A method of processing a graphic stream, the method comprising:

generating graphic objects by decoding the graphic stream;

generating two-dimensional (2D) composition information and color information by decoding the graphic stream;

generating three-dimensional (3D) composition information from the 2D composition information using metadata about the graphic stream; and

outputting the graphic objects to a screen using the 3D composition information to and the color information.

2. The method of claim 1, further comprising:

extracting 3D capability information from a player setting register in a reproducing apparatus; and

determining whether a graphic picture is reproducible in 3D by assigning different depth values according to the graphic objects or by assigning a same depth value to the graphic picture, using the 3D capability information,

wherein the generating of the 3D composition information comprises;

in response to determining that the graphic picture is reproducible in 3D by assigning the different depths values according to the graphic objects using the 3D capability information, obtaining a location movement value according to the graphic objects using the metadata;

converting an object location value included in the 2D composition information to a value that is spaced apart from the object location value to the left and/or the right by a predetermined distance, using the location movement value; and

generating left eye composition information for generating a left eye graphic picture and right eye composition information for generating a right eye graphic picture, each comprising the converted object location value.

3. The method of claim 2, wherein the obtaining of the location movement value comprises:

extracting an object depth value to be applied to each of the graphic objects from the metadata; and

obtaining a location movement value of each of the graphic objects using the object depth value.

4. The method of claim 2, wherein the generating of the 3D composition information comprises generating the 3D composition information by adding hole compensation information that is included in the metadata to each of the left eye composition information and the right eye composition information.

5. The method of claim 4, wherein the hole compensation information comprises hole region identification information and color reference information.

6. The method of claim 5, wherein the outputting of the graphic objects comprises generating each of the left eye graphic picture and the right eye graphic picture by arranging each of the graphic objects in a changed location and applying a color indicated by the color reference information to a hole region, using the 3D is composition information.

7. The method of claim 4, wherein the hole compensation information comprises at least one of hole region identification information and a hole graphic object to be inserted into a hole region.

8. The method of claim 7, wherein the outputting of the graphic objects comprises generating each of the left eye graphic picture and the right eye graphic picture by arranging each of the graphic objects in a changed location and arranging the hole graphic object in the hole region, using the 3D composition information.

9. The method of claim 1, wherein the generating of the 3D composition information comprises extracting, from the metadata, graphic picture generating standard information that indicates which video image from among a left eye video image, a right eye video image, and a 2D video image, is used to prepare the graphic stream.

10. The method of claim 9, wherein, in response to the graphic stream being prepared based on the left eye video image, the generating of the 3D composition information comprises:

obtaining a location movement value of each of the graphic objects using the metadata;

changing an object location value included in the 2D composition information to the left and/or right by a predetermined distance, using the location movement value; and

generating right eye composition information for generating a right eye graphic picture including the changed location movement value.

11. The method of claim 10, wherein, in response to the graphic stream being prepared based on the right eye video image, the generating of the 3D composition information comprises:

obtaining a location movement value of each of the graphic objects using the metadata;

is changing an object location value included in the 2D composition information to the left and/or right by a predetermined distance, using the location movement value; and

generating left eye composition information for generating a left eye graphic picture including the changed object location value.

12. The method of claim 1, further comprising:

extracting 3D capability information from a player setting register in a reproducing apparatus for performing the method; and

determining whether a graphic picture is reproducible in 3D by assigning different depth values according to the graphic objects or by assigning the same depth value to the graphic picture, using the 3D capability information,

wherein the generating of the 3D composition information comprises, in response to determining that the graphic picture is reproducible in 3D by assigning the same depth value to the graphic picture using the 3D capability information;

obtaining a location movement value of a graphic picture to output all graphic objects using the metadata;

changing an object location value included in the 2D composition information to the left and/or right by a predetermined distance using the location movement value of the graphic picture; and

generating the 3D composition information including the changed object location value.

13. The method of claim 12, wherein the outputting of the graphic objects comprises outputting the graphic picture alternately at changed locations of the left and/or right using the 3D composition information.

14. An apparatus for processing a graphic stream, the apparatus comprising:

a graphic processor configured to generate graphic objects, two-dimensional (2D) composition information, and color information by decoding a graphic stream;

a depth processor configured to generate three-dimensional (3D) composition information from the 2D composition information using metadata about the graphic stream; and

is a graphic picture output unit configured to output the graphic objects to a screen using the 3D composition information and the color information.

15. The apparatus of claim 14, further comprising a player setting register for storing 3D capability information,

wherein the depth processor is further configured to determine whether a graphic picture is reproducible in 3D by assigning different depth values according to the graphic objects or by assigning the same depth value to the graphic picture, using the 3D capability information, and

in response to determining that the graphic picture is reproducible in 3D by assigning the different depth values according to the graphic objects by using the 3D capability information, the depth processor is further configured to obtain a location movement value according to each of the graphic objects using the metadata, to change an object location value included in the 2D composition information to a value that is spaced apart from the object location value to the left and/or right by a predetermined distance using the location movement value, and to generate left eye composition information for generating a left eye graphic picture and right eye composition information for generating a right eye graphic picture, each comprising the changed object location value.

16. The apparatus of claim 15, wherein the depth processor is further configured to extract an object depth value to be applied to each of the graphic objects from the metadata, and to obtain a location movement value of each of the graphic objects using the object depth value.

17. The apparatus of claim 15, wherein the depth processor is configured to generate the 3D composition information by adding hole compensation information included in the metadata to each of the left eye composition information and the right eye composition information.

18. The apparatus of claim 17, wherein the hole compensation information comprises hole region identification information and color reference information.

19. The apparatus of claim 18, wherein the graphic picture output unit is further configured to generate each of the left eye graphic picture and the right eye graphic picture by arranging each of the graphic objects in a changed location and applying a color indicated by the color reference information to a hole region.

20. The apparatus of claim 17, wherein the hole compensation information comprises at least one of hole region identification information and a hole graphic object to be inserted into a hole region.

21. The apparatus of claim 20, wherein the graphic picture output unit is configured to generate each of the left eye graphic picture and the right eye graphic picture by arranging each of the graphic objects in a changed location and arranging the hole graphic object in the hole region.

22. The apparatus of claim 14, wherein the depth processor is further configured to extract, from the metadata, graphic picture generating standard information indicating which video image from among a left eye video image, a right eye video image, and a 2D video image, is used to prepare the graphic stream.

23. The apparatus of claim 22, wherein, in response to the graphic stream being prepared based on the left eye video image, the depth processor is further configured to obtain a location movement value of each of the graphic objects using the metadata, to change an object location value included in the 2D composition information to the left and/or right by a predetermined distance using the location movement value, and to generate right eye composition information for generating a right eye graphic picture including the changed object location value.

24. The apparatus of claim 23, wherein, in response to the graphic stream being prepared based on the right eye video image, the depth processor is further configured to obtain a location movement value of each of the graphic object using the metadata, to change an object location value included in the 2D composition information to the left and/or right by a predetermined distance using the location movement value, and to generate left eye composition information for generating a left eye graphic picture including the changed object location value.

25. The apparatus of claim 14, further comprising a player setting register configured to store 3D capability information,

wherein the depth processor is further configured to determine whether a graphic picture is reproducible in 3D by assigning different depth values according to the graphic objects or by assigning the same depth value to the graphic picture using the 3D capability information, and

in response to determining that the graphic picture is reproducible in 3D by assigning the same depth value to the graphic picture using the 3D capability information, the depth processor is further configured to obtain a location movement value of the graphic picture to output entire graphic objects using the metadata, to change an object location value included in the 2D composition information to the left and/or right by a predetermined distance using the location movement value of the graphic picture, and to generate the 3D composition value including the changed object location value.

26. The apparatus of claim 25, wherein the graphic picture output unit is further configured to output the graphic picture alternately at changed locations to the left and/or right using the 3D composition information.

27. A computer-readable storage medium comprising:

a graphic stream; and

metadata about the graphic stream,

wherein the graphic stream comprises a graphic object, two-dimensional (2D) composition information, and color information, and

the metadata comprises hole compensation information and one of graphic object identification information, a depth value of the graphic object, and a location to movement value, and the metadata is used to generate three-dimensional (3D) composition information for outputting the graphic object in 3D from the 2D composition information.

28. A computer-readable storage medium having stored therein program is instructions to cause a processor to implement a method of processing a graphic stream, the method comprising:

generating graphic objects by decoding a graphic stream;

generating two-dimensional (2D) composition information and color information by decoding the graphic stream;

generating three-dimensional (3D) composition information from the 2D composition information using metadata about the graphic stream; and

outputting the graphic objects to a screen using the 3D composition information and the color information.

29. A computer-readable storage medium having stored therein program instructions to cause a processor to implement a method of processing a graphic stream, the method comprising:

determining whether a graphic picture is reproducible in three dimensions (3D) by assigning different depth values according to graphic objects or by assigning a same depth value to the graphic picture, using 3D capability information.

30. A computer-readable storage medium comprising:

a graphic stream; and

metadata about the graphic stream for reproducing the graphic stream in a three-dimensional (3D) graphic picture,

wherein the metadata comprises depth information about a graphic object and depth information about a graphic picture, and

the depth information about the graphic object comprises hole compensation information and one of a graphic object identifier, a depth value of the graphic object, and a location movement value.

31. A method of processing a graphic stream, the method comprising determining whether a graphic picture is reproducible in three dimensions (3D) by assigning different depth values according to graphic objects, or by assigning the same depth value to the graphic picture, using 3D capability information.

32. The method of claim 31, further comprising, prior to the determining, is determining whether a graphic stream to be decoded is a stereoscopic graphic stream, wherein the determining of whether the graphic picture is reproducible in 3D is performed when the graphic stream to be decoded is a stereoscopic graphic stream.

33. The method of claim 31, wherein the 3D capability information is stored in a player setting register in a reproducing apparatus, and the method further comprises extracting the 3D capability information from the player setting register before the determining.

34. The method of claim 33, further comprising:

in response to determining that the graphic picture is reproducible in 3D by assigning the different depth values according to graphic objects using the 3D capability information, extracting depth information about the graphic objects from metadata about a graphic stream; and

reproducing a graphic stream in 3D using the depth information about the graphic objects.

35. The method of claim 34, wherein the depth information about the graphic objects comprises a graphic object identifier and one of a depth value to be applied to each of the graphic objects identified by the graphic object identifier and a location movement value, and

the reproducing of the graphic stream in 3D using the depth information about the graphic objects comprises obtaining a location to map each of the graphic objects by moving each of the graphic objects to the left and/or right using the location movement value, and generating a left eye graphic picture and a right eye graphic picture by arranging each of the graphic objects in the obtained location.

36. The method of claim 35, further comprising, in response to the depth information about the graphic objects comprising a depth value to be applied to each of the graphic objects, changing the depth value to the location movement value.

37. The method of claim 35, wherein the depth information about the graphic objects further comprises hole compensation information, and the generating of the left eye graphic picture and the right eye graphic picture comprises filling a hole region generated by changing a location of each of the graphic objects, using the hole compensation information.

38. The method of claim 33, further comprising:

in response to determining that the graphic picture is reproducible in 3D by assigning the same depth value to the graphic picture using the 3D capability information, extracting depth information about the graphic picture from metadata about a graphic stream; and

reproducing the graphic stream in 3D using the depth information about the graphic picture.

39. The method of claim 38, wherein the reproducing of the graphic stream in 3D comprises:

obtaining a location movement value to move the graphic picture using the depth information about the graphic picture; and

obtaining a location to map the graphic picture by moving the graphic picture to the left and/or right using the location movement value, and generating a left eye graphic picture and a right eye graphic picture by arranging the graphic picture in the obtained location.

40. An apparatus for processing a graphic stream comprising a graphic decoder configured to determine whether a graphic picture is reproducible in three-dimensions (3D) by assigning different depth values according to graphic objects, or assigning the same depth value to the graphic picture, using 3D capability information.

41. The apparatus of claim 40, wherein the graphic decoder is further configured to determine whether a graphic stream to be decoded is a stereoscopic graphic stream, and if the graphic stream to be decoded is a stereoscopic graphic stream, the graphic decoder is configured to determine whether the graphic picture is reproducible in 3D by assigning different depth values according to the graphic objects or assigning the same depth value to the graphic picture, using the 3D capability is information.

42. The apparatus of claim 40, further comprising a player setting register configured to store the 3D capability information, wherein the graphic decoder extracts the 3D capability information from the player setting register.

43. The apparatus of claim 42, wherein, in response to determining that the graphic picture is reproducible in 3D by assigning the different depth values according to graphic objects using the 3D capability information, the graphic decoder is further configured to extract depth information about the graphic objects from metadata about a graphic stream, and to reproduce a graphic stream in 3D using the depth information about the graphic objects.

44. The apparatus of claim 43, wherein the depth information about the graphic objects comprises a graphic object identifier and one of a depth value to be applied to each of the graphic objects identified by the graphic object identifier and a location movement value, and

the graphic decoder is further configured to obtain a location to map each of the graphic objects by moving each of the graphic objects to the left and/or right using the location movement value, and to generate a left eye graphic picture and a right eye graphic picture by arranging each of the graphic objects in the obtained location.

45. The apparatus of claim 44, wherein, in response to the depth information about the graphic objects comprising a depth value to be applied to each of the graphic objects, the graphic decoder is further configured to change the depth value to the location movement value.

46. The apparatus of claim 44, wherein the depth information about the graphic objects further comprises hole compensation information, and the graphic decoder is further configured to fill a hole region generated by changing a location of each of the graphic objects, using the hole compensation information.

47. The apparatus of claim 42, wherein, in response to determining that the graphic picture is reproducible in 3D by assigning the same depth value to the graphic picture using the 3D capability information, the graphic decoder is further configured to extract depth information about the graphic picture from metadata about a graphic stream, and to reproduce the graphic stream in 3D using the depth information about the graphic picture.

48. The apparatus of claim 47, wherein the graphic decoder is further configured to obtain a location movement value to move the graphic picture using the depth information about the graphic picture, to obtain a location to map the graphic picture by moving the graphic picture to the left and/or right using the location movement value, and to generate a left eye graphic picture and a right eye graphic picture by arranging the graphic picture in the obtained location.