Recording medium, playback device, integrated circuit

• US 20110033170A1
• Filed: 10/19/2010
• Published: 02/10/2011
• Est. Priority Date: 02/19/2009
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: IKEDA, Wataru, Sasaki, Taiji, Ogawa, Tomoki, Yahata, Hiroshi
• Granted Patent: US 8,712,215 B2
• Time in Patent Office: Days
• US Class Current: 386/244
• CPC Class Codes: G11B 2220/2541 Blu-ray discs; Blue laser DVR discs
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/359 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/42646 for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

A base-view video stream and a dependent-view video stream are recorded on a BD-ROM. The base-view video stream includes picture data constituting a base view of a stereoscopic image. The dependent-view video stream includes offset metadata and picture data constituting a dependent view of the stereoscopic image. The offset metadata includes an offset sequence that defines an offset control of a plane memory when a graphics to be overlaid with the picture data is played back in a one-plane offset mode.

Claims

1. A recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the metadata is control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane.

2. The recording medium of claim 1, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane.

3. The recording medium of claim 2, wherein

each of the picture data included in the main-view video stream and the picture data included in the sub-view video stream represents a plurality of groups of pictures, and

each group of pictures in the plurality of groups of pictures constitutes a plurality of frames, and the control information is a plurality of pieces of control information held as parameter sequences in one-to-one correspondence with the plurality of frames.

4. A playback device for playing back a recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the metadata is control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the playback device comprises:

a video decoder operable to obtain the picture data constituting the main view and the picture data constituting the sub view by decoding the main-view video stream and the sub-view video stream;

a graphics decoder operable to obtain the graphics data by decoding the graphics stream;

the main-view video plane on which the picture data constituting the main view is drawn;

the sub-view video plane on which the picture data constituting the sub view is drawn;

the graphics plane on which the graphics data is drawn; and

an overlay unit operable to overlay the graphics plane with the main-view video stream and the sub-view video stream,

wherein the overlay unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

5. The playback device of claim 4, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane, and

the overlay unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

6. The playback device of claim 5, wherein

each of the picture data included in the main-view video stream and the picture data included in the sub-view video stream represents a plurality of groups of pictures,

each group of pictures in the plurality of groups of pictures constitutes a plurality of frames, and the control information is a plurality of pieces of control information held as parameter sequences in one-to-one correspondence with the plurality of frames, and

the overlay unit, in accordance with each piece of control information being each parameter sequence, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

7. A semiconductor integrated circuit for performing an image signal process onto data received from a recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the metadata is control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane,

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the main-view video stream is multiplexed as a main-view transport stream and then is divided into a plurality of main-view data groups,

the sub-view video stream is multiplexed as a sub-view transport stream and then is divided into a plurality of sub-view data groups,

the main-view data groups and the sub-view data groups are recorded as data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner,

the graphics stream is multiplexed into one of or both of the main-view transport stream and the sub-view transport stream, and at least one of the main-view data groups and the sub-view data groups include the graphics data,

the semiconductor integrated circuit comprises:

a main control unit operable to control the semiconductor integrated circuit;

a stream processing unit operable to receive, from the recording medium, the data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner, store the received data into a memory provided inside or outside of the semiconductor integrated circuit, and then demultiplex the data into the picture data and the graphics data;

a signal processing unit operable to decode the picture data and the graphics data; and

an AV output unit operable to output the picture data decoded by the signal processing unit,

the stream processing unit includes;

a switching unit operable to switch storage destination when the received data is stored into the memory,

the memory includes a first area, a second area, a third area, a fourth area, and a fifth area,

the main control unit controls the switching unit to store the main-view data groups into the first area and to store the sub-view data groups into the second area,

data belonging to the main-view data groups, among the decoded picture data, is stored into the third area, the third area corresponding to the main-view video plane,

data belonging to the sub-view data groups, among the decoded picture data, is stored into the fourth area, the fourth area corresponding to the sub-view video plane,

the decoded graphics data is stored into the fifth area, the fifth area corresponding to the graphics plane,

the AV output unit includes;

an image superimposing unit operable to superimpose the decoded picture data with the decoded graphics data,

the image superimposing unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively, and

the AV output unit outputs the decoded picture data having been superimposed with the decoded graphics data.

8. A recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data and coordinate information that indicates a drawing position at which the graphics data is drawn on a graphics plane,

the graphics plane is overlaid with a main-view video plane on which the picture data constituting the main view is drawn, and overlaid with a sub-view video plane on which the picture data constituting the sub view is drawn,

the graphics stream further includes control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane.

9. The recording medium of claim 8, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane.

10. The recording medium of claim 9, wherein

the control information is first control information, and the sub-view video stream further includes metadata,

the metadata is second control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane,

the second control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane, and includes information that defines directions of the offsets to be applied to the graphics plane, and

the offset control is performed onto the graphics plane in accordance with the second control information.

11. The recording medium of claim 10, wherein

the graphics data is subtitle data.

12. A playback device for playing back a recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data and coordinate information that indicates a drawing position at which the graphics data is drawn on a graphics plane,

the graphics plane is overlaid with a main-view video plane on which the picture data constituting the main view is drawn, and overlaid with a sub-view video plane on which the picture data constituting the sub view is drawn,

the graphics stream further includes control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane,

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the playback device comprises:

a video decoder operable to obtain the picture data constituting the main view and the picture data constituting the sub view by decoding the main-view video stream and the sub-view video stream;

a graphics decoder operable to obtain the graphics data by decoding the graphics stream;

the main-view video plane on which the picture data constituting the main view is drawn;

the sub-view video plane on which the picture data constituting the sub view is drawn;

the graphics plane on which the graphics data is drawn; and

an overlay unit operable to overlay the graphics plane with the main-view video stream and the sub-view video stream,

wherein the offsets of leftward and rightward directions are applied to the horizontal coordinates in the graphics plane in accordance with the control information when the graphics data is drawn onto the graphics plane.

13. The playback device of claim 12, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane, and

the offsets of leftward and rightward directions are applied to the horizontal coordinates in the graphics plane in accordance with the control information when the graphics data is drawn onto the graphics plane.

14. The playback device of claim 13, wherein

the control information is first control information, and the sub-view video stream further includes metadata,

the metadata is second control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the overlay unit, in accordance with the control information, applies the offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

15. The playback device of claim 14, wherein

the graphics data is subtitle data.

16. A semiconductor integrated circuit for performing an image signal process onto data received from a recording medium on which a main-view video stream, a sub-view video stream, and a graphics stream are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes metadata and picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data and coordinate information that indicates a drawing position at which the graphics data is drawn on a graphics plane,

the graphics plane is overlaid with a main-view video plane on which the picture data constituting the main view is drawn, and overlaid with a sub-view video plane on which the picture data constituting the sub view is drawn,

the graphics stream further includes control information defining an offset control that applies offsets of leftward and rightward directions to the drawing positions in horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane,

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the main-view video stream is multiplexed as a main-view transport stream and then is divided into a plurality of main-view data groups,

the sub-view video stream is multiplexed as a sub-view transport stream and then is divided into a plurality of sub-view data groups,

the main-view data groups and the sub-view data groups are recorded as data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner,

the graphics stream is multiplexed as a graphics transport stream,

the semiconductor integrated circuit comprises:

a main control unit operable to control the semiconductor integrated circuit;

a stream processing unit operable to receive, from the recording medium, the graphics transport stream and the data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner, store the received graphics transport stream and the received data into a memory provided inside or outside of the semiconductor integrated circuit, and then demultiplex the data and the graphics transport stream into the picture data and the graphics data;

a signal processing unit operable to decode the picture data and the graphics data; and

an AV output unit operable to output the picture data decoded by the signal processing unit,

the stream processing unit includes;

a switching unit operable to switch storage destination when the received data is stored into the memory,

the memory includes a first area, a second area, a third area, a fourth area, and a fifth area,

the main control unit controls the switching unit to store the main-view data groups into the first area and to store the sub-view data groups into the second area,

data belonging to the main-view data groups, among the decoded picture data, is stored into the third area, the third area corresponding to the main-view video plane,

data belonging to the sub-view data groups, among the decoded picture data, is stored into the fourth area, the fourth area corresponding to the sub-view video plane,

the decoded graphics data is stored into the fifth area, the fifth area corresponding to the graphics plane,

the AV output unit includes;

an image superimposing unit operable to superimpose the decoded picture data with the decoded graphics data,

the image superimposing unit superimposes the main-view video plane and the sub-view video plane with the graphics plane on which the graphics data has been drawn by applying the offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and

the AV output unit outputs the decoded picture data having been superimposed with the decoded graphics data.

17. A recording medium on which a main-view video stream, a sub-view video stream, a graphics stream, and management information are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the management information includes control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane.

18. The recording medium of claim 17, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane.

19. The recording medium of claim 18, wherein

a stereoscopic playback mode includes:

a main-sub playback mode in which the stereoscopic image is played back by using the main view and the sub view; and

a main-main playback mode in which the stereoscopic image is played back by using only the main view, and

the control information defines an offset control to be performed onto the graphics plane when the graphics is a popup menu, and the stereoscopic playback mode is the main-main playback mode.

20. The recording medium of claim 19, wherein

the management information is a stream selection table in playlist information defining playback sections in the main-view video stream and the sub-view video stream, and

the stream selection table indicates stream numbers of playable elementary streams, and the control information is associated with the stream numbers in the stream selection table.

21. A playback device for playing back a recording medium on which a main-view video stream, a sub-view video stream, a graphics stream, and management information are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the management information includes control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane, and

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the playback device comprises:

a video decoder operable to obtain the picture data constituting the main view and the picture data constituting the sub view by decoding the main-view video stream and the sub-view video stream;

a graphics decoder operable to obtain the graphics data by decoding the graphics stream;

the main-view video plane on which the picture data constituting the main view is drawn;

the sub-view video plane on which the picture data constituting the sub view is drawn;

the graphics plane on which the graphics data is drawn; and

an overlay unit operable to overlay the graphics plane with the main-view video stream and the sub-view video stream,

wherein the overlay unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

22. The playback device of claim 21, wherein

the control information further includes information that defines directions of the offsets to be applied to the graphics plane, and

the overlay unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

23. The playback device of claim 22, wherein

a stereoscopic playback mode includes:

a main-sub playback mode in which the stereoscopic image is played back by using the main view and the sub view; and

a main-main playback mode in which the stereoscopic image is played back by using only the main view,

the control information defines an offset control to be performed onto the graphics plane when the graphics is a popup menu, and the stereoscopic playback mode is the main-main playback mode, and

when the graphics is a popup menu and the stereoscopic playback mode is the main-main playback mode, the overlay unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

24. The playback device of claim 23, wherein

the management information is a stream selection table in playlist information defining playback sections in the main-view video stream and the sub-view video stream,

the stream selection table indicates stream numbers of playable elementary streams, and the control information is associated with the stream numbers in the stream selection table,

the playback device comprises a stream number register, and

after a stream number is stored in a stream number register, the overlay unit, in accordance with a piece of control information associated with the stream number stored in the stream number register, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively.

25. A semiconductor integrated circuit for performing an image signal process onto data received from a recording medium on which a main-view video stream, a sub-view video stream, a graphics stream, and management information are recorded, wherein

the main-view video stream includes picture data constituting a main view of a stereoscopic image,

the sub-view video stream includes picture data constituting a sub view of the stereoscopic image,

the graphics stream includes graphics data, and a graphics plane on which the graphics data is drawn is overlaid with a main-view video plane and a sub-view video plane on which the respective picture data are drawn,

the management information includes control information defining an offset control that applies offsets of leftward and rightward directions to horizontal coordinates in the graphics plane when the graphics plane is overlaid with the main-view video plane and the sub-view video plane,

the control information includes information that indicates, by a number of pixels, values of the offsets to be applied to the graphics plane,

the main-view video stream is multiplexed as a main-view transport stream and then is divided into a plurality of main-view data groups,

the sub-view video stream is multiplexed as a sub-view transport stream and then is divided into a plurality of sub-view data groups,

the main-view data groups and the sub-view data groups are recorded as data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner,

the graphics stream is multiplexed as a graphics transport stream,

the semiconductor integrated circuit comprises:

a main control unit operable to control the semiconductor integrated circuit;

a stream processing unit operable to receive, from the recording medium, the graphics transport stream and the data in which the main-view data groups and the sub-view data groups are arranged in an interleaved manner, store the received graphics transport stream and the received data into a memory provided inside or outside of the semiconductor integrated circuit, and then demultiplex the data and the graphics transport stream into the picture data and the graphics data;

a signal processing unit operable to decode the picture data and the graphics data; and

an AV output unit operable to output the picture data decoded by the signal processing unit,

the stream processing unit includes;

a switching unit operable to switch storage destination when the received data, in which the main-view data groups and the sub-view data groups are arranged in the interleaved manner, is stored into the memory,

the memory includes a first area, a second area, a third area, a fourth area, and a fifth area,

the main control unit controls the switching unit to store the main-view data groups into the first area and to store the sub-view data groups into the second area,

data belonging to the main-view data groups, among the decoded picture data, is stored into the third area, the third area corresponding to the main-view video plane,

data belonging to the sub-view data groups, among the decoded picture data, is stored into the fourth area, the fourth area corresponding to the sub-view video plane,

the decoded graphics data is stored into the fifth area, the fifth area corresponding to the graphics plane,

the AV output unit includes;

an image superimposing unit operable to superimpose the decoded picture data with the decoded graphics data,

the image superimposing unit, in accordance with the control information, applies offsets of leftward and rightward directions to the horizontal coordinates in the graphics plane, and overlays resultant graphics planes with the main-view video plane and the sub-view video plane, respectively, and

the AV output unit outputs the decoded picture data having been superimposed with the decoded graphics data.