Method and apparatus for encoding three-dimensional (3D) content

• US 10,375,373 B2
• Filed: 05/11/2018
• Issued: 08/06/2019
• Est. Priority Date: 07/24/2013
• Status: Active Grant

• Current Assignee: Helios Streaming, LLC (Ideahub, Inc.)
• Original Assignee: Ideahub, Inc.
• Inventors: Lee, Jin Young, Hur, Nam Ho
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US15/977,218
• Publication Number:
  US 20180262746A1
• Time in Patent Office: 452 Days
• Field of Search: 348 43, 348 42, 348 46, 386326, 386328, 386329
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format

Abstract

Disclosed is a method of encoding three-dimensional (3D) content. The method of encoding 3D content according to an embodiment may include setting a dependency between texture information and depth information of the 3D content, and generating a bitstream comprising the dependency.

Claims

1. A method of adaptive streaming service performed by a server or multiple servers, the method comprising:

receiving a request, from a client, for a segment of a media content based on metadata of the media content, wherein the metadata is a Media Presentation Description (MPD), and wherein the MPD is a description of a media presentation related to the media content; and

providing the media content based on the request,

wherein the MPD includes at least one period,

wherein each period includes at least one adaptation set comprising a media content component,

wherein each adaptation set includes at least one representation,

wherein each representation includes at least one segment, and

wherein the MPD provides information that enables the client to switch from one representation to another representation to adapt to a network condition.

2. The method of claim 1, wherein one or more segments of a representation in the MPD is requested by the client based on specific selection by a user.

3. The method of claim 2, wherein the representation is related to a text media component.

4. The method of claim 1, wherein one representation is switched to another representation at a random access point.

5. The method of claim 1, wherein the adaptation set includes at least one of a bandwidth attribute, a width attribute, a height attribute, and a frame rate attribute associated with at least one representation included in the adaptation set.

6. The method of claim 1, wherein an element of the media content component includes at least one of (i) an “

Accessibility”

element related to information about an accessibility scheme, (ii) a “

Role”

element related to information about a role annotation scheme, (iii) a “

Rating”

element related to information about a rating scheme, and (iv) a “

-Viewpoint”

element related to information about a viewpoint annotation scheme.

7. The method of claim 1, wherein an element of the at least ono adaptation set comprises fat least one of:

(i) a ContentType attribute which is a media content component type of the adaptation set,

(ii) a par attribute which is a picture aspect ratio,

(iii) a minBandWidth attribute which is a minimum bandwidth attribute value of all representations within the adaptation set,

(iv) a maxBandWidth attribute which is a maximum bandwidth attribute value of all representations within the adaptation set,

(v) a minWidth attribute which is a minimum width attribute value of all representations within the adaptation set,

(vi) a maxWidth attribute which is a maximum width attribute value of all representations within the adaptation set,

(vii) a minHeight attribute which is a minimum height attribute value of all representations within the adaptation set,

(viii) a maxHeight attribute which is a maximum height attribute value of all representations within the adaptation set,

(ix) a minFrameRate attribute which is a minimum frame rate attribute value of all representations within the adaptation set, and

(x) a maxFrameRate attribute which is a maximum frame rate attribute value of all representations within the adaptation set.

8. The method of claim 1, wherein the MPD provides information that enables the client to select a representation, wherein the representation is ignored by the client based on a user'"'"'s selection.

9. A server, comprising:

one or more processors configured to;

receive a request, from a client, for a segment of a media content based on metadata of the media content, wherein the metadata is a Media Presentation Description (MPD), and wherein the MPD is a description of a media presentation related to the media content; and

provide the media content based on the request,

wherein the MPD includes at least one period,

wherein each period includes at least one adaptation set comprising a media content component,

wherein each adaptation set includes at least one representation,

wherein each representation includes at least one segment, and

wherein the MPD provides information that enables the client to switch from one representation to another representation to adapt to a network condition.

10. The method of claim 9, wherein one or more segments of a representation in the MPD is requested by the client based on specific selection by a user.

11. The method of claim 10, wherein the representation is related to a text media component.

12. The method of claim 9, wherein one representation is switched to another representation at a random access point.

13. The method of claim 9, wherein the adaptation set includes at least one of a bandwidth attribute, a width attribute, a height attribute, and a frame rate attribute associated with at least one representation included in the adaptation set.

14. The method of claim 9, wherein an element of the media content component -includes at least one -of (i) an “

Accessibility”

element related to information about an accessibility scheme, (ii) a “

Role”

element related to information about a role annotation scheme, (iii) a “

Rating”

element related to information about a rating scheme, and (iv) a “

-Viewpoint”

element related to information about a viewpoint annotation scheme.

15. The method of claim 9, wherein an element of the adaptation set comprises at least one of:

(i) a ContentType attribute which is a media content component type of the adaptation set,

(ii) par attribute which is a picture aspect ratio,

(iii) a minBandWidth attribute which is a minimum bandwidth attribute value of all representations within the adaptation set,

(iv) a maxBandWidth attribute which is a maximum bandwidth attribute value of all representations within the adaptation set,

(v) a minWidth attribute which is a minimum width attribute value of all representations within the adaptation set,

(vi) a maxWidth attribute which is a maximum width attribute value of all representations within the adaptation set,

(vii) a minHeight attribute which is a minimum height attribute value of all representations within the adaptation set,

(viii) a maxHeight attribute which is a maximum height attribute value of all representations within the adaptation set,

(ix) a minFrameRate attribute which is a minimum frame rate attribute value of all representations within the adaptation set, and

(x) a maxFrameRate attribute which is a maximum frame rate attribute value of all representations within the adaptation set.

16. The method of claim 9, wherein the MPD provides information that enables the client to select a representation, wherein the representation is ignored by the client based on a user'"'"'s selection.

17. A method of adaptive streaming service performed by a client, the method comprising:

transmitting a request, to a server or multiple servers, for a segment of a media content based on metadata of the media content, wherein the metadata is a Media Presentation Description (MPD), and wherein the MPD is a description of a media presentation related to the media content; and

receiving the media content, based on the request, from the server or multiple servers,

wherein the MPD includes at least one period,

wherein each period includes at least one adaptation set comprising a media content component,

wherein each adaptation set includes at least one representation,

wherein each representation includes at least one segment, and

wherein the MPD provides information that enables the client to switch from one representation to another representation to adapt to a network condition.

18. The method of claim 17, wherein one or more segments of a representation in the MPD is requested by the client based on specific selection by a user.

19. The method of claim 18, wherein the representation is related to a text media component.

20. The method of claim 17, wherein one representation is switched to another representation at a random access point.

21. The method of claim 17, wherein the adaptation set includes at least one of a bandwidth attribute, a width attribute, a height attribute, and a frame rate attribute associated with at least one representation included in the adaptation set.

22. The method of claim 17, wherein an element of the media content component -includes at least one -of (i) an “

Accessibility”

element related to information about an accessibility scheme, (ii) a “

Role”

element related to information about a role annotation scheme, (iii) a “

Rating”

element related to information about a rating scheme, and (iv) a “

-Viewpoint”

element related to information about a viewpoint annotation scheme.

23. The method of claim 17, wherein an element of the adaptation set comprises at least one of:

aa ContentType attribute which is a media content component type of the adaptation set,

(ii) a par attribute which is a picture aspect ratio,

(iii) a minBandWidth attribute which is a minimum bandwidth attribute value of all representations within the adaptation set,

(iv) a maxBandWidth attribute which is a maximum bandwidth attribute value of all representations within the adaptation set,

(v) a minWidth attribute which is a minimum width attribute value of all representations within the adaptation set,

(vi) a maxWidth attribute which is a maximum width attribute value of all representations within the adaptation set,

(vii) a minHeight attribute which is a minimum height attribute value of all representations within the adaptation set,

(viii) a maxHeight attribute which is a maximum height attribute value of all representations within the adaptation set,

(ix) a minFrameRate attribute which is a minimum frame rate attribute value of all representations within the adaptation set, and

(x) a maxFrameRate attribute which is a maximum frame rate attribute value of all representations within the adaptation set.

24. The method of claim 17, wherein the MPD provides information that enables the client to select a representation, wherein the representation is ignored by the client based on a user'"'"'s selection.