METHOD AND APPARATUS FOR SIGNALING REGION OF INTERESTS

• US 20170345205A1
• Filed: 05/19/2017
• Published: 11/30/2017
• Est. Priority Date: 05/26/2016
• Status: Active Grant

• Current Assignee: MediaTek, Inc.
• Original Assignee: MediaTek, Inc.
• Inventors: Lai, Wang Lin, Liu, Shan
• Granted Patent: US 10,360,721 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/232 using fly-eye lenses, e.g. arrangements of circular lenses
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Aspects of the disclosure provide an apparatus that includes an interface circuit, an image generating circuit and a display device. The interface circuit is configured to receive media data with timed directorial information indicative of a region of interests at a time. The image generating circuit is configured to extract the timed directorial information, and generate one or more images of the region of interests based on the media data and the timed directorial information. The display device is configured to display the one or more images at the time.

Claims

1. An apparatus, comprising:

an interface circuit configured to receive media data with timed directorial information indicative of a region of interests at a time;

an image generating circuit configured to extract the timed directorial information, and generate one or more images of the region of interests based on the media data and the timed directorial information; and

a display device configured to display the one or more images at the time.

2. The apparatus of claim 1, wherein the timed directorial information is indicative of at least one of:

a projection of the region of interests on a rectangular plane;

a region on a surface of a sphere;

a camera identification;

a track identification; and

a face identification.

3. The apparatus of claim 1, wherein the timed directorial information includes a viewpoint to indicate the region of interests.

4. The apparatus of claim 3, wherein the timed directorial information is indicative of a horizontal coverage range and a vertical coverage range about the viewpoint.

5. The apparatus of claim 4, wherein the timed directorial information is indicative of boundaries that are formed by great circles.

6. The apparatus of claim 4, wherein the timed directorial information is indicative of boundaries that are formed by yaw circles and pitch circles.

7. A method for image rendering, comprising:

receiving media data with timed directorial information that is indicative of a region of interests at a time;

extracting the timed directorial information from the media data;

generating one or more images of the region of interests based on the media data and the timed directorial information; and

displaying the one or more images at the time.

8. The method of claim 7, wherein receiving the media data with the timed directorial information that is indicative of the region of interests at the time comprises at least one of:

receiving the timed directorial information that is indicative of a projection of the region of interests on a rectangular plane;

receiving the timed directorial information that is indicative of a region on a surface of a sphere;

receiving the timed directorial information that is indicative of a camera identification;

receiving the timed directorial information that is indicative of a track identification; and

receiving the timed directorial information that is indicative of a face identification.

9. The method of claim 7, wherein receiving the media data with the timed directorial information that is indicative of the region of interests at the time further comprises:

receiving the timed directorial information that includes a viewpoint to indicate the region of interests.

10. The method of claim 9, further comprising:

receiving the timed directorial information that is indicative of a horizontal coverage range and a vertical coverage range about the viewpoint.

11. The method of claim 10, further comprising:

receiving the timed directorial information that is indicative of boundaries that are formed by great circles.

12. The method of claim 10, further comprising:

receiving the timed directorial information is indicative of boundaries that are formed by yaw circles and pitch circles.

13. An apparatus, comprising:

a memory configured to buffer captured media data; and

an image generating circuit configured to determine a region of interests at a time, and encapsulate timed directorial information that is indicative of the region of interests at the time with the media data.

14. The apparatus of claim 13, wherein the timed directorial information is indicative of at least one of:

a projection of the region of interests on a rectangular plane;

a region on a surface of a sphere;

a camera identification;

a track identification; and

a face identification.

15. The apparatus of claim 13, wherein the timed directorial information includes a viewpoint to indicate the region of interests.

16. The apparatus of claim 15, wherein the timed directorial information is indicative of a horizontal coverage range and a vertical coverage range about the viewpoint.

17. The apparatus of claim 16, wherein the timed directorial information is indicative of boundaries that are formed by great circles.

18. The apparatus of claim 16, wherein the timed directorial information is indicative of boundaries that are formed by yaw circles and pitch circles.

19. A method for image rendering, comprising:

receiving captured media data;

determining a region of interests at a time; and

encapsulating timed directorial information that is indicative of the region of interests at the time with the media data.