METHOD, APPARATUS AND SYSTEM FOR FACILITATING NAVIGATION IN AN EXTENDED SCENE

• US 20180182168A1
• Filed: 08/26/2016
• Published: 06/28/2018
• Est. Priority Date: 09/02/2015
• Status: Active Grant

• Current Assignee: InterDigital Patent Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: LAURENT, Anthony, ALLEAUME, Vincent, BELLOT, Maximilien
• Granted Patent: US 11,699,266 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region

Abstract

A method, apparatus and system for facilitating navigation toward a region of interest in an extended scene of video content include determining a timeline including information regarding at least one region of interest in the video content and displaying, in a portion of the video content currently being displayed, a visual indicator indicating a direction in which to move in the video content to cause the display of the at least one region of interest. In one embodiment of the present principles a timeline is attached to the content and carries information evolving over time about the region(s) of interest. A renderer processes the timeline and provides navigation information to a user using available means such as a graphical representation or haptic information, or a combination of several means.

Claims

1. A method of rendering navigation information when rendering a portion of a large field of view content, the method comprising:

obtaining data representative of a timeline attached to the large field of view content, said timeline comprising activation information regarding at least one region of interest in said video content;

determining navigation information according to said portion of the large field of view content and said at least one region of interest; and

rendering said determined navigation information while rendering said portion of the large field of view content.

2. The method of claim 1 wherein at least one region of interest of said at least one region of interest is further associated with at least one level of interest in the timeline and wherein navigation information is further determined according to said at least one level of interest.

3. The method of claim 1, wherein said at least one region of interest is further associated with an optimal viewpoint for rendering said region of interest and wherein navigation information is further determined according to said optimal viewpoint.

4. The method of claim 1, wherein the large field of view content is a three-dimension scene and wherein a region of interest of said at least one region of interest is determined according to an object of said 3D scene.

5. The method of claim 1, wherein the large field of view content is a video and wherein a region of interest of said at least one region of interest is determined according to a description of a shape of a two-dimension part of said video.

6. The method of claim 1, wherein the navigation information is a visual information to be overlaid on said portion of the large field of view content.

7. The method of claim 1, wherein the navigation information comprises is haptic effects.

8. An apparatus comprising a memory associated with a processor configured to render navigation information when rendering a portion of a large field of view content, the processor being configured to:

obtain data representative of a timeline attached to the large field of view content, said timeline comprising activation information regarding at least one region of interest in said video content;

determine navigation information according to said portion of the large field of view content and said at least one region of interest; and

render said determined navigation information while rendering said portion of the large field of view content.

9. The apparatus of claim 8 wherein at least one region of interest of said at least one region of interest is further associated with at least one level of interest in the timeline and wherein said at least one processor is further configured to determine navigation information according to said at least one level of interest.

10. The apparatus of claim 8, wherein said at least one region of interest is further associated with an optimal viewpoint for rendering said region of interest and wherein said at least one processor is further configured to determine navigation information according to said optimal viewpoint.

11. The apparatus of claim 8, wherein the large field of view content is a three-dimension scene and wherein a region of interest of said at least one region of interest is determined according to an object of said 3D scene.

12. The apparatus of claim 8, wherein the large field of view content is a video and wherein a region of interest of said at least one region of interest is determined according to a description of a shape of a two-dimension part of said video.

13. The apparatus of claim 8, wherein the navigation information is a visual information to be overlaid on said portion of the large field of view content.

14. The apparatus of claim 8, wherein the navigation information is a haptic effect.

16. The apparatus of claim 14 comprising haptic effectors, said at least one processor being configured to render said haptic effects on the haptic effectors.

15. (canceled)