METHOD, APPARATUS, AND COMPUTER PROGRAM PRODUCT FOR PREDICTIVE CUSTOMIZATIONS IN SELF AND NEIGHBORHOOD VIDEOS

• US 20160381320A1
• Filed: 06/24/2016
• Published: 12/29/2016
• Est. Priority Date: 06/25/2015
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Mate, Sujeet Shyamsundar, Curcio, Igor Danilo Diego
• Application Number:
  US15/192,320
• Publication Number:
  US 20160381320A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

A method, apparatus, and computer program product are provided for enhanced customization for smart video rendering of high resolution immersive content on devices with lower resolution displays. A method is provided that includes receiving first instance default region of interest data for a first instance of content; receiving first instance region of interest customization interaction data for the first instance of the content; receiving second instance default region of interest data for a second instance of the content; determining customization similarity detection for the second instance of the content based on the first instance default region of interest data, the first instance region of interest customization interaction data, and the second instance default region of interest data; generating predicted customized region of interest data for the second instance of the content; and providing an indication of the predicted customized region of interest data.

Claims

1. A method comprising:

receiving first instance default region of interest data for a first instance of content;

receiving first instance region of interest customization interaction data for the first instance of the content;

receiving second instance default region of interest data for a second instance of the content;

determining, by a processor, customization similarity detection for the second instance of the content based on the first instance default region of interest data, the first instance region of interest customization interaction data, and the second instance default region of interest data;

generating, by the processor, predicted customized region of interest data for the second instance of the content; and

providing an indication of the predicted customized region of interest data.

2. The method of claim 1, wherein the first instance default region of interest data comprises:

spatio-temporal coordinates of a first instance default region of interest; and

one or more object of interest positions within the first instance default region of interest;

wherein the first instance region of interest customization interaction data comprises;

spatio-temporal coordinates of a first instance customized region of interest; and

one or more object of interest positions within the first instance customized region of interest, and

wherein the second instance default region of interest data comprises;

spatio-temporal coordinates of a second instance default region of interest; and

one or more object of interest positions within the second instance default region of interest.

3. The method of claim 2, wherein determining the customization similarity detection comprises comparing the first instance default region of interest data to the second instance default region of interest data to determine if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other.

4. The method of claim 3, wherein if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other, generating predicted customized region of interest data for the second instance comprises determining a region of interest for the second instance which is spatially similar to a customized region of interest for the first instance based on the first instance region of interest customization interaction data.

5. The method of claim 2, further comprising:

determining one or more significant objects of interest in the first instance of content and the second instance of content;

determining a relationship between the one or more significant objects of interest in the first instance and the first instance default region of interest and the first instance customized region of interest; and

modifying a predicted customized region of interest for the second instance based on the relationship and a relative position of the one or more significant objects of interest in the second instance.

6. The method of claim 2, wherein at least one of the first instance default region of interest data or the second instance default region of interest data further comprises temporal coordinates for one of the audio rhythm or the pattern content.

7. The method of claim 1, wherein the predicted customized region of interest data comprises spatio-temporal coordinates of one or more predicted customized regions of interest.

8. An apparatus comprising at least one processor and at least one memory including computer program instructions, the at least one memory and the computer program instructions, with the at least one processor, causing the apparatus at least to:

receive first instance default region of interest data for a first instance of content;

receive first instance region of interest customization interaction data for the first instance of the content;

receive second instance default region of interest data for a second instance of the content;

determine customization similarity detection for the second instance of the content based on the first instance default region of interest data, the first instance region of interest customization interaction data, and the second instance default region of interest data;

generate predicted customized region of interest data for the second instance of the content; and

provide an indication of the predicted customized region of interest data.

9. The apparatus of claim 8, wherein the first instance default region of interest data comprises:

spatio-temporal coordinates of a first instance default region of interest; and

one or more object of interest positions within the first instance default region of interest;

wherein the first instance region of interest customization interaction data comprises;

spatio-temporal coordinates of a first instance customized region of interest; and

one or more object of interest positions within the first instance customized region of interest, and

wherein the second instance default region of interest data comprises;

spatio-temporal coordinates of a second instance default region of interest; and

one or more object of interest positions within the second instance default region of interest.

10. The apparatus of claim 9, wherein the at least one memory and the computer program instructions, with the at least one processor, are configured to cause the apparatus to determine the customization similarity detection by comparing the first instance default region of interest data to the second instance default region of interest data to determine if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other.

11. The apparatus of claim 10, wherein if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other, the at least one memory and the computer program instructions, with the at least one processor, are configured to cause the apparatus to generate predicted customized region of interest data for the second instance by determining a region of interest for the second instance which is spatially similar to a customized region of interest for the first instance based on the first instance region of interest customization interaction data.

12. The apparatus of claim 9, wherein the at least one memory and the computer program instructions, with the at least one processor, are further configured to cause the apparatus to:

determine one or more significant objects of interest in the first instance of content and the second instance of content;

determine a relationship between the one or more significant objects of interest in the first instance and the first instance default region of interest and the first instance customized region of interest; and

modify a predicted customized region of interest for the second instance based on the relationship and a relative position of the one or more significant objects of interest in the second instance.

13. The apparatus of claim 9, wherein at least one of the first instance default region of interest data or the second instance default region of interest data further comprises temporal coordinates for one of the audio rhythm or the pattern content.

14. The apparatus of claim 8, wherein the predicted customized region of interest data comprises spatio-temporal coordinates of one or more predicted customized regions of interest.

15. A computer program product comprising at least one non-transitory computer-readable storage medium bearing computer program instructions embodied therein for use with a computer, the computer program instructions comprising program instructions, when executed, causing the computer at least to:

receive first instance default region of interest data for a first instance of content;

receive first instance region of interest customization interaction data for the first instance of the content;

receive second instance default region of interest data for a second instance of the content;

determine customization similarity detection for the second instance of the content based on the first instance default region of interest data, the first instance region of interest customization interaction data, and the second instance default region of interest data;

generate predicted customized region of interest data for the second instance of the content; and

provide an indication of the predicted customized region of interest data.

16. The computer program product of claim 15, wherein the first instance default region of interest data comprises:

spatio-temporal coordinates of a first instance default region of interest; and

one or more object of interest positions within the first instance default region of interest;

wherein the first instance region of interest customization interaction data comprises;

spatio-temporal coordinates of a first instance customized region of interest; and

one or more object of interest positions within the first instance customized region of interest, and

wherein the second instance default region of interest data comprises;

spatio-temporal coordinates of a second instance default region of interest; and

one or more object of interest positions within the second instance default region of interest.

17. The computer program product of claim 16, wherein the program instructions configured to determine the customization similarity detection comprise program instructions which, when executed, cause the computer to compare the first instance default region of interest data to the second instance default region of interest data to determine if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other.

18. The computer program product of claim 17, wherein if the first instance default region of interest and the second instance default region of interest are within a threshold distance of each other, the program instructions configured to generate predicted customized region of interest data for the second instance comprise program instructions which, when executed, cause the computer to determine a region of interest for the second instance which is spatially similar to a customized region of interest for the first instance based on the first instance region of interest customization interaction data.

19. The computer program product of claim 16, wherein the computer program instructions further comprise program instructions which, when executed, cause the computer to:

determine one or more significant objects of interest in the first instance of content and the second instance of content;

determine a relationship between the one or more significant objects of interest in the first instance and the first instance default region of interest and the first instance customized region of interest; and

modify a predicted customized region of interest for the second instance based on the relationship and a relative position of the one or more significant objects of interest in the second instance.

20. The computer program product of claim 16, wherein at least one of the first instance default region of interest data or the second instance default region of interest data further comprises temporal coordinates for one of the audio rhythm or the pattern content.