Systems and methods for recreating a reference image from a media asset

• US 10,163,008 B2
• Filed: 10/04/2016
• Issued: 12/25/2018
• Est. Priority Date: 10/04/2016
• Status: Active Grant

• Current Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Stathacopoulos, Paul T., Maughan, Benjamin H., Matthews, Sean
• Primary Examiner(s): Bekele, Mekonen
• Application Number:
  US15/284,832
• Publication Number:
  US 20180096202A1
• Time in Patent Office: 812 Days
• CPC Class Codes: G01C 21/3632 Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3635 Guidance using 3D or perspective road maps
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass

Abstract

Systems and methods that provide for an interactive media guidance application implemented in a user device, e.g., an app on a mobile phone. The interactive media guidance application uses the geographical location, e.g., longitude and latitude coordinates, and geospatial orientation, e.g., gyroscopic angles, of the user device to allow the user to capture images of the location in the same manner as the location was depicted in his or her favorite film or television program. The interactive media guidance application can deliver to the user the desired immersive experience where he or she sees and has the same viewpoint as the director or another person associated with the film or television program.

Claims

1. A method for recreating on a user device a reference image from a media asset, comprising:

receiving a user image captured by the user device;

determining a geographical location associated with the user image;

based on the determined geographical location;

identifying, from a database, the reference image from the media asset;

determining a first geospatial orientation of the user device based on a view shown in the user image;

receiving a second geospatial orientation of an imaging device that was used to generate the reference image;

determining whether the first geospatial orientation matches the second geospatial orientation;

based on the first geospatial orientation not matching the second geospatial orientation;

determining a deviation between the first geospatial orientation and the second geospatial orientation;

generating a notification for a user to change a position of the user device to approximate the second geospatial orientation based on the deviation; and

receiving an updated user image captured by the user device placed at the changed position that approximates the second geospatial orientation.

2. The method of claim 1, wherein the geographical location includes at least one of a latitude coordinate and a longitude coordinate.

3. The method of claim 1, wherein the first geospatial orientation includes one or more gyroscopic angles.

4. The method of claim 1, wherein the database includes the media asset and the reference image tagged with the geographical location.

5. The method of claim 4, comprising:

receiving, from the user, an indication of the media asset;

identifying, from the database, the reference image from the media asset based on the determined geographical location and the indication of the media asset.

6. The method of claim 1, wherein at least one of the geographical location and the first geospatial orientation associated with the user image is determined from metadata extracted from the user image.

7. The method of claim 1, comprising:

based on the deviation between the first geospatial orientation and the second geospatial orientation being below a predefined threshold, overlaying a digital effect on the user image.

8. The method of claim 7, comprising:

subsequent to overlaying the digital effect on the user image, generating another notification for the user to change the position of the user device.

9. The method of claim 8, comprising:

receiving a second user image captured by the user device;

identifying, from the database, a second reference image from the media asset.

10. The method of claim 9, comprising:

based on a second deviation between geospatial orientation for the second user image and geospatial orientation for the second reference image being below the predefined threshold, overlaying a second digital effect on the second user image.

11. A system for recreating on a user device a reference image from a media asset, comprising:

the user device;

control circuitry configured to;

receive a user image captured by the user device;

determine a geographical location associated with the user image;

based on the determined geographical location;

identify, from a database, the reference image from the media asset;

determine a first geospatial orientation of the user device based on a view shown in the user image;

receive a second geospatial orientation of an imaging device that was used to generate the reference image;

determine whether the first geospatial orientation matches the second geospatial orientation;

based on the first geospatial orientation not matching the second geospatial orientation;

determine a deviation between the first geospatial orientation and the second geospatial orientation;

generate a notification for a user to change a position of the user device to approximate the second geospatial orientation based on the deviation; and

receive an updated user image captured by the user device placed at the changed position that approximates the second geospatial orientation.

12. The system of claim 11, wherein the geographical location includes at least one of a latitude coordinate and a longitude coordinate.

13. The system of claim 11, wherein the first geospatial orientation includes one or more gyroscopic angles.

14. The system of claim 11, wherein the database includes the media asset and the reference image tagged with the geographical location.

15. The system of claim 14, wherein the control circuitry is configured to:

receive, from the user, an indication of the media asset;

identify, from the database, the reference image from the media asset based on the determined geographical location and the indication of the media asset.

16. The system of claim 11, wherein at least one of the geographical location and the first geospatial orientation associated with the user image is determined from metadata extracted from the user image.

17. The system of claim 11, wherein the control circuitry is configured to:

based on the deviation between the first geospatial orientation and the second geospatial orientation being below a predefined threshold, overlay a digital effect on the user image.

18. The system of claim 17, wherein the control circuitry is configured to:

subsequent to overlaying the digital effect on the user image, generate another notification for the user to change the position of the user device.

19. The system of claim 18, wherein the control circuitry is configured to:

receive a second user image captured by the user device;

identify, from the database, a second reference image from the media asset.

20. The system of claim 19, wherein the control circuitry is configured to:

based on a second deviation between geospatial orientation for the second user image and geospatial orientation for the second reference image being below the predefined threshold, overlay a second digital effect on the second user image.