Geo-referencing media content

• US 9,843,642 B2
• Filed: 01/21/2015
• Issued: 12/12/2017
• Est. Priority Date: 01/28/2014
• Status: Active Grant

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Inventors: Mateos Sole, Antonio
• Primary Examiner(s): Sison, June
• Assistant Examiner(s): Nguyen, Steven
• Application Number:
  US14/601,721
• Publication Number:
  US 20150215410A1
• Time in Patent Office: 1,056 Days
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

Geo origination data is generated for a geo-tagged media device of a user from measurements performed by sensors. The geo origination data is sent to a server system. At the server system, geo-tagged media content elements are selected based on the geo origination data. Further, based on the selected geo-tagged media content elements and the geo origination data, geo-referenced rendering data to be used for rendering media content from the selected geo-tagged media content elements perceivable to the user of the geo-tagged media device is generated. The geo-referenced rendering data can be streamed to the geo-tagged media device along with media content derived from the geo-tagged media content elements for rendering at the geo-tagged media device.

Claims

1. A method, comprising:

receiving geo origination data and non-locational sensor data from a geo-tagged media device of a user;

selecting, based at least in part on the geo origination data, one or more geo-tagged media content elements from a plurality of geo-tagged media content elements;

generating, based at least in part on the one or more selected geo-tagged media content elements and the geo origination data, geo-referenced rendering data for the one or more selected geo-tagged media content elements, the geo-referenced rendering data to be used for rendering media content from the one or more selected geo-tagged media content elements perceivable to the user of the geo-tagged media device;

selecting, based at least in part on the non-locational sensor data, one or more second geo-tagged media content elements from the plurality of geo-tagged media content elements;

generating, based at least in part on the one or more second selected geo-tagged media content elements and the non-locational sensor data, second geo-referenced rendering data for the one or more second selected geo-tagged media content elements, the second geo-referenced rendering data to be used for rendering second media content from the one or more second selected geo-tagged media content elements perceivable to the user of the geo-tagged media device;

wherein the method is performed by one or more computing devices.

2. The method of claim 1, wherein the method is performed by a cloud-based media content provider system.

3. The method of claim 1, wherein the one or more geo-tagged media content elements comprises at least one geo-tagged media content element of the one or more second geo-tagged media content elements.

4. The method of claim 1, wherein at least one geo-tagged media content element of the one or more second geo-tagged media content elements comprises one or more pre-configured rendering properties;

and wherein the second geo-referenced rendering data comprises at least one pre-configured rendering property of the one or more pre-configured rendering properties as modified based at least in part on the non-locational sensor data.

5. The method of claim 1, wherein at least one geo-tagged media content element of the one or more geo-tagged media content elements comprises one or more pre-configured rendering properties;

and wherein the geo-referenced rendering data comprises at least one pre-configured rendering property, of the one or more pre-configured rendering properties, as modified based at least in part on the geo origination data.

6. The method of claim 1, further comprising generating one or more geo-referenced media content elements that include the geo-referenced rendering data and media content from the one or more selected geo-tagged media content elements.

7. The method of claim 6, further comprising:

analyzing non-locational data and the geo origination data collected from the geo-tagged media device to determine one or more actions of the user; and

modifying at least one of the one or more geo-referenced media content elements based on the one or more actions of the user.

8. The method of claim 6, further comprising causing the one or more geo-referenced media content elements to be streamed to and rendered with the geo-tagged media device.

9. The method of claim 6, further comprising:

rendering the one or more geo-referenced media content elements into one or more media frame at a cloud-based server;

encoding the one or more media frames that have rendered the one or more geo-referenced media content elements into a media data stream;

transmitting the media data stream from the cloud-based server to the geo-tagged media device.

10. The method of claim 1, wherein a media data stream is used to stream the geo-referenced rendering data as metadata and media content from the one or more geo-tagged media content elements;

and wherein the metadata in the media data stream is separate from the media content in the media data stream.

11. The method of claim 1, wherein the geo-referenced rendering data and the media content are formatted into one or more media content objects encoded in a media data stream to the geo-tagged media device.

12. The method of claim 1, wherein the geo-referenced rendering data comprises one or more rendering relationships among different entities;

and wherein the different entities include two or more of geo-tagged media content elements, users, media devices, user actions, or external conditions.

13. The method of claim 12, wherein the one or more rendering relationships include at least one rendering relationship among different geo-tagged media content elements in the selected one or more geo-tagged media content elements.

14. The method of claim 1, further comprising:

receiving second geo origination data from a second geo-tagged media device of a second user;

generating, based at least in part on the one or more selected geo-tagged media content elements and the second geo origination data, second geo-referenced rendering data for the one or more selected geo-tagged media content elements, the geo-referenced rendering data to be used for rendering media content from the one or more selected geo-tagged media content elements perceivable to the second user of the second geo-tagged media device.

15. The method of claim 1, wherein at least one geo-tagged media content element is stored at a cloud-based content repository.

16. The method of claim 1, wherein at least one geo-tagged media content element is constructed from a media content feed received from a geo-tagged media device.

25. A non-transitory computer readable medium storing computer instructions which, when executed by one or more computing processors, cause the one or more computing processors to perform the method of claim 1.

27. An apparatus comprising:

one or more computing processors;

a non-transitory computer readable medium that stores computer instructions which,

when executed by the one or more computing processors, cause the one or more computing processors to perform the method of claim 1.

17. A method, comprising:

performing measurements with one or more sensors;

generating, based on the measurements, geo origination data and non-locational sensor data for a geo-tagged media device of a user;

sending the geo origination data and the non-locational sensor data to a server system configured to select, based at least in part on the geo origination data, one or more geo-tagged media content elements, and to generate, based at least in part on the geo origination data and the one or more selected geo-tagged media content elements, geo-referenced rendering data for the one or more selected geo-tagged media content elements, the geo-referenced rendering data to be used for rendering media content from the one or more selected geo-tagged media content elements perceivable to the user of the geo-tagged media device;

wherein the server system is further configured to select, based at least in part on the non-locational sensor data, one or more second geo-tagged media content elements, and to generate, based at least in part on the non-locational sensor data and the one or more selected second geo-tagged media content elements, second geo-referenced rendering data for the one or more selected second geo-tagged media content elements, the second geo-referenced rendering data to be used for rendering media content from the one or more selected second geo-tagged media content elements perceivable to the user of the geo-tagged media device;

wherein the method is performed by one or more computing devices.

18. The method of claim 17, wherein the method is performed by the geo-tagged media device.

19. The method of claim 17, further comprising:

generating, based on the measurements, non-locational sensor data for the geo-tagged media device of a user;

sending the non-locational sensor data to the server system.

20. The method of claim 17, further receiving one or more geo-referenced media content elements that include the geo-referenced rendering data and media content from the one or more selected geo-tagged media content elements.

21. The method of claim 17, further comprising receiving one or more video frames in to which media content from the one or more selected geo-tagged media content elements has been rendered based at least in part on the geo-referenced rendering data.

22. The method of claim 17, further comprising decoding the geo-referenced rendering data as metadata from an input media data stream, and decoding media content of the one or more geo-tagged media content elements from the same input media data stream.

23. The method of claim 17, wherein the geo-referenced rendering data comprises one or more rendering relationships among different entities;

and wherein the different entities include two or more of geo-tagged media content elements, users, media devices, user actions, or external conditions.

24. The method of claim 17, further comprising sending to the server system a media content feed for constructing at least one geo-referenced media content element to be rendered at one or more geo-tagged media devices.

26. A non-transitory computer readable medium storing computer instructions which, when executed by one or more computing processors, cause the one or more computing processors to perform the method of claim 17.

28. An apparatus comprising:

one or more computing processors;

a non-transitory computer readable medium that stores computer instructions which,

when executed by the one or more computing processors, cause the one or more computing processors to perform the method of claim 17.