Virtualizing content

• US 10,210,658 B2
• Filed: 06/16/2015
• Issued: 02/19/2019
• Est. Priority Date: 10/31/2012
• Status: Active Grant

• Current Assignee: Outward, Inc. (Williams-Sonoma Inc.)
• Original Assignee: Outward, Inc. (Williams-Sonoma Inc.)
• Inventors: Chui, Clarence, Mignard, Marc
• Primary Examiner(s): Harold, Jefferey F
• Assistant Examiner(s): Haiem, Sean N.
• Application Number:
  US14/741,295
• Publication Number:
  US 20150363977A1
• Time in Patent Office: 1,344 Days
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/0125 one of the standards being a high definition standard

Abstract

Techniques for virtualizing content are disclosed. One or more objects comprising source video content are determined. The one or more objects comprising the source video content are virtualized by mapping each to and representing each with a corresponding database object. Data comprising the corresponding database objects is provided for rendering the source video content instead of any original pixel information of the source video content so that a virtualized version of the source video content is rendered.

Claims

1. A method, comprising:

identifying elements in source content;

mapping each identified element in the source content to a corresponding existing database object, wherein a set of existing database objects to which identified elements in the source content are mapped collectively defines a model environment representing the source content, wherein the model environment does not comprise any original source content but rather represents a virtualized version of the source content;

storing a specification of the model environment as a representation of the source content, wherein the specification of the model environment facilitates rendering of the model environment according to different rendering capabilities of any of a plurality of types of destination devices;

receiving a request for the source content from a prescribed destination device; and

in order to reduce communication bandwidth, providing the specification of the model environment instead of the source content to the prescribed destination device in response to the request for the source content from the prescribed destination device, wherein the specification of the model environment is provided to the prescribed destination device using less communication bandwidth than providing the source content, wherein the specification of the model environment provided to the prescribed destination device in response to the request for the source content from the prescribed destination device is used to render the model environment at the prescribed destination device from objects specified in the provided specification of the model environment, and wherein the model environment is rendered at the destination device based on a rendering capability of the destination device.

2. The method of claim 1, further comprising determining camera pose with respect to the source content and providing the same camera pose with respect to the model environment representing the source content.

3. The method of claim 1, wherein identifying elements is at least in part automated, at least in part assisted by human intervention, or both.

4. The method of claim 1, wherein mapping is at least in part automated, at least in part assisted by human intervention, or both.

5. The method of claim 1, wherein mapping comprises selecting an existing database object that best matches an identified element.

6. The method of claim 1, wherein mapping comprises purposely selecting a mismatching existing database object for an identified element.

7. The method of claim 1, wherein mapping comprises mapping an identified element that comprises a partial object to a whole or complete existing database object.

8. The method of claim 1, further comprising tracking and mapping motion of an identified element to motion of the corresponding existing database object in the model environment representing the source content.

9. The method of claim 1, wherein the source content is two-dimensional and the model environment representing the source content is three-dimensional.

10. The method of claim 1, wherein the source content comprises source video content.

11. A system, comprising:

a processor configured to;

identify elements in source content;

map each identified element in the source content to a corresponding existing database object, wherein a set of existing database objects to which identified elements in the source content are mapped collectively defines a model environment representing the source content, wherein the model environment does not comprise any original source content but rather represents a virtualized version of the source content;

store a specification of the model environment as a representation of the source content, wherein the specification of the model environment facilitates rendering of the model environment according to different rendering capabilities of any of a plurality of types of destination devices;

receive a request for the source content from a prescribed destination device; and

in order to reduce communication bandwidth, provide the specification of the model environment instead of the source content to the prescribed destination device in response to the request for the source content from the prescribed destination device wherein the specification of the model environment is provided to the prescribed destination device using less communication bandwidth than providing the source content, wherein the specification of the model environment provided to the prescribed destination device in response to the request for the source content from the prescribed destination device is used to render the model environment at the prescribed destination device from objects specified in the provided specification of the model environment, and wherein the model environment is rendered at the destination device based on a rendering capability of the destination device; and

a memory coupled to the processor and configured to provide the processor with instructions.

12. The system of claim 11, wherein the processor is further configured to determine camera pose with respect to the source content and provide the same camera pose with respect to the model environment representing the source content.

13. The system of claim 11, wherein the processor is further configured to receive human input for identifying elements, mapping elements, or both.

14. The system of claim 11, wherein to map comprises to select an existing database object that best matches an identified element.

15. The system of claim 11, wherein to map comprises to purposely select a mismatching existing database object for an identified element.

16. The system of claim 11, wherein to map comprises to map an identified element that comprises a partial object to a whole or complete existing database object.

17. The system of claim 11, wherein the processor is further configured to track and map motion of an identified element to motion of the corresponding existing database object in the model environment representing the source content.

18. The system of claim 11, wherein the source content is two-dimensional and the model environment representing the source content is three-dimensional.

19. The system of claim 11, wherein the source content comprises source video content.

20. A computer program product embodied in a non-transitory computer usable storage medium, comprising computer instructions which when executed cause a computer to perform the following steps:

identify elements in source content;

map each identified element in the source content to a corresponding existing database object, wherein a set of existing database objects to which identified elements in the source content are mapped collectively defines a model environment representing the source content, wherein the model environment does not comprise any original source content but rather represents a virtualized version of the source content;

store a specification of the model environment as a representation of the source content, wherein the specification of the model environment facilitates rendering of the model environment according to different rendering capabilities of any of a plurality of types of destination devices;

receive a request for the source content from a prescribed destination device; and

in order to reduce communication bandwidth, provide the specification of the model environment instead of the source content to the prescribed destination device in response to the request for the source content from the prescribed destination device wherein the specification of the model environment is provided to the prescribed destination device using less communication bandwidth than providing the source content, wherein the specification of the model environment provided to the prescribed destination device in response to the request for the source content from the prescribed destination device is used to render the model environment at the prescribed destination device from objects specified in the provided specification of the model environment, and wherein the model environment is rendered at the destination device based on a rendering capability of the destination device.

21. The computer program product of claim 20, further comprising computer instructions which when executed cause a computer to determine camera pose with respect to the source content and provide the same camera pose with respect to the model environment representing the source content.

22. The computer program product of claim 20, wherein to identify elements is at least in part automated, at least in part assisted by human intervention, or both.

23. The computer program product of claim 20, wherein to map is at least in part automated, at least in part assisted by human intervention, or both.

24. The computer program product of claim 20, wherein to map comprises to select an existing database object that best matches an identified element.

25. The computer program product of claim 20, wherein to map comprises to purposely select a mismatching existing database object for an identified element.

26. The computer program product of claim 20, wherein to map comprises to map an identified element that comprises a partial object to a whole or complete existing database object.

27. The computer program product of claim 20, further comprising computer instructions which when executed cause a computer to track and map motion of an identified element to motion of the corresponding existing database object in the model environment representing the source content.

28. The computer program product of claim 20, wherein the source content is two-dimensional and the model environment representing the source content is three-dimensional.

29. The computer program product of claim 20, wherein the source content comprises source video content.