Tagging virtualized content

• US 10,387,729 B2
• Filed: 07/09/2014
• Issued: 08/20/2019
• Est. Priority Date: 07/09/2013
• Status: Active Grant

• Current Assignee: Outward, Inc. (Williams-Sonoma Inc.)
• Original Assignee: Outward, Inc. (Williams-Sonoma Inc.)
• Inventors: Chui, Clarence
• Primary Examiner(s): Rush, Eric
• Application Number:
  US14/327,467
• Publication Number:
  US 20150016714A1
• Time in Patent Office: 1,868 Days
• Field of Search: 382100, 382154, 382159, 382160, 382180, 382181, 382209, 382224, 382228, 382229, 382285, 382291, 345419, 345420, 345581, 715230, 715231
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/35 Categorising the entire scene, e.g. birthday party or wedding scene
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/647 by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 20/70 Labelling scene content, e.g. deriving syntactic or semantic representations
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Techniques for tagging virtualized content are disclosed. In some embodiments, a modeled three-dimensional scene of objects representing abstracted source content is generated and analyzed to determine a contextual characteristic of the scene that is based on a plurality of objects comprising the scene. The modeled scene is tagged with a tag specifying the determined contextual characteristic.

Claims

1. A system, comprising:

a processor configured to;

map elements comprising source content to a set of existing three-dimensional database objects to generate a modeled three-dimensional scene comprising a virtualized version of the source content, wherein the virtualized version of the source content comprises a re-imagined version of the source content based on existing database assets and does not include any original pixel data of the source content;

modify the set of existing three-dimensional database objects according to one or more criteria to alter the modeled three-dimensional scene comprising the virtualized version of the source content;

analyze properties of the modified set of existing three-dimensional database objects that are specified with corresponding object definitions to determine a contextual characteristic of the modeled three-dimensional scene comprising the virtualized version of the source content; and

tag the modeled three-dimensional scene comprising the virtualized version of the source content with a tag specifying the determined contextual characteristic; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system of claim 1, wherein the source content comprises two-dimensional content.

3. The system of claim 1, wherein the modeled three-dimensional scene is specified by object definitions and relative positions and orientations of the objects in the scene.

4. The system of claim 1, wherein to analyze properties comprises to compute a metric associated with at least a subset of the modified set of existing three-dimensional database objects.

5. The system of claim 1, wherein to analyze properties comprises to perform a statistical analysis of at least a subset of the modified set of existing three-dimensional database objects.

6. The system of claim 1, wherein the contextual characteristic is based on a number or a density of objects in the scene.

7. The system of claim 1, wherein the contextual characteristic is based on a type or a class of objects comprising the scene.

8. The system of claim 1, wherein the contextual characteristic is based on a spatial relationship of objects comprising the scene.

9. The system of claim 1, wherein the contextual characteristic is based on a correlation of objects comprising the scene.

10. The system of claim 1, wherein the contextual characteristic is based on motion of objects comprising the scene.

11. The system of claim 1, wherein the contextual characteristic is based on a time evolution of objects comprising the scene.

12. The system of claim 1, wherein the processor is further configured to interpret the contextual characteristic and map the contextual characteristic to a behavior.

13. The system of claim 1, wherein the processor is further configured to map the contextual characteristic to an action and tag the scene with a tag specifying the action.

14. The system of claim 1, wherein the tag is associated with an object comprising the scene.

15. The system of claim 1, wherein the tag is associated with a frame comprising the scene.

16. The system of claim 1, wherein the tag is inherited by each frame derived from the scene.

17. The system of claim 1, wherein the processor is further configured to determine an advertisement provided with respect to the scene based on the determined contextual characteristic.

18. The system of claim 1, wherein the tagged scene is searchable via the contextual characteristic.

19. The system of claim 1, wherein to map a source content element to an existing database object comprises to map a source content element to a best matching existing database object available.

20. The system of claim 1, wherein to map a source content element to an existing database object comprises to map a source content element to a purposely misinterpreted or mismatched existing database object.

21. The system of claim 1, wherein to map a source content element to an existing database object comprises to map a partial source content element to a complete or whole existing database object.

22. The system of claim 1, wherein altering the modeled three-dimensional scene comprises customizing the modeled three-dimensional scene.

23. The system of claim 1, wherein modifying the set of existing three-dimensional database objects comprises substituting one or more objects comprising the set of existing database objects with alternatives.

24. The system of claim 1, wherein modifying the set of existing three-dimensional database objects comprises adding or removing one or more objects to or from the set of existing database objects.

25. A method, comprising:

mapping elements comprising source content to a set of existing three-dimensional database objects to generate a modeled three-dimensional scene comprising a virtualized version of the source content, wherein the virtualized version of the source content comprises a re-imagined version of the source content based on existing database assets and does not include any original pixel data of the source content;

modifying the set of existing three-dimensional database objects according to one or more criteria to alter the modeled three-dimensional scene comprising the virtualized version of the source content;

analyzing properties of the modified set of existing three-dimensional database objects that are specified with corresponding object definitions to determine a contextual characteristic of the modeled three-dimensional scene comprising the virtualized version of the source content; and

tagging the modeled three-dimensional scene comprising the virtualized version of the source content with a tag specifying the determined contextual characteristic.

26. The method of claim 25, wherein the source content comprises two-dimensional content.

27. The method of claim 25, wherein the modeled three-dimensional scene is specified by object definitions and relative positions and orientations of the objects in the scene.

28. The method of claim 25, wherein analyzing properties comprises computing a metric associated with at least a subset of the modified set of existing three-dimensional database objects.

29. The method of claim 25, wherein analyzing properties comprises performing a statistical analysis of at least a subset of the modified set of existing three-dimensional database objects.

30. The method of claim 25, wherein the contextual characteristic is based on a number or a density of objects in the scene.

31. The method of claim 25, wherein the contextual characteristic is based on a type or a class of objects comprising the scene.

32. The method of claim 25, wherein the contextual characteristic is based on a spatial relationship of objects comprising the scene.

33. The method of claim 25, wherein the contextual characteristic is based on a correlation of objects comprising the scene.

34. The method of claim 25, wherein the contextual characteristic is based on motion of objects comprising the scene.

35. The method of claim 25, wherein the contextual characteristic is based on a time evolution of objects comprising the scene.

36. The method of claim 25, further comprising interpreting the contextual characteristic and mapping the contextual characteristic to a behavior.

37. The method of claim 25, further comprising mapping the contextual characteristic to an action and tagging the scene with a tag specifying the action.

38. The method of claim 25, wherein the tag is associated with an object comprising the scene.

39. The method of claim 25, wherein the tag is associated with a frame comprising the scene.

40. The method of claim 25, wherein the tag is inherited by each frame derived from the scene.

41. The method of claim 25, further comprising determining an advertisement provided with respect to the scene based on the determined contextual characteristic.

42. The method of claim 25, wherein the tagged scene is searchable via the contextual characteristic.

43. The method of claim 25, wherein mapping a source content element to an existing database object comprises mapping a source content element to a best matching existing database object available.

44. The method of claim 25, wherein mapping a source content element to an existing database object comprises mapping a source content element to a purposely misinterpreted or mismatched existing database object.

45. The method of claim 25, wherein mapping a source content element to an existing database object comprises mapping a partial source content element to a complete or whole existing database object.

46. The method of claim 25, wherein altering the modeled three-dimensional scene comprises customizing the modeled three-dimensional scene.

47. The method of claim 25, wherein modifying the set of existing three-dimensional database objects comprises substituting one or more objects comprising the set of existing database objects with alternatives.

48. The method of claim 25, wherein modifying the set of existing three-dimensional database objects comprises adding or removing one or more objects to or from the set of existing database objects.

49. A computer program product stored on a non-transitory computer readable storage medium and comprising computer instructions which when executed cause a computer to:

map elements comprising source content to a set of existing three-dimensional database objects to generate a modeled three-dimensional scene comprising a virtualized version of the source content, wherein the virtualized version of the source content comprises a re-imagined version of the source content based on existing database assets and does not include any original pixel data of the source content;

modify the set of existing three-dimensional database objects according to one or more criteria to alter the modeled three-dimensional scene comprising the virtualized version of the source content;

analyze properties of the modified set of existing three-dimensional database objects that are specified with corresponding object definitions to determine a contextual characteristic of the modeled three-dimensional scene comprising the virtualized version of the source content; and

tag the modeled three-dimensional scene comprising the virtualized version of the source content with a tag specifying the determined contextual characteristic.

50. The computer program product of claim 49, wherein the source content comprises two-dimensional content.

51. The computer program product of claim 49, wherein the modeled three- dimensional scene is specified by object definitions and relative positions and orientations of the objects in the scene.

52. The computer program product of claim 49, wherein to analyze properties comprises to compute a metric associated with at least a subset of the modified set of existing three-dimensional database objects.

53. The computer program product of claim 49, wherein to analyze properties comprises to perform a statistical analysis of at least a subset of the modified set of existing three-dimensional database objects.

54. The computer program product of claim 49, wherein the contextual characteristic is based on a number or a density of objects in the scene.

55. The computer program product of claim 49, wherein the contextual characteristic is based on a type or a class of objects comprising the scene.

56. The computer program product of claim 49, wherein the contextual characteristic is based on a spatial relationship of objects comprising the scene.

57. The computer program product of claim 49, wherein the contextual characteristic is based on a correlation of objects comprising the scene.

58. The computer program product of claim 49, wherein the contextual characteristic is based on motion of objects comprising the scene.

59. The computer program product of claim 49, wherein the contextual characteristic is based on a time evolution of objects comprising the scene.

60. The computer program product of claim 49, further comprising computer instructions which when executed cause a computer to interpret the contextual characteristic and map the contextual characteristic to a behavior.

61. The computer program product of claim 49, further comprising computer instructions which when executed cause a computer to map the contextual characteristic to an action and tag the scene with a tag specifying the action.

62. The computer program product of claim 49, wherein the tag is associated with an object comprising the scene.

63. The computer program product of claim 49, wherein the tag is associated with a frame comprising the scene.

64. The computer program product of claim 49, wherein the tag is inherited by each frame derived from the scene.

65. The computer program product of claim 49, further comprising computer instructions which when executed cause a computer to determine an advertisement provided with respect to the scene based on the determined contextual characteristic.

66. The computer program product of claim 49, wherein the tagged scene is searchable via the contextual characteristic.

67. The computer program product of claim 49, wherein to map a source content element to an existing database object comprises to map a source content element to a best matching existing database object available.

68. The computer program product of claim 49, wherein to map a source content element to an existing database object comprises to map a source content element to a purposely misinterpreted or mismatched existing database object.

69. The computer program product of claim 49, wherein to map a source content element to an existing database object comprises to map a partial source content element to a complete or whole existing database object.

70. The computer program product of claim 49, wherein altering the modeled three- dimensional scene comprises customizing the modeled three-dimensional scene.

71. The computer program product of claim 49, wherein modifying the set of existing three-dimensional database objects comprises substituting one or more objects comprising the set of existing database objects with alternatives.

72. The computer program product of claim 49, wherein modifying the set of existing three-dimensional database objects comprises adding or removing one or more objects to or from the set of existing database objects.