AUGMENTATION OF ELEMENTS IN DATA CONTENT

• US 20140146084A1
• Filed: 01/06/2014
• Published: 05/29/2014
• Est. Priority Date: 05/14/2012
• Status: Active Grant

• Current Assignee: Sphero Inc.
• Original Assignee: Orbotix Incorporated
• Inventors: Polo, Fabrizio, Castator-Smith, Skylar, Wilson, Adam, Smith, Brian, Martin, Patrick, Dorris, Brandon
• Granted Patent: US 9,292,758 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes

Abstract

A system and method are disclosed for processing data content. Received data content comprises a scene and includes one or more recognized objects. The recognized object(s) include various characteristics, and can be detected and tracked during content capture. The data content can then be stored, and incorporated with metadata associated with the recognized object and/or one or more other elements in the data content. User inputs can be enabled in real-time, or post-capture, to augment one or more of the elements in the stored data content, including one or more characteristics of the recognized object. The data content can then be augmented to introduce one or more augmented elements, corresponding to respective elements of the data content, into the data content based on the user inputs.

Claims

1. A method of processing data content, the method being performed by one or more processors and comprising:

receiving the data content, the data content comprising a scene including a recognized object;

detecting and tracking the recognized object over a duration of the data content;

storing the data content, including storing metadata associated with one or more elements of the data content, the one or more elements including characteristics of the recognized object;

enabling user inputs to augment the one or more elements of the stored data content;

augmenting the data content by introducing one or more augmented elements into the data content based on the user inputs, the one or more augmented elements corresponding to a respective one or more elements of the stored data content.

2. The method of claim 1, further comprising enabling real-time virtual augmentation of the one or more elements of the data content.

3. The method of claim 1, further comprising outputting augmented data content, including the one or more augmented elements, based on the user inputs.

4. The method of claim 3, wherein the one or more elements includes an audio characteristic of the data content, and wherein the outputted augmented data content includes augmented audio content based on the user inputs.

5. The method of claim 1, wherein the data content corresponds to a raw video of the scene including the recognized object.

6. The method of claim 3, wherein the recognized object outputs data corresponding to the characteristics of the recognized object, the outputted data being associated with metadata corresponding to the characteristics, and wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing selectable augmented elements corresponding to one or more of the characteristics of the recognized object.

7. The method of claim 3, wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing a set of selectable virtual characters to represent the recognized object in the outputted augmented data content.

8. A system comprising:

a display;

one or more capturing components to capture data content;

one or more memory resources to store recorded data content, metadata associated with the recorded data content, and a plurality of augmentation elements associated with the metadata;

one or more processors to;

receive the data content, the data content comprising a scene including a recognized object;

detect and track the recognized object over a duration of the data content;

store the data content, including storing metadata associated with one or more elements of the data content, the one or more elements including characteristics of the recognized object;

enable user inputs to augment the one or more elements of the stored data content;

augment the data content by introducing one or more augmented elements into the data content based on the user inputs, the one or more augmented elements corresponding to a respective one or more elements of the stored data content.

9. The system of claim 8, wherein the one or more processors further enable real-time virtual augmentation of the one or more elements of the data content.

10. The system of claim 8, wherein the one or more processors further output augmented data content including the one or more augmented elements to the display.

11. The system of claim 10, wherein the one or more elements includes an audio characteristic of the data content, and wherein the outputted augmented data content includes augmented audio content.

12. The system of claim 8, wherein the data content corresponds to raw video of the scene including the recognized object.

13. The system of claim 10, wherein the recognized object outputs data corresponding to the characteristics of the recognized object, the outputted data being associated with metadata corresponding to the characteristics, and wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing selectable augmented elements corresponding to one or more of the characteristics of the recognized object.

14. The system of claim 10, wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing a set of selectable virtual characters to represent the recognized object in the outputted augmented data content.

15. A non-transitory computer-readable medium, storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive data content, the data content comprising a scene including a recognized object;

detect and track the recognized object over a duration of the data content;

store the data content, including storing metadata associated with one or more elements of the data content, the one or more elements including characteristics of the recognized object;

enable user inputs to augment the one or more elements of the stored data content;

augment the data content by introducing one or more augmented elements into the data content based on the user inputs, the one or more augmented elements corresponding to a respective one or more elements of the stored data content.

16. The non-transitory computer-readable medium of claim 15, wherein enabling the user inputs includes enabling real-time virtual augmentation of the one or more elements of the data content.

17. The non-transitory computer-readable medium of claim 15, wherein the instructions, when executed, further cause the one or more processors to output augmented data content, including the one or more augmented elements to a display of the computing device, based on the user inputs.

18. The non-transitory computer-readable medium of claim 17, wherein the one or more elements includes an audio characteristic of the data content, and wherein the outputted augmented data content includes augmented audio content based on the user inputs.

19. The non-transitory computer-readable medium of claim 17, wherein the recognized object outputs data corresponding to the characteristics of the recognized object, the outputted data being associated with metadata corresponding to the characteristics, and wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing selectable augmented elements corresponding to one or more of the characteristics of the recognized object.

20. The non-transitory computer-readable medium of claim 17, wherein enabling the user inputs to augment the one or more elements of the stored data content includes providing a set of selectable virtual characters to represent the recognized object in the outputted augmented data content.