Augmentation of elements in a data content

• US 9,483,876 B2
• Filed: 02/05/2016
• Issued: 11/01/2016
• Est. Priority Date: 05/14/2012
• Status: Active Grant

• Current Assignee: Sphero Inc.
• Original Assignee: Sphero Inc.
• Inventors: Polo, Fabrizio, Castator-Smith, Skylar, Wilson, Adam, Smith, Brian, Martin, Patrick, Dorris, Brandon
• Primary Examiner(s): Koziol, Stephen R
• Assistant Examiner(s): Azima, Shaghayegh
• Application Number:
  US15/017,211
• Publication Number:
  US 20160155272A1
• Time in Patent Office: 270 Days
• Field of Search: 382/103
• US Class Current: 1/1
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes

Abstract

A computing device can augment video content by receiving video content from an image capturing device and detecting and tracking a self-propelled device in the video content. The computing device can display a plurality of augmented reality elements selectable to augment the self-propelled device and receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device. The computing device may then augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

Claims

1. A mobile computing device comprising:

a touch-sensitive display;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, cause the mobile computing device to;

receive video content from an image capturing device;

detect and track a self-propelled device in the video content;

display, on the touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

2. The mobile computing device of claim 1, wherein the executed instructions further cause the mobile computing device to:

receive real-time data from the self-propelled device; and

provide an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

3. The mobile computing device of claim 2, wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

4. The mobile computing device of claim 3, wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

5. The mobile computing device of claim 1, wherein the executed instructions further cause the mobile computing device to:

store the video content to enable a user of the mobile computing device to augment the stored video content after capture.

6. The mobile computing device of claim 1, wherein the executed instructions further cause the mobile computing device to:

provide an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

7. The mobile computing device of claim 1, wherein the executed instructions further cause the mobile computing device to:

identify a plurality of elements in the video content;

generate content metadata corresponding to each of the plurality of elements;

using the content metadata, associate each of the plurality of elements with a number of corresponding augmented reality elements;

provide an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augment the video content to include the selected respective augmented element for each of the plurality of elements.

8. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a mobile computing device, cause the mobile computing device to:

receive video content from an image capturing device;

detect and track a self-propelled device in the video content;

display, on a touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receive a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augment the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

9. The non-transitory computer-readable medium of claim 8, wherein the executed instructions further cause the mobile computing device to:

receive real-time data from the self-propelled device; and

provide an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

10. The non-transitory computer-readable medium of claim 9, wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

11. The non-transitory computer-readable medium of claim 10, wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

12. The non-transitory computer-readable medium of claim 8, wherein the executed instructions further cause the mobile computing device to:

store the video content to enable a user of the mobile computing device to augment the stored video content after capture.

13. The non-transitory computer-readable medium of claim 8, wherein the executed instructions further cause the mobile computing device to:

provide an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

14. The non-transitory computer-readable medium of claim 8, wherein the executed instructions further cause the mobile computing device to:

identify a plurality of elements in the video content;

generate content metadata corresponding to each of the plurality of elements;

using the content metadata, associate each of the plurality of elements with a number of corresponding augmented reality elements;

provide an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augment the video content to include the selected respective augmented element for each of the plurality of elements.

15. A computer-implemented method of augmenting video content, the method being performed by one or more processors of a mobile computing device and comprising:

receiving video content from an image capturing device;

detecting and tracking a self-propelled device in the video content;

displaying, on a touch-sensitive display, a plurality of augmented reality elements selectable to augment the self-propelled device;

receiving a user selection of one of the plurality of augmented reality elements to augment the self-propelled device; and

augmenting the self-propelled device in the video content by superimposing the selected augmented reality element over the self-propelled device as the self-propelled device moves.

16. The method of claim 15 further comprising:

receiving real-time data from the self-propelled device; and

providing an augmentation tool on the touch-sensitive display to enable a user of the mobile computing device to augment the self-propelled device in real time.

17. The method of claim 16, wherein the real-time data received from the self-propelled device comprises one or more of orientation data, temperature data, or power level data of the self-propelled device.

18. The method of claim 17, wherein the selected augmented reality element for the self-propelled device visually represents the real-time data received from the self-propelled device.

19. The method of claim 15, further comprising:

providing an interface feature on the touch-sensitive display to enable a user of the mobile computing device to share the video content, including the augmented self-propelled device, with a number of other users.

20. The method of claim 15, further comprising:

identifying a plurality of elements in the video content;

generating content metadata corresponding to each of the plurality of elements;

using the content metadata, associating each of the plurality of elements with a number of corresponding augmented reality elements;

providing an augmentation tool on the touch-sensitive display to enable a user to select a respective augmented reality element for each of the plurality of elements; and

augmenting the video content to include the selected respective augmented element for each of the plurality of elements.