CONTEXTUAL LOCAL IMAGE RECOGNITION DATASET

• US 20150371448A1
• Filed: 06/23/2015
• Published: 12/24/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: DAQRI, LLC
• Inventors: Mullins, Brian
• Granted Patent: US 9,613,462 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 2201/0084 Digital still camera

Abstract

A contextual local image recognition module of a device retrieves a primary content dataset from a server and then generates and updates a contextual content dataset based on an image captured with the device. The device stores the primary content dataset and the contextual content dataset. The primary content dataset comprises a first set of images and corresponding virtual object models. The contextual content dataset comprises a second set of images and corresponding virtual object models retrieved from the server.

Claims

1. A device comprising:

a processor configured by a contextual local image recognition module to retrieve a primary content dataset from a server, to generate and to update a contextual content dataset based on an image captured with the device; and

a storage device coupled to the processor, the storage device comprising the primary content dataset and the contextual content dataset, the primary content dataset comprising a first set of images and corresponding virtual object models, the contextual content dataset comprising a second set of images and corresponding virtual object models retrieved from the server.

2. The device of claim 1, wherein the contextual local image recognition module is configured to locally render the virtual object model corresponding to the image captured with the device when the image captured with the device corresponds to one of the first set of images in the storage device.

3. The device of claim 1, wherein the contextual local image recognition module is configured to request the server for the virtual object model corresponding to the image captured with the device when the image captured with the device does not correspond to one of the first set of images in the storage device.

4. The device of claim 3, wherein the contextual local image recognition module is configured to receive the virtual object model corresponding to the image captured with the device from the server, and to update the contextual content dataset when the image captured with the device does not correspond to one of the first set of images in the storage device.

5. The device of claim 1, wherein the contextual local image recognition module is configured to request the server for the virtual object model corresponding to the image captured with the device when the image captured with the device does not correspond to one of the second set of images in the storage device.

6. The device of claim 5, wherein the contextual local image recognition module is configured to receive the virtual object model corresponding to the image captured with the device from the server, and to update the contextual content dataset when the image captured with the device does not correspond to one of the second set of images in the storage device.

7. The device of claim 1, wherein the contextual local image recognition module is configured to determine usage conditions of the device, and to generate a request to the server for a third set of images and corresponding virtual object models based on the usage conditions.

8. The device of claim 7, wherein the contextual local image recognition module is configured to update the contextual content dataset with the third set of images and corresponding virtual object models.

9. The device of claim 7, wherein the usage conditions of the device comprises social information of a user of the device and location and time information of the device using a three-dimensional object generation application based on the contextual local image recognition module.

10. The device of claim 1, wherein the processor further comprises a three-dimensional object generation module configured to generate, in a display of the device, a visualization of a virtual object engaged with the image of a physical object captured with the device, the virtual object corresponding to the image, with a rendering of the visualization of the virtual object based a position of the device relative to the physical object.

11. A computer-implemented method comprising:

retrieving a primary content dataset from a server;

generating and updating, at a device, a contextual content dataset based on an image captured with the device; and

storing, at the device, the primary content dataset and the contextual content dataset, the primary content dataset comprising a first set of images and corresponding virtual object models, the contextual content dataset comprising a second set of images and corresponding virtual object models retrieved from the server.

12. The computer-implemented method of claim 11, further comprising:

locally rendering the virtual object model corresponding to the image captured with the device when the image captured with the device corresponds to one of the first set of images stored in the device.

13. The computer-implemented method of claim 11, further comprising:

requesting the server for the virtual object model corresponding to the image captured with the device when the image captured with the device does not correspond to one of the first set of images stored in device.

14. The computer-implemented method of claim 13, further comprising:

receiving the virtual object model corresponding to the image captured with the device from the server; and

updating the contextual content dataset when the image captured with the device does not correspond to one of the first set of images in the device.

15. The computer-implemented method of claim 11, further comprising:

requesting the server for the virtual object model corresponding to the image captured with the device when the image captured with the device does not correspond to one of the second set of images in the device.

16. The computer-implemented method of claim 15, further comprising:

receiving the virtual object model corresponding to the image captured with the device from the server; and

updating the contextual content dataset when the image captured with the device does not correspond to one of the second set of images in the device.

17. The computer-implemented method of claim 11, further comprising:

determining usage conditions of the device;

generating a request to the server for a third set of images and corresponding virtual object models; and

updating the contextual content dataset with the third set of images and corresponding virtual object models.

18. The computer-implemented method of claim 17, wherein the usage conditions of the device comprises social information of a user of the device;

and

location and time information of the device using a three-dimensional object generation application based on the contextual local image recognition module.

19. The computer-implemented method of claim 11, further comprising:

generating, in a display of the device, a visualization of a virtual object engaged with the image of a physical object captured with the device, the virtual object corresponding to the image, with a rendering of the visualization of the virtual object based on a position of the device relative to the physical object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

retrieving a primary content dataset from a server;

generating and updating, at a device, a contextual content dataset based on an image captured with the device; and

storing, at the device, the primary content dataset and the contextual content dataset, the primary content dataset comprising a first set of images and corresponding virtual object models, the contextual content dataset comprising a second set of images and corresponding virtual object models retrieved from the server.