Visual completion

• US 8,971,571 B1
• Filed: 03/15/2012
• Issued: 03/03/2015
• Est. Priority Date: 01/06/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Starner, Thad Eugene, Essa, Irfan
• Primary Examiner(s): Bayat, Ali
• Application Number:
  US13/421,127
• Time in Patent Office: 1,083 Days
• Field of Search: 382/100, 382/103, 382/107, 382/232, 382/236
• US Class Current: 382/103
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.

Claims

1. A method comprising:

receiving video data recorded by a camera on a wearable computing device;

based on the video data, detecting a movement corresponding to a selection of an object;

before the movement is complete, initiating a search on the object of an object-model database; and

during the movement, periodically updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.

2. The method of claim 1, wherein the object-models comprise at least one of two-dimensional images and three-dimensional models.

3. The method of claim 1, wherein at least one of the object-models comprises a representation of the object.

4. The method of claim 1, wherein the object-models are semi-transparent.

5. The method of claim 1, wherein overlaying the object with each object-model comprises aligning the object-model with the object.

6. The method of claim 5, wherein aligning the object-model with the object comprises at least one of scaling the object-model and rotating the object-model.

7. The method of claim 1, further comprising receiving an acceptance of one of the object-models.

8. The method of claim 7, further comprising causing the wearable computing device to display information associated with the accepted object-model.

9. The method of claim 1, wherein the movement comprises a movement corresponding to an outline of the object.

10. The method of claim 1, wherein the movement comprises a movement that occludes the object.

11. The method of claim 1, wherein the movement comprises one of a rotation of the object and a rotation around the object.

12. A method comprising:

causing a camera on a wearable computing device to record video data of a movement corresponding to a selection of an object;

before the movement is complete, initiating a search on the object of an object-model database; and

during the movement, periodically updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.

13. The method of claim 12, wherein initiating the search comprises transmitting to a server a request for the search, the request comprising at least a portion of the video data.

14. The method of claim 12, further comprising displaying the video data on the display.

15. The method of claim 12, further comprising:

during the movement, causing the wearable computing device to display information associated with each of the object-models.

16. The method of claim 12, further comprising:

receiving an acceptance of one of the object-models; and

responsively causing the wearable computing device to display information associated with the accepted object-model.

17. The method of claim 12, further comprising:

during the movement, caching information associated with each of the object-models;

receiving an acceptance of one of the object-models; and

responsively causing the wearable computing device to display the cached information associated with the accepted object-model.

18. A method comprising:

a wearable computing device receiving a selection of an object;

initiating a search on the object of an object-model database; and

updating the search and causing the wearable computing device to overlay, on a display, the object with object-models from the database corresponding to results of the search.