REAL TIME OBJECT SCANNING USING A MOBILE PHONE AND CLOUD-BASED VISUAL SEARCH ENGINE

• US 20140233854A1
• Filed: 02/15/2013
• Published: 08/21/2014
• Est. Priority Date: 02/15/2013
• Status: Active Grant

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Zhong, Yu, Garrigues, Pierre, Culpepper, Benjamin Jackson
• Granted Patent: US 9,633,272 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A system for tagging an object comprises and interface and a processor. The interface is configured to receive an image. The processor is configured to determine a key frame. Determining a key frame comprises determining that the image is stable. The processor is configured to determine a tag for an item in the key frame.

Claims

1. A system for tagging an object, comprising:

an interface configured to receive an image; and

a processor configured to;

determine a key frame, wherein determining a key frame comprises determining that the image is stable; and

determine a tag for an item in the key frame.

2. A system as in claim 1, wherein determining that an image is stable comprises determining a feature.

3. A system as in claim 2, wherein the feature is in a current frame and in a prior frame.

4. A system as in claim 2, wherein the feature is one of a plurality of features.

5. A system as in claim 4, wherein a percentage of the plurality of features is above a threshold for a predetermined number of frames.

6. A system as in claim 4, wherein a number of the plurality of features is above a threshold for a predetermined number of frames.

7. A system as in claim 4, wherein each of the plurality of features is in the current frame and the prior frame.

8. A system as in claim 4, wherein movement is determined associated with each of the plurality of features.

9. A system as in claim 8, wherein in the event that a specific feature of the plurality of features has movement above a threshold, remove the specific feather point from the plurality of features.

10. A system as in claim 1, wherein the image is received from a camera on a mobile device.

11. A system as in claim 10, wherein the mobile device comprises a mobile phone.

12. A system as in claim 10, wherein the mobile device comprises a tablet.

13. A system as in claim 1, wherein the tag is determined using a computer vision engine.

14. A system as in claim 1, wherein the tag is determined using a human computation module.

15. A system as in claim 14, wherein the human computation module requests the tag from one or more human taggers.

16. A system as in claim 15, wherein the human computation module determines validity of the tag.

17. A system as in claim 14, wherein the tag is determine using the human computation module in the event that the tag could not be determined using the computer vision module.

18. A system as in claim 1, wherein the key frame has visual content different from visual content from a previous key frame.

19. A method for tagging an object, comprising:

determining a key frame, wherein determining a key frame comprises determining that an image is stable; and

determining a tag for an item in the key frame.

20. A computer program product for tagging an object, the computer program product being embodied in a tangible computer readable storage medium and comprising computer instructions for:

determining a key frame, wherein determining a key frame comprises determining that an image is stable; and

determining a tag for an item in the key frame.