TWO-DIMENSIONAL IMAGE CAPTURE FOR AN AUGMENTED REALITY REPRESENTATION

• US 20120314096A1
• Filed: 06/08/2011
• Published: 12/13/2012
• Est. Priority Date: 06/08/2011
• Status: Active Grant

• Current Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Kruglick, Ezekiel
• Granted Patent: US 9,058,687 B2
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/55 from multiple images

Abstract

Technologies and implementations for capturing two-dimensional images for an augmented reality representation are generally disclosed.

Claims

1. A method, comprising:

determining, by an electronic image capturing device, an augmented reality representation of an object based at least in part on an analysis of one or more two-dimensional images of the object, wherein the augmented reality representation includes a plurality of surface hypotheses;

determining one or more reliability values associated with individual surface hypotheses;

comparing the one or more reliability values with one or more threshold reliability criteria to identify one or more surface areas of interest from the plurality of surface hypotheses; and

displaying guidance regarding capturing one or more additional two-dimensional images of the object via a display of the electronic image capturing device, wherein the guidance is based at least in part on the identified surface areas of interest.

2. The method of claim 1, further comprising:

determining one or more viewing cones associated with individual surface areas of interest; and

determining a view range and orientation associated with one or more of the viewing cones based at least in part on a quality level input,

wherein the guidance is based at least in part on the view range and orientation associated with one or more of the viewing cones.

3. The method of claim 2, wherein the one or more viewing cones individually comprise a defined viewing area bounded by a defined viewing angle and centered by a surface normal vector.

4. The method of claim 1, further comprising:

monitoring real-time video data; and

determining a real-time relative position and orientation between the electronic image capturing device and the object based at least in part on the real-time video data,

wherein the guidance is based at least in part on the determined real-time relative position and orientation between the electronic image capturing device and the object.

5. The method of claim 1, wherein the augmented reality representation comprises a three-dimensional image of the object.

6. The method of claim 1, wherein the plurality of surface hypotheses are computed employing a Random Sample Consensus Surface Extraction (RANSAC) algorithm.

7. The method of claim 1, wherein the one or more threshold reliability criteria comprise one or more of the following criteria:

a pixel per area threshold, an incomplete image data threshold, and/or an absent image data threshold.

8. The method of claim 1, wherein the guidance indicates one or more vantage points for capturing the one or more additional two-dimensional images of the object.

9. The method of claim 1, wherein the guidance indicates the reliability values associated with individual surface hypotheses.

10. The method of claim 1, further comprising receiving an indication from a user that one or more two-dimensional images of the object have been selected, wherein the determining, by an electronic image capturing device, of the augmented reality representation of the object is based at least in part on the indication from the user.

11. An electronic image capturing device, comprising:

an optical sensor configured to capture two-dimensional images of an object and capture real-time video data; and

a control unit configured to;

determine an augmented reality representation of the object based at least in part on an analysis of one or more two-dimensional images of the object, wherein the augmented reality representation includes a plurality of surface hypotheses,

determine one or more reliability values associated with individual surface hypotheses,

compare of the one or more reliability values with one or more threshold reliability criteria to identify one or more surface areas of interest from the plurality of surface hypotheses,

determine guidance regarding capturing one or more additional two-dimensional images of the object via a display of the electronic image capturing device, wherein the guidance is based at least in part on the identified surface areas of interest.

12. The electronic image capturing device of claim 11, wherein the control unit is further configured to:

determine one or more viewing cones associated with individual surface areas of interest; and

determine a view range and orientation associated with one or more of the viewing cones based at least in part on a quality level input,

wherein the guidance is based at least in part on the view range and orientation associated with one or more of the viewing cones.

13. The electronic image capturing device of claim 12, wherein the one or more viewing cones individually comprise a defined viewing area bounded by a defined viewing angle and centered by a surface normal vector.

14. The electronic image capturing device of claim 11, wherein the control unit is further configured to:

monitor real-time video data; and

determine a real-time relative position and orientation between the electronic image capturing device and the object based at least in part on the real-time video data,

wherein the guidance is based at least in part on the determined real-time relative position and orientation between the electronic image capturing device and the object.

15. The electronic image capturing device of claim 11, wherein the augmented reality representation comprises a three-dimensional image of the object.

16. The electronic image capturing device of claim 11, wherein the plurality of surface hypotheses are computed employing a Random Sample Consensus Surface Extraction (RANSAC) algorithm.

17. The electronic image capturing device of claim 11, wherein the one or more threshold reliability criteria comprise one or more of the following criteria:

a pixel per area threshold, an incomplete image data threshold, and/or an absent image data threshold.

18. The electronic image capturing device of claim 11, wherein the guidance indicates one or more vantage points for capturing the one or more additional two-dimensional images of the object.

19. The electronic image capturing device of claim 11, wherein the guidance indicates the reliability values associated with individual surface hypotheses.

20. The electronic image capturing device of claim 11, wherein the electronic image capturing device comprises a digital camera, a cell phone, a personal data assistant, a mobile computing pad, a personal media player device, or a wireless web-watch device.

21. An article comprising:

a signal bearing medium comprising machine-readable instructions stored thereon, which, if executed by one or more processors, operatively enable a computing device to;

determine an augmented reality representation of an object based at least in part on an analysis of one or more two-dimensional images of the object, wherein the augmented reality representation includes a plurality of surface hypotheses;

determine one or more reliability values associated with individual surface hypotheses;

compare of the one or more reliability values with one or more threshold reliability criteria to identify one or more surface areas of interest from the plurality of surface hypotheses; and

determine guidance regarding capturing one or more additional two-dimensional images of the object via a display of the electronic image capturing device, wherein the guidance is based at least in part on the identified surface areas of interest.