SYSTEM AND METHOD FOR PRESENTING TRUE PRODUCT DIMENSIONS WITHIN AN AUGMENTED REAL-WORLD SETTING

• US 20140285522A1
• Filed: 03/21/2014
• Published: 09/25/2014
• Est. Priority Date: 03/25/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Eunjoo, Nielsen, Per Orum
• Granted Patent: US 9,286,727 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/21 Collision detection, intersection
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

Methods, systems, computer-readable media, and apparatuses for presenting a representation of an augmented real-world setting are presented. In some embodiments, a method includes presenting a representation of an augmented real-world setting. The method includes capturing a plurality of images of a real-world setting. The method also includes analyzing one or more real-world objects within the plurality of images of the real-world setting. The method further includes receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation and overlaying an augmented reality object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step.

Claims

1. A method for presenting a representation of an augmented real-world setting using a mobile device, the method comprising:

capturing a plurality of images of a real-world setting;

analyzing, via the mobile device, one or more real-world objects within the plurality of images of the real-world setting;

receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlaying an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

displaying additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

2. The method of claim 1 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

3. The method of claim 1 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

4. The method of claim 1 further comprising, updating, via the mobile device, the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device.

5. The method of claim 1 wherein the analyzing step comprises determining physical dimensions of the one or more real-world objects within at least one image of the real-world setting.

6. The method of claim 1 further comprising determining whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

7. The method of claim 6 further comprising recommending, via the mobile device, a second position for overlaying the AR object depicting the real-world product within at least one of the plurality of images of the real-world setting, in response to determining the conflict.

8. The method of claim 6 further comprising recommending, via the mobile device, one or more alternate real-world products, in response to determining the conflict.

9. The method of claim 8 further comprising updating the augmented real-world setting by replacing the AR object with a second AR object depicting at least one of the one or more alternate real-world products within at least one of the plurality of images of the real-world setting.

10. The method of claim 1 further comprising receiving the information pertaining to the real-world product from a server computer.

11. The method of claim 1 wherein the first physical dimensions and the second physical dimensions comprise at least one of a height, length, and width.

12. An apparatus for presenting a representation of an augmented real-world setting, the apparatus comprising:

an image capture device configured to capture a plurality of images of a real-world setting;

a display device configured to display the augmented real-world setting;

a processor coupled to the image capture device and the display device, wherein the processor is configured to;

analyze one or more real-world objects within the plurality of images of the real-world setting;

receive information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlay an AR object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting based at least in part on the analyzing step; and

display, via the display device, additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

13. The apparatus of claim 12 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

14. The apparatus of claim 12 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

15. The apparatus of claim 12 wherein the processor is further configured to update the augmented real-world setting based at least in part on a perspective of the real-world setting from the image capture device.

16. The apparatus of claim 12 wherein the analyzing step comprises determining physical dimensions of the one or more real-world objects within at least one image of the real-world setting.

17. The apparatus of claim 12 wherein the processor is further configured to determine whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

18. The apparatus of claim 17 wherein the processor is further configured to recommend a second position for overlaying the AR object depicting the real-world product within at least one of the plurality of images of the real-world setting, in response to determining the conflict.

19. The apparatus of claim 17 wherein the processor is further configured to recommend one or more alternate real-world products, in response to determining the conflict.

20. The apparatus of claim 19 wherein the processor is further configured to update the augmented real-world setting by replacing the AR object with a second AR object depicting at least one of the one or more alternate real-world products within at least one of the plurality of images of the real-world setting.

21. The apparatus of claim 12 wherein the processor is further configured to receive the information pertaining to the real-world product from a server computer.

22. The apparatus of claim 12 wherein the first physical dimensions and the second physical dimensions comprise at least one of a height, length, and width.

23. An apparatus for presenting a representation of an augmented real-world setting, the apparatus comprising:

means for capturing a plurality of images of a real-world setting;

means for analyzing one or more real-world objects within the plurality of images of the real-world setting;

means for receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

means for overlaying an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

means for displaying additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

24. The apparatus of claim 23 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

25. The apparatus of claim 23 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

26. The apparatus of claim 23 further comprising:

means for updating the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device; and

means for determining whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

27. A processor-readable, non-transitory, computer readable medium comprising processor readable instructions configured to cause a processor, on a mobile device, to:

capture a plurality of images of a real-world setting;

analyze one or more real-world objects within the plurality of images of the real-world setting;

receive information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlay an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

display additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

28. The processor-readable, non-transitory, computer readable medium of claim 27 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

29. The processor-readable, non-transitory, computer readable medium of claim 27 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

30. The processor-readable, non-transitory, computer readable medium of claim 27 wherein the instructions are further configured to cause the processor to:

update, via the mobile device, the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device; and

determine whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.