SYSTEM AND METHOD FOR SELECTING TARGETS IN AN AUGMENTED REALITY ENVIRONMENT

• US 20130293580A1
• Filed: 04/30/2013
• Published: 11/07/2013
• Est. Priority Date: 05/01/2012
• Status: Abandoned Application

• Current Assignee: Augmented Reality Holdings, LLC
• Original Assignee: Zambala LLLP
• Inventors: Spivack, Nova T.
• Application Number:
  US13/874,421
• Publication Number:
  US 20130293580A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 30/0639 Item locations
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

Techniques are disclosed for facilitating electronic commerce in an augmented reality environment. In some embodiments, a method comprises detecting, by a mobile device, presence of the physical product or the real life service; and presenting, on the mobile device, information to conduct the transaction of a physical product or a real life service via the augmented reality environment. In some embodiments, a method comprises detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and prompting the user to choose an object of interest from the one or more detected targets. Among other advantages, embodiments disclosed herein provide an intuitive and integrated user experience in shopping using augmented reality devices, thereby reducing the consumer user'"'"'s effort in conducting such activities, reducing necessary sales personnel and their working hours, and increasing sales.

Claims

1. A method for selecting a physical product or a real life service in an augmented reality platform via a mobile device, the method comprising:

detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and

prompting the user to choose an object of interest from the one or more detected targets.

2. The method of claim 1, further comprising:

providing, via a display of the mobile device, the user with a lasso tool in the perspective to surround a respective target so as to form the select area.

3. The method of claim 1, further comprising:

prompting, via a display of the mobile device, the user to enter a learning mode in which the mobile device receives an assistance from the user to perform the detection.

4. The method of claim 3, wherein the assistance includes one or more of:

(i) entering at least partially a name, (ii) entering metadata, (iii) defining a boundary via a pointer, or (iv) taking snapshots from a plurality of views to develop a recognition pattern, for a respective target.

5. The method of claim 1, further comprising:

receiving, via the mobile device, the user'"'"'s choice of the object of interest.

6. The method of claim 5, further comprising:

detecting, via the mobile device, one or more of;

(i) movement and selection by a selection tool or a pointer, or (ii) movement and selection represented by a gesture.

7. The method of claim 6, further comprising:

capturing, via the mobile device, the gesture from one or more of;

(i) movements or non-movements of an eye of the user, (ii) locations of a focal point of an eye of the user, or (iii) movements of an eye lid of the user.

8. The method of claim 6, further comprising:

capturing, via the mobile device, the gesture from one or more of;

(i) movements of hand or finger as recognized by a camera of the mobile device, (ii) movements of a virtual pointer controlled by a wireless peripheral device, (iv) movements of a virtual pointer controlled by a touch-sensitive display of the mobile device, or (v) movements of the mobile device itself.

9. The method of claim 8, wherein the capturing is further based on a speed or velocity of the movements.

10. The method of claim 5, further comprising:

confirming, via the mobile device, with the user of the choice of the object of interest.

11. The method of claim 5, wherein the confirmation comprises highlighting or outlining the target in the augmented reality platform.

12. The method of claim 1, wherein the device is in form of an electronic eyewear or a head-mounted device.

13. The method of claim 1, wherein the target is a physical or a virtual goods.

14. A mobile device for an augmented reality platform, the device comprising:

a processor; and

a memory coupled to the processor and storing a plurality of instructions which, when executed by the processor, cause the processor to;

detect one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by the mobile device; and

prompt the user to choose an object of interest from the one or more detected targets.

15. The device of claim 14, wherein the processor is further instructed to:

provide, via a display of the mobile device, the user with a lasso tool in the perspective to surround a respective target so as to form the select area.

16. The device of claim 14, wherein the processor is further instructed to:

prompt, via a display of the mobile device, the user to enter a learning mode in which the mobile device receives an assistance from the user to perform the detection.

17. The device of claim 16, wherein the assistance includes one or more of:

(i) entering at least partially a name, (ii) entering metadata, (iii) defining a boundary via a pointer, or (iv) taking snapshots from a plurality of views to develop a recognition pattern, for a respective target.

18. The device of claim 14, wherein the processor is further instructed to:

receive, via the mobile device, the user'"'"'s choice of the object of interest.

19. The device of claim 18, wherein the processor is further instructed to:

detect, via the mobile device, one or more of;

(i) movement and selection by a selection tool or a pointer, or (ii) movement and selection represented by a gesture.

20. The device of claim 19, wherein the processor is further instructed to:

capture, via the mobile device, the gesture from one or more of;

(i) movements or non-movements of an eye of the user, (ii) locations of a focal point of an eye of the user, or (iii) movements of an eye lid of the user.

21. The device of claim 19, wherein the processor is further instructed to:

capture, via the mobile device, the gesture from one or more of;

(i) movements of hand or finger as recognized by a camera of the mobile device, (ii) movements of a virtual pointer controlled by a wireless peripheral device, (iv) movements of a virtual pointer controlled by a touch-sensitive display of the mobile device, or (v) movements of the mobile device itself.

22. The device of claim 21, wherein the processor is further instructed to:

capture based on a speed or velocity of the movements.

23. The device of claim 18, wherein the processor is further instructed to:

confirm, via the mobile device, with the user of the choice of the object of interest.

24. The device of claim 23, wherein the confirmation comprises highlighting or outlining the target in the augmented reality platform.

25. The device of claim 14, wherein the device is in form of an electronic eyewear or a head-mounted device.

26. The device of claim 14, wherein the target is a physical or a virtual goods.