INPUT METHOD DESIGNED FOR AUGMENTED REALITY GOGGLES

• US 20130335573A1
• Filed: 06/15/2012
• Published: 12/19/2013
• Est. Priority Date: 06/15/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: FORUTANPOUR, Babak, BALASUBRAMANYAM, Shivakumar, Mann, Liberty Edward IV
• Granted Patent: US 9,152,226 B2
• Time in Patent Office: Days
• US Class Current: 348/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

Apparatuses, methods, systems and computer-readable media for using proximity inputs on or near a touch screen lens to select objects within a field of view are presented. In some embodiments, a viewing apparatus (e.g. head mounted display, augmented reality goggles) may include at least one lens, wherein the lens can sense touches or near-touches and output data indicative of a location of the proximity input by the user. A processor may receive the data and may select an object within the field of view of the user corresponding to the data, wherein the object and the location of the proximity input on or near the lens by the user are on a common line of sight. In some embodiments, the viewing apparatus may include at least one camera that is configured to record at least one image representative of the user'"'"'s field of view.

Claims

1. A viewing apparatus for a user comprising:

at least one lens through which the user can visually perceive a field of view; and

a processor configured to;

receive data indicative of a proximity input with respect to the at least one lens; and

perform one or more operations in response to the received data.

2. The viewing apparatus of claim 1, wherein the data is indicative of a location of a touch by the user on the at least one lens;

and

wherein the processor is further configured to select an object within the field of view corresponding to the data, wherein the object and the location of the touch on the at least one lens are on a common line of sight of the user.

3. The viewing apparatus of claim 2, further comprising:

at least one camera configured to record at least one image representative of the field of view; and

the processor, further configured to;

receive the at least one image,

identify a location on the at least one image that is mapped to the location of the touch on the at least one lens, and

wherein the selection of the object within the field of view further corresponds to the location on the at least one image.

4. The viewing apparatus of claim 3, wherein:

the at least one camera is each further configured to perform a zooming function that magnifies a viewing location within the field of view based at least in part on a gesture performed by the user.

5. The viewing apparatus of claim 3, wherein the at least one image is recorded in response to the reception of the data by the processor.

6. The viewing apparatus of claim 2, further comprising:

an image projection module configured to project visual information on the at least one lens, wherein the visual information is based on information about the selected object; and

the processor, further configured to;

instruct the image projection module to display the visual information on the at least one lens.

7. The viewing apparatus in claim 6, wherein:

the at least one lens comprises two lenses; and

the processor is further configured to;

detect which lens is touched, and

instruct the image projection module to display the visual information, wherein the visual information is based further on which lens is touched.

8. The viewing apparatus in claim 6, wherein:

the at least one lens is further configured to output the data to the processor, the data being further indicative of an amount of pressure of the touch by the user on the at least one lens; and

the processor is further configured to;

instruct the image projection module to display the visual information, wherein the visual information is based further on the amount of pressure of the touch.

9. The viewing apparatus of claim 1, wherein the one or more operations comprise transmitting information to another device.

10. The viewing apparatus of claim 1, wherein the one or more operations comprise displaying information related to an object or individual proximate to the user.

11. The viewing apparatus of claim 10, further comprising an SPS unit, wherein the object or individual proximate to the user is determined based at least in part on input received from the SPS unit.

12. The viewing apparatus of claim 10, further comprising a camera configured to capture an image of at least a portion of the field of view, wherein the object or individual proximate to the user is determined by identifying the object or individual in the captured image.

13. The viewing apparatus of claim 1, wherein the at least one lens is touch sensitive and is configured to output the data when a user touches the at least one lens.

14. The viewing apparatus of claim 1, wherein the proximity input comprises an object hovering near the at least one lens.

15. The viewing apparatus of claim 14, further comprising at least one camera configured to capture an image of the object, wherein the data received by the processor comprises information based on the image, and wherein the processor is further configured to identify when an input has occurred based on the received data.

16. The viewing apparatus of claim 15, wherein the at least one camera is further configured to use infrared (IR) data to detect position or depth of the object.

17. The viewing apparatus of claim 15, wherein the at least one camera is two cameras, configured to provide a stereo image of the object.

18. The viewing apparatus of claim 15, wherein the at least one camera is further configured to capture an image of at least a portion of the field of view.

19. The viewing apparatus of claim 1, wherein the data is indicative of at least two locations of at least two touches by the user on the at least one lens.

20. The viewing apparatus of claim 19, wherein the at least two touches by the user occur in a sequence in time.

21. A method for use with a viewing apparatus, comprising:

receiving data indicative of a proximity input performed with respect to at least one lens of the viewing apparatus, a field of view being observable through the at least one lens by a user of the viewing apparatus; and

performing one or more operations in response to the received data.

22. The method of claim 21, wherein the proximity input includes a location of a touch by the user on the at least one lens;

and

wherein the touch causes a processor to select an object within the field of view corresponding to the data, wherein the object and the location of the touch on the at least one lens are on a common line of sight of the user.

23. The method of claim 22, wherein the touch further causes:

at least one camera to record at least one image representative of the field of view; and

the processor to;

receive the at least one image,

identify a location on the at least one image that is mapped to the location of the touch on the at least one lens, and

wherein the selection of the object within the field of view further corresponds to the location on the at least one image.

24. The method of claim 23, wherein:

the at least one camera is each further configured to perform a zooming function that magnifies a viewing location within the field of view based at least in part on a gesture performed by the user.

25. The method of claim 23, wherein the at least one image is recorded in response to the reception of the data.

26. The method of claim 22, wherein the touch further causes:

an image projection module to project visual information on the at least one lens, wherein the visual information is based on information about the selected object; and

the processor to instruct the image projection module to display the visual information on the at least one lens.

27. The method of claim 26, wherein:

the at least one lens comprises two lenses; and

the touch by the user on the at least one lens comprises a touch by the user on one of the two lenses, wherein the method further comprises;

detecting which lens is touched, and

instructing the image projection module to display the visual information, wherein the visual information is based further on which lens is touched.

28. The method of claim 26, wherein the touch further causes:

the at least one lens to output the data, the data being indicative of an amount of pressure of the touch by the user on the at least one lens; and

the processor to instruct the image projection module to display the visual information, wherein the visual information is based further on the amount of pressure of the touch.

29. The method of claim 21, wherein the one or more operations comprise transmitting information to another device.

30. The method of claim 21, wherein the one or more operations comprise displaying information related to an object or individual proximate to the user.

31. The method of claim 30, further comprising determining the object or individual proximate to the user based at least in part on input received from an SPS unit.

32. The method of claim 30, further comprising capturing an image of at least a portion of the field of view, wherein the object or individual proximate to the user is determined by identifying the object or individual in the captured image.

33. The method of claim 21, wherein the proximity input comprises an object hovering near the at least one lens.

34. The method of claim 33, further comprising at least one camera detecting the object hovering near the at least one lens.

35. The method of claim 33, further comprising determining that an object moving within a threshold distance to the at least one lens comprises the proximity input.

36. The method of claim 21, wherein the proximity input comprises both at least one touch on the at least one lens and an object hovering near the at least one lens.

37. The method of claim 21, wherein the data is indicative of at least two locations of at least two touches by the user on the at least one lens.

38. The method of claim 37, wherein the at least two touches by the user occur in a sequence in time.

39. A viewing apparatus for a user comprising:

at least one viewing means through which through which a field of view is observable by the user; and

means for receiving data indicative of a proximity input with respect to the at least one viewing means; and

means for performing one or more operations in response to the received data.

40. The viewing apparatus of claim 39, wherein the data is indicative of a location of a touch by the user on the at least one viewing means;

and the viewing apparatus further comprises

means for selecting an object within the field of view corresponding to the data, wherein the object and the location of the touch on the at least one viewing means are on a common line of sight of the user.

41. The viewing apparatus of claim 40, further comprising:

recording means to record at least one image representative of the field of view;

means for receiving the at least one image; and

means for identifying a location on the at least one image that is mapped to the location of the touch on the at least one viewing means,

wherein the object within the field of view further corresponds to the location of the touch on the at least one viewing means.

42. A processor-readable storage medium comprising processor-readable instructions configured to cause a processor to:

receive data indicative of a proximity input performed with respect to at least one lens of a viewing apparatus, a field of view being observable through the at least one lens by a user of the viewing apparatus; and

perform one or more operations in response to the received data.

43. The processor-readable storage medium of claim 42, wherein the proximity input includes a touch by the user on the at least one lens;

and

wherein the instructions further cause the processor to select an object within the field of view corresponding to the touch, wherein the object and a location of the touch on the at least one lens are on a common line of sight of the user.

44. The processor-readable storage medium of claim 43, wherein the processor-readable instructions further cause the processor to:

receive at least one image from at least one camera configured to record the at least one image, the at least one image being representative of the field of view; and

,

identify a location on the at least one image that is mapped to the location of the touch on the at least one lens, and

wherein the selection of the object within the field of view further corresponds to the location on the at least one image.

45. The processor-readable storage medium of claim 43, wherein the processor-readable instructions further cause the processor to:

instruct an image projection module to display visual information on the at least one lens;

wherein the image projection module is configured to project the visual information on the at least one lens; and

wherein the visual information is based on information about the selected object.