ACCESSING APPLICATIONS IN A MOBILE AUGMENTED REALITY ENVIRONMENT

• US 20130201215A1
• Filed: 02/03/2012
• Published: 08/08/2013
• Est. Priority Date: 02/03/2012
• Status: Abandoned Application

• Current Assignee: APX Labs LLC (TeamViewer AG)
• Original Assignee: Brian A. Ballard
• Inventors: MARTELLARO, John A., JENKINS, Jeffrey E., BALLARD, Brian A.
• Application Number:
  US13/366,005
• Publication Number:
  US 20130201215A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/18 Use of optical transmission of display information
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

An augmented reality system and method that allows a user to access, and more particularly, install and subsequently have access to an application on an augmented reality mobile device. The system and method enhances the augmented reality experience by minimizing or eliminating user interaction in the process of initiating the installation of the application. This is achieved, at least in part, through the use of a passively activated application program. It is passively activated in that it effects the application installation based on signals received and processed by the augmented reality mobile device, where the signals reflect the surrounding environment in which the augmented reality mobile device is operating. No direct interaction by the user of the augmented reality mobile device is required to initiate the installation of the application.

Claims

1. An augmented reality mobile device comprising:

a processor including a module configured to receive and process a first signal reflecting the environment in which the augmented reality mobile device is operating and generate a second signal based on the processed first signal; and

a passively activated application program, such that the functionality is activated without direct user interaction, the passively activated application program configured to receive the second signal from the processor, recognize an environmental trigger encoded in the second signal, and effect the installation of an application in the augmented reality mobile device, wherein the application corresponds with the environmental trigger.

2. The augmented reality mobile device of claim 1 further comprising:

an output device in communication with the processor and configured to present computer-generated information to the user of the augmented reality mobile device in response to the recognition of the environmental trigger in the second signal.

3. The augmented reality mobile device of claim 2, wherein the augmented reality mobile device is a pair of augmented reality glasses, wherein the output device is a translucent display, and wherein the computer-generated information is an icon rendered on the translucent display within the user field of view.

4. The augmented reality mobile device of claim 3, wherein the processor comprises a visual module configured to receive and process a third signal reflecting a user gesture and generate a fourth signal based on the processed third signal, and wherein the passively activated application program is configured to receive the fourth signal from the processor and recognize the user gesture in the fourth signal as intent by the user to select the icon and effect the installation of the application.

5. The augmented reality mobile device of claim 1 further comprising:

a touchscreen in communication with the processor, the touchscreen configured to display computer-generated information to the user of the augmented reality mobile device in the form of an icon and in response to the recognition of the environmental trigger in the second signal, to receive a haptic input, and to generate a third signal reflecting the haptic input, wherein the passively activated application program is further configured to receive the third signal and recognize the haptic input as intent by the user to select the icon and effect the installation of the application.

6. The augmented reality mobile device of claim 2, wherein the output device is a sound generation device, and wherein the computer-generated information is a computer-generated speech pattern.

7. The augmented reality mobile device of claim 6, wherein the processor comprises an audible module configured to receive and process a third signal reflecting a user generated speech pattern and generate a fourth signal based on the processed third signal, and wherein the passively activated application program is configured to receive the fourth signal from the processor and recognize the user generated speech pattern in the fourth signal as intent by the user to respond to the computer-generated speech pattern and initiate the installation of the application.

8. The augmented reality mobile device of claim 1 further comprising:

a communication module connecting the augmented reality mobile device to a wireless network, over which the application is downloaded.

9. The augmented reality mobile device of claim 1 further comprising:

a camera configured to capture an image of the environment in which the augmented reality mobile device is operating, wherein the module in the processor is a visual module and wherein the first signal reflects the image captured by the camera.

10. The augmented reality mobile device of claim 9, wherein the environmental trigger is an object appearing in the image.

11. The augmented reality mobile device of claim 10, wherein the visual module comprises an environmental component configured to process the first signal if the environmental trigger is an object.

12. The augmented reality mobile device of claim 11, wherein the object is a glyph.

13. The augmented reality mobile device of claim 12, wherein the glyph is a QR code.

14. The augmented reality mobile device of claim 10, wherein the object is a logo.

15. The augmented reality mobile device of claim 9, wherein the environmental trigger embedded in the second signal is motion detectable in the image.

16. The augmented reality mobile device of claim 15, wherein the visual module comprises an interactive component configured to process the first signal if the environmental trigger is a motion.

17. The augmented reality mobile device of claim 1 further comprising:

a microphone configured to pick up a sound occurring in the environment in which the augmented reality mobile device is operating, wherein the module in the processor is an audible module, and wherein the environmental trigger is the sound picked up by the microphone.

18. The augmented reality mobile device of claim 17, wherein the audible processor comprises:

a tonal component configured to process the first signal if the sound is a tonal sequence.

19. The augmented reality mobile device of claim 17, wherein the audible processor comprises:

a speech component configured to process the first signal if the sound is a speech pattern.

20. The augmented reality mobile device of claim 1 further comprising:

a GPS receiver, wherein the module in the processor is a geolocational module and wherein the environmental trigger is a GPS coordinate determined by the GPS receiver.

21. The augmented reality mobile device of claim 1 further comprising:

an inertial measurement unit (IMU), wherein the module in the processor is a positional module and wherein the environmental trigger is a relative position, acceleration or orientation as determined by the IMU.

22. In augmented reality mobile device, a method of installing an application comprising:

receiving and processing a first signal reflecting the environment in which the augmented reality mobile device is operating;

generating a second signal based on the processed first signal;

without any direct, prior user interaction, decoding and analyzing the second signal for the presence of an environmental trigger; and

installing an application on the augmented reality mobile device if it is determined that an environmental trigger is encoded in the second signal, wherein the installed application corresponds with the environmental trigger.

23. The method of claim 22, wherein the first signal reflects an image captured by a camera associated with the augmented reality mobile device.

24. The method of claim 23, wherein the environmental trigger is an object present in the image.

25. The method of claim 24, wherein the object is a glyph.

26. The method of claim 25, wherein the glyph is a QR code.

27. The method of claim 24, wherein the object is a logo.

28. The method of claim 23, wherein the environmental trigger is a motion detectable in the image.

29. The method of claim 22, wherein the first signal reflects a sound picked up by a microphone associated with the augmented reality mobile device.

30. The method of claim 29, wherein the sound is a speech pattern.

31. The method of claim 29, wherein the sound is a tonal sequence

32. The method of claim 22, wherein the first signal reflects GPS coordinates as determined by a GPS receiver associated with the augmented reality mobile device.

33. The method of claim 22, wherein the first signal reflects a WIFI hotspot.

34. The method of claim 22, wherein the first signal reflects a relative position in the environment in which the augmented reality device is operating or a velocity, as determined by an inertial measurement unit associated with the augmented reality mobile device.

35. The method of claim 22 further comprising:

rendering an icon on a translucent display associated with the augmented reality mobile device in the user field of view if it is determined that an environmental trigger is present in the second signal;

detecting a user gesture and determining that the user gesture was a selection of the icon; and

initiating the installation of the application based on the determination that the user gesture was a selection of the icon.

36. The method of claim 22 further comprising:

rendering an icon on a touchscreen associated with the augmented reality mobile device if it is determined that an environmental trigger is present in the second signal;

detecting a haptic feedback signal and determining that the haptic feedback signal was a selection of the icon; and

initiating the installation of the application based on the determination that the haptic feedback signal was a selection of the icon.

37. The method of claim 22 further comprising:

generating a first speech pattern through a speaker associated with the augmented reality mobile device if it is determined that an environmental trigger is present in the second signal;

detecting a user generated speech pattern through a microphone associated with the augmented reality mobile device, and determining that the user generated speech pattern reflects an intent to install the application; and

initiating the installation of the application based on the determination that the determination that the user generated speech pattern reflected an intent to install the application.

38. The method of claim 22, wherein installing the application on the augmented reality mobile device if it is determined that an environmental trigger is encoded in the second signal comprises:

downloading the application over a wireless network connection.