VIRTUAL REALITY APPLICATIONS

• US 20140059458A1
• Filed: 08/24/2012
• Published: 02/27/2014
• Est. Priority Date: 08/24/2012
• Status: Active Grant

• Current Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Malamud, Mark, Levien, Roy
• Granted Patent: US 9,690,457 B2
• Time in Patent Office: Days
• US Class Current: 715/765
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

Augmented reality technology is described. The technology can detect objects in a scene, identifying one or more installed or available applications based on the detected objects, and place icons representing the identified applications proximate to the detected objects in a display of the scene, e.g., so that a user can start or install the identified applications. The technology can also facilitate interaction with an identified object, e.g., to remotely control a recognized object.

Claims

1. A method performed by a computing system having a processor, comprising:

detecting at least one object of multiple objects in a scene;

receiving contextual information;

identifying one or more installed applications based on the detected at least one object, wherein the identifying includes identifying the one or more installed applications based on the received contextual information; and

placing an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

2. The method of claim 1, wherein the detecting includes employing a digital camera.

3. The method of claim 1, wherein the scene is displayed on an output device.

5. The method of claim 1, wherein the contextual information is received via input from a user.

6. The method of claim 1, wherein the contextual information is based on detected positional information.

7. The method of claim 1, wherein the detecting includes employing one or more image recognition methods.

8. The method of claim 1, wherein the identifying includes searching a list of attributes associated with installed applications for an attribute associated with the detected at least one object.

9. The method of claim 1, further comprising receiving a user selection of one of the placed icons and causing an installed application corresponding to the selected icon to start execution.

10. The method of claim 1, further comprising receiving a list of attributes associated with at least one of the installed applications.

11. The method of claim 10, wherein the list is received via keyboard input.

12. The method of claim 10, wherein the list is downloaded from a remote computer.

13. The method of claim 1, further comprising receiving an input to associate an installed application not identified with an object detected in the scene, and associating the application with the detected object.

14. The method of claim 1, further comprising receiving an input to disassociate an application identified as corresponding with an object detected in the scene, and disassociating the application from the detected object.

4. (canceled)

15. A method performed by a computing system having a processor, comprising:

detecting at least one object of multiple objects in a scene;

identifying one or more applications not installed at a mobile computing device based on the detected at least one object; and

placing an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

16. The method of claim 15, wherein the detecting includes employing a digital camera.

17. The method of claim 15, wherein the scene is displayed on an output device.

18. The method of claim 15, further comprising receiving contextual information, wherein the identifying includes identifying the one or more applications based on the received contextual information.

19. The method of claim 18, wherein the contextual information is received via input from a user.

20. The method of claim 18, wherein the contextual information is based on detected positional information.

21. The method of claim 15, wherein the detecting includes employing one or more image recognition methods.

22. The method of claim 15, wherein the identifying includes searching a list of attributes associated with applications for an attribute associated with the detected at least one object.

23. The method of claim 15, wherein the one ore more applications are identified based on features provided by the one or more applications.

24-33. -33. (canceled)

34. A computer-readable storage device storing instructions that, if executed by a computing device, cause the computing device to perform operations comprising:

detecting at least one object of multiple objects in a scene;

receiving contextual information;

identifying one or more installed applications based on the detected at least one object, wherein the identifying includes identifying the one or more installed applications based on the received contextual information; and

placing an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

35. The computer-readable storage device of claim 34, wherein the detecting includes employing a digital camera.

36. The computer-readable storage device of claim 34, wherein the scene is displayed on an output device.

38. The computer-readable storage device of claim 34, wherein the contextual information is received via input from a user.

39. The computer-readable storage device of claim 34, wherein the contextual information is based on detected positional information.

40. The computer-readable storage device of claim 34, wherein the detecting includes employing one or more image recognition methods.

41. The computer-readable storage device of claim 34, wherein the identifying includes searching a list of attributes associated with installed applications for an attribute associated with the detected at least one object.

42. The computer-readable storage device of claim 34, the operations further comprising receiving a user selection of one of the placed icons and causing an installed application corresponding to the selected icon to start execution.

43. The computer-readable storage device of claim 34, the operations further comprising receiving a list of attributes associated with at least one of the installed applications.

44. The computer-readable storage device of claim 43, wherein the list is received via keyboard input.

45. The computer-readable storage device of claim 43, wherein the list is downloaded from a remote computer.

46. The computer-readable storage device of claim 34, the operations further comprising receiving an input to associate an installed application not identified with an object detected in the scene, and associating the application with the detected object.

47. The computer-readable storage device of claim 34, the operations further comprising receiving an input to disassociate an application identified as corresponding with an object detected in the scene, and disassociating the application from the detected object.

37. (canceled)

48. A computer-readable storage device storing instructions that, f executed by a computing device, cause the computing device to perform operations comprising:

detecting at least one object of multiple objects in a scene;

identifying one or more applications not installed at a mobile computing device based on the detected at least one object; and

placing an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

49. The computer-readable storage device of claim 48, wherein the detecting includes employing a digital camera.

50. The computer-readable storage device of claim 48, wherein the scene is displayed on an output device.

51. The computer-readable storage device of claim 48, the operations further comprising receiving contextual information, wherein the identifying includes identifying the one or more applications based on the received contextual information.

52. The computer-readable storage device of claim 51, wherein the contextual information is received via input from a user.

53. The computer-readable storage device of claim 51, wherein the contextual information is based on detected positional information.

54. The computer-readable storage device of claim 48, wherein the detecting includes employing one or more image recognition computer-readable storage devices.

55. The computer-readable storage device of claim 48, wherein the identifying includes searching a list of attributes associated with applications for an attribute associated with the detected at least one object.

56. The computer-readable storage device of claim 48, wherein the one ore more applications are identified based on features provided by the one or more applications.

57-66. -66. (canceled)

67. A system, comprising:

a component configured to detect at least one object of multiple objects in a scene;

a component configured to receive contextual information

a component configured to identify one or more installed applications based on the detected at least one object and the received contextual information; and

a component configured to place an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

68. The system of claim 67, wherein the component configured to detect employs a digital camera.

69. The system of claim 67, wherein the scene is displayed on an output device.

71. The system of claim 67, wherein the contextual information is received via input from a user.

72. The system of claim 67, wherein the contextual information is based on detected positional information.

73. The system of claim 67, wherein the component configured to detect employs one or more image recognition systems.

74. The system of claim 67, wherein the component configured to identify searches a list of attributes associated with installed applications for an attribute associated with the detected at least one object.

75. The system of claim 67, further comprising component configured to receive a user selection of one of the placed icons and causing an installed application corresponding to the selected icon to start execution.

76. The system of claim 67, further comprising a component configured to receive a list of attributes associated with at least one of the installed applications.

77. The system of claim 76, wherein the list is received via keyboard input.

78. The system of claim 76, wherein the list is downloaded from a remote computer.

79. The system of claim 67, further comprising a component configured to receive an input to associate an installed application not identified with an object detected in the scene, and associate the application with the detected object.

80. The system of claim 67, further comprising a component configured to receive an input to disassociate an application identified as corresponding with an object detected in the scene, and disassociate the application from the detected object.

70. (canceled)

81. A system, comprising:

a component configured to detect at least one object of multiple objects in a scene;

a component configured to identify one or more applications not installed at a mobile computing device based on the detected at least one object; and

a component configured to place an icon representing the identified one or more applications proximate to the detected one or more objects in a display of the scene.

82. The system of claim 81, wherein the component configured to detect employs a digital camera.

83. The system of claim 81, wherein the scene is displayed on an output device.

84. The system of claim 81, further comprising a component configured to receive contextual information, wherein the component configured to identify identifies the one or more applications based on the received contextual information.

85. The system of claim 84, wherein the contextual information is received via input from a user.

86. The system of claim 84, wherein the contextual information is based on detected positional information.

87. The system of claim 81, wherein the component configured to detect employs one or more image recognition systems.

88. The system of claim 81, wherein the component configured to identify searches a list of attributes associated with applications for an attribute associated with the detected at least one object.

89. The system of claim 81, wherein the one ore more applications are identified based on features provided by the one or more applications.

90-114. -114. (canceled)