Virtual reality applications
First Claim
Patent Images
1. A method performed by a computing system having a processor, the method comprising:
- digitizing a vision of a scene received from an image capture device to provide a digitized scene;
detecting multiple objects in the digitized scene, wherein detecting the multiple objects comprises recognizing digitized objects in the digitized scene;
receiving contextual information associated with a user, wherein the contextual information comprises first contextual information and second contextual information;
identifying installed applications based on the detected objects, wherein the identifying includes identifying the installed applications based on one of the first contextual information or the second contextual information, further wherein the identifying includes searching a list of attributes for an attribute associated with one or more of the detected objects, the list of attributes provided by the user and associated with at least one of the installed applications;
identifying an object from the detected objects based on another one of the first contextual information or the second contextual information to provide the identified object;
placing an icon that represents at least one of the identified installed applications proximate to the identified object in a display of the digitized scene, wherein the at least one of the identified installed applications is selected based on the identified object;
receiving a user selection of the icon;
responsive to the reception of the user selection of the icon, selecting the identified object;
determining that the identified object can be interacted with, wherein the determination comprises querying a database about the identified object;
obtaining at least one specification regarding an interaction with the identified object, wherein the at least one specification includes information regarding commands to interact with the identified object and information regarding user interface elements; and
providing a user interface to interact with the identified object based on the at least one specification in accordance with the user interface elements.
5 Assignments
0 Petitions
Accused Products
Abstract
Augmented reality technology is described. The technology can detect objects in a scene, identifying one or more installed or available applications based on the detected objects, and place icons representing the identified applications proximate to the detected objects in a display of the scene, e.g., so that a user can start or install the identified applications. The technology can also facilitate interaction with an identified object, e.g., to remotely control a recognized object.
-
Citations
33 Claims
-
1. A method performed by a computing system having a processor, the method comprising:
-
digitizing a vision of a scene received from an image capture device to provide a digitized scene; detecting multiple objects in the digitized scene, wherein detecting the multiple objects comprises recognizing digitized objects in the digitized scene; receiving contextual information associated with a user, wherein the contextual information comprises first contextual information and second contextual information; identifying installed applications based on the detected objects, wherein the identifying includes identifying the installed applications based on one of the first contextual information or the second contextual information, further wherein the identifying includes searching a list of attributes for an attribute associated with one or more of the detected objects, the list of attributes provided by the user and associated with at least one of the installed applications; identifying an object from the detected objects based on another one of the first contextual information or the second contextual information to provide the identified object; placing an icon that represents at least one of the identified installed applications proximate to the identified object in a display of the digitized scene, wherein the at least one of the identified installed applications is selected based on the identified object; receiving a user selection of the icon; responsive to the reception of the user selection of the icon, selecting the identified object; determining that the identified object can be interacted with, wherein the determination comprises querying a database about the identified object; obtaining at least one specification regarding an interaction with the identified object, wherein the at least one specification includes information regarding commands to interact with the identified object and information regarding user interface elements; and providing a user interface to interact with the identified object based on the at least one specification in accordance with the user interface elements. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer-readable storage device having stored thereon instructions that, if executed by a computing device, cause the computing device to perform operations comprising:
-
digitize a vision of a scene to provide a digitized scene; detect multiple objects in the digitized scene, wherein the detection of the multiple objects comprises recognition of digitized objects in the digitized scene; receive contextual information associated with a user, wherein the contextual information comprises first contextual information and second contextual information; identify installed applications based on the detected objects, wherein the identification includes identification of the installed applications based on one of the first contextual information or the second contextual information, further wherein the identification includes searching a list of attributes for an attribute associated with one or more of the detected objects, the list of attributes provided by the user and associated with at least one of the installed applications; identify an object from the detected objects based on another one of the first contextual information or the second contextual information; place an icon, that when selected by the user, launches at least one of the identified installed applications proximate to the identified object in a display of the digitized scene, wherein the at least one of the identified installed applications is selected based on the identified object; receive a user selection of the icon; responsive to the reception of the user selection of the icon, select the object; determine that the object can be interacted with, wherein the determination comprises querying a database about the object, obtain a specification regarding an interaction with the object, wherein the specification includes commands to interact with the object and user interface elements; and provide a user interface to interact with the object based on the specification in accordance with the user interface elements. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A system, comprising:
-
a processor; and a memory comprising instructions that, in response to execution by the processor, cause the system to perform operations comprising; detect multiple objects in a digitized scene, wherein the detection of the multiple objects comprises recognition of digitized objects in the digitized scene; receive contextual information associated with a user, wherein the contextual information comprises first contextual information and second contextual information; identify installed applications based on the detected objects and on one of the first contextual information or the second contextual information, wherein the identification of the installed applications includes search a list of attributes for an attribute associated with one or more of the detected objects, the list of attributes provided by the user and associated with at least one of the installed applications; identify an object from the detected objects based on another one of the first contextual information or the second contextual information; place an icon, that when selected by the user launches at least one of the identified installed applications proximate to the identified object in a display of the digitized scene, wherein the at least one of the identified installed applications is selected based on the identified object; receive a user selection of the icon, wherein the user selection launches at least one of the identified installed applications; responsive to the reception of the user selection of the icon, select the identified object; determine that the identified object can be interacted with, wherein the determination comprises a query of a database about the object; obtain at least one specification regarding an interaction with the identified object, wherein the at least one specification includes information regarding commands to interact with the identified object and information regarding user interface elements; and provide a user interface to interact with the object based on the at least one specification. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33)
-
Specification