Context adaptive user interface for augmented reality display
First Claim
1. A system for providing a user interface with a virtual object appearing in context with a real environment of a user using a see through, augmented reality display device system comprising:
- a computer system communicatively coupled via a network to the see-through near-eye, augmented reality display device system for receiving image data of a real environment of a user, the computer system comprising one or more processors and a memory accessible by the one or more processors;
the one or more processors being configured to identify one or more appearance characteristics including surface characteristics of one or more real world objects in the real environment;
the one or more processor being configured to identify one or more types of realistic physical connections available for providing a realistic visual connectivity relationship based on any of the appearance characteristics identified for the one or more real world objects;
a set of graphical design rules being stored in the memory, the set of graphical design rules defining compatibility criteria between appearance characteristics including as between respective surface characteristics;
the one or more processors being configured to select a type of object for the virtual object and to select an anchor real world objects set from the one or more real world objects based on compatibility criteria of the set of graphical design rules for forming a realistic physical connection using one of the one or more of the identified types of realistic physical connection available;
the one or more processors being configured to select at least one virtual connecting member for realistic visual interposition between a member of the selected anchor real world objects set and the virtual object so as to provide said realistic visual connectivity relationship using the selected at least one virtual connecting member as being visually interposed between a member of the selected anchor real world objects set and the virtual object; and
the one or more processors being configured to generate display data for an image of the virtual object having the realistic physical connection with a selected member of the anchor real world objects set with the selected at least one virtual connecting member being visually interposed there between, the generated display data being usable by the see-through, near-eye, augmented reality display device system.
2 Assignments
0 Petitions
Accused Products
Abstract
A user interface includes a virtual object having an appearance in context with a real environment of a user using a see-through, near-eye augmented reality display device system. A virtual type of object and at least one real world object are selected based on compatibility criteria for forming a physical connection like attachment, supporting or integration of the virtual object with the at least one real object. Other appearance characteristics, e.g. color, size or shape, of the virtual object are selected for satisfying compatibility criteria with the selected at least one real object. Additionally, a virtual object type and appearance characteristics of the virtual object may be selected based on a social context of the user, a personal context of the user or both.
-
Citations
23 Claims
-
1. A system for providing a user interface with a virtual object appearing in context with a real environment of a user using a see through, augmented reality display device system comprising:
-
a computer system communicatively coupled via a network to the see-through near-eye, augmented reality display device system for receiving image data of a real environment of a user, the computer system comprising one or more processors and a memory accessible by the one or more processors; the one or more processors being configured to identify one or more appearance characteristics including surface characteristics of one or more real world objects in the real environment; the one or more processor being configured to identify one or more types of realistic physical connections available for providing a realistic visual connectivity relationship based on any of the appearance characteristics identified for the one or more real world objects; a set of graphical design rules being stored in the memory, the set of graphical design rules defining compatibility criteria between appearance characteristics including as between respective surface characteristics; the one or more processors being configured to select a type of object for the virtual object and to select an anchor real world objects set from the one or more real world objects based on compatibility criteria of the set of graphical design rules for forming a realistic physical connection using one of the one or more of the identified types of realistic physical connection available; the one or more processors being configured to select at least one virtual connecting member for realistic visual interposition between a member of the selected anchor real world objects set and the virtual object so as to provide said realistic visual connectivity relationship using the selected at least one virtual connecting member as being visually interposed between a member of the selected anchor real world objects set and the virtual object; and the one or more processors being configured to generate display data for an image of the virtual object having the realistic physical connection with a selected member of the anchor real world objects set with the selected at least one virtual connecting member being visually interposed there between, the generated display data being usable by the see-through, near-eye, augmented reality display device system. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. Processor-readable storage implemented as hardware storage having plural and respectively addressable storage locations for simultaneously storing respective addressable data items including instructions encoded therein for causing one or more processors to execute a method causing display of virtual imagery that appears to be realistically and in context integrated with a real world object of a real environment viewable by a user using a see-through, augmented reality display system, the executed method comprising:
-
first identifying a real world object present in the viewable real environment and to which predetermined virtual imagery can be visually coupled by way of a visually interposed virtual connecting member such that the predetermined virtual imagery appears to be realistically and in context connectively integrated with the identified real world object; second identifying a virtual connecting member usable for realistic connective disposition visually between the predetermined virtual imagery and the identified real world object so as to provide said realistic and in context, visually connective integration of the virtual imagery with the identified real world object; generating display data for displaying the virtual connecting member as being visually connectedly interposed between the predetermined virtual imagery and the identified real world object; and using the generated display data to cause display by the see-through, augmented reality display system of the predetermined virtual imagery as being realistically and in context, visually connectively integrated with the identified real world object. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14)
-
-
15. A method for presenting predetermined virtual imagery that appears to be realistically and in context integrated with a real environment viewable by a user using a see-through, augmented reality display system, the method comprising:
-
first identifying as an anchor at least one real world object present in the real environment and viewable through the see-through, augmented reality display system where the identified anchor can serve as a foundation for realistically supporting a virtual connecting member to which the predetermined virtual imagery will be displayed as being physically connected to by way of interposition of the virtual connecting member such that the predetermined virtual imagery is seen as being realistically supported by both of the identified anchor and the interposed virtual connecting member; second identifying one of a plurality of predetermined virtual connecting members as the virtual connecting member to be displayed and used for realistic visual and supportive connective disposition between the predetermined virtual imagery and the identified anchor so as to provide said realistic and in context integration of the virtual imagery with the identified anchor; generating display data for displaying the identified virtual connecting member as being visually connectedly interposed between the predetermined virtual imagery and the identified real world object; and using the generated display data to cause display by the see-through, augmented reality display system of the predetermined virtual imagery as being realistically and in context integrated with the identified real world object by way of the identified virtual connecting member. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23)
-
Specification