Providing contextual personal information by a mixed reality device
First Claim
1. One or more processor-readable storage devices having instructions encoded thereon for causing one or more software controlled processors to execute a method for providing location-relevant contextual personal information by a mixed reality display device system, the method comprising:
- receiving and storing person selection criteria having been provided by a user wearing a mixed reality display device of the system, the person selection criteria being for identifying another person who satisfies the person selection criteria;
sending a request including a location of the user and the person selection criteria to a personal information service engine executing on one or more remote computer systems for a personal identification data set for each person sharing the location and satisfying the person selection criteria, the location being one shared by the user and one or more other persons such that face to face meetings can occur at the location between the user and the one or more other persons, the location including a scene in a field of view of the mixed reality display device;
receiving at least one personal identification data set from the personal information service engine for a person sharing the location;
determining whether the person associated with the at least one personal identification data set is in the field of view of the mixed reality display device;
responsive to the person associated with the at least one personal identification data set not being currently within the field of view of the mixed reality display device, determining a position of the person within the location, and outputting data which indicates the out-of-field-of-view position of the person within the location; and
responsive to the person associated with the at least one personal identification data set being in the field of view, outputting data which identifies the in-field-of-view position and identity of the person in the field of view.
2 Assignments
0 Petitions
Accused Products
Abstract
The technology provides contextual personal information by a mixed reality display device system being worn by a user. A user inputs person selection criteria, and the display system sends a request for data identifying at least one person in a location of the user who satisfy the person selection criteria to a cloud based application with access to user profile data for multiple users. Upon receiving data identifying the at least one person, the display system outputs data identifying the person if he or she is within the field of view. An identifier and a position indicator of the person in the location is output if not. Directional sensors on the display device may also be used for determining a position of the person. Cloud based executing software can identify and track the positions of people based on image and non-image data from display devices in the location.
-
Citations
20 Claims
-
1. One or more processor-readable storage devices having instructions encoded thereon for causing one or more software controlled processors to execute a method for providing location-relevant contextual personal information by a mixed reality display device system, the method comprising:
-
receiving and storing person selection criteria having been provided by a user wearing a mixed reality display device of the system, the person selection criteria being for identifying another person who satisfies the person selection criteria; sending a request including a location of the user and the person selection criteria to a personal information service engine executing on one or more remote computer systems for a personal identification data set for each person sharing the location and satisfying the person selection criteria, the location being one shared by the user and one or more other persons such that face to face meetings can occur at the location between the user and the one or more other persons, the location including a scene in a field of view of the mixed reality display device; receiving at least one personal identification data set from the personal information service engine for a person sharing the location; determining whether the person associated with the at least one personal identification data set is in the field of view of the mixed reality display device; responsive to the person associated with the at least one personal identification data set not being currently within the field of view of the mixed reality display device, determining a position of the person within the location, and outputting data which indicates the out-of-field-of-view position of the person within the location; and responsive to the person associated with the at least one personal identification data set being in the field of view, outputting data which identifies the in-field-of-view position and identity of the person in the field of view. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method for providing location-relevant contextual personal information to a head mounted, mixed reality, display device of a mixed reality system, the method comprising:
-
receiving a request indicating a location of a user of a head mounted, mixed reality display device of the system and indicating person selection criteria for at least one personal identification data set for each of other persons sharing the location with the user and satisfying the person selection criteria, the shared location being such that face to face meetings can occur at the location between the user and one or more of the other persons at the location, the location including a scene in a field of view of the mixed reality display device of the user; determining whether there is a person sharing the location and satisfying the indicated person selection criteria based on accessible user profile data; responsive to there being a person sharing the location and satisfying the indicated person selection criteria, providing at least one personal identification data set for the person; determining whether the person associated with the provided at least one personal identification data set is currently within the field of view of the head mounted, mixed reality, display device of the user; responsive to the person not being currently within the field of view of the display device determining a position of the person within the location, and sending an indication of the position in the at least one personal identification data set; and responsive to the person being currently within the field of view of the display device of the user, sending the at least one personal identification data set including a positional indicator and a personal identifier for the person in the field of view. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
-
16. A head mounted, mixed reality display device system for providing contextual personal information comprising:
-
a mixed reality display positioned by a head mounted support structure worn by a user; at least one front facing camera positioned on the support structure for capturing image data of a field of view of the mixed reality display; one or more directional sensors attached to the support structure, each having a sensor position with reference to a body part of the user and transmitting an identity data set including the sensor position; one or more software controlled processors communicatively coupled to the at least one front facing camera for receiving the image data of the field of view; the one or more software controlled processors being communicatively coupled to a remote computer system executing a personal information service engine for sending a request with person selection criteria and a location of the user wearing the head mounted support structure, for receiving a personal identification data set of one or more other persons sharing the location with the user and satisfying the person selection criteria, and for determining whether the person associated with the personal identification data set is in the field of view of the mixed reality display, where the location shared by the user and the one or more other persons is such that face to face meetings can occur at the location between the user and the one or more other persons and the location includes a scene in a field of view of the mixed reality display of the user; and at least one image generation unit communicatively coupled to the one or more software controlled processors and optically coupled to the mixed reality display for, responsive to the person associated with the personal identification data set being in the field of view, tracking virtual data to an in-field-of-view position of the person, and responsive to the person associated with the personal identification data set not being currently within the field of view, displaying image data which indicates a position of the person within the location but outside the field of view. - View Dependent Claims (17, 18, 19, 20)
-
Specification