Augmented books in a mixed reality environment
First Claim
Patent Images
1. A method of presenting a mixed reality experience to a user viewing a reading material including at least one of text and an image, the method comprising:
- (a) identifying a position of the reading material in three-dimensional space;
(b) tracking a position of a user'"'"'s eyes with respect to text or images in the reading material;
(c) receiving a request for information regarding a portion of the reading material;
(d) searching for a response to the request for information received in said step (c);
(e) displaying the response to a user, if found in said step (d), in a first virtual display slate at a position in the user'"'"'s field of view that does not overlap with text and/or images from the reading material;
(f) pinning the position of the virtual display slate in a fixed position with respect to the reading material in the user'"'"'s field of view; and
(g) displaying a second virtual display slate to the user, the second virtual display slate included by an author of a software application relating to the reading material, the software application executing on a computing system associated with the mixed reality environment, the second virtual display slate displaying additional information about a portion of the reading material when the user reaches the portion of the reading material.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method are disclosed for augmenting a reading experience in a mixed reality environment. In response to predefined verbal or physical gestures, the mixed reality system is able to answer a user'"'"'s questions or provide additional information relating to what the user is reading. Responses may be displayed to the user on virtual display slates in a border or around the reading material without obscuring text or interfering with the user'"'"'s reading experience.
100 Citations
14 Claims
-
1. A method of presenting a mixed reality experience to a user viewing a reading material including at least one of text and an image, the method comprising:
-
(a) identifying a position of the reading material in three-dimensional space; (b) tracking a position of a user'"'"'s eyes with respect to text or images in the reading material; (c) receiving a request for information regarding a portion of the reading material; (d) searching for a response to the request for information received in said step (c); (e) displaying the response to a user, if found in said step (d), in a first virtual display slate at a position in the user'"'"'s field of view that does not overlap with text and/or images from the reading material; (f) pinning the position of the virtual display slate in a fixed position with respect to the reading material in the user'"'"'s field of view; and (g) displaying a second virtual display slate to the user, the second virtual display slate included by an author of a software application relating to the reading material, the software application executing on a computing system associated with the mixed reality environment, the second virtual display slate displaying additional information about a portion of the reading material when the user reaches the portion of the reading material. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
Specification