TEMPORAL ELEMENT RESTORATION IN AUGMENTED REALITY SYSTEMS

• US 20140267410A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Fein, Gene, Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr., Tegreene, Clarence T.
• Granted Patent: US 10,109,075 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

Methods, apparatuses, computer program products, devices and systems are described that carry out accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device; presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and processing the request and any related interaction of the user via the at least one augmented reality representation.

Claims

1. A system comprising:

circuitry for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device;

circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and

circuitry for processing the request and any related interaction of the user via the at least one augmented reality representation.

2. The system of claim 1 wherein the circuitry for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device comprises:

circuitry for receiving at least one of a notification pertaining to the at least one item, aspect, or element;

an instance of media content pertaining to the at least one item, aspect, or element;

or an action pertaining to the at least one item, aspect, or element.

3. The system of claim 1 wherein the circuitry for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device comprises:

circuitry for receiving at least one system state which at least one of refers to, employs, or contains the at least one item, aspect, or element.

4. The system of claim 3 wherein the circuitry for receiving at least one system state which at least one of refers to, employs, or contains the at least one item, aspect, or element comprises:

circuitry for receiving at least one system state of at least one of a launched application, a restored application, a tool, or a process.

5. The system of claim 1 wherein the circuitry for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device comprises:

circuitry for receiving a request associated with at least one item, aspect, or element that was previously presented on an augmented reality display, but which is no longer presented on the augmented reality display.

6. The system of claim 5 wherein the circuitry for receiving a request associated with at least one item, aspect, or element that was previously presented on an augmented reality display, but which is no longer presented on the augmented reality display comprises:

circuitry for receiving a request associated with at least one item, aspect, or element that was previously presented in a first scene on an augmented reality display, but which is no longer presented on a second scene on the augmented reality display, wherein the first and second scenes have in common at least one of a program, an app, a system, a session, or a timeframe.

7. The system of claim 1 wherein the circuitry for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device comprises:

circuitry for receiving at least one of an email alert, a text message, a voice message, a social network message, or a web page tracking message in a browser.

8. The system of claim 1 wherein the circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device comprises:

circuitry for substituting at least one of a related item, related aspect, or related element currently in the field of view of the augmented reality device with the at least one augmented reality representation.

9. The system of claim 1 wherein the circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device comprises:

circuitry for generating a proxy representation of the at least one item, aspect, or element as the at least one augmented reality representation.

10. The system of claim 1 wherein the circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device comprises:

circuitry for modifying at least one attribute of the scene on the augmented reality display to include at least one proxy representation of the at least one item, aspect, or element.

11. The system of claim 1 wherein the circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device comprises:

circuitry for presenting at least one augmented reality representation having at least one of a distinctive indication, affordance, or multifunctional graphical element.

12. The system of claim 1 wherein the circuitry for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device comprises:

circuitry for presenting at least one augmented reality representation that has at least one attribute that is specific to the context of the field of view of an augmented reality device.

13. The system of claim 11 wherein the circuitry for presenting at least one augmented reality representation that has at least one attribute that is specific to the context of the field of view of an augmented reality device comprises:

circuitry for presenting at least one augmented reality representation that has at least one of a size dimension, a color scheme, a movement, or a brightness that is specific to the context of the field of view of an augmented reality device.

14. The system of claim 1 wherein the circuitry for processing the request and any related interaction of the user via the at least one augmented reality representation comprises:

circuitry for providing a menu of options near the at least one augmented reality representation.

15. The system of claim 1 wherein the circuitry for processing the request and any related interaction of the user via the at least one augmented reality representation comprises:

circuitry for providing a dialog interface near the at least one augmented reality representation.

16. The system of claim 1 wherein the circuitry for processing the request and any related interaction of the user via the at least one augmented reality representation comprises:

circuitry for establishing a communication channel in response to an interaction of the user with the at least one augmented reality representation.

17. The system of claim 1 further comprising:

circuitry for at least one of terminating, dismissing, removing, or releasing the at least one augmented reality representation in response to an indication of at least one of a user input indicating completion of the request, completion of the request, or completion of at least one aspect of the request.

18. A computer-implemented method comprising:

accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device;

presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and

processing the request and any related interaction of the user via the at least one augmented reality representation.

19-34. -34. (canceled)

35. A computer program product comprising:

an article of manufacture including a signal-bearing medium bearing;

(1) one or more instructions for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device;

(2) one or more instructions for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and

(3) one or more instructions for processing the request and any related interaction of the user via the at least one augmented reality representation.

36. The computer program product of claim 35, wherein the signal-bearing medium includes a computer-readable medium.

37. The computer program product of claim 35, wherein the signal-bearing medium includes a recordable medium.

38. The computer program product of claim 35, wherein the signal-bearing medium includes a communications medium.

39. A system comprising:

a computing device; and

instructions that when executed on the computing device cause the computing device to

(1) accept a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device;

(2) present in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and

(3) process the request and any related interaction of the user via the at least one augmented reality representation.

40. The system of claim 39 wherein the computing device comprises:

one or more of a dedicated augmented reality device, a personal digital assistant (PDA), a personal entertainment device, a mobile phone, a laptop computer, a tablet personal computer, a networked computer, a computing system comprised of a cluster of processors, a computing system comprised of a cluster of servers, a workstation computer, and/or a desktop computer.

41. A system comprising:

means for accepting a request associated with at least one of an item, an aspect, or an element that is not present in a field of view of a user'"'"'s augmented reality device;

means for presenting in a display of the augmented reality device at least one augmented reality representation related to the at least one item, aspect, or element in response to at least one output of the circuitry for accepting a request associated with at least one item, aspect, or element that is not present in a field of view of an augmented reality device; and

means for processing the request and any related interaction of the user via the at least one augmented reality representation.