REAL-TIME ANNOTATOR

• US 20090171901A1
• Filed: 12/28/2007
• Published: 07/02/2009
• Est. Priority Date: 12/28/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Multerer, Boyd Cannon, Bathiche, Steven N., Guday, Shai, MacLaurin, Matthew B., Wilson, Andrew David, Russell, Zachary Lewis, Whitten, Jon Marcus Randall
• Granted Patent: US 8,131,750 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: Y10S 707/913 Multimedia

Abstract

Systems (and corresponding methodologies) that annotate experience data in real-time are provided. The real-time annotated experience data can be employed in accordance with augmented reality systems which are capable of overlaying virtual data upon real-world data. The system employs ‘smart-tags’ that are capable of identifying data that relates to and/or is associated with the real-world scenarios and situations.

Claims

1. A system that facilitates real-time annotation, comprising:

a tag identifier component that discovers a plurality of tags related to an experience in view of a context;

a retrieval component that accesses tagged data related to a subset of the plurality of tags; and

an annotation component that annotates the experience in real-time with the accessed data.

2. The system of claim 1, wherein the tag identifier employs at least one of facial recognition, pattern recognition, speech recognition, audio analysis or text analysis to establish the plurality of tags.

3. The system of claim 1, wherein the annotation component renders the annotated experience via at least one of a visual or audio device.

4. The system of claim 1, further comprising an annotation system that tags the data related to a plurality of user experiences in view of contextual factors.

5. The system of claim 4, further comprising an interface component that at least one of monitors or receives the data related to the elements.

6. The system of claim 5, further comprising an information gather component that collects the data related to the elements via a sensory mechanism.

7. The system of claim 6, wherein the sensory mechanism is at least one of a physiological or environmental sensor.

8. The system of claim 6, further comprising a query component that employs a query to supplement the collected data with data from a network-based source.

9. The system of claim 6, further comprising:

an analysis component that determines criteria related to the collected data; and

a tag generator component that generates the tags based upon a subset of the criteria.

10. The system of claim 9, further comprising:

a pattern analyzer component that identifies at least one of identity of an individual or object; and

a tag generator component that generates the tags based upon a subset of the criteria.

11. The system of claim 9, further comprising:

a sound analyzer component that identifies at least one of identity of an individual or object; and

a tag generator component that generates the tags based upon a subset of the criteria.

12. The system of claim 9, further comprising:

a context analyzer component that establishes context that includes at least one of an activity context, user context, or environment context; and

a tag generator component that generates the tags based upon a subset of the context.

13. The system of claim 1, further comprising a machine learning and reasoning component that employs at least one of a probabilistic and a statistical-based analysis that infers an action that a user desires to be automatically performed.

14. A computer-implemented method of annotating reality in real-time, comprising:

monitoring an element of an experience;

analyzing the element;

employing the analysis to identify a plurality of tags; and

annotating the element in real-time with data identified by a subset of the tags.

15. The computer-implemented method of claim 14, wherein the act of analyzing includes at least one of analyzing a pattern, analyzing a sound, or analyzing a context of the element.

16. The computer-implemented method of claim 14, further comprising retrieving the data identified by the subset of the tags from a network-based source.

17. The computer-implemented method of claim 14, further comprising:

monitoring a disparate set of elements;

identifying data related to a subset of the disparate set of elements; and

tagging the data based upon content in view of context.

18. A computer-executable system that facilitates annotation of reality in real-time, comprising:

means for monitoring experiences of a user;

means for analyzing elements of a subset of the experiences;

means for generating tags associated to the elements based upon the analysis;

means for indexing data related to the elements as a function of the tags; and

means for storing the indexed data.

19. The computer-executable system of claim 18, further comprising means for annotating an experience of a disparate user in real-time based upon the indexed data.

20. The computer-executable system of claim 19, further comprising:

means monitoring experiences of the disparate user; and

means for analyzing the experiences, wherein the analysis is employed to locate or retrieve the indexed data.