Acquisition of a user expression and an environment of the expression

• US 20060209017A1
• Filed: 03/31/2005
• Published: 09/21/2006
• Est. Priority Date: 03/18/2005
• Status: Active Grant

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Searete LLC (Intellectual Ventures LLC)
• Inventors: Cohen, Alexander J., Lord, Robert W., Jung, Edward K.Y., Levien, Royce A., Malamud, Mark A., Rinaldo, John D. Jr.
• Granted Patent: US 8,787,706 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability

Abstract

Embodiments include an apparatus, device, system, and method. In an embodiment, a human wearable apparatus is provided. The apparatus includes an annotation environment capture device operable to generate information indicative of a recognizable aspect of an item and an annotating device operable to generate information indicative of a user expression associated with the recognizable aspect of the item.

Claims

1. A human wearable apparatus, the apparatus comprising:

a) an annotation environment capture device operable to generate information indicative of a recognizable aspect of an item; and

b) an annotating device operable to generate information indicative of a user expression associated with the recognizable aspect of the item.

2. The apparatus of claim 1, wherein the annotation environment capture device includes a head mountable annotation environment device.

3. The apparatus of claim 1, wherein the annotating device includes a head mountable annotating device.

4. The apparatus of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to capture at least one parameter of an environment that includes the recognizable aspect of an item.

5. The apparatus of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to capture an optical representation of an environment that includes the recognizable aspect of an item.

6. The apparatus of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to capture an audio representation of an environment that includes the recognizable aspect of an item.

7. The apparatus of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a machine-recognizable aspect of an item.

8. The apparatus of claim 4, wherein the annotation environment capture device operable to generate information indicative of a machine-recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a machine-recognizable radio frequency identification signal corresponding to an aspect of an item.

9. The apparatus of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of an optically-recognizable aspect of an item.

11. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a human recognizable aspect of an item.

12. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable native text of an item.

13. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable visual aspect of an item.

14. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable image aspect of an item.

15. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable shape aspect of an item.

16. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable dimensional aspect of an item.

17. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes an annotation environment capture device operable to generate information indicative of a recognizable human readable content.

19. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes a annotation environment capture device operable to generate information indicative of a recognizable aspect of an item in response to an input received from the user.

20. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes a annotation environment capture device operable to generate information indicative of a recognizable aspect of an item in response to an input responsive to a gesture by the user.

21. The system of claim 1, wherein the annotation environment capture device operable to generate information indicative of a recognizable aspect of an item includes a module operable to recognize data indicative of the recognizable aspect of an item.

22. The system of claim 21, wherein the module operable to recognize data indicative of the recognizable aspect of an item includes an artificial intelligence module operable to recognize data indicative of the recognizable aspect of an item.

23. The system of claim 21, wherein the module operable to recognize data indicative of the recognizable aspect of an item includes a pattern recognition module operable to recognize data indicative of the recognizable aspect of an item.

24. The apparatus of claim 1, wherein the annotating device operable to generate information indicative of a user expression associated with the recognizable aspect of the item includes an annotating device operable to generate information indicative of a user expression associated with the recognizable aspect of the item, wherein the user expression includes at least one of a hand formed user expression, a verbal user expression, a preformed user expression, or a gestural user expression.

25. The apparatus of claim 1, further comprising:

c) a communications device.

26. The apparatus of claim 1, further comprising:

c) a storage device.

10. (canceled)

18. (canceled)

27. A head mountable apparatus, the apparatus comprising:

a) an annotation environment capture device operable to generate information indicative of a recognizable aspect of an item; and

b) an annotating device operable to generate information indicative of a user expression associated with the recognizable aspect of the item.

28. The apparatus of claim 27, further comprising:

c) a communications device.

29. The apparatus of claim 27, further comprising:

c) a storage device.

30. A method comprising:

a) generating in a portable apparatus a first information indicative of a recognizable aspect of an item; and

b) generating in the portable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item.

31. The method of claim 30, wherein the generating in a portable apparatus a first information indicative of a recognizable aspect of an item includes a generating in a portable head mountable apparatus a first information indicative of a recognizable aspect of an item.

32. The method of claim 31, wherein the generating in the portable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item includes a generating in the portable head mountable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item.

33. The method of claim 30, further comprising:

c) saving at least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

34. The method of claim 30, further comprising:

c) transmitting least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

35. A wearable apparatus, the comprising:

a) a context module operable to generate a first information indicative of a recognizable aspect of an item; and

b) an annotation module operable to generate a second information indicative of a user expression associated with the recognizable aspect of the item.

36. The apparatus of claim 35, further comprising:

c) a communications module operable to transmit at least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

37. The apparatus of claim 35, further comprising:

c) a storage module operable to save at least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

38. A method comprising:

a) generating in a portable apparatus a first information indicative of a recognizable aspect of an item; and

b) generating in the portable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item.

39. The method of claim 38, wherein the generating in a portable apparatus a first information indicative of a recognizable aspect of an item includes a generating in a portable head mountable apparatus a first information indicative of a recognizable aspect of an item.

40. The method of claim 39, wherein the generating in the portable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item includes a generating in the portable head mountable apparatus a second information indicative of a user expression associated with the recognizable aspect of the item.

41. The method of claim 38, further comprising:

c) saving at least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

42. The method of claim 38, further comprising:

c) transmitting least one of the first information indicative of a recognizable aspect of an item and the second information indicative of a user expression associated with the recognizable aspect of the item.

43. A method comprising:

a) tracking a gaze of a user'"'"'s eye;

b) acquiring an image of a recognizable aspect of an item corresponding to the gaze of a user'"'"'s eye;

c) generating a first information indicative of the recognizable aspect of an item corresponding to the gaze of a user'"'"'s eye; and

d) generating a second information indicative of a user expression associated with the recognizable aspect of an item corresponding to the gaze of a user'"'"'s eye.

44. The method of claim 43, further comprising:

e) receiving a signal indicative of the user expression associated with the recognizable aspect of the item.

45. The method of claim 43, wherein the acquiring an image of a recognizable aspect of the item corresponding to the gaze of a user'"'"'s eye includes acquiring an image of a recognizable aspect of the item corresponding to the gaze of a user'"'"'s eye in response a received user input.

46. The method of claim 43, wherein the generating a second information indicative of a user expression associated with the recognizable aspect of the item includes generating a second information indicative of a user verbal expression associated with the recognizable aspect of the item.

47. The method of claim 43, wherein the generating a second information indicative of a user expression associated with the recognizable aspect of the item includes generating a second information indicative of a user hand formed expression associated with the recognizable aspect of the item.

48. The method of claim 43, wherein the generating a second information indicative of a user expression associated with the recognizable aspect of the item includes generating a second information indicative of a user gesture associated with the recognizable aspect of the item.

49. The method of claim 43, wherein the method includes a method performed in a head mountable apparatus.

50. A head mountable apparatus, the apparatus comprising:

a) a tracking module operable to track a gaze of a user'"'"'s eye;

b) a sensor module operable to acquire an image of a recognizable aspect of the item corresponding to the gaze of a user'"'"'s eye;

c) a context module operable to generate a first information indicative of the recognizable aspect of an item corresponding to the gaze of a user'"'"'s eye; and

d) an annotation module operable to generate a second information indicative of a user expression associated with the recognizable aspect of the item.

51. The apparatus of claim 50, further comprising:

a receiver module operable to receive a signal indicative of the user expression associated with the recognizable aspect of the item.