Learning method and system using detached sensor

• US 8,538,320 B2
• Filed: 03/14/2013
• Issued: 09/17/2013
• Est. Priority Date: 08/13/1996
• Status: Expired due to Fees

• Current Assignee: IpLearn-Focus LLC (IpLearn LLC)
• Original Assignee: IpLearn-Focus LLC (IpLearn LLC)
• Inventors: Ho, Chi Fai, Tong, Peter P.
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US13/831,547
• Publication Number:
  US 20130201318A1
• Time in Patent Office: 187 Days
• Field of Search: 434/350, 434/322, 434/323
• US Class Current: 434/350
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/04 characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation

Abstract

One embodiment includes a computer-implemented method using a window environment of a display, with a detached imaging sensor, to enable a user to learn. Another embodiment includes a computer-implemented system helping a user learn using a detached imaging sensor. In yet another embodiment, a computer-implemented system monitors automatically more than once a user'"'"'s behavior while the user is working on materials. Through monitoring the user'"'"'s volitional or involuntary behavior, the system determines whether to change what is to be presented by the display. The change could include providing rewards, punishments, and stimulation; or changing the materials. The system can also react by asking the user a question. Based on the user'"'"'s response, the system may change to more appropriate materials, or different presentation styles.

Claims

1. A computing system comprising:

a display;

an imaging sensor to sense a first feature of a user regarding a first volitional behavior of the user to produce a first set of measurements, the imaging sensor being detached from the first feature to sense the first feature, the first feature relating to the head of the user, and the first set of measurements including an image of the first feature, wherein the system further to sense a second feature of the user regarding a second volitional behavior of the user to produce a second set of measurements, the second feature not relating to the head of the user; and

a processor coupled to the imaging sensor and the display, the processor to;

analyze at least the first set and the second set of measurements; and

determine whether to change what is to be presented by the display in view of the analysis.

2. A computing system as recited in claim 1, wherein the first feature includes a facial feature of the user.

3. A computing system as recited in claim 2, wherein the facial feature includes a facial orientation.

4. A computing system as recited in claim 3, wherein via the facial orientation, the system capable of determining if the user is looking away from the display.

5. A computing system as recited in claim 2, wherein the facial feature includes at least one eye of the user.

6. A computing system as recited in claim 5, wherein the facial feature includes the pupil of the at least one eye of the user.

7. A computing system as recited in claim 1, wherein the imaging sensor capable of sensing multiple facial features of the user.

8. A computing system as recited in claim 7, wherein the multiple facial features include a facial orientation and at least one eye of the user.

9. A computing system as recited in claim 1, wherein the second feature includes an action by the user.

10. A computing system as recited in claim 9, wherein the second set of measurements helps determine at least a position on the display.

11. A computing system as recited in claim 9, wherein to analyze includes to analyze a speed of the user action.

12. A computing system as recited in claim 1, wherein to analyze includes to analyze a speed of inputs to the system by the user.

13. A computing system as recited in claim 1, wherein at least one of the sets of measurements capable of helping control movement of content on the display for the user to read.

14. A computing system as recited in claim 1, wherein the imaging sensor capable of sensing the user periodically.

15. A computing system as recited in claim 1, wherein the system capable of asking the user to be at a certain position relative to the display to sense the first feature.

16. A computing system as recited in claim 1, wherein the system capable of associating at least some measurements from the imaging sensor to an identity of the user.

17. A computing system as recited in claim 1, wherein the processor further capable of changing what is to be presented by the display in view of analysis of the first and the second set of measurements.

18. A computing system as recited in claim 17, wherein changing what is to be presented includes changing a visual effect of what is to be presented.

19. A computing system as recited in claim 17, wherein changing what is to be presented includes changing at least a portion of content to be presented.

20. A computing system as recited in claim 19, wherein the at least a portion of content to be presented to be accessed via a network from another system.

21. A computing system as recited in claim 17, wherein changing what is to be presented includes asking the user to respond to an inquiry.

22. A computing system as recited in claim 17, wherein the system capable of producing a third set of measurements regarding a third volitional behavior of the user, and wherein the processor further capable of resuming what is to be presented by the display at least in view of the third set of measurements, after what is to be presented by the display has changed in view of analysis of the first and the second set of measurements.

23. A computing system as recited in claim 1, wherein the system capable of promoting learning via the display.

24. A computing system as recited in claim 1, wherein the system capable of providing an indication regarding whether the user is paying attention to content presented by the display.

25. A computing system as recited in claim 1, wherein the system capable of providing an indication regarding whether the user has stopped paying attention to content presented by the display.

26. A computing system as recited in claim 9,

wherein the imaging sensor capable of sensing the user periodically, and

wherein to analyze includes to analyze a speed of the user action.

27. A computing system as recited in claim 26, wherein to analyze includes at least to analyze whether the user has stopped paying attention to content presented by the display.

28. A computing system as recited in claim 27, wherein the processor further configured to change what is to be presented by the display at least in view of the determination that what is to be presented by the display is to be changed.

29. A computing system as recited in claim 28, wherein the system capable of producing a third set of measurements regarding a third volitional behavior of the user, and wherein the processor further capable of resuming what is to be presented by the display at least in view of the third set of measurements, after what is to be presented by the display has changed.

30. A computing system as recited in claim 29, wherein the imaging sensor capable of sensing multiple facial features of the user, and wherein the multiple facial features include a facial orientation and at least one eye of the user.

31. A computing system as recited in claim 3,

wherein the second feature includes an action by the user, and

wherein the second set of measurements helps determine at least a position on the display.

32. A computing system as recited in claim 31,

wherein the first set of measurements includes more than one image of the first feature,

wherein the processor further configured to change what is to be presented by the display in view of the determination that what is to be presented by the display is to be changed, and

wherein to change what is to be presented includes to change a visual effect of what is to be presented.

33. A computing system as recited in claim 32, wherein the system capable of producing a third set of measurements regarding a third volitional behavior of the user, and wherein the processor further capable of resuming what is to be presented by the display at least in view of the third set of measurements, after what is to be presented by the display has changed.

34. A computing system as recited in claim 33, wherein the system capable of associating at least some measurements from the imaging sensor to an identity of the user.

62. A computing system as recited in claim 11, wherein to analyze includes to compare the speed with a reference speed of the user, and wherein the reference speed is a static reference speed.

63. A computing system as recited in claim 11, wherein to analyze includes to compare the speed with a reference speed of the user, and wherein the reference speed is a dynamic reference speed.

64. A computing system as recited in claim 1, wherein the computing system capable of sensing features of different behaviors and capable of analyzing the sensed results in a manner that is intermixed.

65. A computing system as recited in claim 1, wherein the processor further capable of providing an indication to the user regarding the system sensing the user.

66. A computing system as recited in claim 1, wherein the processor capable of self-adapting based on at least the first set of measurements.

72. A computing system as recited in claim 30, wherein the system capable of associating at least some measurements from the imaging sensor to an identity of the user.

35. A computing system comprising:

a display;

an optical sensor to sense a first feature of a user regarding a first volitional behavior of the user to produce a first set of measurements, the optical sensor being detached from the first feature to sense the first feature, the first feature being from the head of the user, and the first set of measurements including an image of the first feature;

a non-optical sensor to sense the user to produce a second set of measurements; and

a processor coupled to the optical sensor, the non-optical sensor, and the display, the processor to;

analyze at least the first set and the second set of measurements; and

determine whether to change what is to be presented by the display in view of the analysis.

36. A computing system as recited in claim 35, wherein the optical sensor includes a camera.

37. A computing system as recited in claim 35, wherein the first feature includes a facial feature of the user.

38. A computing system as recited in claim 37, wherein the facial feature includes at least one eye of the user.

39. A computing system as recited in claim 38, wherein the facial feature includes the pupil of the at least one eye of the user.

40. A computing system as recited in claim 35, wherein the optical sensor capable of sensing multiple facial features of the user.

41. A computing system as recited in claim 40, wherein the multiple facial features include a facial orientation and at least one eye of the user.

42. A computing system as recited in claim 35, wherein the non-optical sensor capable of sensing a second feature of the user regarding a second volitional behavior of the user to produce the second set of measurements, the second feature not from the head of the user.

43. A computing system as recited in claim 42, wherein the second feature includes an action the user.

44. A computing system as recited in claim 43, wherein the second set of measurements helps determine at least a position on the display.

45. A computing system as recited in claim 44, wherein to analyze includes to analyze at least a speed of the user action.

46. A computing system as recited in claim 35, wherein the first set of measurements includes more than one image of the first feature.

47. A computing system as recited in claim 35, wherein the optical sensor capable of sensing the user periodically.

48. A computing system as recited in claim 35, wherein the system capable of associating at least some measurements from the optical sensor to an identity of the user.

49. A computing system as recited in claim 35, wherein the processor further configured to change what is to be presented by the display at least in view of the determination that what is to be presented by the display is to be changed.

50. A computing system as recited in claim 49, wherein to change what is to be presented includes to change a visual effect of what is to be presented.

51. A computing system as recited in claim 49, wherein to change what is to be presented includes to change at least a portion of content to be presented.

52. A computing system as recited in claim 49, wherein to change what is to be presented includes to ask the user to respond to an inquiry.

53. A computing system as recited in claim 49, wherein the system capable of producing a third set of measurements regarding a third volitional behavior of the user, and wherein the processor further capable of resuming what is to be presented by the display at least in view of the third set of measurements, after what is to be presented by the display has changed.

54. A computing system as recited in claim 35, wherein the system capable of providing an indication regarding whether the user is paying attention to content presented by the display.

55. A computing system as recited in claim 35, wherein the system capable of providing an indication regarding whether the user has stopped paying attention to content presented by the display.

56. A computing system as recited in claim 50, wherein the system capable of producing a third set of measurements regarding a third volitional behavior of the user, and wherein the processor further capable of resuming what is to be presented by the display in view of the third set of measurements, after what is to be presented by the display has changed.

57. A computing system as recited in claim 53, wherein the first set of measurements includes more than one image of the first feature.

58. A computing system as recited in claim 57,

wherein the non-optical sensor capable of sensing a second feature of the user regarding a second volitional behavior of the user to produce the second set of measurements, and

wherein the second feature includes an action by the user.

59. A computing system as recited in claim 58,

wherein the optical sensor includes a camera, and

wherein the optical sensor capable of sensing multiple facial features of the user.

60. A computing system as recited in claim 59, wherein the multiple facial features include a facial orientation and at least one eye of the user.

61. A computing system as recited in claim 60, wherein to analyze includes to analyze at least a speed of the user action.

67. A computing system as recited in claim 45, wherein to analyze includes to compare the speed with a reference speed of the user, and wherein the reference speed is a static reference speed.

68. A computing system as recited in claim 45, wherein to analyze includes to compare the speed with a reference speed of the user, and wherein the reference speed is a dynamic reference speed.

69. A computing system as recited in claim 35, wherein the computing system capable of sensing the user with the different sensors and capable of analyzing the sensed results in a manner that is intermixed.

70. A computing system as recited in claim 35, wherein the processor further capable of providing an indication to the user regarding the system sensing the user.

71. A computing system as recited in claim 35, wherein the processor capable self-adapting based on at least the first set of measurements.

73. A computing system as recited in claim 61,

wherein the system capable of associating at least some measurements from the optical sensor to an identity of the user, and

wherein the optical sensor capable of sensing the user periodically to produce multiple sets of measurements.