Computing method and system with detached sensor in a network environment

• US 9,224,304 B2
• Filed: 03/20/2015
• Issued: 12/29/2015
• Est. Priority Date: 08/13/1996
• Status: Expired due to Fees

• Current Assignee: IpLearn-Focus LLC (IpLearn LLC)
• Original Assignee: IpLearn-Focus LLC (IpLearn LLC)
• Inventors: Ho, Chi Fai, Tong, Peter P.
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US14/663,947
• Publication Number:
  US 20150194065A1
• Time in Patent Office: 284 Days
• US Class Current: 1/1
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/04 characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation

Abstract

One embodiment includes a computer-implemented method and system in a network environment using at least a display and a detached sensor. Another embodiment includes a computer-implemented system helping a user learn using a detached imaging sensor. In yet another embodiment, a computer-implemented system monitors automatically more than once a user'"'"'s behavior while the user is working on materials. Through monitoring the user'"'"'s voluntary or involuntary behavior, the system determines what to present by the display. The presentation could include providing rewards, punishments, stimulation, and other materials. The system can also react by asking the user a question. Based on the user'"'"'s response, the system may change to more appropriate materials, or different presentation styles.

Claims

1. A computing apparatus comprising:

a storage unit;

a network interface adapter to couple at least to the Internet; and

a processor operatively connected to the storage unit and the network interface adapter,

wherein the storage unit storing instructions that, when executed at least by the processor, cause the processor to;

access data via an identity of a user, the data based on a first set of measurements produced by an imaging sensor sensing a first feature of the user, in a first session, regarding a first voluntary behavior of the user, the imaging sensor detached from the first feature when sensing the first feature, and the first set of measurements to include a plurality of images of the first feature of the user;

access data based on a second set of measurements produced by the imaging sensor sensing a second feature of the user, in a second session, which is after the first session, regarding a second voluntary behavior of the user to interact with content presented by a display, the imaging sensor detached from the second feature when sensing the second feature, and the second set of measurements to include a plurality of images of the second feature of the user;

analyze the data based on the first set of measurements and the data based on the second set of measurements, using at least a rule accessed via the Internet with the network interface adapter, to determine a first content to be presented to the user by the display; and

access, using the network interface adapter, at least some of the first content via the Internet.

2. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to determine the first content based on a speed of the second voluntary behavior of the user, with the speed identified by the processor using at least a part of the second set of measurements.

3. A computing apparatus as recited in claim 2, wherein the instructions, when executed, cause the processor to determine the first content depending on comparing the speed of the second voluntary behavior with a reference speed.

4. A computing apparatus as recited in claim 3, wherein the reference speed depends on a speed of the user.

5. A computing apparatus as recited in claim 3, wherein the reference speed depends on a speed of another user.

6. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to:

access data based on a third set of measurements produced by the imaging sensor sensing a third feature of the user regarding a third voluntary behavior of the user, the imaging sensor detached from the third feature when sensing the third feature, and the third set of measurements to include a plurality of images of the third feature of the user; and

determine content to be presented by the display, depending on analyzing at least a part of the data based on the second set of measurements and at least a part of the data based on the third set of measurements.

7. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to transmit, using the network interface adapter, at least a part of the data based on the second set of measurements, via the Internet, to another computing apparatus.

8. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to determine whether the user is not looking at the display based on a third set of measurements produced by the imaging sensor regarding the user.

9. A computing apparatus as recited in claim 8, wherein the instructions, when executed, cause the processor to determine content to be presented by the display based on whether the user is not looking at the display.

10. A computing apparatus as recited in claim 2, wherein the speed depends on a calibration process performed on the user, with the calibration process using the imaging sensor.

11. A computing apparatus as recited in claim 10, wherein the calibration process depends on a reference image of the user.

12. A computing apparatus as recited in claim 10, wherein the calibration process depends on a speed of another user.

13. A computing apparatus as recited in claim 10, wherein the calibration process depends on a static reference speed.

14. A computing apparatus as recited in claim 10, wherein the calibration process depends on a dynamic reference.

15. A computing apparatus as recited in claim 2, wherein the instructions, when executed, cause the processor to determine the first content based on a speed of at least one other user.

16. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to:

access data based on a third set of measurements produced by the imaging sensor sensing a third feature of the user regarding a third voluntary behavior of the user, the imaging sensor detached from the third feature when sensing the third feature, and

determine a position on the display depending on at least a part of the data based on the third set of measurements.

17. A computing apparatus as recited in claim 1, wherein the rule depends on data from a plurality of users.

18. A computing apparatus as recited in claim 17, wherein the data from the plurality of users depends on responses from the plurality of users.

19. A computing apparatus as recited in claim 1, wherein after the first content has been determined, the instructions, when executed, cause the processor to access, using the network interface adapter, the at least some of the first content via the Internet.

20. A computing apparatus as recited in claim 2, wherein the instructions, when executed, cause the processor to:

determine whether the user is not looking at the display based on measurements produced by the imaging sensor regarding the user; and

determine a position on the display based on measurements produced by the imaging sensor regarding the user.

21. A computing apparatus as recited in claim 20, wherein the instructions, when executed, cause the processor to:

determine content to be presented by the display in view of the user not looking at the display; and

present an inquiry to the user based on measurements produced by the imaging sensor regarding the user.

22. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access data based on a third set of measurements produced by the imaging sensor sensing a third feature of the user, and analyze at least a part of the data based on the third set of measurements to identify a facial orientation of the user.

23. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access data based on a third set of measurements produced by the imaging sensor sensing a third feature of the user, and analyze at least a part of the data based on the third set of measurements to identify a facial expression of the user.

24. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to identify a heart beat of the user based on measurements on the user, to determine content to be presented by the display.

25. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access, using the network interface adapter, via the Internet, content that includes a game, to be presented by the display.

26. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access, using the network interface adapter, via the Internet, content that includes a video, to be presented by the display.

27. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access, using the network interface adapter, via the Internet, content that includes materials applicable for the user to learn, to be presented by the display.

28. A computing apparatus as recited in claim 1, wherein the instructions, when executed, cause the processor to access, using the network interface adapter, via the Internet, content that includes materials applicable to entertain the user, to be presented by the display.

29. A computing apparatus as recited in claim 2, wherein the speed of the second voluntary behavior is a speed of a movement of at least one of the eyes of the user.

30. A computing apparatus as recited in claim 1, wherein the first session includes a calibration process performed on the user, with the calibration process using the imaging sensor, and with the calibration process performed before the first set of measurements are produced by the imaging sensor.

42. A computing apparatus as recited in claim 1, wherein the storage unit storing instructions that, when executed at least by the processor, further cause a calibration process performed on the user before the first session to help determine the first content, with the calibration process using the imaging sensor.

31. A plurality of computing apparatuses coupled via at least the Internet comprising:

a first computing apparatus; and

a second computing apparatus comprising;

a storage unit;

a network interface adapter to couple at least to the Internet; and

a processor operatively connected to the storage unit and the network interface adapter,

wherein the storage unit storing instructions that, when executed at least by the processor, cause the processor to;

access data via an identity of a user, the data based on a first set of measurements produced by an imaging sensor sensing a first feature of the user, in a first session, regarding a first voluntary behavior of the user, the imaging sensor detached from the first feature when sensing the first feature, and the first set of measurements to include a plurality of images of the first feature of the user;

access data based on a second set of measurements produced by the imaging sensor sensing a second feature of the user, in a second session, which is after the first session, regarding a second voluntary behavior of the user to interact with content presented by a display, the imaging sensor detached from the second feature when sensing the second feature, and the second set of measurements to include a plurality of images of the second feature of the user;

analyze the data based on the first set of measurements and the data based on the second set of measurements, using at least a rule accessed via the Internet with the network interface adapter, to determine a first content to be presented to the user by the display; and

access, using the network interface adapter, at least some of the first content, via the Internet, from the first computing apparatus.

32. An article comprising a non-transitory storage medium having stored thereon instructions executable by a first processor to transmit at least a portion of a first content to a second processor, via the Internet, to enable the second processor to present the first content to a user by a display,

with the first content to be determined by the second processor analyzing, using at least a rule, data, accessed via an identity of the user, based on a first set of measurements, and data based on a second set of measurements, the rule to be accessed by the second processor via the Internet,

with the first set of measurements to be produced by an imaging sensor to sense a first feature of the user, in a first session, regarding a first voluntary behavior of the user, with the imaging sensor to be detached from the first feature when sensing the first feature, and with the first set of measurements to include a plurality of images of the first feature of the user, and

with the second set of measurements to be produced by the imaging sensor to sense a second feature of the user, in a second session, which is after the first session, regarding a second voluntary behavior of the user to interact with content presented by the display, with the imaging sensor to be detached from the second feature when sensing the second feature, and with the second set of measurements to include a plurality of images of the second feature of the user.

33. An article as recited in claim 32 wherein the instructions executable by the first processor to enable the second processor to determine whether the user is not looking at the display based on a third set of measurements produced by the imaging sensor regarding the user.

34. An article as recited in claim 33 wherein the instructions executable by the first processor to enable the second processor to determine content to be presented by the display based on whether the user is not looking at the display.

35. An article as recited in claim 32 wherein the first content also depends on a speed of the second voluntary behavior of the user, with the speed identified by the second processor based on at least a part of the second set of measurements.

36. An article as recited in claim 35 wherein the first content also depends on a speed of at least one other user.

37. An article as recited in claim 32, wherein the rule depends on data from a plurality of users.

38. An article as recited in claim 37, wherein the data from the plurality of users depends on responses from the plurality of users.

39. An article as recited in claim 32 wherein the instructions executable by the first processor to enable the second processor to determine content to present by the display based on measurements regarding the user'"'"'s heart beat.

43. An article as recited in claim 32 wherein the non-transitory storage medium having stored thereon instructions executable by the first processor to transmit at least a portion of the first content to the second processor, with the first content to be determined by the second processor also based on a calibration process performed on the user before the first session, with the calibration process using the imaging sensor.

40. An article comprising a non-transitory storage medium having stored thereon instructions executable by a processor to:

access data via an identity of a user, the data based on a first set of measurements produced by an imaging sensor sensing a first feature of the user, in a first session, regarding a first voluntary behavior of the user, the imaging sensor detached from the first feature when sensing the first feature, and the first set of measurements to include a plurality of images of the first feature of the user;

access data based on a second set of measurements produced by the imaging sensor sensing a second feature of the user, in a second session, which is after the first session, to produce a second set of measurements, regarding a second voluntary behavior of the user to interact with content presented by a display, the imaging sensor detached from the second feature when sensing the second feature, and the second set of measurements to include a plurality of images of the second feature of the user;

analyze the data based on the first set of measurements and the data based on the second set of measurements, using at least a rule accessed via the Internet, to determine a first content to be presented to the user by the display; and

access at least some of the first content via the Internet.

41. An article comprising a non-transitory storage medium having stored thereon instructions executable by a first processor to transmit at least some of a first content from the first processor to a second processor, via the Internet, to be presented by a display, with the second processor to:

access data via an identity of a user, the data based on a first set of measurements produced by an imaging sensor sensing a first feature of a user, in a first session, regarding a first voluntary behavior of the user, the imaging sensor detached from the first feature when sensing the first feature, and the first set of measurements to include a plurality of images of the first feature of the user;

access data based on a second set of measurements produced by the imaging sensor sensing a second feature of the user, in a second session, which is after the first session, regarding a second voluntary behavior of the user to interact with content presented by the display, the imaging sensor detached from the second feature when sensing the second feature, and the second set of measurements to include a plurality of images of the second feature of the user; and

analyze the data based on the first set of measurements and the data based on the second set of measurements, using at least a rule accessed via the Internet by the second processor, to determine the first content.