System, method and computer program product for instant group learning feedback via image-based marking and aggregation

• US 6,628,918 B2
• Filed: 02/21/2001
• Issued: 09/30/2003
• Est. Priority Date: 02/21/2001
• Status: Expired due to Term

• Current Assignee: SRI International, Inc.
• Original Assignee: SRI International, Inc.
• Inventors: De Fronderville, Tristan, Roschelle, Jeremy, Vahey, Philip
• Primary Examiner(s): Hughes, S. Thomas
• Assistant Examiner(s): Harris, Chanda L.
• Application Number:
  US09/792,160
• Publication Number:
  US 20020115050A1
• Time in Patent Office: 951 Days
• Field of Search: 434/350, 434/362, 434/322, 434/323, 455/2.01, 705/10, 725/24
• US Class Current: 434/350
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

A system, method and computer program product are provided for giving feedback in an educational environment using networked devices. Initially, an image stimulus is displayed to a plurality of individual group members regarding material being presented by a group leader utilizing a plurality of networked devices operated by the group members. Thereafter, feedback is received from the individual group members in response to the image stimulus utilizing the networked devices. The feedback is then aggregated after which the aggregated feedback is transmitted to the networked device operated by the group leader. Such aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

Claims

1. A method for giving feedback using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of group members by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from at least two of the group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback from said at least two of the group members; and

(d) transmitting the aggregated feedback to the group leader, wherein the aggregated feedback reflects a composite of said spatial references to said image stimulus.

2. The method as recited in claim 1, wherein the networked devices include thin client devices.

3. The method as recited in claim 2, wherein the thin client devices include wireless devices.

4. The method as recited in claim 3, wherein the wireless devices include handheld wireless devices.

5. The method as recited in claim 4, wherein the wireless devices include personal digital assistants (PDAs).

6. The method as recited in claim 1, wherein the image stimulus is a two dimensional image.

7. The method as recited in claim 1, wherein the image stimulus is a three dimensional image.

8. The method as recited in claim 1, wherein the image stimulus is a sequence of images in the form of a movie.

9. The method as recited in claim 1, wherein the image stimulus includes information associated with a reference coordinate system for use in describing the position of the feedback.

10. The method as recited in claim 1, wherein the image stimulus is an image corresponding to a model of one or more spatial objects.

11. The method as recited in claim 10, wherein the image stimulus is an image corresponding to a model of one or more spatial objects and interactions among the spatial objects.

12. The method as recited in claim 11, wherein the image changes over time according to at least one of rules and input.

13. The method as recited in claim 1, wherein the image stimulus is displayed to the group members utilizing a projector.

14. The method as recited in claim 1, wherein the image stimulus is displayed to the group leader on a networked device visible to the group leader.

15. The method as recited in claim 1, wherein the feedback includes at least one point selected by at least one of the group members.

16. The method as recited in claim 1, wherein the feedback includes at least one shape selected by at least one of the group members.

17. The method as recited in claim 1, wherein the feedback includes at least one region selected by at least one of the group members.

18. The method as recited in claim 1, wherein the feedback includes textual input provided by at least one of the group members.

19. The method as recited in claim 1, wherein the feedback and information pertaining to the feedback is displayed to the group members utilizing the networked devices, and transmitted to a server computer.

20. The method as recited in claim 1, wherein the feedback includes attributes selected by the group members in conjunction with the feedback.

21. The method as recited in claim 20, wherein the attributes include color.

22. The method as recited in claim 20, wherein the attributes include geometric information.

23. The method as recited in claim 20, wherein the attributes include textual information.

24. The method as recited in claim 20, wherein the attributes include audible information.

25. The method as recited in claim 20, wherein the attributes include visual information.

26. The method as recited in claim 1, wherein each group member is capable of contributing more than one instance of feedback.

27. The method as recited in claim 26, wherein each instance of feedback is assigned a unique identifier.

28. The method as recited in claim 27, wherein the group members are capable of deleting or modifying a previous instance of feedback by communicating with a server computer, using the unique identifier.

29. The method as recited in claim 27, wherein the group members are capable of deleting, modifying, or adding attributes from a previous instance of feedback by communicating with a server computer, using the unique identifier.

30. The method as recited in claim 1, wherein allowable attributes associated with the feedback are determined by the group leader.

31. The method as recited in claim 30, wherein the group leader is capable of requiring the group members to select specific attribute types or values with the feedback.

32. The method as recited in claim 30, wherein a server communicates information relating to the allowable attributes to the networked devices, and the network devices limit the feedback in accordance with the information.

33. The method as recited in claim 30, wherein a server communicates upon the feedback being not allowable.

34. The method as recited in claim 33, wherein the corresponding networked device is capable of informing the associated group member that the feedback is disallowed.

35. The method as recited in claim 1, wherein the networked devices are capable of changing a view of the image stimulus by performing a control operation selected from the group consisting of scrolling, zooming, rotating, filtering, and processing.

36. The method as recited in claim 35, wherein the image stimulus includes information associated with a reference coordinate system for use in describing the position of the feedback, wherein the control operation utilizes the information.

37. The method as recited in claim 35, wherein one or more attributes are added to the feedback for indicating the control operation.

38. The method as recited in claim 1, wherein the feedback includes information identifying the group member associated therewith.

39. The method as recited in claim 38, wherein the information includes session information.

40. The method as recited in claim 38, wherein the information includes connection information.

41. The method as recited in claim 1, wherein the feedback is assigned a date and time when the feedback is the subject of an action selected from the group consisting of received, created, and last modified.

42. The method as recited in claim 1, wherein the group leader can control the aggregation step.

43. The method as recited in claim 1, wherein the aggregation step includes multiple operations, where each operation is executed based on an output of a previous operation.

44. The method as recited in claim 43, wherein the aggregation step produces multiple outputs each associated with one of the operations, where each operation does not affect a state of other operations.

45. The method as recited in claim 44, wherein the multiple outputs are filtered utilizing criteria associated with the feedback.

46. The method as recited in claim 44, wherein the multiple outputs are sorted utilizing criteria associated with the feedback.

47. The method as recited in claim 44, wherein a copy of the multiple outputs is stored before being used for other operations.

48. The method as recited in claim 43, wherein the operations are selected from the group consisting of changing feedback, adding feedback, removing feedback, and modifying attributes associated with the feedback.

49. The method as recited in claim 43, wherein the operations generate information relating to a correctness of the feedback.

50. The method as recited in claim 1, wherein the feedback is aggregated into a form similar to that associated with the image stimulus.

51. The method as recited in claim 50, wherein the aggregation indicates the variability in spatial reference present in the original feedback.

52. The method as recited in claim 50, wherein the aggregation reduces the variability in spatial reference present in the original feedback by treating the feedback which is spatially related as being the same.

53. The method as recited in claim 52, wherein the feedback which falls within predetermined regions are treated as being the same.

54. The method as recited in claim 52, wherein related feedback is displayed as an object a size of which is proportional to an amount of related feedback.

55. The method as recited in claim 54, wherein related feedback is displayed as a stacked series of the objects with each object representing the feedback of one of the group members.

56. The method as recited in claim 1, wherein the aggregated feedback is accompanied by the image stimulus.

57. The method as recited in claim 56, wherein the aggregated feedback is displayed in a foreground and the image stimulus is displaced in a background.

58. The method as recited in claim 57, wherein the aggregated feedback is displayed in a foreground and the image stimulus is displaced in a background utilizing effects selected from the group consisting of layering, adjusting transparency, and modifying color.

59. The method as recited in claim 1, wherein the networked devices are capable of changing a view of the aggregated feedback by performing a control operation selected from the group consisting of scrolling, zooming, rotating, filtering, and processing.

60. The method as recited in claim 1, wherein sounds are emitted upon receipt of the feedback.

61. The method as recited in claim 1, wherein textual information is displayed upon receipt of the feedback.

62. The method as recited in claim 1, wherein the aggregated feedback maintains the identity of the group members secret.

63. The method as recited in claim 1, wherein the aggregated feedback is transmitted to the networked devices operated by the group members.

64. The method as recited in claim 1, wherein the aggregated feedback is received by the group members only after the group leader gives authorization.

65. The method as recited in claim 1, wherein the aggregated feedback is received by the group members only after a predetermined criterion is met.

66. The method as recited in claim 65, wherein the criteria is selected from the group consisting of every group member having transmitted feedback, a duration of time having elapsed, and at least two group members have given correct feedback.

67. The method as recited in claim 1, wherein the aggregated feedback includes a plurality of sequentially displayed frames of images.

68. The method as recited in claim 1, and further comprising the step of storing the aggregated feedback for utilization with the Internet.

69. The method as recited in claim 1, and further comprising the step of allowing the group leader to select at least one of a plurality of output types, wherein the feedback is aggregated based on the selected output type.

70. The method as recited in claim 1, wherein the group leader is capable of selecting which of the group members to which to display the image stimulus.

71. A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps comprising of:

(a) displaying an image stimulus to a plurality of group members by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from at least two of the group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback from said at least two of the group members; and

(d) transmitting the aggregated feedback to the group leader, wherein the aggregated feedback reflects a composite of said spatial references to said image stimulus.

72. A system for giving feedback using networked devices, comprising:

(a) circuit logic for displaying an image stimulus to a plurality of group members by a group leader utilizing the plurality of networked devices operated by the group members;

(b) circuit logic for receiving feedback from at least two of the group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) circuit logic for aggregating the feedback from said at least two of the group members; and

(d) circuit logic for transmitting the aggregated feedback to the group leader, wherein the aggregated feedback reflects a composite of said spatial references to said image stimulus.

73. A method for soliciting, receiving, aggregating and viewing feedback using networked devices, comprising the steps of:

(a) enabling a group leader to select an image stimulus to be presented to a plurality of group members utilizing one of said networked devices operated by the group leader,

(b) communicating the image stimulus or a description thereof to a server computer, end thereafter to the plurality of networked devices operated by said group members such that the group members are capable of viewing the image stimulus on the networked devices;

(c) enabling at least two of the group members to create a response, where the response includes one or more spatial references that are placed on the image stimulus;

(d) communicating at least two of the responses from the networked devices to the server computer;

(e) aggregating the received responses on the server computer and composing the responses into one or more unified output objects; and

(f) making the one or more unified output objects available for transmission from the server computer to one or more of the networked devices in a form suitable for display on the networked devices, wherein the aggregated responses are viewable by the group leader and the group members.

74. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members, wherein the image stimulus is an image corresponding to a model of one or more spatial objects and interactions among the spatial objects and wherein the image stimulus changes over time according to at least one of rules and input;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

75. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein each individual group member is capable of contributing more than one instance of feedback, wherein each instance of feedback is assigned a unique identifier, and wherein the individual group members are capable of deleting or modifying a previous instance of feedback by communicating with a server computer by using the unique identifier;

(c) aggregating the feedback; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

76. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein each individual group member is capable of contributing more than one instance of feedback, wherein each instance of feedback is assigned a unique identifier, and wherein the individual group members are capable of deleting, modifying, or adding attributes from a previous instance of feedback by communicating with a server computer by using the unique identifier;

(c) aggregating the feedback; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

77. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback, wherein the feedback is aggregated, and wherein the aggregation indicates a variability in spatial reference present in the original feedback; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

78. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback, wherein the feedback is aggregated into a form similar to that associated with the image stimulus, and wherein the aggregation reduces a variability in spatial reference present in the original feedback by treating the feedback which is spatially related as being the same; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

79. The method as recited in claim 78, wherein the feedback which falls within a plurality of predetermined regions are treated as being the same.

80. The method as recited in claim 78, wherein related feedback is displayed as an object having a size of which is proportional to an amount of related feedback.

81. The method as recited in claim 80, wherein related feedback is displayed as a stacked series of the objects with each object representing the feedback of one of the group members.

82. A method for giving feedback in an educational environment using networked devices, comprising the steps of:

(a) displaying an image stimulus to a plurality of individual group members regarding material being presented by a group leader utilizing the plurality of networked devices operated by the group members;

(b) receiving feedback from the individual group members in response to the image stimulus utilizing the networked devices, wherein said feedback comprises a response that reflects a spatial reference that is placed on said image stimulus;

(c) aggregating the feedback, wherein the aggregated feedback is accompanied by the image stimulus, and wherein the aggregated feedback is displayed in a foreground and the image stimulus is displaced in a background; and

(d) transmitting the aggregated feedback to one of said networked devices operated by the group leader, wherein the aggregated feedback reflects the feedback received from each of the individual group members for allowing the group leader to view the aggregated feedback.

83. The method as recited in claim 82, wherein the aggregated feedback is displayed in said foreground and the image stimulus is displaced in said background utilizing effects selected from the group consisting of layering, adjusting transparency, and modifying color.