System and method for automated capture and compaction of instructional performances
First Claim
1. A method of capturing and rendering educational information, comprising:
- using at least one processor associated with a recording computer;
(a) capturing gesture information from a surface digitizing apparatus coupled to the recording computer, and storing in a recording computer memory gestural data that associates the gesture information to a reference frame associated with the surface digitizing apparatus(b) extracting image information from a camera coupled to the recording computer and storing in a recording computer memory image data that associates the image information to a reference frame associated with the camera'"'"'s field of view,(c) generating recording space calibration data that associates spatial coordinates within the field of view of the camera with spatial coordinates of the surface digitizing apparatus;
(d) sending the gestural data, image data and calibration data to a rendering computer;
using at least one processor associated with a rendering computer coupled to a display device;
(e) receiving the gestural data, image data and calibration data sent by the recording computer;
(f) generating a calibration transform based on the calibration data that converts the gestural data and image data into a form usable by the display device to generate calibrated gestural data and calibrated image data;
(g) using the calibrated gestural data to render a first visual image corresponding to the gestural information captured by the surface digitizing apparatus;
(h) using the calibrated image data to generate a second visual image corresponding to the image information extracted from the camera;
(i) blending the first and second visual images to define a recomposed image made up of combined gesture information and image information that is then displayed on the display device.
1 Assignment
0 Petitions
Accused Products
Abstract
The system comprises functionality for instructors to record their lessons in an easy method while allowing them to capture their teaching techniques with a tool which improves the effectiveness of the playback, by reverse scripting of the teachers motions and use of educational tools including blackboards, whiteboards, and tablet computers among others and automating highlight of the relevant multiple media channels for best emphasis during presentation. Access to the centralized lesson database will permit students to learn from the best teachers and instructors and can execute the system right on their desktops or portable computers or access it through a dedicated website. Playback may be personalized to the needs and preferences of each student and the conceptual content is essentially highlighted in video and audio to maximize didactic effectiveness of presentation.
15 Citations
13 Claims
-
1. A method of capturing and rendering educational information, comprising:
using at least one processor associated with a recording computer; (a) capturing gesture information from a surface digitizing apparatus coupled to the recording computer, and storing in a recording computer memory gestural data that associates the gesture information to a reference frame associated with the surface digitizing apparatus (b) extracting image information from a camera coupled to the recording computer and storing in a recording computer memory image data that associates the image information to a reference frame associated with the camera'"'"'s field of view, (c) generating recording space calibration data that associates spatial coordinates within the field of view of the camera with spatial coordinates of the surface digitizing apparatus; (d) sending the gestural data, image data and calibration data to a rendering computer; using at least one processor associated with a rendering computer coupled to a display device; (e) receiving the gestural data, image data and calibration data sent by the recording computer; (f) generating a calibration transform based on the calibration data that converts the gestural data and image data into a form usable by the display device to generate calibrated gestural data and calibrated image data; (g) using the calibrated gestural data to render a first visual image corresponding to the gestural information captured by the surface digitizing apparatus; (h) using the calibrated image data to generate a second visual image corresponding to the image information extracted from the camera; (i) blending the first and second visual images to define a recomposed image made up of combined gesture information and image information that is then displayed on the display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
Specification