TELEPRESENCE APPARATUS AND METHOD ENABLING A CASE-STUDY APPROACH TO LECTURING AND TEACHING

• US 20150312520A1
• Filed: 04/22/2015
• Published: 10/29/2015
• Est. Priority Date: 04/23/2014
• Status: Abandoned Application

• Current Assignee: President and Fellows of Harvard College (Harvard Corporation)
• Original Assignee: President and Fellows of Harvard College (Harvard Corporation)
• Inventors: NOHRIA, Nitin, MOON, Youngme
• Application Number:
  US14/693,294
• Publication Number:
  US 20150312520A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A telepresence method and system for mimicking a physical amphitheater classroom for a case-study course with remote students comprising a student wall shaped and arranged to define an amphitheater in an arc, an interior of the arc defining a teaching pit, the student wall including: a video display apparatus to present an array of images arranged in groups, a plurality of student speakers, and a plurality of student perspective cameras, each of the plurality of student perspective cameras associated with and located near a corresponding student image for capturing a unique perspective view of the telepresence classroom, wherein the dimensions of the student wall and of the images in relation to the teaching pit have a geometric relationship such that from the instructor'"'"'s perspective the student images are approximately life-sized and the instructor can move anywhere within the pit and maintain a line of sight with the perspective student cameras.

Claims

1. A telepresence system for mimicking a physical amphitheater classroom for a case-study course with remote students, the system comprising:

a student wall approximately 9 to 15 feet in height shaped and arranged to define an amphitheater in an arc of about 90 to 210 degrees with a diameter generally between 27 to 32 feet in diameter, an interior of the arc defining a teaching pit where the instructor can move within, the student wall including;

a video display apparatus to present an array of images arranged in groups, mimicking seating assignments in an amphitheater, the images generally rectangular with one side approximately 2 feet long and another side approximately 2.5 feet long, wherein each image is associated to a corresponding student participating in the course and the images are generally in a fixed seating arrangement during the course;

a plurality of student speakers, each of the plurality of student speakers associated with and positioned near a corresponding student image, the plurality of student speakers outputting sound received from a corresponding live microphone such that any and all sound made by each student will be output as a point source of audio such that the instructor can associate and distinguish a sound with a student image from a position from which the sound originates; and

a plurality of student perspective cameras, each of the plurality of student perspective cameras associated with and located near a corresponding student image for capturing a unique perspective view of the telepresence classroom for each student based on the location of a student image on the student wall, a portion of the student perspective cameras oriented such that each camera'"'"'s field of view captures at least a portion of the student wall and the other student images,

wherein the dimensions of the student wall and of the images in relation to the teaching pit have a geometric relationship such that from the instructor'"'"'s perspective the student images are approximately life-sized and the instructor can move anywhere within the pit and maintain a line of sight with the perspective student cameras, mimicking a physical amphitheater classroom for a case-study course with remote students.

2. The telepresence system of claim 1, wherein the video display apparatus includes a computer controlled single screen, in which computer controls segment the screen into a plurality of student images.

3. The telepresence system of claim 1, wherein the video display apparatus further presents at least one multimedia display area for displaying at least one of annotations made by an instructor on an electronic blackboard during class, a presentation, poll results, and student chats.

4. The telepresence system of claim 3, wherein the multimedia display area comprises a ticker displaying student chats in real time.

5. The telepresence system of claim 3, wherein the multimedia display area comprises at least one divider positioned between the array of images such that the array of images are divided into smaller groups of images.

6. The telepresence system of claim 1, wherein a longer side of the image corresponds to a height of the image and a shorter side of the image corresponds to a width of the image.

7. A method for mimicking a physical amphitheater classroom for a case-study course with remote students, the method comprising:

displaying, on a video display apparatus positioned on a student wall, an array of images arranged in groups, mimicking seating assignments in an amphitheater, the images generally rectangular with one side approximately 2 feet long and another side approximately 2.5 feet long, wherein each image is associated to a corresponding student participating in the course and the images are generally in a fixed seating arrangement during the course, the student wall approximately 9 to 15 feet in height shaped and arranged to define an amphitheater in an arc of about 90 to 210 degrees with a diameter generally between 27 to 32 feet in diameter, an interior of the arc defining a teaching pit where the instructor can move within;

outputting, from a plurality of student speakers positioned on the student wall, each of the plurality of student speakers associated with and positioned near a corresponding student image, sound received from a corresponding live microphone such that any and all sound made by each student will be output as a point source of audio such that the instructor can associate and distinguish a sound with a student image from a position from which the sound originates; and

receiving, from a portion of a plurality of student perspective cameras positioned on the student wall, each of the plurality of student perspective cameras associated with and located near a corresponding student image for capturing a unique perspective view of the telepresence classroom for each student based on the location of a student image on the student wall, a video signal corresponding to an orientation of the plurality of student perspective cameras such that each camera'"'"'s field of view captures at least a portion of the student wall and the other student images,

wherein the dimensions of the student wall and of the images in relation to the teaching pit have a geometric relationship such that from the instructor'"'"'s perspective the student images are approximately life-sized and the instructor can move anywhere within the pit and maintain a line of sight with the perspective student cameras, mimicking a physical amphitheater classroom for a case-study course with remote students.

8. The method of claim 7, wherein the video display apparatus includes a computer controlled single screen, in which computer controls segment the screen into a plurality of student images.

9. The method of claim 7, wherein the video display apparatus further presents at least one multimedia display area for displaying at least one of annotations made by an instructor on an electronic blackboard during class, a presentation, poll results, and student chats.

10. The method of claim 9, wherein the multimedia display area comprises a ticker displaying student chats in real time.

11. The method of claim 9, wherein the multimedia display area comprises at least one divider positioned between the array of images such that the array of images are divided into smaller groups of images.

12. The method of claim 7, wherein a longer side of the image corresponds to a height of the image and a shorter side of the image corresponds to a width of the image.

13. A telepresence system for mimicking a student experience in a physical amphitheater classroom for a case-study course with remote students, the system comprising:

a student wall shaped and arranged to define an amphitheater in an arc, an interior of the arc defining a teaching pit where the instructor can move within, the student wall including;

a video display apparatus to present an array of images arranged in groups, mimicking seating assignments in an amphitheater, wherein each image is associated to a corresponding student participating in the course and the images are generally in a fixed seating arrangement during the course; and

a plurality of student perspective cameras, each of the plurality of student perspective cameras associated with and located near a corresponding student image for capturing a unique studio signal perspective view of the telepresence classroom for each student based on the location of the student image on the student wall, a portion of the student perspective cameras oriented such that its field of view captures at least a portion of the student wall and the other student images, the dimensions of the wall and of the images in relation to the teaching pit have a geometric relationship such that the instructor can move anywhere within the pit and maintain a line of sight with the perspective student cameras;

at least one drama camera, the at least one drama camera configured to have a field of view of the teaching pit separate from the perspective views;

a receiver configured to receive a plurality of course-related multimedia including;

a plurality of unique studio signal perspective views, each of the plurality of unique studio signal perspective views corresponding to a field of view captured by a student perspective camera associated with and located near a corresponding student image,

a plurality of remote location student video signals, each of the remote location student video signals corresponding to a video signal received from a live camera associated with and located near a remote student location,

a plurality of remote location student audio signals, each of the remote location student audio signals corresponding to an audio signal received from a live microphone associated with and located near a remote student location,

an instructor audio signal, the instructor audio signal received from an instructor microphone, and

at least one drama camera video signal, the at least one drama camera video signal corresponding to the field of view captured by the at least one drama camera; and

a dynamically controlled router for forming and transmitting a plurality of audio and video signals to the plurality of remote student locations,

wherein each audio signal transmitted to each remote student location includes a unique student aggregate audio signal formed by aggregating an instructor audio signal and all remote location student audio signals minus the remote location student audio signal corresponding to the student where the unique student aggregate audio signal is transmitted to reflect the sounds of the classroom, and

wherein the plurality of video signals are dynamically selected point-to-point video signals such that each student may have a unique video presentation including a unique studio signal perspective view, the unique studio signal perspective view corresponding to a field of view captured by a student perspective camera associated with and located near a corresponding student image, mimicking a student experience in a physical amphitheater classroom for a case-study course with remote students.

14. The telepresence system of claim 13, wherein the dynamically controlled router responds to operator control commands by a control room operator who monitors events in the course and selects a subset of video feeds to form the point-to-point video presentation to send to each student.

15. The telepresence system of claim 13, wherein the course-related multimedia further includes multimedia answers responsive to an instructor query or question received from one or more students.

16. The telepresence system of claim 13, wherein the course-related multimedia further include annotations made during the course by the instructor on an electronic blackboard.

17. The telepresence system of claim 13, wherein the dynamically selected point-to-point video signals include a plurality of remote location student video signals enabling a debate mode such that students can focus on a discussion between a small group of students and the instructor.

18. The telepresence system of claim 13, wherein the dynamically selected point-to-point video signals include at least one drama camera signal, the drama camera signal including at least one of a close up view of the teacher, a view of the entire teaching wall, and an overhead view of the classroom.

19. The telepresence system of claim 13, wherein the video display apparatus includes a computer controlled single screen, in which computer controls segment the screen into a plurality of student images.

20. The telepresence system of claim 13, wherein the video display apparatus further presents at least one multimedia display area for displaying at least one of annotations made by an instructor on an electronic blackboard during class, a presentation, poll results, and student chats.

21. The telepresence system of claim 20, wherein the multimedia display area comprises a ticker displaying student chats in real time.

22. The telepresence system of claim 20, wherein the multimedia display area comprises at least one divider positioned between the array of images such that the array of images are divided into smaller groups of images.

23. The telepresence system of claim 13, wherein each unique studio signal perspective view is adjustable and the receiver is further configured to receive student perspective view controls from each student corresponding to a pan and tilt of each student perspective camera with respect to a starting position.

24. A method for mimicking a student experience in a physical amphitheater classroom for a case-study course with remote students, the method comprising:

displaying, on a video display apparatus positioned on a student wall, an array of images arranged in groups, mimicking seating assignments in an amphitheater, the images generally in a fixed seating arrangement during the course, the student wall approximately 9 to 15 feet in height shaped and arranged to define an amphitheater in an arc of about 90 to 210 degrees with a diameter generally between 27 to 32 feet in diameter, an interior of the arc defining a teaching pit where the instructor can move within;

receiving, from a portion of a plurality of student perspective cameras positioned on the student wall, a plurality of unique studio signal perspective views corresponding to an orientation of the plurality of student perspective cameras such that each camera'"'"'s field of view captures at least a portion of the student wall and the other student images, each of the plurality of student perspective cameras associated with and located near a corresponding student image for capturing a unique perspective view of the telepresence classroom for each student based on the location of a student image on the student wall, wherein the dimensions of the student wall and of the images in relation to the teaching pit have a geometric relationship such that the instructor can move anywhere within the pit and maintain a line of sight with the perspective student cameras;

receiving, from a receiver, a plurality of course-related multimedia including;

a plurality of unique studio signal perspective views, each of the plurality of unique studio signal perspective views corresponding to a field of view captured by a student perspective camera associated with and located near a corresponding student image,

a plurality of remote location student video signals, each of the remote location student video signals corresponding to a video signal received from a live camera associated with and located near a remote student location,

a plurality of remote location student audio signals, each of the remote location student audio signals corresponding to an audio signal received from a live microphone associated with and located near a remote student location,

an instructor audio signal, the instructor audio signal received from an instructor microphone, and

at least one drama camera video signal, the at least one drama camera video signal corresponding to the field of view captured by the at least one drama camera; and

forming and transmitting, from a dynamically controlled router, a plurality of audio and video output signals to the plurality of remote student locations,

wherein each audio signal transmitted to each remote student location includes a unique student aggregate audio signal formed by aggregating an instructor audio signal and all remote location student audio signals minus the remote location student audio signal corresponding to the student where the unique student aggregate audio signal is transmitted to reflect the sounds of the classroom, and

wherein the plurality of video signals are dynamically selected point-to-point video signals such that each student may have a unique video presentation including a unique studio signal perspective view, the unique studio signal perspective view corresponding to a field of view captured by a student perspective camera associated with and located near a corresponding student image, mimicking a student experience in a physical amphitheater classroom for a case-study course with remote students.

25. The method of claim 24, wherein the dynamically controlled router responds to operator control commands by a control room operator who monitors events in the course and selects a subset of video feeds to form the point-to-point video presentation to send to each student.

26. The method of claim 24, wherein the course-related multimedia further includes multimedia answers responsive to an instructor query or question received from one or more students.

27. The method of claim 24, wherein the course-related multimedia further includes annotations made during the course by the instructor on an electronic blackboard.

28. The method of claim 24, wherein the dynamically selected point-to-point video signals include a plurality of remote location student video signals enabling a debate mode such that students can focus on a discussion between a small group of students and the instructor.

29. The method of claim 24, wherein the dynamically selected point-to-point video signals include at least one drama camera signal, the drama camera signal including at least one of a close up view of the teacher, a view of the entire teaching wall, and an overhead view of the classroom.

30. The method of claim 24, wherein the video display apparatus includes a computer controlled single screen, in which computer controls segment the screen into a plurality of student images.

31. The method of claim 24, wherein the video display apparatus further presents at least one multimedia display area for displaying at least one of annotations made by an instructor on an electronic blackboard during class, a presentation, poll results, and student chats.

32. The method of claim 31, wherein the multimedia display area comprises a ticker displaying student chats in real time.

33. The method of claim 31, wherein the multimedia display area comprises at least one divider positioned between the array of images such that the array of images are divided into smaller groups of images.

34. The method of claim 33, wherein each unique studio signal perspective view is adjustable and the receiver is further configured to receive student perspective view controls from each student corresponding to a pan and tilt of each student perspective camera with respect to a starting position.