Interactive presentation system

• US 7,468,742 B2
• Filed: 12/02/2004
• Issued: 12/23/2008
• Est. Priority Date: 01/14/2004
• Status: Expired due to Fees

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: Ahn, Sang-Chul, Kim, Ig-Jae, Kim, Hyoung-Gon, Hwang, Chang-Sik
• Primary Examiner(s): Ometz; David L
• Assistant Examiner(s): Le; Quang V
• Application Number:
  US11/001,079
• Publication Number:
  US 20050151850A1
• Time in Patent Office: 1,482 Days
• Field of Search: 348/207.99, 348/207.1, 348/207.11, 348/211.11, 348/211.14, 345/156, 345/157, 345/158, 345/159
• US Class Current: 348/207.99
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

The present invention discloses an interactive presentation system which allows a presenter to perform a presentation while having various interactions directly with presentation material images in real time through a gesture or/and voice. The interactive presentation system comprises: an active infrared camera; a command recognition system connected to the active infrared camera; and an image synthesis system connected to the active infrared camera and the command recognition system. The presentation system may further comprises a stereo camera set for properly synthesizing a presenter in a 3D image and a 3D motion system. By this configuration, it is possible to embody an interactive presentation system in which a command through a presenter'"'"'s gesture or voice is processed in real time and the image of the presenter is synthesized in a presentation material screen in real time, and accordingly the audiovisual effect is maximized.

Claims

1. An interactive presentation system, comprising:

an active infrared camera, arranged in front of a presenter, for taking a visible image and an infrared image of the presenter;

a command recognition system connected to the active infrared camera to perform a gesture recognition algorithm upon receipt of the infrared image of the presenter from the active infrared camera and outputting a corresponding command;

an image synthesis system connected to the active infrared camera to synthesize the visible image of the presenter received from the active infrared camera and a presentation material, and connected to the command recognition system to control the presentation material upon receipt of a command signal outputted from the command recognition system; and

a screen arranged in front of the presenter to display the synthesized visible image and the presentation material received from the image synthesis system, so that the presenter can perform a presentation while viewing the visible image of the presenter synthesized with the presentation material in real time.

2. The system of claim 1, wherein the active infrared camera comprises:

an infrared irradiation device mounted so that an infrared irradiation region can be coincident with the visual field range of the active infrared camera and for irradiating infrared rays to the presenter;

a cold mirror for transmitting the infrared rays reflected by the presenter and reflecting visible rays;

an infrared camera for acquiring the infrared image of the presenter upon receipt of the infrared rays transmitted by the cold mirror; and

a moving image camera for acquiring the image of the presenter upon receipt of the visible rays reflected by the cold mirror.

3. The system of claim 2, wherein the active infrared camera further comprises a reflecting mirror for making the visible rays incident on the moving image camera by receiving and reflecting the visible rays reflected by the cold mirror.

4. The system of claim 1, wherein the interactive presentation system further comprises infrared reflecting markers being wearable by the presenter and for retroreflecting infrared rays radiated by the infrared irradiation device of the active infrared camera onto the active infrared camera.

5. The system of claim 4, wherein the gesture recognition algorithm executed by the command recognition system comprises:

a thresholding step of extracting image blobs of the infrared reflecting markers worn by the presenter inputted from the active infrared camera;

a blob labeling step of performing image labeling of the blobs extracted by the thresholding step;

a blob recognition step of extracting one or two large labeling blobs by the blob labeling step;

an angle and position computation step of computing the angle, central position, height and width of the infrared reflecting markers using the extracted blobs by the blob recognition step; and

a gesture recognition step of recognizing a gesture by determining a gesture mode of the infrared reflecting markers based on the results computed in the angle and position computation step.

6. The system of claim 5, wherein, in the blob labeling step, a predetermined boundary blob is set around the infrared reflecting marker blobs acquired from the previous frame so that labeling is performed only within the boundary blob in the next frame.

7. The system of claim 1, wherein the interactive presentation system receives a voice command of the presenter and outputs a command signal to the image synthesis system.

8. The system of claim 1, wherein the interactive presentation system further comprises:

a stereo camera set consisting of a plurality of cameras for three-dimensionally detecting the motion of the presenter; and

a 3D motion tracking system connected to the stereo camera set and for computing the position of the presenter on a 3D image coordinate by receiving the image of the presenter from the stereo camera set, wherein the 3D motion tracking system is connected to the image synthesis system via a network and sends the position information of the presenter to the image synthesis system so that the image of the presenter can be synthesized in a proper position of a 3D presentation material image if the presentation material image is 3D.

9. The system of claim 1, wherein the interactive presentation system further comprises a projector connected to the image synthesis system and for projecting the presentation material synthesized in the image synthesis system.

10. The system of claim 1, wherein the image synthesis system sends the presentation materials synthesized in the image synthesis system to a remote place via a network.