Teleconferencing method and system for providing face-to-face, non-animated teleconference environment

• US 5,572,248 A
• Filed: 09/19/1994
• Issued: 11/05/1996
• Est. Priority Date: 09/19/1994
• Status: Expired due to Term

• Current Assignee: Polycom Incorporated (Plantronics, Inc.)
• Original Assignee: Teleport Corporation
• Inventors: Allen, David L., Williams, Herold
• Primary Examiner(s): Chan, Wing F.
• Application Number:
  US08/308,603
• Time in Patent Office: 778 Days
• Field of Search: 348/14-20, 348/122, 348/211, 348/401, 348/439, 348/448, 348/451, 348/452, 348/458, 348/459, 348/552, 348/581, 348/584, 348/588, 348/591, 348/592, 348/598, 348/606 , 348/632, 348/911, 379/93, 379/96-99, 379/201, 379/202
• US Class Current: 348/14.1
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A method and system provides a face-to-face video conference utilizing a video mirror. The method and apparatus comprise a first station having a first predetermined sensory setting; a second station having a second predetermined sensory setting; and an imaging system for capturing an image or sub-image at the first station, displaying at least a portion of the image or sub-image at the second station such that it becomes generally visually integrated with the second predetermined sensory setting. Also, disclosed is apparatus and method for effecting a face-to-face presence environment regardless of whether the first and second predetermined sensory settings are the same or different. The stations may be portable and/or modular such that they can be easily constructed or assembled. The stations may also be architectured and/or decorated to further enhance the face-to-face environment created by the video conferencing system and method.

Claims

1. An image generator for use in a teleconferencing system comprising:

a differentiator for comparing a differential reference image to an input video image from a first station and for generating a differential image in response thereto; and

a compositor associated with a remote station for receiving said differential image and for combining that differential image with a predetermined composite image to provide a composite image which may be displayed at the remote station to provide a single, complementary, integrated, non-cartoon-animated and face-to-face environment.

2. The image generator as recited in claim 1 wherein said differentiator comprises a differential key generator.

3. The image generator as recited in claim 1 wherein said differential image generally corresponds to an image of subjects situated at said first station.

4. The image generator as recited in claim 1 wherein said differential reference image generally corresponds to at least a portion of said first station.

5. The image generator as recited in claim 1 wherein said predetermined composite image generally corresponds to at least a portion of said remote station in the teleconferencing system.

6. The image generator as recited in claim 1 wherein the image generator further comprises:

at least one CODEC coupled to said differentiator and said compositor for facilitating exchanging signals therebetween.

7. The image generator as recited in claim 1 wherein said image generator further comprises an image enhancer coupled to said compositor for enhancing the resolution of said composite image by a predetermined amount.

8. The image generator as recited in claim 7 wherein said image enhancer is a line doubler.

9. The image generator as recited in claim 7 wherein said predetermined amount is on the order of about 50-150%.

10. The image generator as recited in claim 1 wherein said compositor comprises a scaler for scaling the composite image.

11. The image generator as recited in claim 3 wherein said subjects comprises at least one participant and at least one predetermined subject.

12. The image generator as recited in claim 5 wherein said portion comprises a background image.

13. A conferencing system comprising:

a first station comprising a first sensory area defining a first aura;

a second station comprising a second sensory area defining a second aura; and

an image system for generating a first station image of at least a portion of said first sensory area and also for displaying said first station image at said second station such that said first and second auras become visually combined to provide a single, complementary, integrated, non-cartoon-animated and face-to-face presence environment at said second station.

14. The conferencing system as recited in claim 13 wherein said first station image comprises at least one sub-image of predetermined subjects situated in said first sensory area.

15. The conferencing system as recited in claim 13 wherein said image system comprises:

a compositor for compositing said first station image with a predetermined composite image to generate a composite image.

16. The conferencing system as recited in claim 15 wherein said compositor comprises a scaler for scaling the first station image.

17. The conferencing system as recited in claim 15 wherein said first image station comprises an image of at least a portion of said second sensory area of said second station.

18. The conferencing system as recited in claim 13 wherein said imaging system further comprises a differentiator for comparing said first station image with a differentiator reference image and generating said first station image in response thereto.

19. The conferencing system as recited in claim 18 wherein said differentiator comprises a differential key generator.

20. The conferencing system as recited in claim 13 wherein said conferencing system further comprises:

an audio transceiver device associated with said first and second stations for exchanging and broadcasting audio signals between said first and second sensory areas.

21. The conferencing system as recited in claim 13 wherein said first and second sensory areas are complementary.

22. The conferencing system as recited in claim 14 wherein said predetermined subjects are at least one participant and a plurality of predetermined decorations.

23. The conferencing system as recited in claim 13 wherein said image system further comprises:

a differentiator for generating a differential signal by comparing a first station image signal generally corresponding to said image to a differential reference image signal;

compositing means for combining said differential signal with at least one other signal to provide a display image for displaying at said second station.

24. The system as recited in claim 13 wherein said first and second auras are substantially identical.

25. The conferencing system as recited in claim 23 wherein said compositing means comprises:

a compositor associated with said differentiator for compositing said image signal with a predetermined reference image to provide a composite image for displaying at either said first or second station.

26. An image system for use in a conference environment comprising a station having a first conference area and a remote station having a remote video area, said image system comprising:

a compositor for compositing a first signal which generally corresponds to a video image of a portion of said first conference area with a composite reference signal to provide a composite image signal; and

a display for displaying said composited image signal at said remote video area such that said first and second stations appear complementarily integrated to provide a single and non-cartoon-animated teleconference environment.

27. The image system as recited in claim 26 wherein said image system comprises:

a differentiator for generating the first signal in response to a comparison of a differential reference signal to an input signal corresponding to an image of said first conference area.

28. The image system as recited in claim 27 wherein said differential reference signal generally corresponds to an image of any desired subjects situated at said first conference area.

29. The image system as recited in claim 27 wherein said differentiator is a differential key generator.

30. The image system as recited in claim 26 wherein said image system further comprises:

an audio transceiver device for exchanging and broadcasting audio signals between said station and said remote station.

31. The image system as recited in claim 26 wherein said compositor comprises a scaler for scaling the composite image signal.

32. The image system as recited in claim 26 wherein said composite image signal corresponds to a composite image comprising a first image having a first resolution and a second image having a second resolution wherein said first and second resolutions are different.

33. The image system as recited in claim 32 wherein said first image corresponds to a background and said first resolution is higher than the second resolution.

34. The image system as recited in claim 26 wherein at least one of said station or said remote station is a modular construction.

35. A method for providing a virtual presence conference in a teleconferencing system having a first station and a second station comprising the step of:

capturing an image at said first station;

situating a background behind said image, said background defining a first aura;

displaying said image at a predetermined location in the second station comprising a second aura such that said image becomes visually integrated with said, thereby causing said first image to become complementarily integrated to provide a single, non-cartoon-animated and face-to-face teleconference environment at said second station.

36. The method as recited in claim 35 wherein said displaying step further comprises the steps of:

differentiating between an actual image of said first station and a reference image to generate said image.

37. The method as recited in claim 36 wherein said differentiating step further comprises the step of:

storing an image of at least a portion of said first station as said reference image.

38. The method as recited in claim 36 wherein said method further comprises the step of:

using a differential key generator.

39. The method as recited in claim 35 wherein said displaying step further comprising the steps of:

compositing said image with a predetermined image; and

displaying said composite image.

40. The method as recited in claim 39 wherein said compositing step further comprises the step of:

scaling the image.

41. The method as recited in claim 35 wherein said method further comprises the step of:

enhancing the resolution of said image.

42. The method as recited in claim 39 wherein said enhancing step comprises the step of:

using a line doubler to enhance the resolution of said image.

43. The method as recited in claim 35 wherein said method further comprises the step of:

displaying said image on a rear projection screen integrally associated with said second station.

44. The method as recited in claim 35 wherein said method further comprises the step of:

using a CODEC to facilitate exchanging images between said first and second stations.

45. The method as recited in claim 35 wherein said method further comprises the steps of:

generating an audio signal associated with the image;

broadcasting said audio signal at said second station in general synchronization with said image.

46. The method as recited in claim 35 wherein said method further comprises the steps of:

generating an image having a first image having at least a first resolution and a second image having at least a second resolution, said first and second resolutions being different.

47. The method as recited in claim 46 wherein said first resolution is higher than said second resolution, said first resolution corresponding to a background of said second station.

72. The method as recited in claim 35 further comprising the step of:

generating said background using at least a portion of said first station.

73. The method as recited in claim 35 further comprising the step of generating said background using at least a portion of said second station.

48. A method for teleconferencing comprising the steps of:

teleconnecting a first station having a first setting to a second station having a second setting; and

displaying an image of at least a portion of said first setting, at said second station such that, when said composite image is displayed at said second station, said first and second settings to facilitate providing a single, complementary, integrated, non-cartoon-animated and face-to-face presence environment at said second station.

49. The method as recited in claim 48 wherein said method further comprises the step of:

comparing an actual image of said first station to a differential reference image and generating said image in response thereto.

50. The method as recited in claim 49 wherein said method comprises the step of:

using a differential key generator to generate said image.

51. The method as recited in claim 50 wherein said differential reference image comprises at least a portion of said first setting.

52. The method as recited in claim 48 herein said method further comprises the step of:

compositing said image with a predetermined composite image to provide a seamless composite image.

53. The method as recited in claim 52 wherein said predetermined composite image comprises composite sub-images comprising a plurality of predetermined subjects.

54. The method as recited in claim 52 wherein said compositing step further comprises the step of:

scaling said seamless composite image to a predetermined scale.

55. The method as recited in claim 49 wherein said method further comprises the step of:

compositing said image with a second reference image to provide a seamless composite image.

56. The method as recited in claim 53 wherein said plurality of predetermined subjects comprise a background of said second setting.

57. The method as recited in claim 48 wherein said method comprises the step of:

providing a first setting which generally complements said second setting such that when said image is displayed at said second station, said first and second settings become visually integrated to a participant situated at said second station.

58. The method as recited in claim 48 wherein said method further comprises the step of:

using a CODEC to effect facilitate transmitting images between said first and second stations.

59. The method as recited in claim 48 wherein said displaying step further comprises the step of:

compositing said image to have an aspect ratio of at least 4;

3;

projecting said image in substantially full scale on a rear projection screen at said second station.

60. The method as recited in claim 48 wherein said displaying step further comprises the step of:

enhancing the resolution of said image.

61. The method as recited in claim 60 wherein said enhancing step further comprises the step of using a line doubler.

62. A method for generating a single, complementary, visually integrated and seamless image at a station using at least one remote image received from a remote station comprising the steps of:

(a) capturing said remote image at said remote station;

(b) generating a predetermined composite image;

(c) combining said remote image with said predetermined composite image to provide said seamless image, said seamless image not including any cartoon animation; and

(d) displaying said seamless image at said station to provide a single, complementary and visually integrated teleconference environment.

63. The method as recited in claim 62 wherein said step (a) comprises the step of:

capturing said remote image using a plurality of image sensors.

64. The method as recited in claim 62 wherein said step (b) comprises the step of:

generating a predetermined composite image using at least a portion of the background of said station.

65. The method as recited in claim 62 wherein said step (a) further comprises the step of:

differentiating between an actual image and a differential reference image in order to generate said remote image.

66. The method as recited in claim 65 wherein said method further comprises the step of:

using a differential key generator to effect said differentiating step.

67. A method of generating an image for a video conference comprising the steps of:

capturing a non-cartoon-animated image of a person at one station,

filtering said captured image to provide a non-cartoon-animated filtered image;

compositing the non-cartoon-animated filtered image with a predetermined composite image to provide a composite image;

displaying the composite image at a remote station, such that a single, integrated, complementary and non-cartoon-animated teleconferencing environment is created in said at least one of said stations or said remote station.

68. The method of claim 67 wherein said captured image comprises a participant image of at least one participant and a background image, said filtering step comprising the step of:

differentiating said captured image to separate the background image from the participant image to provide said filtered image.

69. A method for generating a video scene at a station comprising the steps of:

capturing a first image;

combining at least one remote image with the first image to provide a non-cartoon-animated combined image; and

displaying the non-cartoon-animated combined image at the station to facilitate providing a predetermined aura at the station where said non-cartoon-animated combined image facilitates providing a single, integrated, complementary, non-cartoon-animated environment at said station.

70. The method as recited in claim 69 wherein said first image comprises a portion of the background of the station;

said combining step comprising the step of;

differentiating an image captured at a remote station to provide said remote image.

71. The method as recited in claim 70 wherein said combining step of using a compositor to combine said at least one remote image with the first image.