System and method for teleinteraction

• US 5,444,476 A
• Filed: 12/11/1992
• Issued: 08/22/1995
• Est. Priority Date: 12/11/1992
• Status: Expired due to Term

• Current Assignee: Board of Regents of the University of Michigan (University of Michigan)
• Original Assignee: Board of Regents of the University of Michigan (University of Michigan)
• Inventors: Conway, Lynn
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): GRANT, CHRISTOPHER C
• Application Number:
  US07/989,126
• Time in Patent Office: 984 Days
• Field of Search: 379/53, 379/54, 379/202, 379/96, 379/97, 379/98, 358/85, 358/86
• US Class Current: 348/14.1
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems and methods for performing teleinteractive video teleconferencing between two or more teleconference sites, and for enabling any number of teleconference sites to overlay a pointer to point within the video image originating from any teleconference site. The systems and methods employ at least one video imaging device to capture images at a local teleconference site and N display devices to display images captured at the local and the remote teleconference sites, where N is the total number of teleconference sites comprising the system. The teleinteractive capability is accomplished when a local teleconference site selectively inputs the video imaging signal from a remote teleconference site into a pointer overlay device rather than the local video image. The pointer overlay device then overlays the pointer and the overlaid video signal is then transmitted to the remote teleconference sites. Finally, by providing remote control means to actively position the video imaging device at a remote site, the position of the overlaid pointer within a displayed image can be used to reposition a video imaging device at a remote teleconference site.

Claims

1. In a teleconference system in which images originating at a first teleconference site are displayed at a second teleconference site and images originating at a second teleconference site are displayed at said first teleconference site, a system for teleinteractively pointing within an image displayed at a site local to a conferee that originated at a site remote to said conferee, comprising:

at least one local imaging means to capture images within a target space at said local site;

at least one remote imaging means to capture images within a target space at said remote site;

at least one local display means to display images captured by said local imaging means and images captured by said remote imaging means;

at least one remote display means to display images captured by said remote imaging means and images captured by said local imaging means;

switching means at said local site for selectively designating for output from said local site one of a plurality of video images input to said switching means, said plurality of video images including said images captured at said local site and said images captured at said remote site;

switching means at said remote site for selectively designating for output from said remote site one of a plurality of video images input to said switching means, said plurality of video images including said images captured at said remote site and said images captured at said local site;

selectively activated pointer means at said local site where said pointer is directed by a local conferee to point within the selected output image designated by said local switching means to define a local pointer-overlaid image;

selectively activated pointer means within said remote site where said pointer is directed by a remote conferee to point at the selected output image designated by said remote switching means to define a remote pointer-overlaid image;

signal splitting means at said local site to enable display of said local pointer-overlaid image on said local display means and on said remote display means; and

signal splitting means at said remote site to enable display of said remote pointer-overlaid image on said remote display means and on said local display means.

2. The apparatus defined by claim 1, further comprising:

a selectively activated local marker means associated with said local pointer means where a local mark is overlaid upon said local pointer-overlaid image in accordance with movement of said local pointer means, said local mark being erasable; and

a selectively activated remote marker means associated with said remote pointer means where a remote mark is overlaid upon said remote pointer means where a remote mark is overlaid upon said remote pointer-overlaid image in accordance with movement of said remote pointer means, said remote mark being erasable.

3. The apparatus defined by claim 1, wherein each of said local and remote imaging means may include at least one of a video camera, video-cassette recorder, laser disk player, photo compact disk player, or document visualizer.

4. The apparatus defined by claim 1, wherein each of said local and remote display means includes video monitors.

5. The apparatus defined by claim 1, wherein each of said local and remote display means includes a monitor with picture-in-picture capability and said monitor displays both said local and remote images.

6. The apparatus defined by claim 1, wherein the target space at said local site comprises a field of view of one of a video camera, a document visualizer, a video-cassette recorder, laser disk player, or a photo compact disk player output signal.

7. The apparatus defined by claim 1, wherein the target space at said remote site comprises a field of view of one of a video camera, a document visualizer, or a video-cassette recorder, laser disk player, or a photo compact disk player output signal.

8. The apparatus defined by claim 1, further comprising:

local directional control means for positioning said local imaging means, where said local directional control means is responsive to local directional control signals generated by one of said local conferee or said remote conferee; and

remote directional control means for positioning said remote imaging means, where said remote directional control means is responsive to remote directional control signals generated by one of said remote conferee or said local conferee.

9. The apparatus defined by claim 8, further comprising:

arbitration means to distribute control of said local directional control means between said local and said remote conferees; and

arbitration means to distribute control of said remote directional control means between said local and said remote conferees.

10. The apparatus defined by claim 8, wherein said local directional control signal is responsive to one of said local pointer means or said remote pointer means to define a designated local control pointer wherein said local directional control means positions said local imaging means in the direction of said designated local control pointer when said designated local control pointer substantially approaches a target space boundary of said local image, and said remote directional control signal is responsive to one of said remote pointer means or said local pointer means to define a designated remote control pointer wherein said remote directional control means positions said remote imaging means in the direction of said designated remote control pointer means when said designated remote control pointer substantially approaches a target space boundary of said remote target image.

11. The apparatus defined by claim 10, further comprising:

arbitration means to distribute control of said local directional control means between said local and said remote conferees; and

arbitration means to distribute control of said remote directional control means between said local and said remote conferees.

12. In a teleconference system in which images originating at a first teleconference site are displayed at a second teleconference site and images originating at a second teleconference site are displayed at said first teleconference site, a system for teleinteractively pointing within an image displayed at a site local to conferee that originated at a site remote to said conferee, comprising:

at least one local imaging means to capture images within a target space at said local site;

at least one remote imaging means to capture images within a target space at said remote site;

at least one local display means to display images captured by said local imaging means and images captured by said remote imaging means;

at least one remote display means to display images captured by said remote imaging means and images captured by said local imaging means;

selectively activated pointer means at said local site where said pointer means is directed by a local conferee to point within a selected one of said local image and said remote image to define a local pointer-overlaid image, and said local pointer-overlaid image is displayable by said local and remote display means; and

selectively activated pointer means at said remote site where said pointer means is directed by a remote conferee to point within a selected one of said remote image and said local image to define a remote pointer-overlaid image, and said remote pointer-overlaid image is displayable on said local and remote display means.

13. The apparatus defined by claim 12, further comprising:

a selectively activated local marker means associated with said local pointer means where a local mark is overlaid upon said local pointer-overlaid image in accordance with movement of said local pointer means, said local mark being erasable; and

a selectively activated remote marker means associated with said remote pointer means where a remote mark is overlaid upon said remote pointer-overlaid image in accordance with movement of said remote pointer means, said remote mark being erasable.

14. The apparatus defined by claim 12, wherein each of said local and remote imaging means may include at least one of video camera, video-cassette recorder, laser disk player, photo compact disk player, or document visualizer.

15. The apparatus defined by claim 12, wherein each of said local and remote display means includes video monitors.

16. The apparatus defined by claim 12, wherein each of said local and remote display means includes a single monitor with picture-in-picture capability and said monitor displays both said local and remote images.

17. The apparatus defined by claim 12, wherein the target space at said local site comprises a field of view of one of a video camera, a document visualizer, a video-cassette recorder, laser disk player, or a photo compact disk player.

18. The apparatus defined by claim 12, wherein the target space at said remote site comprises a field of view of one of a video camera, a document visualizer, or a video-cassette recorder, laser disk player, or a photo compact disk player.

19. The apparatus defined by claim 12, further comprising:

local directional control means for positioning said local imaging means, where said local directional control means is responsive to local directional control signals generated by one of said local conferee or said remote conferee; and

remote directional control means for positioning said remote imaging means, where said remote directional control means is responsive to remote directional control signals generated by one of said remote conferee or said local conferee.

20. The apparatus defined by claim 19, further comprising:

arbitration means to distribute control of said local directional control means between said local and said remote conferees; and

arbitration means to distribute control of said remote directional control means between said local and said remote conferees.

21. The apparatus defined by claim 19, wherein said local directional control signal is responsive to one of said local pointer means or said remote pointer means to define a designated local control pointer wherein said local directional control means positions said local imaging means in the direction of said designated local control pointer when said designated local control pointer substantially approaches a target space boundary of said local image, and said remote directional control signal is responsive to one of said remote pointer means or said local pointer means to define a designated remote control pointer means wherein said remote directional control means positions said remote imaging means in the direction of said designated remote control pointer means when said pointer means substantially approaches a target space boundary of said remote target image.

22. The apparatus defined by claim 21, further comprising:

arbitration means to distribute control of said local directional control means between said local and said remote conferees; and

arbitration means to distribute control of said remote directional control means between said local and said remote conferees.

23. In a video teleconference site in which local images originate at said site and are displayable at a remote teleconference site and in which remote images originating at said remote teleconference site are displayable at said teleconference site, an apparatus for interactively pointing within either of said local and remote images, comprising:

at least one imaging means to continuously capture said local images within a target space at said teleconference site;

at least one display means to display said local and said remote images;

switching means at said teleconference site for selectively designating for output from said teleconference site one of said local and remote images input to said switching means;

input signal splitting means for distributing an incoming signal from said remote teleconference site to said display means and to said switching means;

selectively activated pointer means where said pointer is directed by a teleconference conferee to point within the selected output image designated by said switching means to define a pointer-overlaid image; and

output signal splitting means at said teleconference site to enable display of said pointer-overlaid image at said teleconference site and at said remote teleconference site.

24. The apparatus defined by claim 23, further comprising a selectively activated marker means associated with said pointer means where a mark is overlaid upon said pointer-overlaid image in accordance with movement of said pointer means, said mark being erasable.

25. The apparatus defined by claim 23, wherein said imaging means may include at least one of a video camera, video-cassette recorder, laser disk player, photo compact disk player, or document visualizer.

26. The apparatus defined by claim 23, wherein said display means includes video monitors.

27. The apparatus defined by claim 23, wherein said display means includes a monitor with picture-in-picture capability and said monitor displays both said local and remote images.

28. The apparatus defined by claim 23, wherein the target space comprises a field of view of one of a video camera, a document visualizer, or a video-cassette recorder, laser disk player, or a photo compact disk player.

29. The apparatus defined by claim 23, further comprising directional control means for positioning said imaging means, where said directional control means is responsive to directional control signals generated at one of said teleconference site and said remote teleconference site.

30. The apparatus defined by claim 29, further comprising arbitration means to distribute control of said directional control means between said teleconference site and said remote teleconference site.

31. The apparatus defined by claim 29, wherein said directional control signal is responsive to a designated one of said selectively activated pointer means or a pointer means at said remote teleconference site, the designated one defined as a designated control pointer, wherein said directional control means displaces said imaging means in the direction of said designated control pointer when said designated control pointer substantially approaches a target space boundary of said local image.

32. The apparatus defined by claim 31, further comprising arbitration means to distribute control of said local directional control means between said teleconference site and said remote teleconference site.

33. In a teleconferencing system in which a first set of images originating at a local teleconference site are displayable at a remote teleconference site and a second set of images originating at said remote teleconference site are displayable at said local teleconference site, an apparatus for teleinteractively pointing within at least one of said first or second set of images displayed at said local teleconference site, comprising:

switching means for selectively designating for output from said local teleconference site one of said images from said first set or said second set of video images input to said switching means;

input signal splitting means for distributing an incoming signal from said remote teleconference site to each of a display means and said switching means;

selectively activated pointer means where said pointer is directed by a teleconference conferee to point within the selected output image designated by said switching means to define a pointer-overlaid image; and

output signal splitting means to enable said pointer-overlaid image to be displayed on the local teleconference site display means and to enable transmission to said remote teleconference site.

34. The apparatus defined by claim 33, further comprising a selectively activated marker means associated with said pointer means where a mark is overlaid upon said pointer-overlaid image in accordance with movement of said pointer means, said mark being erasable.

35. In a N-site teleconference system in which images originating at one of said N teleconference sites are displayed at each of said N teleconference sites and images originating at each of said N teleconference sites are displayed at a particular teleconference site, a system for teleinteractively pointing within an image displayed at a site local to a conferee that originated at a site remote to said conferee, comprising:

imaging means at each of said N teleconference sites to capture images within a target space;

at least one display means at each of said N teleconference sites to display images captured by said imaging means; and

selectively activated pointer means at each of said N teleconference sites where said pointer means is directed by a local conferee to selectively point within a selected one of said images to define a pointer-overlaid image, and said pointer-overlaid image is displayable on each of said display means.

36. The apparatus defined by claim 35, further comprising a selectively activated marker means at each of said teleconference sites, associated with said pointer means at each of said N teleconference sites where a mark is overlaid upon said pointer-overlaid image in accordance with movement of said pointer means, said mark being erasable.

37. The apparatus defined by claim 35, wherein each of said imaging means may include at least one of a video camera, video-cassette recorder, or laser disk player, photo compact disk player, or document visualizer.

38. The apparatus defined by claim 35, wherein said display means includes video monitors.

39. The apparatus defined by claim 35, wherein said display means includes a single monitor with picture-in-picture capability and said monitor displays images from each of said teleconference sites.

40. The apparatus defined by claim 35, wherein the target space comprises a field of view of one of a video camera, a document visualizer, or a video-cassette recorder, laser disk player, or a photo compact disk player.

41. The apparatus defined by claim 35, further comprising directional control means at each of said N teleconference site for locally positioning said imaging means, where said directional control means is responsive to directional control signals generated by one of a local conferee or a remote conferee.

42. The apparatus defined by claim 41, further comprising arbitration means at each of said N teleconference sites to distribute control of a local directional control means between a remote conferee and said local conferee.

43. The apparatus defined by claim 41, wherein said directional control signal is responsive to one of a local pointer means or one of a remote pointer means to define a directional control pointer wherein said directional control pointer positions said imaging means in the direction of said directional control pointer when said pointer means substantially approaches a target space boundary of said image.

44. The apparatus defined by claim 43, further comprising arbitration means at each of said N teleconference sites to distribute control of said directional control pointer between competing conferees.

45. In a teleconference system in which images originating at a first teleconference site are displayed at a second teleconference site and images originating at a second teleconference site are displayed at said first teleconference site, a method for teleinteractively pointing within an image displayed at a site local to an operator that originated at a site remote to said operator, comprising the steps of:

capturing video images within a target space at said local teleconference site;

capturing video images within a target space at said remote teleconference site;

displaying at each teleconference site said images captured at said local site and said images captured at said remote site;

switchably selecting locally at each teleconference site for output one of said captured video images; and

selectively activating locally at each teleconference site pointer means to overlay a pointer within said selected output image to define a pointer-overlaid video image.

46. The method defined by claim 45, further comprising selectively activating locally at each teleconference site marker means associated with said pointer means where a mark is overlaid on said pointer-overlaid video image in accordance with movement of said pointer means, said mark being erasable.

47. The method defined by claim 45, further comprising the step of splitting said pointer-overlaid video image resulting in a plurality of pointer-overlaid video images, one displayable at said local teleconference site and the other displayable at said remote teleconference site.

48. The method defined by claim 45, further comprising the steps of:

providing a video imaging device at each teleconference site for capturing said video images;

providing a means for positioning said video imaging device which is responsive to local operator control wherein said positioning means includes at least one of horizontal pan, vertical tilt, and zoom capabilities;

positioning said video imaging device by a conferee local to a teleconference site to capture a plurality of varying target images.

49. The method defined by claim 48, wherein said positioning means is also responsive to remote operator control.

50. The method defined by claim 49, wherein said positioning means is responsive to operator control in accordance with said pointer-overlaid video image where when said pointer approaches a boundary of said video image, said positioning means is displaced in the direction of said boundary.

51. The method defined by claim 50, wherein said teleconference system includes arbitration means to distribute control of said remote positioning means to one of a plurality of competing requestors.

52. In a teleconferencing system in which images originating at one of N teleconference sites are displayable at each of said N teleconference sites, and images originating at each of said N teleconference sites are displayed at said one teleconference site, a method for teleinteractively pointing within any image displayed at a site local to an operator, comprising the steps of:

capturing video images within a target space at each of said N teleconference sites;

displaying at each of said N teleconference sites said captured images;

switchably selecting for output at each of said N teleconference sites one of said captured video images; and

selectively activating at each of said N teleconference sites pointer means to overlay a pointer within said selected output image to define a pointer-overlaid video image.

53. The method defined by claim 52, further comprising selectively activating at each of said N teleconference sites marker means associated with said pointer means where a mark is overlaid on said pointer overlaid video image in accordance with movement of said pointer means, said mark being erasable.

54. The method defined by claim 52, further comprising the step of splitting said pointer-overlaid video image signal resulting in a plurality of pointer-overlaid video images displayable at said N teleconference sites.

55. The method defined by claim 54, further comprising the steps of:

providing a video imaging device for capturing said video images at each of said N teleconference sites;

providing at each of said N teleconference sites a means for positioning said video imaging devices which is responsive to local operator control wherein said positioning means includes at least one of horizontal pan, vertical tilt, and zoom capabilities;

positioning said video imaging device by a conferee local to a teleconference site to capture a plurality of varying target images.

56. The method defined by claim 55, wherein said positioning means is also responsive to remote operator control.

57. The method defined by claim 56, wherein said positioning means is also responsive to operator control in accordance with said pointer-overlaid video image where when said pointer approaches a boundary of said video image, said positioning means is displaced in the direction of said boundary.

58. The method defined by claim 57, wherein said positioning teleconference system includes arbitration means to distribute control of said remote positioning means between a plurality of competing requestors.