Remote collaboration technology design and methodology

• US 20020149617A1
• Filed: 03/28/2002
• Published: 10/17/2002
• Est. Priority Date: 03/30/2001
• Status: Abandoned Application

• Current Assignee: David F. Becker
• Original Assignee: David F. Becker
• Inventors: Becker, David F.
• Application Number:
  US10/109,189
• Publication Number:
  US 20020149617A1
• Time in Patent Office: Days
• US Class Current: 715/751
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A method for collaborating remotely that incorporates the use of high-resolution computer imagery, or any other source of high-resolution video, is provided. The method provides for converting high-resolution video or analog RGB computer video into for example, High-Definition Television (HDTV) signals or keep the RGB computer signal in its original format but in digital form. These signals are then compressed, encoded and transmitted over a broadband communication network. At a remote site, the signals are decompressed, decoded and displayed on an HDTV-capable display device. Additionally, the HDTV signals can be reformatted back into their original high-resolution video format or analog RGB computer signals for viewing on an appropriate video display device. If the signals are kept in their original RGB format but in digital form, this last step would not be required, only a conversion back to analog form would be needed. Broadcast and interactivity can be provided to multiple sites, and include multiple computer and/or video screens. Local and remote mouse and keyboard control of the computer imagery or other high-resolution video source are also provided in the method. Additional interactivity is provided by incorporating video marking devices into the system. Collaboration is further supported by the inclusion of audio/video teleconferencing methods and technologies, both NTSC(PAL)-based, and HDTV-based. Access to a number of various computers and high-resolution video sources is provided via a matrix video/keyboard/mouse/serial switching system. Security is provided via encryption and the control systems employed. Records of the collaborative session are provided by the inclusion of HDTV video-recording devices. Ergonomic support is provided by a master control system that configures all devices for specific forms of remote collaboration.

Claims

1. A method for remote collaboration with at least one remote location over a broadband network, comprising the steps of:

a. Generating computer video output;

b. Transmitting the video information over the broadband network to a location remote from the generator;

c. Displaying that video imagery on a monitor at the location;

d. Converting keyboard and mouse commands to a digital format;

e. Transmitting the keyboard and mouse commands over a network;

f. Converting the keyboard and mouse commands back to a format compatible to the computer; and

g. Sending those keyboard and mouse commands into the computer that generates video output.

2. The method of claim 1, wherein the video output is analog RGB and there is further included the step of converting the analog RGB video output to serial digital format.

3. The method of claim 2, wherein said step of converting the analog RGB video output is to serial digital high-definition television (HDTV) format.

4. The method of claim 3, wherein there is further included the step of compressing the serial digital output.

5. The method of claim 3, wherein the step of displaying the video imagery is a display of a video imagery on an HDTV-compatible monitor.

6. The method of claim 2, wherein there is further included the step of compressing the series digital output.

7. The method of claim 6, wherein there is further included the step of decompressing the output.

8. The method of claim 7, wherein said step of decompressing is a step of decompressing the serial digital output.

9. The method of claim 7, wherein there is included the step of converting the decompressed signals into analog RGB computer video.

10. The method of claim 1, wherein step (d) includes converting PS/2 keyboard and mouse commands.

11. The method of claim 10, wherein step (f) includes converting the keyboard and mouse commands back to PS/2 format.

12. The method of claim 10, wherein there are multiple mouse instruments and there is included in step (f) the step of monitoring the mouse commands.

13. The method of claim 1, wherein step (a) includes generating multiple computer video output.

14. The method of claim 13, wherein step (a) includes generating stereo computer analog RGB video output.

15. The method of claim 1, wherein step (a) includes generating digital HDTV signals directly from the computer.

16. The method of claim 1, wherein digital HDTV signals generated are compressed directly from the computer.

17. The method of claim 1, wherein step (a) includes generating NTSC(PAL) video signals.

18. The method of claim 1, wherein step (a) includes generating high-definition, HDTV, camera video signals.

19. The method of claim 1, wherein step (a) includes generating voice and sound signals.

20. The method of claim 1, wherein step (a) includes generating video marking.

21. The method of claim 1, wherein step (a) includes generating signals from multiple computers and step (b) includes the step of selecting and using a variety of computers by a matrix switching system.

22. The method of claim 1, wherein there are multiple remote locations and step (b) includes transmitting multiple switching signals through locations simultaneously using multi-point broadcast networking.

23. The method of claim 22, wherein step (b) includes the step of transmitting substantially simultaneously to the multiple locations.

24. The method of claim 23, wherein step (b) further includes using multi-point broadcast networking.

25. The method of claim 1, wherein the remote location is mobile.

26. The method of claim 1, wherein step (a) includes generating multi-color output.

27. The method of claim 1, wherein step (a) includes video response to mouse movements to be overlain on the computer imagery.

28. The method of claim 1, wherein step (e) includes the step of overlaying the computer imagery with video response to mouse movements.

29. The method of claim 28, wherein step (d) includes the step of delivering the keyboard and mouse commands for display in step (c).

30. The method of claim 1, wherein step (a) includes generating imagery by computer at multiple locations.

31. The method of claim 1, wherein step (a) generates analog RGB computer output that is at least 1280 by 1024.

32. The method of claim 1, wherein there is included the step of compressing the video output by a MPEG-4 video compression method.

33. The method of claim 1, wherein there is included the step of converting the output of step (a) to serial digital high-definition television format, wherein said format is SMPTE-274M 1920×

1080i.

34. The method of claim 1, wherein there is included the step of converting pointing signals for transmission over the network.

35. The method of claim 34, wherein the conversion of pointing includes the generation of pointing through NTSC(PAL) video for viewing.

36. The method of claim 34, wherein the conversion of pointing includes the generation of pointing through laser pointing.

37. The method of claim 1, wherein step (e) includes transmitting microphone signals for voice transmission.

38. The method of claim 34, wherein there are multiple pointing sources.

39. The method of claim 38, wherein the multiple sources provide for stereo pointing.

40. The method of claim 1, wherein there are video sources at various locations, at least one of said sources in step (a) including the step of compositing the various images into one high-definition signal and there is further included the step of compressing the signal and step (c) includes displaying the composited imagery.

68. The method of claim 1, wherein there is included the step of compressing the video output by a MPED-7 video compression method.

41. A communication system operable for supporting collaboration between a first location and a second location, the locations being remote from each other comprising:

a. At least one computer at the first location, said computer producing a computer video signal;

b. At least one computer monitor at the first location for displaying said computer video signal;

c. Video converter circuitry at the first location for converting said computer video signal to a high-definition TV digital signal;

d. A data link for transmitting said high-definition TV digital signal to the second location; and

e. A high-definition TV monitor at the second location for displaying said high-definition TV digital signal at the second location.

42. The communication system of claim 41, further comprising:

A video router at the first location for routing said video signal to said computer monitor at the first location and the video converter circuitry at the first location.

43. The communication system of claim 41, wherein said data link has sufficient bandwidth for transmitting said high-definition TV digital signal to the second location such that full motion, full-resolution viewing is provided simultaneously at said computer monitor at the first location and said monitor at the second location.

44. The communication system of claim 41, wherein said high-definition TV digital signal has a resolution of at least 640 by 480.

45. The communication system of claim 44, wherein said high-definition TV digital signal would be above 1280 by 1024.

46. The communication system of claim 41, further comprising:

At least one keyboard at the second location and at least one mouse input device at the second location, said monitor at the second location, said keyboard at the second location, and said mouse input at the second location connecting through the data link directly to the computer at said first location.

47. The communication system of claim 41, further comprising:

a. At least one keyboard at the first location interconnected with said computer for inputting keyboard signals to said first computer;

b. Keyboard converter circuitry at the first location; and

c. At least one keyboard at the second location in communication with said keyboard converter circuitry through said data link for inputting keyboard signals to said computer at the first location.

48. The communication system of claim 47, further comprising:

A keyboard selector for selecting which of said keyboard at the first location and the second location will control keyboard input to the computer at said first location.

49. The communication system of claim 48, wherein one of said keyboards at the first location has priority over all other keyboards.

50. The communication system of claim 48, further comprising:

A keyboard signal router in communication with said keyboards at the first location and the second location.

51. The communication system of claim 41, further comprising:

a. At least one mouse input device at the first location interconnected with the computer for inputting mouse signals to the first computer;

b. Mouse converter circuitry at the first location; and

c. At least one mouse input device at the second location in communication with said mouse converter circuitry through said data link for inputting mouse signals to said computer at the first location.

52. The communication system of claim 51, further comprising:

A mouse selector for selecting which of said one or more mouse input devices at the first location and said one or more mouse input devices at the second location will control mouse input to said computer at the first location.

53. The communication system of claim 51, wherein one of said mouse input devices at the first location has priority over all other mouse input devices.

54. The communication system of claim 51, further comprising:

A mouse signal router in communication with said mouse input devices at the first location and the second location.

55. The communication system of claim 51, wherein said mouse at the second location has an output directly displayed on said high-definition TV digital signal at the second location.

57. The communication method of claim 56, comprising:

Displaying said TV compatible digital signal with a high-definition TV monitor at the second location.

58. The communication method of claim 56, further comprising providing sufficient bandwidth for said transmitting to permit simultaneous real-time, full motion viewing at the first location and second location.

59. The communication method of claim 56, further comprising:

Providing capability for converting a plurality of scanning rates for said computer video into a selected scanning rate.

60. The communication method of claim 56, further comprising:

a. Providing capability for video communication operable for displaying video pictures of persons at the first location and the second location; and

b. Providing voice communication between the first location and the second location.

61. The communication method of claim 56, further comprising:

Providing a plurality of video displays at the first location from the second location.

56. A communication method operable for enhancing collaboration between a first location and a second location remote from the first location, comprising:

a. Utilizing a computer at the first location for producing a computer video signal at the first location;

b. Converting said computer video signal to a TV compatible digital signal;

c. Transmitting said TV compatible digital signal to a second location; and

d. Providing controls at the first location and the second location for controlling the computer at the first location.

62. A communication system operable for supporting collaboration between a first location and a second location remote from the first location, comprising:

A data link;

A computer video signal;

A converter circuitry connected to said data link and said video signal for receiving said computer video signal and converting said computer video signal to a high-definition TV signal suitable for transmission over said data link to the second location.

63. The system of claim 62, wherein there is included said computer video signal has one of a plurality of scanning rates, said high-definition TV signal having a resolution of at least 640 by 480, said high-definition TV signal being operable for displaying full motion video, said converter circuitry being operable for interconnecting a keyboard signal and a mouse signal from said keyboard and said mouse at the second location to a computer at the first location.

64. The system of claim 63, wherein the resolution is at least 1280 by 1024.

65. The system of claim 62, wherein said computer video signal is generated from a mobile location.

66. The system of claim 65, wherein the computer video signal originates from a camera.

67. The system of claim 65, wherein the computer video signal originates from a laser pointer.

69. The system of claim 62, wherein the second location is a mobile location, said location includes a transmitter for transmitting a video signal from the second location to the first location.

70. The system of claim 69, wherein the mobile location includes a transmitter for transmitting an audio signal from the second location to the first location.

71. A method for remotely viewing a 3D environment, comprising:

a. Utilizing a computer for producing the 3D environment at a local location by producing two or more images;

b. Converting each of said two or more images to a television format;

c. Compressing said two or more images in said television format to produce two or more compressed images;

d. Transmitting said two or more compressed images;

e. Decompressing said two or more compressed images at a remote location; and

f. Recombining said images on one or more high-definition TV compatible monitors.

72. A method for collaboration between a first location and second location remote to the first location, comprising:

a. Generating a video output at the first location with a computer located at the first location;

b. Displaying said video output at the first location;

c. Converting said video output to a high-definition television format;

d. Compressing said high-definition television format to produce a compressed signal;

e. Transmitting said compressed signal;

f. Decompressing said compressed signal at the second location to produce a decompressed television video; and

g. Displaying said decompressed television video.

73. The method of claim 72, further comprising:

Providing a video marking device at the first location for marking said video output and said decompressed television video for viewing at the first and second location.

74. The method of claim 72, further comprising:

Providing a video marking device at the second location for marking said video output and said decompressed television video for viewing at the first location and the second location.

75. The method of claim 72, further comprising:

Producing a plurality of video views at the first location for viewing at the second location.

76. The method of claim 72, further comprising:

Producing a plurality of video views at the second location for viewing at the first location.

77. The method of claim 72, further comprising:

Encrypting said compressed signal.

78. The method of claim 72, further comprising:

Providing a plurality of control interfaces at the first location and the second location for configuring aspects including one or more of a group including lighting, window shading, sound sources, volume levels, security, privacy modes, caver images, and recording.

80. A method of claim 79, wherein there are a plurality of remote locations and step (d) includes the step of transmitting said compressed high-definition television format output to a plurality of remote locations;

wherein step (e) includes decompressing said compressed high-definition television format for viewing at the plurality of remote locations.

79. A method for real-time communication to at least one remote location, comprising:

a. Utilizing a computer for generating a real-time video output;

b. Producing said real-time video output in a high-definition television format output;

c. Compressing said high-definition television output to produce a compressed high-definition television format output.;

d. Transmitting said compressed high-definition television format output to at least one remote location; and

e. Decompressing said compressed high-definition television format output for viewing at the remote location.

81. A method for communication between a first and a second and third locations remote from the first location, further comprising:

a. Utilizing a computer at the first location for generating a video output;

b. Producing said video output in a high-definition television format output;

c. Compressing said high-definition television format output to produce a compressed HDTV output;

d. Transmitting said compressed HDTV output to the two remote locations;

e. Decompressing said compressed HDTV output for viewing at each of the remote locations; and

f. Interacting with said computer at the first location from at least one of said remote locations.

82. A method for collaboration between a first location and second location remote to the first location, comprising:

a. Generating a video output at the first location with a computer located at the first location;

b. Displaying said video output at the first location;

c. Converting said video to a digital format;

d. Compressing said digital video to produce a compressed signal;

e. Transmitting said compressed signal;

f. Decompressing said compressed signal at the second location to produce a decompressed digital video signal;

g. Converting said decompressed digital video signal to an analog video signal; and

h. Displaying said decompressed television video.