Virtual collaboration window system and method

• US 7,441,198 B2
• Filed: 12/16/2005
• Issued: 10/21/2008
• Est. Priority Date: 09/14/2001
• Status: Expired due to Term

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services GmbH (Accenture PLC)
• Inventors: Singh, Mitu, Dempski, Kelly L.
• Primary Examiner(s): SAX, STEVEN PAUL
• Application Number:
  US11/303,302
• Publication Number:
  US 20060092267A1
• Time in Patent Office: 1,040 Days
• Field of Search: 715/757, 715/702, 715/727, 715/728, 715/729, 715/748, 715/749, 715/750, 715/751, 715/752, 715/756, 715719-726, 715848-852, 715821-823, 345/629, 345/420, 345/619, 345/632
• US Class Current: 715/757
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

This invention is a method for manipulating virtual objects displayed on a video conference broadcast by generating a computerized three dimensional image of an object to be superimposed on a first video broadcast signal from a local video camera for display on a remote video monitor, and superimposing the same object on a second video broadcast signal from a remote video camera for display on a local video monitor, grabbing a portion of the three dimensional image by placing a hand in close proximity to the portion of the image moving the hand while maintaining the hand in close proximity to the image and regenerating the three dimensional image to a new perspective view corresponding to the movement of the image with the hand to create the appearance that the hand is manipulating a virtual object displayed over the video broadcast signal.

Claims

1. A system for manipulating virtual objects displayed on a video image for a video conference broadcast, the system comprising:

at least one locally arranged video monitor and at least one remotely arranged video monitor and operating as a display for the video conference broadcast;

a video camera associated with each monitor for generating a video broadcast signal corresponding to the video image of the video conference broadcast;

a manual input device associated with each monitor; and

a computer processor system associated with each monitor and communicatively connected to a high bandwidth communication network;

wherein each processor system displays a three-dimensional virtual object superimposed on or overlaying the video image of the video conference broadcast on each associated monitor to provide an augmented reality view, and is adapted to detect new position and new rotation of the virtual object corresponding to a local manipulation of the virtual object from each associated manual input device and transmit a signal representative of the new position and the new rotation to the other of the processor systems;

wherein the processor systems are capable of generating a plurality of perspective views of the three-dimensional virtual object and upon selection of a first view, the processor systems display the same side of the virtual object locally and remotely and upon selection of a second view, the processor systems display a different side of the virtual object remotely and locally.

2. The system of claim 1 wherein said manual input device is at least one of a mouse, a joystick, a trackball, a touch screen, or a video gesture recognition system.

3. The system of claim 1 wherein said manual input device is a touch screen integrated with said video monitor.

4. The system of claim 1 wherein each processor system has a video input card, and each camera is connected to said video input card in each associated processor system.

5. The system of claim 1 wherein the computer processor system further includes voice recognition software for receiving voice commands for manipulating the displayed virtual objects.

6. A system for manipulating virtual objects displayed on a video image for a video conference broadcast, the system comprising:

at least two video monitors configured to be remotely located at multiple locations and operating as a display for the video conference broadcast;

a video camera associated with each monitor for generating a video broadcast signal corresponding to the video image of the video conference broadcast;

a manual input device associated with each monitor;

a video processor system coupled to each of said monitor, and corresponding associated video camera and input device,

a computer processor system communicatively connected to a high bandwidth communication network and each video processor system, wherein the computer processor system displays a three-dimensional virtual object superimposed on or overlaying the video image of the video conference broadcast on each monitor to provide an augmented reality view and is adapted to receive a signal from each manual input device and to manipulate the virtual object in response thereto,

wherein the computer processor system operates to process an image data for the three-dimensional virtual object in a first mode and in a second mode, the computer processor system, in the first mode, updating a display corresponding to the image data in response to the signal from each manual input signal received from the multiple locations and in the second mode, setting up a visual cue that indicates the manipulation of the virtual object by a selected one of the multiple locations at a time.

7. The system of claim 6 wherein the manual input device is a touch sensitive screen integrated with the video monitor.

8. The system of claim 7 wherein the video monitor is a flat panel display of sufficient size and the associated video camera is of sufficient focal length and positioning with respect to the video monitor to display apparent life size views of participants from a first location of the multiple locations as seen from the perspective of participants at a second location of the multiple locations.

9. The system of claim 6 further comprising a voice recognition system and a voice activated command structure for assisting the manipulation of the virtual object.

10. A method for manipulating a virtual object displayed on a video conference broadcast at a local and a remote location, the method comprising:

a) generating with a remote processor a three-dimensional image of the virtual object overlaying a first video broadcast signal from a local video camera for display on a remote video monitor operating as a display for the video conference broadcast to provide an augmented reality view;

b) generating with a local processor a three-dimensional image of the virtual object overlaying a second video broadcast signal from a remote video camera for display on a local video monitor operating as a display for the video conference broadcast to provide the augmented reality view;

c) grabbing a portion of the virtual object displayed at one of the local and remote locations by placing a real object in close proximity to the portion of the displayed image to activate a touch-sensitive screen;

d) moving the real object while maintaining the real object in active coupling with the touch-sensitive screen;

e) regenerating the three-dimensional image at each of the local and remote locations to correspond to the movement of the real object thereby providing the appearance to viewers at the local and remote locations that the real object is manipulating a virtual object; and

f) selecting a perspective view of the virtual object at each of the local and remote locations wherein upon selection of a first view, displaying the same side of the virtual object displays at the local and remote locations; and

upon selection of a second view, displaying a different side of the virtual object at each of the local and remote locations.

11. The method of claim 10, further comprising:

prior to (e), detecting a new position and a new rotation of the virtual object corresponding to the grabbing of the portion of the virtual object.

12. The method of claim 11, further comprising:

prior to (e), transmitting the new position and the new rotation of the virtual object to the remote location.

13. The method of claim 10 further comprising:

recreating a front side view of the virtual object at the local location and a rear side view of the virtual object at the remote location;

wherein the first perspective view displays the front side of the virtual object and the second perspective view displays the rear side of the virtual object.

14. The method of claim 10 further comprising:

prior to (d), locking out grabbing of the portion of the virtual object at the one of the local and the remote locations that does not manipulate the virtual object.

15. The method of claim 14 further comprising:

upon conflicting inputs at the local and remote locations, determining a control over the grabbing of the virtual object based on social conventions and etiquette.

16. The method of claim 10 wherein e) regenerating the three-dimensional image at each of the local and remote locations to correspond to the movement comprises regenerating the three-dimensional image of the virtual object having a complete design from the three-dimensional image of the virtual object in unfinished format.

17. The method of claim 10 wherein c) grabbing a portion of the virtual object comprises stretching the portion of the virtual object.

18. The method of claim 10 further comprising:

displaying at least a first part of the three-dimensional image of the virtual object in a first color in response to the manipulation of the first part of the virtual object.

19. The method according to claim 18 further comprising:

displaying at least a second part of the virtual object in a second color in response to the manipulation of the second part of the virtual object.