Blended Space For Aligning Video Streams

• US 20070279483A1
• Filed: 11/13/2006
• Published: 12/06/2007
• Est. Priority Date: 05/31/2006
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Beers, Ted W., Gorzynski, Mark E., Derocher, Michael D., Moltoni, Thomas, Kleist, Thomas, Mitchell, April Slayden
• Application Number:
  US11/559,348
• Publication Number:
  US 20070279483A1
• Time in Patent Office: Days
• US Class Current: 348/14.80
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A method is described for aligning video streams and positioning camera in a collaboration event to create a blended space. A local physical environment of one set of attendees is combined with respective apparent spaces of other sets of attendees that are transmitted from two or more remote environments. A geometrically consistent shared space is created that maintains natural collaboration cues of eye contact and directional awareness. The remote environments in the local physical environment are represented in a fashion that is geometrically consistent with the local physical environment. The local physical environment extends naturally and consistently with the way the remote environments may be similarly extended with their own blended spaces. Therefore, an apparent shared space that is sufficiently similar for all sets of attendees is presented in both the local and remote physical environments.

Claims

1. A system comprising:

a management subsystem configured to dynamically configure the topology of a virtual collaborative event to create a blended space, said management subsystem being further configured to receive and process requests originating from at least one event management client, wherein the configuration of said topology includes the determination of media stream connections among multiple nodes based on at least one policy for maintaining a geometrically consistent space preserving eye contact and direction awareness, wherein said media stream connections establish and maintain actual relationships among said nodes.

2. A system comprising:

a communication network;

a plurality of nodes communicatively coupled to said communication network;

a management subsystem communicatively coupled to said network and interfacing to an event management client; and

wherein said management subsystem is configured to dynamically manage the topology of a blended space collaborative event based on said event management client.

3. A method for aligning video streams and positioning cameras in a collaboration event to create a blended space, comprising:

combining a local physical environment of one set of attendees with respective apparent spaces of other sets of attendees that are transmitted from two or more remote environments;

creating a geometrically consistent shared space that maintains natural collaboration cues of eye contact and directional awareness;

representing the remote environments in the local physical environment in a fashion that is geometrically consistent with the local physical environment; and

extending the local physical environment naturally and consistently with the way the remote environments may be similarly extended with their own blended spaces, wherein an apparent shared space that is sufficiently similar for all sets of attendees is presented in the local and remote physical environments.

4. The method of claim 3, further comprising:

presenting a portion of a conference table that is geometrically consistent with an actual conference table in the local environment.

5. The method of claim 3, wherein each local environment has three displays mounted side-by-side in a left-center-right configuration and three cameras, each respectively center mounted above one of the three displays.

6. The method of claim 5, further comprising:

associating each camera in all environments with a respective display in another environment; and

configuring video streams for each camera to an appropriate display.

7. The method of claim 5, further comprising:

assigning a geometric angle and zoom factor to direct a respective view and envelopment of appropriate attendees for each camera.

8. The method of claim 7, wherein the zooms of the camera are set to display two attendees substantially life size.

9. The method of claim 7, wherein the camera angles are determined based on the assignment of attendees into a location of the virtual space to allow for substantially direct eye contact.

10. The method of claim 3 wherein the steps of associating each camera and configuring video streams are done before the meeting starts and are maintained throughout the meeting.

11. The method of claim 3 further comprising aesthetically controlling the visual and audio environment to make it appear natural to the attendees by maintaining eye contact, and third party awareness of interactions among attendees.

12. The method of claim 3 wherein the step of configuring video streams includes configuring non-attendee video streams that are assigned to displays of the local environments to further enhance the appearance of the blended space.

13. The method of claim 12, wherein the non-attendee video streams include an image of a blank conference table if no attendees are present to maintain the illusion of a geometric consistent environment.

14. The method of claim 3 wherein the blended space combines a set of attendees in a local environment with apparent spaces transmitted from remote locations that are represented locally in the local environment that is geometrically consistent with the local room environment.

15. The method of claim 14, wherein each remote environment has its respective remote locations presented geometrically consistent in the blended space.

16. The method of claim 14, wherein each remote environment has its own local environment that has a blended space consistent with the other remote environments.

17. The method of claim 3 wherein the blended space is represented by meta data sufficient for each local environment to be configured for participation in the collaboration event.

18. The method of claim 17 wherein the meta data is determined by a formula.

19. The method of claim 18, wherein the assignment screen for the video streams uses a modulo number of positions.

20. The method of claim 19 wherein the formula is MOD(virtual position−

1,N) where N is the number of sets of attendees and virtual position represents a location around a virtual conference table.

21. The method of claim 17, wherein the meta data is recalculated when another set of attendees from another remote location joins the collaboration event.

22. The method of claim 21, wherein a set of camera angles and set of display assignments are updated when the meta data is recalculated to create a new blended space.

23. The method of claim 3 wherein the configuration of the collaboration event is provided by an event management client (EMC) that represents the blended space with the organization of the meeting with animated sequences of connecting virtual tables.

24. The method of claim 23 wherein the EMC displays information above the virtual table that a remote environment will occupy relative to the local environment viewing the EMC.

25. The method of claim 23 wherein the virtual tables are presented in tangible three-dimensional format that is oriented to each observer and wherein the virtual table shapes conform to a shaped convention that permits their being illustrated as joined in 3D spaces.

26. The method of claim 23 wherein the EMC presents a front table representing the local location and at least one virtual table across from the front table for each of the remote locations.