Communication and collaboration system using rich media environments

• US 7,590,941 B2
• Filed: 10/09/2003
• Issued: 09/15/2009
• Est. Priority Date: 10/09/2003
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Bhatti, Nina T., Harville, Michael, Baker, Henry Harlyn, Wee, Susie J., Covell, Michele
• Primary Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US10/682,542
• Publication Number:
  US 20050081160A1
• Time in Patent Office: 2,168 Days
• Field of Search: 715/700, 715/716, 715/717, 715/719, 715/753, 715/764, 715/771, 715/773, 715/863, 715/500.1, 715/501.1, 715/205, 715/751, 715/755, 715/759, 715/203, 345/156, 345/173, 348/143, 348/155, 348/159, 379/202.01, 382/190, 382/209, 725/9, 725/10, 725/12, 704/231, 704/270
• US Class Current: 715/753
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system that enables communication and collaboration among individuals using rich media environments. A system according to the present techniques includes a set of rich media environments each having a corresponding arrangement of sensing and rendering components for sensing of and rendering to a corresponding set of individuals. A system according to the present techniques includes an interest thread detector that uses the sensing and rendering components to detect formation of multiple communication interactions among the individuals and that creates an interest thread for each detected communication interaction and further includes a communication provider that for each interest thread captures a set of media data from a corresponding subset of the sensing components and that combines the captured media data in response to the activities of the corresponding individuals and that communicates the combined media data to a corresponding subset of the rendering components.

Claims

1. A system for communication, comprising:

first set of sensing and rendering components arranged to cover physical movements of multiple individuals present in a first environment;

second set of sensing and rendering components arranged to cover physical movements of multiple individuals present in a second environment;

interest thread detector that uses the first and second set of sensing and rendering components to detect multiple communication interactions each involving a respective subset of the individuals present in the first and second environments and that maintains an interest thread for each communication interaction;

communication provider that captures a set of media data from the sensing components and that combines the captured media data in response to the respective activities indicated by physical movements of each subset of the individuals and that communicates the combined media data to the rendering components, wherein the communication provider includes a user manager configured to maintain a set of user profiles for the respective individuals, the user profiles including permission profiles having thread permissions and user permissions configured to enable an individual to keep their actions and presence from being detected by the interest thread detector.

2. The system of claim 1, wherein the communication provider selects a respective subset of the first and second set of sensing and rendering components for use for each interest thread.

3. The system of claim 1, wherein the respective activities include speech levels of the individuals involved in the respective interest thread.

4. The system of claim 1, wherein the respective activities include gestures by the individuals involved in the respective interest thread.

5. The system of claim 1, wherein the respective activities include movements by the individuals involved in the respective interest thread.

6. The system of claim 1, wherein the respective activities include locations of the individuals involved in the respective interest thread.

7. The system of claim 1, wherein the communication provider refines the media data obtained from the sensor components in response to the respective activities.

8. The system of claim 1, wherein the communication provider stores the combined media data to provide a history of each communication interaction.

9. The system of claim 1, wherein the communication interactions include a communication interaction that pertains to an artifact in one of the environments.

10. The system of claim 9, wherein the artifact changes over time.

11. The system of claim 10, wherein a change to the artifact is made by one of the individuals involved in the interest threads.

12. The system of claim 10, wherein the communication provider records a history of the artifact over time.

13. The system of claim 9, wherein the artifact is a shared virtual writing surface.

14. The system of claim 1, wherein the interest thread detector detects one or more activities in the environments and creates an interest area for the detected activity.

15. The system of claim 14, wherein the interest thread detector associates the interest area with another interest thread.

16. The system of claim 1, wherein the communication interactions include a communication interaction that involves two or more of the individuals in one of the environments.

17. The system of claim 1, wherein the communication interactions include a communication interaction that involves one or more of the individuals in two of the environments.

18. The system of claim 1, wherein the interest thread detector detects formation by detecting a movement of one of the individuals.

19. The system of claim 18, wherein the movement pertains to one of the rendering devices.

20. The system of claim 18, wherein the movement pertains to one of the other individuals.

21. The system of claim 1, wherein one or more of the individuals is in a remote location and in possession of a remote sensing and rendering component.

22. A method for communication, comprising:

providing a first set of sensing and rendering components for covering physical movements of multiple individuals present in a first environment;

providing a second set of sensing and rendering components for covering physical movements of multiple individuals present in a second environment;

detecting multiple communication interactions each a communication interaction involving a respective subset of the individuals present in the first and second environments;

maintaining an interest thread for the each detected communication interaction;

maintaining a set of user profiles for each of the individuals capturing a set of media data from the sensing components;

combining the captured media data in response to the respective activities indicated by physical movements of the respective subset of the individuals;

communicating the combined media data to the rendering components, including communicating the user profile for each of the individuals, each user profile including a permission profile having a thread permission and a user permission configured to enable an individual to keep their actions and presence from being detected by the interest thread detector.

23. The method of claim 22, further comprising selecting a respective subset of the sensing and rendering components for use for each interest thread.

24. The method of claim 22, wherein combining the captured media data includes detecting speech levels of the corresponding individuals.

25. The method of claim 22, wherein combining the captured media data includes detecting gestures by the corresponding individuals.

26. The method of claim 22, wherein combining the captured media data includes detecting movements by the corresponding individuals.

27. The method of claim 22, wherein combining the captured media data includes detecting locations of the corresponding individuals.

28. The method of claim 22, further comprising refining the media data obtained from the sensor components in response to the respective activities.

29. The method of claim 22, further comprising storing the combined media data in a history of each communication interaction.

30. The method of claim 22, further comprising monitoring an artifact over time.

31. The method of claim 30, further comprising recording a history of the artifact over time.

32. The method of claim 22, further comprising detecting one or more activities in the environments and creating an interest area for each detected activity.

33. The method of claim 32, further comprising associating the interest area with another interest thread.

34. A computer-readable storage media that contains a set of code that when executed provides communication by:

providing a first set of sensing and rendering components for covering physical movements of multiple individuals present in a first environment;

providing a second set of sensing and rendering components for covering physical movements of multiple individuals present in a second environment;

detecting multiple communication interactions each involving a respective subset of the individuals present in the first and second environments;

maintaining an interest thread for each detected communication interaction;

maintaining a set of user profiles for each of the individuals;

capturing a set of media data from the sensing components;

combining the captured media data in response to the respective activities indicated by physical movements of the respective subset of the individuals;

communicating the combined media data to the rendering components, including communicating a user profile for each of the individuals, each user profile including a permission profile having a thread permission and a user permission configured to enable an individual to keep their actions and presence from being detected by the interest thread detector.

35. The computer-readable storage media of claim 34, further comprising selecting a respective subset of the sensing and rendering components for use for each interest thread.

36. The computer-readable storage media of claim 34, wherein combining the captured media data includes detecting speech levels of the corresponding individuals.

37. The computer-readable storage media of claim 34, wherein combining the captured media data includes detecting gestures by the corresponding individuals.

38. The computer-readable storage media of claim 34, wherein combining the captured media data includes detecting movements by the corresponding individuals.

39. The computer-readable storage media of claim 34, wherein combining the captured media data includes detecting locations of the corresponding individuals.

40. The computer-readable storage media of claim 34, further comprising refining the media data obtained from the sensor components in response to the respective activities.

41. The computer-readable storage media of claim 34, further comprising storing the combined media data in a history of each communication interaction.

42. The computer-readable storage media of claim 34, further comprising monitoring an artifact over time.

43. The computer-readable storage media of claim 42, further comprising recording a history of the artifact over time.

44. The computer-readable storage media of claim 34, further comprising detecting one or more activities in the environments and creating an interest area for each detected activity.

45. The computer-readable storage media of claim 44, further comprising associating the interest area with another interest thread.