Method and system for communicating through shared media

• US 20060092178A1
• Filed: 10/29/2004
• Published: 05/04/2006
• Est. Priority Date: 10/29/2004
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Baker, Henry H., Harville, Michael, Tanguay, Donald O. Jr., Gelb, Daniel G.
• Application Number:
  US10/977,428
• Publication Number:
  US 20060092178A1
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method and system for communicating through shared media. Specifically, a method provides for accessing a plurality of images from respective input interfaces of a plurality of input interfaces. At least one of the plurality of images is captured using a camera, and wherein at least one of the plurality of images contains a form of communication. The form of communication is extracted from the plurality of images. A respective appearance model is constructed corresponding to each of the plurality of input interfaces. At least one of the respective appearance models contributes the respective form of communication that is extracted and transformed to a reference frame of a reference coordinate system. The respective appearance models are combined together to generate a shared virtual model. The shared virtual model is displayed to at least one output medium.

Claims

1. A method for communicating through shared media, comprising:

accessing a plurality of images from respective input interfaces of a plurality of input interfaces, wherein at least one of said plurality of images is captured using a camera, and wherein at least one of said plurality of images contains a respective form of communication;

extracting said respective form of communication from said plurality of images;

constructing a respective appearance model corresponding to each of said plurality of input interfaces, wherein at least one of said respective appearance models contributes said respective form of communication that is extracted and transformed to a reference frame of a reference coordinate system;

combining said respective appearance models together to generate a shared virtual model; and

displaying said shared virtual model to at least one output medium.

2. The method of claim 1, wherein said displaying said shared virtual model further comprises:

superimposing said shared virtual model onto at least one of said plurality of input interfaces.

3. The method of claim 2, further comprising:

extracting selected contributions that are non-communicative from a selected input interface;

removing said selected contributions that are non-communicative from said shared virtual model so that said selected contributions that are non-communicative are not superimposed onto said selected input interface.

4. The method of claim 1, wherein at least one of said plurality of images comprises a video stream.

5. The method of claim 1, wherein said constructing a respective appearance model further comprises:

modeling and removing the background from at least one of said plurality of images.

6. The method of claim 1, wherein said output medium comprises a projector.

7. The method of claim 1, further comprising:

tracking a selected input interface;

adjusting output images associated with said selected input interface from at least one projector system to align with positioning of said selected input interface.

8. The method of claim 1, wherein said combining of said respective appearance models comprises:

layering at least two of said respective appearance models to generate said shared virtual model.

9. The method of claim 8, further comprising:

capturing a new image;

constructing a new layer containing said new image; and

layering said new layer with at least one of said respective appearance models that are layered to generate said shared virtual model.

10. The method of claim 1, further comprising:

detecting a boundary of an input interface to define a corresponding input interface coordinate system.

11. The method of claim 1, further comprising:

separately recording each of said respective appearance models over time; and

recording said shared virtual model over time.

12. The method of claim 11, further comprising:

navigating through a history of said shared virtual model.

13. The method of claim 1, further comprising:

erasing some forms of communication on an input interface; and

manifesting this erasure onto displays of said shared virtual model.

14. The method of claim 1, further comprising:

updating a new form of communication in said respective appearance model when said new form of communication remains static for a period of time.

15. The method of claim 1, further comprising:

enhancing the appearance of at least one of said respective forms of communication in at least one output medium displaying said shared virtual model.

16. The method of claim 1, further comprising:

recognizing a gesture made by a participant in said plurality of images as a control mechanism.

17. The method of claim 1, further comprising:

recognizing a laser pointer light on at least one of said plurality of input interfaces; and

displaying transient forms of communication in at least one of said output medium displaying said shared virtual model based on recognizing said transient forms of communication.

18. The method of claim 1, further comprising:

recognizing digitized forms of communication as inputs to said shared virtual model.

19. A system for communicating through shared media, comprising:

an extractor adapted to receive a plurality of images from respective input interfaces of a plurality of input interfaces captured from at least one camera system, wherein at least one of said plurality of images contributes forms of communication to a shared virtual model, and wherein at least one of said plurality of images is captured using a camera, said extractor for extracting said forms of communication from each of said plurality of images;

an analyzer coupled to said extractor for constructing a respective appearance model corresponding to each of said plurality of input interfaces, wherein at least one of said respective appearance models contributes respective forms of communication that are transformed to a reference frame of a reference coordinate system;

an aggregator coupled to said analyzer for combining each of said respective appearance models together to generate said shared virtual model.

20. The system of claim 19, wherein said extractor extracts selected non-communicative contributions from an image associated with a selected input interface;

and wherein said system further comprises a remover coupled to said aggregator for removing said selected non-communicative contributions from said shared virtual model so that said selected non-communicative contributions are not superimposed onto said selected input interface.

21. The system of claim 19, further comprising:

at least one projector system coupled to said aggregator for projecting said shared virtual model to at least one of said plurality of input interface.

22. The system of claim 21, wherein said at least one projector system comprises:

a single projector projecting said shared virtual model to multiple input interfaces.

23. The system of claim 21, wherein said at least one projector system comprises:

multiple projectors projecting said shared virtual model to a single input interface.

24. The system of claim 19, wherein said plurality of input interfaces is located at a single site.

25. The system of claim 19, wherein said plurality of input interfaces is distributed across at least two or more sites.

26. The system of claim 19, further comprising:

a tracker coupled to said at least one camera system for tracking an input interface to enable images associated with said input interface to be captured successively by at least two camera systems.

27. The system of claim 19, further comprising:

a tracker coupled to said at least one camera system for tracking an input interface to enable said shared virtual model to be projected to said input interface successively by at least two projector systems.

28. The system of claim 19, wherein at least one camera system comprises:

multiple camera systems capturing an image from a single input interface.

29. The system of claim 19, wherein at least one camera system comprises:

a single camera system capturing images from multiple input interfaces.

30. A computer system comprising a processor and a computer readable memory coupled to said processor and comprising program instructions that, when executed, implement a method for communicating through shared media, comprising:

accessing a plurality of images from respective input interfaces of a plurality of input interfaces, wherein at least one of said plurality of images is captured using a camera, and wherein at least one of said plurality of images contains a respective form of communication;

extracting said respective form of communication from said plurality of images;

constructing a respective appearance model corresponding to each of said plurality of input interfaces, wherein at least one of said respective appearance models contributes said respective form of communication that is extracted and transformed to a reference frame of a reference coordinate system;

combining said respective appearance models together to generate a shared virtual model; and

displaying said shared virtual model to at least one output medium.

31. The computer system of claim 30, wherein said displaying said shared virtual model further comprises instructions for performing:

superimposing said shared virtual model onto at least one of said plurality of input interfaces.

32. The computer system of claim 31, wherein said computer readable memory further comprises instructions for performing:

extracting selected contributions that are non-communicative from a selected input interface;

removing said selected contributions that are non-communicative from said shared virtual model so that said selected contributions that are non-communicative are not superimposed onto said selected input interface.

33. The computer system of claim 30, wherein at least one of said plurality of images comprises a video stream.

34. The computer system of claim 30, wherein said constructing a respective appearance model in said computer readable memory further comprises instructions for performing:

modeling and removing the background from at least one of said plurality of images.

35. The computer system of claim 30, wherein said output medium comprises a projector.

36. The computer system of claim 30, wherein said computer readable memory further comprises instructions for performing:

tracking a selected input interface;

adjusting output images associated with said selected input interface from at least one projector system to align with positioning of said selected input interface.

37. A computer readable medium containing program instructions that implements a method for communicating through shared media, comprising:

accessing a plurality of images from respective input interfaces of a plurality of input interfaces, wherein at least one of said plurality of images is captured using a camera, and wherein at least one of said plurality of images contains a respective form of communication;

extracting said respective form of communication from said plurality of images;

constructing a respective appearance model corresponding to each of said plurality of input interfaces, wherein at least one of said respective appearance models contributes said respective form of communication that is extracted and transformed to a reference frame of a reference coordinate system;

combining said respective appearance models together to generate a shared virtual model; and

displaying said shared virtual model to at least one output medium.