Communicating between a virtual area and a physical space

• US 9,182,883 B2
• Filed: 07/20/2012
• Issued: 11/10/2015
• Est. Priority Date: 01/15/2009
• Status: Active Grant

• Current Assignee: Sococo, Inc.
• Original Assignee: Social Communications Company
• Inventors: Van Wie, David
• Primary Examiner(s): Mamo, Elias
• Application Number:
  US13/554,051
• Publication Number:
  US 20130024785A1
• Time in Patent Office: 1,208 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06Q 50/60 Business processes related to postal services shipping G06Q10/083; franking apparatus G07B17/00
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04M 2201/42 Graphical user interfaces
• CPC Class Codes: H04M 2203/1025 of avatars
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Apparatus transmits an identifier for association with a virtual area by an administering network service, generates output data from human perceptible stimulus in a physical space, transmits the output data in connection with the virtual area, receives input data associated with the virtual area, and generates human perceptible stimulus in the physical space from the input data. A persistent association is created between the apparatus and a virtual area. A respective presence is established in the virtual area for a communicant operating a client network node connected to the virtual area. A respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus are administered in association with the virtual area. A client network node displays a graphical user interface, establishes the administered connections, and presents interaction controls associated with the object for interacting with communicants in the physical space.

Claims

1. A method, comprising:

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type;

based on receipt of a login request identifying the apparatus, establishing a presence in the virtual area for the apparatus;

representing the presence of the apparatus in the virtual area, wherein the representing comprises associating with the apparatus a first visualization when the apparatus is in a first state, and associating with the apparatus a second visualization different from the first visualization when the apparatus is in a second state;

based on receipt of a login request identifying a communicant operating a client network node, instigating a presence in the virtual area for the communicant, wherein the instigating comprises generating a representation of the communicant in the virtual area, and the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

based on copresence of the apparatus and the communicant in the virtual area, administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node.

2. The method of claim 1, wherein the association between the apparatus and the virtual area is independent of any particular communicant.

3. The method of claim 1, further comprising receiving a globally unique identifier of the apparatus, and wherein the creating comprises associating the identifier with the virtual area.

4. The method of claim 3, further comprising:

in response to receipt of a login request comprising the identifier, initiating the virtual area to enable the virtual area to be communicant accessible.

5. The method of claim 1, wherein the virtual area comprises multiple zones each of which supports establishment of a respective presence for one or more communicants, and the creating comprises associating the apparatus with a respective one of the zones.

6. The method of claim 1, further comprising associating the apparatus with an object in the virtual area.

7. The method of claim 6, further comprising associating the object with a graphical representation of the apparatus, and transmitting to the client network node a specification for displaying the graphical representation of the apparatus in spatial relation to a graphical representation of the virtual area.

8. The method of claim 7, further comprises transmitting to the client network node specifications for displaying different states of the apparatus in the virtual area.

9. The method of claim 8, wherein the transmitting comprises:

based on a determination that that the apparatus source is in an active state, transmitting to the client network node a specification of the first visualization; and

based on a determination that the apparatus source is in an inactive state, transmitting to the client network node a specification of the second visualization.

10. The method of claim 7, further comprising:

based on communicant input in connection with the object, administering a connection between an audio source of the client network node and an audio sink of the apparatus.

13. The apparatus of claim 1, wherein the administering comprising administering between each active pair of complementary sources and sinks of the client network node and the apparatus respective connections that bridge communicant activity in the physical space into the virtual area and bridge communicant activity in the virtual area into the physical space.

14. The apparatus of claim 13, wherein the administering comprising administering connections that relay data corresponding to communicant activity in the physical space from the apparatus source to the client network node.

15. The apparatus of claim 13, wherein the administering comprising administering connections that relay data from the client network node corresponding to communicant activity in the virtual area node to the apparatus sink.

16. The method of claim 1, wherein the apparatus source corresponds to a transducer that transforms human perceptible stimulus that is broadcasted into the physical space into output data of the respective data stream content type.

17. The method of claim 1, wherein the apparatus source corresponds to a transducer that transforms input data of the respective data stream content type into human perceptible stimulus that is broadcasted into the physical space.

18. The method of claim 1, wherein the apparatus source comprises a microphone and the apparatus sink comprises a speaker, wherein the microphone is operable to generate output voice data from human voice sound projected into the physical space, the speaker is operable to project human voice sound into the physical space from input voice data associated with the virtual area, and the administering comprises administering connections that relay the output voice data from the apparatus to the client network node and that relay the input voice data from the client network node to the apparatus.

19. The method of claim 1, wherein the apparatus source comprises a camera operable to perform operations comprising capturing images of a scene in the physical space and generating output image data from the captured images, and the administering comprises administering a connection that relays the output image data from the apparatus to the client network node.

20. The method of claim 1, wherein the apparatus sink comprises a projector operable to perform operations comprising projecting images into the physical space, and the administering comprises administering a connection that relays input control data for controlling the projecting from the client network node to the apparatus.

22. The method of claim 1, further comprising receiving audio data from the apparatus source, and associating the audio data with a communicant in the physical space based on comparison of the audio data with one or more voice data records associated with respective communicants.

23. The method of claim 1, further comprising establishing a respective presence in the virtual area for a particular communicant based on a determination that the particular communicant is in the physical space.

24. The method of claim 23, further comprising receiving location data that is associated with the particular communicant, and determining that the particular communicant is in the physical space based on comparison of the received location data with location data associated with the physical space.

25. The method of claim 1, further comprising creating a persistent association between the physical space and the virtual area.

11. A method, comprising:

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type;

associating the apparatus with an object in the virtual area, and associating the object with a graphical representation of the apparatus;

establishing a respective presence in the virtual area for a communicant operating a client network node connected to the virtual area, wherein the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

transmitting to the client network node a specification for displaying the graphical representation of the apparatus in spatial relation to a graphical representation of the virtual area;

administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus in association with the virtual area, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node; and

based on communicant input in connection with the object, administering a connection between an application sharing source of the client network node and an image projection sink of the apparatus.

12. A method, comprising:

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type;

associating the apparatus with an object in the virtual area, and associating the object with a graphical representation of the apparatus;

establishing a respective presence in the virtual area for a communicant operating a client network node connected to the virtual area, wherein the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

transmitting to the client network node a specification for displaying the graphical representation of the apparatus in spatial relation to a graphical representation of the virtual area;

administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus in association with the virtual area, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node; and

based on communicant input in connection with the object, administering a connection between a laser pointer control source of the client network node and a laser pointer control sink of the apparatus.

21. A method, comprising:

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type, wherein the apparatus sink comprises a laser pointer operable to perform operations comprising projecting a laser beam into the physical space;

establishing a respective presence in the virtual area for a communicant operating a client network node connected to the virtual area, wherein the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus in association with the virtual area, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node, and the administering comprises administering a connection that relays input control data for controlling the projecting of the laser beam from the client network node to the apparatus.

26. Apparatus, comprising:

a memory storing processor-readable instructions; and

a processor coupled to the memory, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type;

based on receipt of a login request identifying the apparatus, establishing a presence in the virtual area for the apparatus;

representing the presence of the apparatus in the virtual area, wherein the representing comprises associating with the apparatus a first visualization when the apparatus is in a first state, and associating with the apparatus a second visualization different from the first visualization when the apparatus is in a second state;

based on receipt of a login request identifying a communicant operating a client network node, instigating a presence in the virtual area for the communicant, wherein the instigating comprises generating a representation of the communicant in the virtual area, and the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

based on copresence of the apparatus and the communicant in the virtual area, administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node.

27. At least one non-transitory computer-readable medium having computer-readable program code that, when executed by a computer system, causes the computer system to perform operations comprising:

creating between an apparatus in a physical space and a virtual area a persistent association that persists even after all communicants and the apparatus have disconnected from the virtual area, wherein the apparatus has an apparatus source of a respective data stream content type and an apparatus sink of a respective data stream content type;

based on receipt of a login request identifying the apparatus, establishing a presence in the virtual area for the apparatus;

representing the presence of the apparatus in the virtual area, wherein the representing comprises associating with the apparatus a first visualization when the apparatus is in a first state, and associating with the apparatus a second visualization different from the first visualization when the apparatus is in a second state;

based on receipt of a login request identifying a communicant operating a client network node, instigating a presence in the virtual area for the communicant, wherein the instigating comprises generating a representation of the communicant in the virtual area, and the client network node has a client sink that is complementary to the apparatus source and a client source that is complementary to the apparatus sink;

based on copresence of the apparatus and the communicant in the virtual area, administering a respective connection between each active pair of complementary sources and sinks of the client network node and the apparatus, wherein each connection supports transmission of the respective data stream content type between the apparatus and the client network node.