NETWORK MANAGEMENT USING INTERACTION WITH DISPLAY SURFACE

• US 20100149096A1
• Filed: 12/17/2008
• Published: 06/17/2010
• Est. Priority Date: 12/17/2008
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kleinhanzl, Afshan A., Neufeld, Nadav M., Mettifogo, Gionata, Migos, Charles J.
• Application Number:
  US12/337,465
• Publication Number:
  US 20100149096A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A computing system is provided to make managing the devices and content on a network easier by making the process intuitive, tactile and gestural. The computing system includes a display surface for graphically displaying the devices connected to a network and the content stored on those devices. A sensor is used to recognize activity on the display surface so that gestures may be used to control a device on the network and transport data between devices on the network. Additionally, new devices can be provided access to communicate on the network based on interaction with the display device.

Claims

1. A method for controlling a device on a network, comprising:

displaying, on a display surface of a first device, images representing a set of devices that can communicate on a network;

automatically sensing an object adjacent to the display surface;

automatically determining that a first type of gesture of a plurality of types of gestures is being performed by the object adjacent to the surface;

identifying a command associated with the first type of gesture; and

generating a communication and sending the communication from the first device to a target device via the network to cause the target device to perform the command in response to determining that the first type of gesture is being performed, the target device is different than the first device, the set of devices that can communicate on the network includes the target device.

2. The method of claim 1, further comprising:

automatically determining that a second type of gesture of the plurality of types of gestures is being performed by the object on the surface; and

determining that the second type of gesture indicates a selection of the target device.

3. The method of claim 1, wherein:

the first type of gesture includes the presence of the object over an image on the display surface corresponding to the target device.

4. The method of claim 1, wherein:

each of the plurality of types of gestures is associated with a different command that can be performed on more than one of the devices that can communicate on the network; and

the method further comprises automatically determining other type of gestures of a plurality of types of gestures are being performed at different times by the object and sending additional communications to different devices via the network to cause the different devices to perform different commands.

5. The method of claim 1, wherein:

the generating a communication includes generating a communication that requests that the target device to play content stored on another device.

6. The method of claim 1, further comprising:

automatically identifying a selection gesture by the object that selects a source device, the set of devices that can communicate on the network includes the source device, the generating a communication includes generating a communication that requests that the target device play content stored on the source device, the source device is different than the target device.

7. The method of claim 6, further comprising:

automatically determining that the target device is selected for the command based on sensed movement of the object.

8. The method of claim 7, wherein:

set of devices that can communicate on the network includes the first device;

the object is a human hand;

the first type of gesture includes the presence of the object over an image on the display surface corresponding to the target device;

each of the plurality of types of gestures is associated with a different command that can be performed on more than one of the devices that can communicate on the network; and

the method further comprises automatically determining other type of gestures of a plurality of types of gestures are being performed at different times by the object on the surface and sending additional communications to different devices via the network to cause the different devices to perform different commands.

9. The method of claim 1, further comprising:

automatically identifying a selection gesture by the object that selects a source device, the set of devices that can communicate on the network includes the source device, the generating a communication includes generating a communication that requests that the target device play content streamed from the source device, the source device is different than the target device; and

automatically determining that the target device is selected for the command based on sensed movement of the object.

10. The method of claim 1, wherein:

the object is a human hand.

11. A method for controlling a device on a network, comprising:

displaying, on a display surface of a first device, images representing a set of networked devices that can communicate on a network;

automatically sensing an object adjacent to the display surface;

automatically determining that a first type of gesture of a plurality of types of gestures is being performed by the object adjacent to the surface;

identifying a command associated with the first type of gesture; and

generating a communication and sending the communication from the first device to at least one of a set of selected devices via the network, the communication includes information to cause the selected devices to implement a data relationship that includes repeated transfer of data based on a set of one or more rules associated with the data relationship.

12. The method of claim 11, further comprising:

automatically identifying a gesture by the object above an image of a first device on the display surface that selects the first device, the set of selected devices includes the first device; and

automatically identifying a gesture by the object above an image of a second device on the display surface that selects the second device of the set of selected devices, the set of selected devices includes the second device.

13. The method of claim 11, further comprising:

graphically depicting the data relationship on the display surface using a first image on the display surface.

14. The method of claim 13, further comprising:

automatically identifying a particular gesture by the object at or near the first image;

providing configuration options in response to identifying the particular gesture;

receiving configuration information; and

configuring the data relationship based on the configuration information.

15. The method according to claim 11, wherein:

the communication includes information to cause the selected devices to implement synchronization between the selected devices.

16. The method according to claim 11, wherein:

the communication includes information to cause the selected devices to implement backup process.

17. An apparatus for providing communication on a network, comprising:

one or more processors;

one or more storage devices in communication with the one or more processors;

a network interface in communication with the one or more processors;

a display surface in communication with the one or more processors; and

a sensor in communication with the one or more processors, the sensor senses data indicating presence of a communication device on the display surface that is not directly connected to the network;

the one or more processors recognize the communication device on the display surface that is not directly connected to the network, determine how to communicate with the communication device on the display surface and relay data between the communication device on the display surface that is not directly connected to the network and at least one other device on the network.

18. The apparatus of claim 17, wherein:

the one or more processors relay the data by communicating with the communication device without using the network and communicating with the at least one other device on the network using the network.

19. The apparatus of claim 17, wherein:

the sensor senses a gesture by an object adjacent to the display surface;

the one or more processors recognizes the gesture and identify a function to be performed; and

the one or more processors cause the function to be performed with respect to the communication device and another device on the network.

20. The apparatus of claim 17, wherein:

the sensor senses different gestures by a body adjacent to the display surface;

the one or more processors recognize the different gestures from a set of possible gestures;

the one or more processors identify different functions to be performed for the different gestures; and

the one or more processors causes the different functions to be performed with respect to the communication device and at least one other device on the network.