SYSTEM FOR CONTROLLING DEVICES AND INFORMATION ON NETWORK BY USING HAND GESTURES

• US 20100073287A1
• Filed: 04/03/2009
• Published: 03/25/2010
• Est. Priority Date: 06/25/2008
• Status: Active Grant

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: Lee, Joong-Ho, Jeong, Hee Seok, Shin, Hyun-Jin, Yeom, Ki Won, Lae, Hyung, Park, Ji Hyung
• Granted Patent: US 8,723,792 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

The disclosure relates to a system for controlling devices and information on a network by hand gestures, and more particularly, to a system for controlling devices and information on a network by hand gestures in which a device or a file to be controlled is selected by a user and a display device is pointed so that information and data can be shared and that various devices can be coupled to each other easily and can be controlled easily.

The system for controlling devices and information on a network by hand gestures can remarkably improve the interaction between various input and display devices and a user under a ubiquitous computing environment.

Claims

1. A system for controlling devices and information on a network by hand gestures,

comprising:

a control device for searching a data input or a file selection;

a controlled device for interpreting data transferred from the control device to display

the interpreted data; and

a management server for, when a control device is selected by a user and when a controlled device is pointed by a hand gesture of the user, analyzing the hand gesture of pointing the controlled device and network coupling the selected control device and the pointed controlled device to each other.

2. The system as claimed in claim 1, wherein the management server comprises:

a coupling management module for controlling network coupling based on an

Internet protocol (IP) address and a port number of the control device; and

a gesture sensing module for analyzing vision information of photographing a hand gesture of a user and interpreting the hand gesture of the user.

3. The system as claimed in claim 1, further comprising a camera for photographing a hand gesture of a user and for providing a filtered image based on an algorithm of searching and tracking a hand or an end of a finger to the management server.

4. The system as claimed in claim 1, further comprising a camera for photographing the controlled device and for providing an image for tracking a position of the controlled device to the management server.

5. The system as claimed in claim 3, wherein the camera is a universal serial bus (USB) web camera or a network camera.

6. The system as claimed in claim 1, wherein the control device is a virtual keyboard or mouse on a table top display, and wherein an icon is generated for virtual coupling on the table top display by an user, the icon is attached to the virtual keyboard or mouse, and the controlled device is pointed by a hand gesture to connect the pointed controlled device.

7. The system as claimed in claim 1, wherein the management server performs network coupling between at least one control device and at least one controlled device by sensing at least two hand gestures.

13. The system as claimed in claim 4, wherein the camera is a universal serial bus (USB) web camera or a network camera.

8. A networking method of devices by hand gestures, comprising:

searching a data input or a file selection by at least one control device;

pointing at least one controlled device by a hand gesture of a user;

analyzing the hand gesture of pointing the controlled device sensing the pointed controlled device; and

network coupling the sensed controlled device and the control device to each other.

9. The networking method as claimed in claim 8, wherein, in sensing the pointed controlled device, the pointed controlled device is sensed based on hand gesture direction information obtained by analyzing a vision information photographing a hand gesture of a user and based on previously stored information on positions of controlled devices.

10. The networking method as claimed in claim 8, wherein, in sensing the pointed controlled device, the pointed controlled device is sensed based on hand gesture direction information obtained by analyzing a vision information photographing a hand gesture of a user and based on information on positions of controlled devices obtained by analyzing from an image of photographing the controlled devices.

11. The networking method as claimed in claim 8, wherein, in network coupling the sensed controlled device and the control device to each other, network coupling is performed by using a network identification address of the control device and a network identification address of the controlled device.

12. The networking method as claimed in claim 8, further comprising controlling the controlled device by the control device using the coupled network.