REMOTE MANIPULATION DEVICE AND METHOD USING A VIRTUAL TOUCH OF A THREE-DIMENSIONALLY MODELED ELECTRONIC DEVICE
First Claim
Patent Images
1. A remote control apparatus using a virtual touch of a three-dimensionally modeled electronic device, comprising:
- a 3D coordinate calculation unit extracting 3D coordinate data of a user'"'"'s body and the electronic device using an image received through image photographing;
an electronic device detecting unit recognizing spatial location information and product information of the electronic device using the 3D coordinate data of the electronic device extracted by the 3D coordinate calculation unit and generating a virtual contact point region for a virtual touch with a user and the electronic device based on direction information corresponding to a straight line between the user and the electronic device;
a user detecting unit calculating a virtual touch location and a change of the location for operating the electronic device using the 3D coordinate data of the user'"'"'s body calculated by the 3D coordinate calculation unit and generating a command code for operating a predetermined electronic device based on the change of the virtual touch location that is calculated;
an electronic device driving control unit converting the command code generated by the user detecting unit into a control command signal for operating a corresponding electronic device to transmit an operation command signal to the corresponding electronic device when the command code generated by the user detecting unit is inputted; and
an electronic device information database (DB) storing product information comprising a manufacturer and a model name of the electronic device, protocol information applied to the operation of each product, and operation method information of each electronic device.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed is a remote control apparatus and method using a virtual touch of a three-dimensionally modeled electronic device. The remote control apparatus includes a 3D coordinate calculation unit, an electronic device detecting unit, a user detecting unit, an electronic device driving control unit, and an electronic device information database. The remote control apparatus enables the user to remotely control an operation of an electronic device using a virtual touch through a motion or gesture of the user'"'"'s finger.
-
Citations
17 Claims
-
1. A remote control apparatus using a virtual touch of a three-dimensionally modeled electronic device, comprising:
-
a 3D coordinate calculation unit extracting 3D coordinate data of a user'"'"'s body and the electronic device using an image received through image photographing; an electronic device detecting unit recognizing spatial location information and product information of the electronic device using the 3D coordinate data of the electronic device extracted by the 3D coordinate calculation unit and generating a virtual contact point region for a virtual touch with a user and the electronic device based on direction information corresponding to a straight line between the user and the electronic device; a user detecting unit calculating a virtual touch location and a change of the location for operating the electronic device using the 3D coordinate data of the user'"'"'s body calculated by the 3D coordinate calculation unit and generating a command code for operating a predetermined electronic device based on the change of the virtual touch location that is calculated; an electronic device driving control unit converting the command code generated by the user detecting unit into a control command signal for operating a corresponding electronic device to transmit an operation command signal to the corresponding electronic device when the command code generated by the user detecting unit is inputted; and an electronic device information database (DB) storing product information comprising a manufacturer and a model name of the electronic device, protocol information applied to the operation of each product, and operation method information of each electronic device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A remote control method using a virtual touch of a three-dimensionally modeled electronic device, comprising:
-
(A) extracting 3D coordinate data of a user'"'"'s body and the electronic device using an image received through image photographing; (B) scanning the electronic device using 3D coordinate data according to the electronic device among the calculated 3D coordinate data to perform 3D modeling according to a type of the electronic device; (C) based on the type of the 3D-modeled electric device, comparing the 3D-modeled electronic device with the electronic device information pre-stored in an electronic device information database to detect the corresponding electronic device, and setting a control signal according to the operation of the detected electronic device; (D) matching direction information corresponding to a straight line between the user and the electronic device to generate a virtual contact point region for the virtual touch between the user and the electronic device based on the direction information that is matched; (E) calculating a first spatial coordinate having a 3D coordinate of a tip of a user'"'"'s finger and a second spatial coordinate having a 3D coordinate of a central point of a user'"'"'s eye using the 3D coordinate data of the user'"'"'s body among the calculated 3D coordinate data and calculating contact point coordinate data where a straight line connecting the first spatial coordinate and the second spatial coordinate meets the virtual contact point region that is generated; (F) determining whether or not there is a change of the contact point coordinate data that meets the virtual 2D contact point region that is generated, and when there is a change of the contact point coordinate data, generating and outputting a command code of a predetermined electronic device so as to correspond to the change of the contact point coordinate data; and (G) converting the generated command code into a control command signal for operating a corresponding electronic device to transmit an operation command signal to the corresponding electronic device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
Specification