Apparatus and method for remote control using camera-based virtual touch

• US 10,642,372 B2
• Filed: 01/29/2019
• Issued: 05/05/2020
• Est. Priority Date: 02/22/2014
• Status: Active Grant

• Current Assignee: Vtouch Co Ltd
• Original Assignee: Vtouch Co Ltd
• Inventors: Kim, Seok-joong
• Primary Examiner(s): Hong, Richard J
• Application Number:
  US16/260,661
• Publication Number:
  US 20190163284A1
• Time in Patent Office: 462 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A remote control apparatus comprises an image acquisition unit for acquiring an image of the body of a user by photographing the image, a location calculation unit for calculating coordinate data representing the locations of a first coordinate (eye) and a second coordinate (a finger or a pointer) of the body of the user by means of the image received from the image acquisition unit, and a match confirmation unit for checking whether the locations of the first and second coordinates of the body of the user match the extended connecting straight line, the coordinates having been confirmed on the basis of the camera lens-based coordinate data calculated in the location calculation unit, and if the match is confirmed, then concluding the setup intention of the user to be an affirmative.

Claims

1. A remote control method using a camera-based virtual touch, comprising the steps of:

(a) obtaining a 2D image of an user'"'"'s body by a camera, and calculating coordinate data indicating positions of first coordinates and second coordinates of the user'"'"'s body based on the 2D image of the user'"'"'s body,

(b) determining whether the position of the second coordinates of the user'"'"'s body substantially identical to the position of the first coordinates of the user'"'"'s body on the 2D image based on the calculated coordinate data,

(c) detecting a variation in the obtained coordinate data of the first coordinates and second coordinates to detect the user'"'"'s motion in response to determination that the position of the second coordinates of the user'"'"'s body is substantially identical to the position of the first coordinates of the user'"'"'s body on the 2D image, and

(d) generating a control command signal for controlling or selecting a particular icon displayed on an electronic device based on the detected motion, and sending the control command signal to the electronic device,

wherein the first coordinates are coordinates of an eye of the user'"'"'s body, and the second coordinates are coordinates of a finger of the user'"'"'s body or a pointer,

wherein the calculated coordinate data is 2D data and is coordinate data at a position viewed from lens of the camera, and

wherein the particular icon to be selected or controlled is determined based on the position of the second coordinates relative to the position of the first coordinates on the 2D image after the variation in the obtained coordinate data of the first coordinates and second coordinates.

2. A remote control apparatus using a camera-based virtual touch, comprising:

position calculator, obtaining a 2D image of an user'"'"'s body by a camera and calculating coordinate data indicating positions of first coordinates and second coordinates of the user'"'"'s body based on the 2D image of the user'"'"'s body,

a matching identifier, determining whether the position of the second coordinates of the user'"'"'s body substantially identical to the position of the first coordinates of the user'"'"'s body on the 2D image based on the calculated coordinate data, and

a virtual touch setting unit, detecting a variation in the obtained coordinate data of the first coordinates and second coordinates to detect the user'"'"'s motion in response to determination that the position of the second coordinates of the user'"'"'s body is substantially identical to the position of the first coordinates of the user'"'"'s body on the 2D image, generating a control command signal for controlling or selecting a particular icon displayed on an electronic device based on the detected motion, and sending the control command signal to the electronic device,

wherein the first coordinates are coordinates of an eye of the user'"'"'s body, and the second coordinates are coordinates of a finger of the user'"'"'s body or a pointer,

wherein the calculated coordinate data is 2D data and is coordinate data at a position viewed from lens of the camera, and

wherein the particular icon to be selected or controlled is determined based on the position of the second coordinates relative to the position of the first coordinates after the variation in the obtained coordinate data of the first coordinates and second coordinates.