Input user interface device, projecting device, command deciding method and program storage medium storing command deciding method program

• US 9,213,411 B2
• Filed: 03/18/2013
• Issued: 12/15/2015
• Est. Priority Date: 03/21/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Takasu, Akihide
• Primary Examiner(s): Siddiqui, Saiful A
• Application Number:
  US13/846,600
• Publication Number:
  US 20130249790A1
• Time in Patent Office: 1,002 Days
• Field of Search: 345156-158, 345165-168, 345173-179, 463 37- 38, 178 1801- 1809
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An input user interface device includes an image pickup unit which picks up an image including an object image, a shape detection unit which detects a shape of the object image in the image picked up by the image pickup unit, a determination unit which determines whether the shape of the object image detected by the shape detection unit corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position data, and a command deciding unit which decides the gesture command or the position designation command on the basis of the decision by the deciding unit.

Claims

1. An input user interface device comprising:

an electronic camera which captures an image including an object image;

a shape detection unit which detects a shape of the object image in the image captured by the electronic camera;

a determination unit which determines whether a single shape of the object image detected by the shape detection unit corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position;

a position detection unit which detects a position of the object image in each of a plurality of frames of the image captured by the electronic camera;

a gesture detection unit which detects a gesture of the object image in the image based on sequentially detected positions of the object image in the plurality of frames detected by the position detection unit; and

a controller which decides whether a single input corresponds to (i) the gesture command, based on the determination by the determination unit with respect to the single shape, data obtained via the position detection unit, and data obtained via the gesture detection unit, or (ii) the position designation command, based on the determination by the determination unit with respect to the single shape,

wherein the controller does not use the data obtained by the gesture detection unit when deciding whether the single input corresponds to the position designation command.

2. The input user interface device according to claim 1, wherein the controller decides that the single input corresponds to the gesture command, when the determination unit determines that the single shape corresponds to a reference shape associated with the gesture command and the gesture detected by the gesture detection unit corresponds to a reference gesture associated with the gesture command.

3. The input user interface according to claim 2, further comprising a shape storage unit which stores the reference shape associated with the gesture command,

wherein the determination unit determines whether the single shape of the object image detected by the shape detection unit corresponds to the reference shape associated with the gesture command by comparing the reference shape stored in the shape storage unit and the single shape of the object image detected by the shape detection unit.

4. The input user interface device according to claim 2, further comprising a gesture storage unit which stores the reference gesture as data of a position difference associated with the gesture command,

wherein the unit controller determines whether the gesture detected by the gesture detection unit corresponds to the reference gesture associated with the gesture command by comparing the reference gesture stored in the gesture storage unit and the gesture detected by the gesture detection unit.

5. The input user interface device according to claim 1, wherein the controller decides that the single input corresponds to the position designation command, when the determination unit determines that the single shape corresponds to a reference shape associated with the position designation command.

6. The input user interface device according to claim 5, further comprising a shape storage unit which stores the reference shape associated with the position designation command,

wherein the determination unit determines whether the single shape of the object image detected by the shape detection unit corresponds to the reference shape associated with the position designation command by comparing the reference shape stored in the shape storage unit and the single shape of the object image detected by the shape detection unit.

7. The input user interface according to claim 5, wherein the controller decides that the single input corresponds to the position designation command for designating the position detected by the position detection unit, when the determination unit determines that the single shape corresponds to the reference shape associated with the position designation command.

8. The input user interface device according to claim 5, wherein the reference shape is a pointing shape of a hand.

9. The input user interface device according to claim 1, wherein one of a cursor and a pointer is displayed at the position detected by the position detection unit, when the controller decides that the single input corresponds to the position designation command based on the single shape of the object image being determined by the determination unit to be associated with the position designation command.

10. A projecting device, comprising:

an input user interface device comprising;

an electronic camera which captures an image including an object image;

a shape detection unit which detects a shape of the object image in the image captured by the electronic camera;

a determination unit which determines whether a single shape of the object image detected by the shape detection unit corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position;

a position detection unit which detects a position of the object image in each of a plurality of frames of the image captured by the electronic camera;

a gesture detection unit which detects a gesture of the object image in the image based on sequentially detected positions of the object image in the plurality of frames detected by the position detection unit; and

a controller which decides whether a single input corresponds to (i) the gesture command, based on the determination by the determination unit with respect to the single shape, data obtained via the position detection unit, and data obtained via the gesture detection unit, or (ii) the position designation command, based on the determination by the determination unit with respect to the single shape,

wherein the controller does not use the data obtained by the gesture detection unit when deciding whether the single input corresponds to the position designation command; and

a projecting device body which receives a video signal from an external device and projects image data represented by the received video signal,

wherein the input of the gesture command decided by the controller is a control command for the projecting device body.

11. The projecting device according to claim 10, further comprising a correction parameter calculation unit which detects an outer shape of an image area captured by the electronic camera and projected by the projecting device body and calculates a correction parameter based on the outer shape,

wherein the projecting device body comprises a video signal processing unit which executes distortion correction through coordinate conversion of the image area represented by the video signal based on the correction parameter calculated by the correction parameter calculation unit.

12. A method for deciding a command, the method comprising:

capturing an image including an object image using an electronic camera;

detecting a shape of the object image in the image captured in the capturing;

determining whether a single shape detected in the detecting corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position;

detecting a position of the object image in each of a plurality of frames of the image captured in the capturing;

detecting a gesture of the object image in the image based on sequentially detected positions of the object image in the plurality of frames; and

deciding, by a controller, whether a single input corresponds to (i) the gesture command, based on the determination with respect to the single shape, data obtained via the detecting the position of the object image, and data obtained via the detecting the gesture of the object image, or (ii) the position designation command based on the determination with respect to the single shape,

wherein the deciding whether the single input corresponds to the position designation command is not based on the data obtained via the detecting the gesture of the object image.

13. A non-transitory computer readable recording medium having a program stored thereon to control a computer to execute a procedure, the computer receiving an image input from an electronic camera which captures an image including an object image, and the procedure comprising:

capturing an image including an object image;

detecting a shape of the object image in the image captured by the electronic camera;

determining whether a single shape of the object image detected by the shape detection unit corresponds to a shape associated with a gesture command or a shape associated with a position designation command for designating a position;

detecting a position of the object image in each of a plurality of frames of the image captured by the electronic camera;

detecting a gesture of the object image in the image based on sequentially detected positions of the object image in the plurality of frames; and

deciding, by a controller, whether a single input corresponds to (i) the gesture command, based on the determination with respect to the single shape, data obtained via the detecting the position of the object image, and data obtained via the detecting the gesture of the object image, or (ii) the position designation command based on the determination with respect to the single shape,

wherein the deciding, by the controller, whether the single input corresponds to the position designation command is not based on the data obtained via the detecting the gesture of the object image.