COMMAND ISSUING DEVICE, METHOD AND COMPUTER PROGRAM PRODUCT

• US 20130086531A1
• Filed: 06/01/2012
• Published: 04/04/2013
• Est. Priority Date: 09/29/2011
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Sugita, Kaoru, Mihara, Isao, Hirakawa, Daisuke
• Application Number:
  US13/486,295
• Publication Number:
  US 20130086531A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

According to an embodiment, a command issuing device includes an acquiring unit configured to acquire a moving image by capturing a hand of an operator; a projection area recognizer configured to recognize a projection area of a projection finger in the moving image; a projector configured to project one of pictures of a graphical user interface (GUI) onto the projection area; an operation area recognizer configured to recognize an operation area of an operation finger in the moving image; a selection determining unit configured to measure an overlapping degree of the projection area and the operation area to determine whether or not the GUI is selected; and a issuing unit configured to issue a command associated with the GUI when it is determined that the GUI is selected.

Claims

1. A command issuing device comprising:

an acquiring unit configured to acquire a moving image by capturing a hand of an operator;

a projection area recognizer configured to recognize a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

a projector configured to project one of the pictures of the GUI onto the projection area;

an operation area recognizer configured to recognize an operation area of an operation finger in the moving image, the operation finger being one of fingers which is assigned to operate the GUI;

a selection determining unit configured to measure an overlapping degree of the projection area and the operation area to determine whether or not the GUI is selected; and

a issuing unit configured to issue a command associated with the GUI when it is determined that the GUI is selected.

2. The device according to claim 1, wherein the projection area has a plurality of sub projection areas, and the projector projects a plurality of GUI pictures onto the sub projection areas.

3. The device according to claim 1, wherein the projection area is an area represented by a shape feature value of the projection finger.

4. The device according to claim 1, further comprising:

a switching determining unit configured to determine whether to switch the picture of GUI projected on the projection area on the basis of a posture of the hand; and

a switch configured to switch the GUI to be projected onto the projection area, wherein

the projector projects a picture of GUI resulting from switching onto the projection area.

5. The device according to claim 1, wherein the projector projects a feedback picture for the picture of GUI projected on the projection area with which the operation area overlaps onto any area of the hand.

6. The device according to claim 1, further comprising an assignment determining unit configured to determine assignment of GUIs to the projection area, wherein

the projector projects the picture of GUI onto the projection area according to the determined assignment.

7. A command issuing device comprising:

an acquiring unit configured to acquire a moving image by capturing a hand of an operator;

a projection area recognizer configured to recognize a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

a projector configured to project one of the pictures of the GUI onto the projection area;

a selection determining unit configured to measure a bending degree of the projection finger to determine whether or not the GUI is selected; and

a issuing unit configured to issue a command associated with the GUI when it is determined that the GUI is selected.

8. The device according to claim 7, wherein the projection area is an area represented by a shape feature value of the projection finger.

9. The device according to claim 7, further comprising:

a switching determining unit configured to determine whether to switch the picture of GUI projected on the projection area on the basis of a posture of the hand; and

a switch configured to switch the GUI to be projected onto the projection area, wherein

the projector projects a picture of GUI resulting from switching onto the projection area.

10. The device according to claim 7, wherein the projector projects a feedback picture for the picture of GUI projected on the projection area with which the operation area overlaps onto any area of the hand.

11. The device according to claim 7, further comprising an assignment determining unit configured to determine assignment of GUIs to the projection area, wherein

the projector projects the picture of GUI onto the projection area according to the determined assignment.

12. A command issuing method comprising:

acquiring a moving image by capturing a hand of an operator;

recognizing a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

projecting one of the pictures of the GUI onto the projection area;

recognizing an operation area of an operation finger in the moving image, the operation finger being one of fingers which is assigned to operate the GUI;

measuring an overlapping degree of the projection area and the operation area to determine whether or not the GUI is selected; and

issuing a command associated with the GUI when it is determined that the GUI is selected.

13. A command issuing method comprising:

acquiring a moving image by capturing a hand of an operator;

recognizing a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

projecting one of the pictures of the GUI onto the projection area;

measuring a bending degree of the projection finger to determine whether or not the GUI is selected; and

issuing a command associated with the GUI when it is determined that the GUI is selected.

14. A computer program product comprising a computer-readable medium including program instructions, wherein the instructions, when executed by a computer, cause the computer to execute:

acquiring a moving image by capturing a hand of an operator;

recognizing a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

projecting one of the pictures of the GUI onto the projection area;

recognizing an operation area of an operation finger in the moving image, the operation finger being one of fingers which is assigned to operate the GUI;

measuring an overlapping degree of the projection area and the operation area to determine whether or not the GUI is selected; and

issuing a command associated with the GUI when it is determined that the GUI is selected.

15. A computer program product comprising a computer-readable medium including program instructions, wherein the instructions, when executed by a computer, cause the computer to execute:

acquiring a moving image by capturing a hand of an operator;

recognizing a projection area of a projection finger in the moving image, the projection finger being one of fingers onto which one of pictures of a graphical user interface (GUI) is projected;

projecting one of the pictures of the GUI onto the projection area;

measuring a bending degree of the projection finger to determine whether or not the GUI is selected; and

issuing a command associated with the GUI when it is determined that the GUI is selected.