Input apparatus, input method, and program

• US 10,168,769 B2
• Filed: 09/20/2016
• Issued: 01/01/2019
• Est. Priority Date: 09/28/2015
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Norieda, Shin, Yoshimoto, Makoto, Saida, Yoshinori
• Primary Examiner(s): Marinelli, Patrick F
• Application Number:
  US15/759,997
• Publication Number:
  US 20180260033A1
• Time in Patent Office: 833 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An input apparatus (2000) includes a motion detection unit (2020) and an input recognition unit (2040). The motion detection unit (2020) detects motion of an object by using a captured image including the object. Here, the detected motion of the object is motion of the object in a period defined based on a result of detection by a sensor attached to the body of a user of the input apparatus (2000). The input recognition unit (2040) recognizes input to an information processing apparatus based on the detected motion of the object.

Claims

1. An input apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to;

detect motion of an object by using a captured image, that includes the object, in a period defined based on a result of detection of a touch to a body of a user by a sensor attached to the body of the user; and

recognize input to an information processing apparatus based on the detected motion of the object,

wherein the processor is further configured to detect a marker from the captured image, define a partial region of the captured image based on the marker, and detect motion of the object in the partial region of the captured image,

wherein the marker is a predetermined image displayed on a display device of a device attached to the body of the user.

2. The input apparatus according to claim 1, wherein the sensor is a vibration sensor, an acceleration sensor, a vibration switch, a pressure sensor, or an electrostatic capacitance sensor.

3. The input apparatus according to claim 1, wherein the processor is further configured to detect the touch to the body of the user by detecting a vibration being applied to the body of the user using the sensor.

4. The input apparatus according to claim 1, wherein the processor is further configured to determine at least one of a start point and an end point of motion of the object to be detected by using a detection timing of the sensor.

5. The input apparatus according to claim 1, wherein the object is a part of the body of the user or a device provided with the sensor.

6. The input apparatus according to claim 1, wherein the processor is further configured to recognize input drawing a first region based on motion of the object, and

wherein the processor is further configured to:

display on a display screen a second region defined based on the first region; and

extract a partial image included in a range corresponding to the second region from a captured image.

7. The input apparatus according to claim 6,

wherein the processor is further configured to:

display the second region on the display screen so as to be superimposed on the captured image; and

extract the partial image from a range the second region being superimposed on the captured image displayed on the display screen.

8. The input apparatus according to claim 1, wherein the processor is further configured to:

convert position of the object in the captured image into a coordinate in a coordinate system determined based on the marker, and

detect changed in the position of the object in the coordinate system as the motion of the object.

9. An input method executed by a computer, the method comprising:

detecting motion of an object by using a captured image, that includes the object, in a period defined based on a result of detection of a touch to a body of a user by a sensor attached to the body of the user; and

recognizing input to an information processing apparatus based on the detected motion of the object,

wherein the method further comprises detecting a marker from the captured image, defining a partial region of the captured image based on the marker, and detecting motion of the object in the partial region of the captured image,

wherein the marker is a predetermined image displayed on a display device of a device attached to the body of the user.

10. A non-transitory computer-readable storage medium storing a program causing a computer to execute each step in the input method according to claim 9.