INFORMATION PROCESSING DEVICE AND METHOD, PROGRAM AND RECORDING MEDIUM FOR IDENTIFYING A GESTURE OF A PERSON FROM CAPTURED IMAGE DATA

• US 20160282953A1
• Filed: 06/06/2016
• Published: 09/29/2016
• Est. Priority Date: 01/29/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: YAMAOKA, Keisuke, YOKONO, Jun
• Granted Patent: US 9,952,678 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/40 Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

An information processing device includes: an outline extraction unit extracting an outline of a subject from a picked-up image of the subject; a characteristic amount extraction unit extracting a characteristic amount, by extracting sample points from points making up the outline, for each of the sample points; an estimation unit estimating a posture of a high degree of matching as a posture of the subject by calculating a degree of the characteristic amount extracted in the characteristic amount extraction unit being matched with each of a plurality of characteristic amounts that are prepared in advance and represent predetermined postures different from each other; and a determination unit determining accuracy of estimation by the estimation unit using a matching cost when the estimation unit carries out the estimation.

Claims

1. (canceled)

2. :

An information processing apparatus, comprising;

circuitry configured to;

obtain, using an imaging device, an image of at least a part of a human subject; and

control a display to display a joint image of the at least the part of the human subject, the joint image showing a gesture of the at least the part of the human subject in accordance with the obtained image, the joint image including at least two lines joined with each other at a position corresponding to a position of at least one joint of the human subject in the joint image, the at least one joint corresponding to a place at which two parts of the human subject are joined, the two lines being not included in the obtained image obtained by the imaging device.

3. :

The information processing apparatus of claim 2, wherein the circuitry is configured to control the display to display an entire image of the human subject.

4. :

The information processing apparatus of claim 3, wherein the entire image of the human subject is displayed with the joint image.

5. :

The information processing apparatus of claim 3, wherein the circuitry is configured to generate an instruction to control a gaming application in accordance with the gesture.

6. :

The information processing apparatus of claim 2, wherein the circuitry is configured to;

estimate a posture of the human subject; and

determine the gesture based on the estimated posture.

7. :

The electronic device according to claim 2, wherein the electronic device is a user equipment and further comprises a transceiver which is configured to receive radio signals on the special cell and secondary cell.

8. :

The information processing apparatus of claim 2, wherein the circuitry is configured to;

estimate a posture of the human subject;

determine whether the estimated posture corresponds to one of predetermined postures; and

control the display such that the joint image shows the corresponding one of the predetermined postures.

9. :

The information processing apparatus of claim 2, wherein each of the two lines is straight.

10. :

The information processing apparatus of claim 2, wherein the circuitry is configured to control the display to display the two lines not included in the obtained image obtained by the imaging device based on the obtained image.

11. :

A computer-implemented method, comprising;

obtaining, using an imaging device, an image of at least a part of a human subject; and

controlling a display to display a joint image of the at least the part of the human subject, the joint image showing a gesture of the at least the part of the human subject in accordance with the obtained image, the joint image including two lines joined with each other at a position corresponding to a position of at least one joint of the human subject in the joint image, the at least one joint corresponding to a place at which two parts of the human subject are joined, the two lines being not included in the obtained image obtained by the imaging device.

12. :

A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method, comprising;

obtaining, using an imaging device, an image of at least a part of a human subject; and

controlling a display to display a joint image of the at least the part of the human subject, the joint image showing a gesture of the at least the part of the human subject in accordance with the obtained image, the joint image including two lines joined with each other at a position corresponding to a position of at least one joint of the human subject in the joint image, the at least one joint corresponding to a place at which two parts of the human subject are joined, the two lines being not included in the obtained image obtained by the imaging device.