Information processing device and method, program and recording medium for identifying a gesture of a person from captured image data

• US 9,952,678 B2
• Filed: 06/06/2016
• Issued: 04/24/2018
• Est. Priority Date: 01/29/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamaoka, Keisuke, Yokono, Jun
• Primary Examiner(s): NGUYEN, LUONG TRUNG
• Application Number:
  US15/174,585
• Publication Number:
  US 20160282953A1
• Time in Patent Office: 687 Days
• CPC Class Codes: A63F 13/40 Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

An information processing device includes: an outline extraction unit extracting an outline of a subject from a picked-up image of the subject; a characteristic amount extraction unit extracting a characteristic amount, by extracting sample points from points making up the outline, for each of the sample points; an estimation unit estimating a posture of a high degree of matching as a posture of the subject by calculating a degree of the characteristic amount extracted in the characteristic amount extraction unit being matched with each of a plurality of characteristic amounts that are prepared in advance and represent predetermined postures different from each other; and a determination unit determining accuracy of estimation by the estimation unit using a matching cost when the estimation unit carries out the estimation.

Claims

1. An information processing apparatus, comprising:

circuitry configured to;

obtain, using an imaging device, an image of at least a part of a human subject;

estimate a position of a joint of the human subject based on the obtained image, the joint being a place at which two parts of the human subject are joined;

output, using a plurality of points and lines indicative of the estimated position of the joint, data indicative of the estimated position of the joint of the human subject as an estimation result; and

estimate a posture of the human subject based on the output data.

2. The information processing apparatus of claim 1, wherein the circuitry is configured to output the image of the at least a part of the human subject.

3. The information processing apparatus of claim 2, wherein the circuitry is configured to output the data indicative of the estimated position of the joint of the human subject as an estimation result by overlapping the plurality of points and lines on the image of the at least a part of the human subject.

4. The information processing apparatus of claim 2, wherein the circuitry is configured to generate an instruction to control a gaming application in accordance with the estimated posture.

5. The information processing apparatus of claim 1, wherein the circuitry is configured to

determine a gesture of the at least a part of the human subject based on the estimated posture.

6. The information processing apparatus of claim 1, wherein the circuitry is configured to determine whether the estimated posture corresponds to one of predetermined postures.

7. The information processing apparatus of claim 1, wherein each of the lines is straight.

8. A method, comprising:

obtaining, using an imaging device, an image of at least a part of a human subject;

estimating, using circuitry, a position of a joint of the human subject based on the obtained image, the joint being a place at which two parts of the human subject are joined;

outputting, using a plurality of points and lines indicative of the estimated position of the joint, data indicative of the estimated position of the joint of the human subject as an estimation result; and

estimating a posture of the human subject based on the output data.

9. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method, comprising:

obtaining, using an imaging device, an image of at least a part of a human subject;

estimating a position of a joint of the human subject based on the obtained image, the joint being a place at which two parts of the human subject are joined;

outputting, using a plurality of points and lines indicative of the estimated position of the joint, data indicative of the estimated position of the joint of the human subject as an estimation result; and

estimating a posture of the human subject based on the output data.