INFORMATION PROCESSOR, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20130058566A1
• Filed: 07/16/2012
• Published: 03/07/2013
• Est. Priority Date: 09/05/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sato, Tatsuhito, Gotoh, Tomohiko, Mochizuki, Daisuke, Mochizuki, Shunsuke, Sun, Yun, Okamura, Yuki, Yaeda, Takeshi
• Granted Patent: US 9,104,943 B2
• Time in Patent Office: Days
• US Class Current: 382/159
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis

Abstract

An information processor includes a detection unit detecting a photographic subject region of an image, a characteristic amount generation unit generating a characteristic amount including at least positional information of the photographic subject region for each of the detected photographic subject region, a combined characteristic amount generation unit generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated for each of the photographic subject region, and an identification unit identifying a label corresponding to a combination of a photographic subject appearing in the image based on the generated combined characteristic amount.

Claims

1. An information processor comprising:

a detection unit detecting a photographic subject region of an image;

a characteristic amount generation unit generating a characteristic amount including at least positional information of the photographic subject region for each of the detected photographic subject region;

a combined characteristic amount generation unit generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated for each of the photographic subject region; and

an identification unit identifying a label corresponding to a combination of a photographic subject appearing in the image based on the generated combined characteristic amount.

2. The information processor according to claim 1, further comprising:

a combined photographic subject identifier carrying out machine learning using the label and the combined characteristic amount corresponding to an image for learning as inputs;

wherein

the identification unit identifies the label corresponding to the combination of the photographic subject appearing in the image using the combined photographic subject identifier learned in advance based on the generated combined characteristic amount.

3. The information processor according to claim 2, wherein the characteristic amount generation unit generates the characteristic amount by combining at least the positional information of the photographic subject region and an identification result of the individual photographic subject in the photographic subject region for each of the detected photographic subject region.

4. The information processor according to claim 2, wherein the characteristic amount generation unit generates the characteristic amount by combining at least the positional information of the photographic subject region and an image characteristic of the photographic subject region for each of the detected photographic subject region.

5. The information processor according to claim 2, wherein the positional information of the photographic subject region includes at least one of a shape, center coordinates, a size, or gradient of the photographic subject region.

6. The information processor according to claim 2, wherein

the image is a cooked food image having a cooked food as the photographic subject, and

the detection unit detects a region in which a plate appears in the cooked food image as the photographic subject region.

7. An information processing method carried out by an information processor, the method comprising:

detecting a photographic subject region in an image;

generating a characteristic amount including at least positional information of the photographic subject region for each of the detected photographic subject region;

generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated for each of the photographic subject region; and

identifying a label corresponding to a combination of a photographic subject appearing in the image based on the generated combined characteristic amount.

8. A program causing a computer to execute functions, comprising:

a detection unit detecting a photographic subject region in an image;

a characteristic amount generation unit generating a characteristic amount including at least positional information of the photographic subject region for each of the detected photographic subject region;

a combined characteristic amount generation unit generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated for each of the photographic subject region; and

an identification unit identifying a label corresponding to a combination of a photographic subject appearing in the image based on the generated combined characteristic amount.