Information processor, information processing method, and program

• US 9,104,943 B2
• Filed: 07/16/2012
• Issued: 08/11/2015
• Est. Priority Date: 09/05/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sato, Tatsuhito, Gotoh, Tomohiko, Mochizuki, Daisuke, Mochizuki, Shunsuke, Sun, Yun, Okamura, Yuki, Yaeda, Takeshi
• Primary Examiner(s): Ahmed, Samir
• Application Number:
  US13/549,903
• Publication Number:
  US 20130058566A1
• Time in Patent Office: 1,121 Days
• Field of Search: 382/159, 382/195, 700/47, 700/48
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis

Abstract

An information processor includes a detection unit detecting a photographic subject region of an image, a characteristic amount generation unit generating a characteristic amount including at least positional information of the photographic subject region for each of the detected photographic subject region, a combined characteristic amount generation unit generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated for each of the photographic subject region, and an identification unit identifying a label corresponding to a combination of a photographic subject appearing in the image based on the generated combined characteristic amount.

Claims

1. An information processor comprising circuitry configured to:

detect at least a size of a plurality of individual plates in an image, each of the individual plates appearing in the image as individually supporting one of a plurality of foods;

generate a characteristic amount identifying the food supported by each of the individual plates detected;

generate a combined characteristic amount corresponding to the image by combining the characteristic amount for at least two of the foods supported by the individual plates;

determine a label corresponding to the combination of the at least two of the foods supported by the individual plates appearing in the image based on the generated combined characteristic amount; and

recognize the combination of the at least two of the foods-supported by the individual plates appearing in the image based on the determined label.

2. The information processor according to claim 1, wherein

the circuitry is further configured to carry out machine learning using the label and the combined characteristic amount corresponding to an image for learning as inputs.

3. The information processor according to claim 1, wherein the circuitry is further configured to generate the characteristic amount by combining at least the size of the individual plates and an identification result of each individual food for each of the detected individual plates.

4. The information processor according to claim 1, wherein the circuitry is further configured to generate the characteristic amount by combining at least the size of the individual plates and an image characteristic of the food supported by each individual detected plate.

5. The information processor according to claim 1, wherein the circuitry is further configured to detect a shape of the plurality of individual plates and the center coordinates for each of the individual plates.

6. The information processor according to claim 1, wherein the image is a cooked food image having a cooked food as the food supported by each of the detected individual plates.

7. A method comprising:

a processor configured to;

detecting at least a size of a plurality of individual plates in an image, each of the individual plates appearing in the image as individually supporting one of a plurality of foods;

generating a characteristic amount identifying the food supported by each of the individual plates detected in the detecting step;

generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated by the characteristic amount generating step for at least two of the foods supported by the individual plates;

determining a label corresponding to the combination of the at least two of the foods supported by the individual plates appearing in the image based on the generated combined characteristic amount; and

recognizing the combination of the at least two of the foods-supported by the individual plates appearing in the image based on the determined label.

9. The method according to claim 7, wherein the characteristic amount generating step includes combining at least the size of the individual plates and an identification result of each individual food for each of the detected individual plates.

10. The method according to claim 7, wherein the characteristic amount generating step includes combining at least the size of the individual plates and an image characteristic of the food supported by each individual detected plate.

11. The method according to claim 7, wherein the detecting step further detects a shape for the plurality of individual plates and center coordinates for each of the individual plates.

12. The method according to claim 7, wherein

the image is a cooked food image having a cooked food as each food supported by each of the detected individual plates.

8. A non-transitory medium carrying a program causing a computer reading the program to perform a method, comprising:

detecting at least a size of a plurality of individual plates in an image, each of the individual plates appearing in the image as individually supporting one of a plurality of foods;

generating a characteristic amount identifying the food supported by each of the individual plates;

generating a combined characteristic amount corresponding to the image by combining the characteristic amount generated by the characteristic amount generating step for at least two of the foods supported by the individual plates;

determining a label corresponding to the combination of the at least two of the foods supported by the individual plates appearing in the image based on the generated combined characteristic amount; and

recognizing the combination of the at least two of the foods-supported by the individual plates appearing in the image based on the determined label.