INFORMATION PROCESSING APPARATUS AND INFORMATION PROCESSING METHOD

• US 20140119614A1
• Filed: 10/03/2013
• Published: 05/01/2014
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: MOCHIZUKI, Daisuke, SATO, Tatsuhito
• Granted Patent: US 9,367,727 B2
• Time in Patent Office: Days
• US Class Current: 382/110
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

There is provided an information processing apparatus including an image acquisition unit configured to acquire a dish image obtained by shooting a single or multiple dishes, and a first dish recognition unit configured to recognize the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image.

Claims

1. An information processing apparatus comprising:

an image acquisition unit configured to acquire a dish image obtained by shooting a single or multiple dishes; and

a first dish recognition unit configured to recognize the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image.

2. The information processing apparatus according to claim 1, further comprising:

a recognition result integrating unit configured to integrate a first recognition result obtained by the first dish recognition unit with a second recognition result obtained by a second dish recognition unit, the second dish recognition unit recognizing the single or multiple dishes included in the dish image without using the condition.

3. The information processing apparatus according to claim 2, further comprising:

a dish data management unit configured to register the dish data in an additional manner based on the second recognition result.

4. The information processing apparatus according to claim 3,

wherein, when the single or multiple dishes are not automatically recognized, the second recognition result is decided based on an input of a user, and

wherein the dish data management unit registers the dish data in an additional manner based on the second recognition result decided based on the input of the user.

5. The information processing apparatus according to claim 3,

wherein, the second recognition result is a result obtained by automatically recognizing the single or multiple dishes or a result obtained by correcting the result based on information that is input by a user, and

wherein the dish data management unit registers the dish data in an additional manner based on the second recognition result decided through correction based on the information that is input by the user.

6. The information processing apparatus according to claim 2,

wherein the information processing apparatus is a client used by a user who shoots the dish image,

wherein the image acquisition unit transmits the acquired dish image to a server that includes the second dish recognition unit, and

wherein the recognition result integrating unit receives the second recognition result from the server.

7. The information processing apparatus according to claim 1, further comprising:

a dish data management unit configured to register the dish data in an additional manner, and to delete a part of the dish data based on a predetermined criterion when a predetermined volume of the dish data are accumulated.

8. The information processing apparatus according to claim 7,

wherein the first dish recognition unit recognizes the single or multiple dishes by matching the dish image with the selected dish data.

9. The information processing apparatus according to claim 8,

wherein the dish data management unit deletes a part of the dish data based on a number indicating how many times the dish data is used for matching with the dish image, or a date and time indicating when the dish data is used for matching with the dish image.

10. The information processing apparatus according claim 8,

wherein the dish data management unit deletes a part of the dish data based on a number indicating how many times the dish data successfully matches with the dish image, or a date and time indicating when the dish data successfully matches the dish image.

11. The information processing apparatus according to claim 1,

wherein the image acquisition unit acquires the dish image that entails metadata, and

wherein the information processing apparatus further comprises:

an information extraction unit configured to extract the information regarding at least one of the person relating to the dish image, the shooting environment of the dish image, the shooting place of the dish image, and the shooting time of the dish image from the metadata.

12. The information processing apparatus according to claim 11,

wherein the information extraction unit extracts information regarding the person relating to the dish image, and

wherein the first dish recognition unit recognizes the single or multiple dishes with reference to the dish data registered in association with the person.

13. The information processing apparatus according to claim 11,

wherein the information extraction unit extracts information regarding the shooting environment of the dish image, and

wherein the first dish recognition unit recognizes the single or multiple dishes by using the dish data registered in association with information indicating an environment common to the shooting environment.

14. The information processing apparatus according to claim 11,

wherein the information extraction unit extracts information regarding the shooting place of the dish image, and

wherein the first dish recognition unit recognizes the single or multiple dishes by using the dish data registered in association with the shooting place.

15. The information processing apparatus according to claim 11,

wherein the information extraction unit extracts information regarding the shooting time of the dish image, and

wherein the first dish recognition unit recognizes the single or multiple dishes by using the dish data registered in association with a time zone including the shooting time.

16. The information processing apparatus according to claim 1,

wherein the first dish recognition unit treats a characteristic of a whole of the dish image as information regarding at least one of the shooting environment of the dish image, the shooting place of the dish image, and the shooting time of the dish image.

17. The information processing apparatus according to claim 16,

wherein the dish data is data of an image that is cut away from a source image, and is registered in association with information regarding the source image, and

wherein, when the characteristic of the whole of the dish image is similar to a characteristic of the source image, the first dish recognition unit recognizes the single or multiple dishes by using the data of the image that is cut away from the source image.

18. An information processing apparatus comprising:

acquiring a dish image obtained by shooting a single or multiple dishes; and

recognizing the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image.