Information processing apparatus and information processing method

• US 9,367,727 B2
• Filed: 10/03/2013
• Issued: 06/14/2016
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mochizuki, Daisuke, Sato, Tatsuhito
• Primary Examiner(s): Azarian, Seyed
• Application Number:
  US14/045,040
• Publication Number:
  US 20140119614A1
• Time in Patent Office: 985 Days
• Field of Search: 382/100, 382/103, 382/106, 382/110, 382/113, 382/140, 382/143, 382154-155, 382/162, 382/168, 382/173, 382/181, 382/199, 382/209, 382/219, 382/222, 382/232, 382/254, 382/274, 382/276, 382282-291, 382/305, 382/312, 600/316, 434/127
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

There is provided an information processing apparatus including an image acquisition unit configured to acquire a dish image obtained by shooting a single or multiple dishes, and a first dish recognition unit configured to recognize the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image.

Claims

1. An information processing apparatus comprising:

circuitry configured to

acquire a dish image obtained by shooting a single or multiple dishes; and

recognize the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image,

wherein the shooting the single or multiple dishes is performed using a camera.

2. The information processing apparatus according to claim 1, wherein the circuitry is further configured to

integrate a first recognition result, obtained based on the recognition of the single or multiple dishes, with a second recognition result obtained by another recognition of the single or multiple dishes included in the dish image without using the condition.

3. The information processing apparatus according to claim 2, wherein the circuitry is further configured to

register the dish data in an additional manner based on the second recognition result.

4. The information processing apparatus according to claim 3,

wherein, when the single or multiple dishes are not automatically recognized, the second recognition result is decided based on an input of a user, and

wherein the dish data is registered in an additional manner based on the second recognition result decided based on the input of the user.

5. The information processing apparatus according to claim 3,

wherein, the second recognition result is a result obtained by automatically recognizing the single or multiple dishes or a result obtained by correcting the result based on information that is input by a user, and

wherein the dish data is registered in an additional manner based on the second recognition result decided through correction based on the information that is input by the user.

6. The information processing apparatus according to claim 2,

wherein the information processing apparatus is a client used by a user who shoots the dish image,

wherein the acquired dish image is transmitted to a server that includes the second dish recognition unit, and

wherein the second recognition result is received from the server.

7. The information processing apparatus according to claim 1, wherein the circuitry is further configured to

register the dish data in an additional manner, and

delete a part of the dish data based on a predetermined criterion when a predetermined volume of the dish data are accumulated.

8. The information processing apparatus according to claim 7,

wherein the single or multiple dishes are recognized by matching the dish image with the selected dish data.

9. The information processing apparatus according to claim 8,

wherein a part of the dish data is deleted based on a number indicating how many times the dish data is used for matching with the dish image, or a date and time indicating when the dish data is used for matching with the dish image.

10. The information processing apparatus according claim 8,

wherein a part of the dish data is deleted based on a number indicating how many times the dish data successfully matches with the dish image, or a date and time indicating when the dish data successfully matches the dish image.

11. The information processing apparatus according to claim 1,

wherein the dish image is acquired that entails metadata, and

wherein the circuitry is further configured to

extract the information regarding at least one of the person relating to the dish image, the shooting environment of the dish image, the shooting place of the dish image, and the shooting time of the dish image from the metadata.

12. The information processing apparatus according to claim 11,

wherein information regarding the person relating to the dish image is extracted, and

wherein the single or multiple dishes are recognized with reference to the dish data registered in association with the person.

13. The information processing apparatus according to claim 11,

wherein information regarding the shooting environment of the dish image is extracted, and

wherein the single or multiple dishes are recognized by using the dish data registered in association with information indicating an environment common to the shooting environment.

14. The information processing apparatus according to claim 11,

wherein information regarding the shooting place of the dish image is extracted, and

wherein single or multiple dishes are recognized by using the dish data registered in association with the shooting place.

15. The information processing apparatus according to claim 11,

wherein information regarding the shooting time of the dish image is extracted, and

wherein the single or multiple dishes are recognized by using the dish data registered in association with a time zone including the shooting time.

16. The information processing apparatus according to claim 1,

wherein a characteristic of a whole of the dish image is treated as information regarding at least one of the shooting environment of the dish image, the shooting place of the dish image, and the shooting time of the dish image.

17. The information processing apparatus according to claim 16,

wherein the dish data is data of an image that is cut away from a source image, and is registered in association with information regarding the source image, and

wherein, when the characteristic of the whole of the dish image is similar to a characteristic of the source image, the single or multiple dishes are recognized by using the data of the image that is cut away from the source image.

18. The information processing apparatus according to claim 1, wherein the circuitry is further configured to recognize a respective dish area corresponding to each of the dishes included in the dish image.

19. An information processing method executed via an information processing apparatus, the method comprising:

acquiring a dish image obtained by shooting a single or multiple dishes; and

recognizing the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image,

wherein the shooting the single or multiple dishes is performed using a camera.

20. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

acquiring a dish image obtained by shooting a single or multiple dishes; and

recognizing the single or multiple dishes included in the dish image with reference to dish data selected, from dish data registered in advance, based on a condition regarding at least one of a person relating to the dish image, a shooting environment of the dish image, a shooting place of the dish image, and a shooting time of the dish image,

wherein the shooting the single or multiple dishes is performed using a camera.