Information processing device, information processing system, and storage medium storing program

• US 9,531,955 B2
• Filed: 05/19/2014
• Issued: 12/27/2016
• Est. Priority Date: 06/21/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sato, Tatsuhito
• Primary Examiner(s): FLOHRE, JASON A
• Application Number:
  US14/280,766
• Publication Number:
  US 20140375860A1
• Time in Patent Office: 953 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators

Abstract

There is provided an information processing device including an image obtaining unit configured to obtain an image including a plurality of objects, and a display control unit configured to, after an operation has been performed on a first object of the plurality of objects, control identification information associated with a second object, the identification information indicating the second object.

Claims

1. An information processing device comprising:

circuitry configured to

obtain an image including a plurality of objects;

after an operation has been performed on a first object of the plurality of objects, control identification information associated with a second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, and the identification information indicating the second object; and

obtain one or more candidates for the identification information indicating the second object, wherein

at least one region of a plurality of regions set in the image is specified based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

2. The information processing device according to claim 1, wherein the circuitry is further configured to

control the identification information based on a result of identification of the first object on which the operation has been performed.

3. The information processing device according to claim 2, wherein

the operation performed on the first object is an operation of specifying a region in the image corresponding to the first object.

4. The information processing device according to claim 1, wherein

the operation performed on the first object is an operation of setting identification information indicating the first object.

5. The information processing device according to claim 1, wherein the circuitry is further configured to

control a display to display, as the identification information, a candidate or candidates estimated from the one or more candidates, after the operation has been performed on the first object.

6. The information processing device according to claim 5, wherein the circuitry is further configured to

control the display to display the one or more candidates for the identification information indicating the second object in association with the second object, after the operation has been performed on the first object, and

update the identification information indicating the second object based on identification information indicating a candidate or candidates estimated from the one or more candidates.

7. The information processing device according to claim 5, wherein the circuitry is further configured to

obtain one or more candidates for identification information indicating the first object, and

estimate identification information indicating the second object from the one or more candidates for the identification information indicating the second object, based on one candidate that has been selected from the one or more candidates for the identification information indicating the first object.

8. The information processing device according to claim 5, wherein the circuitry is further configured to

obtain one or more candidates for identification information indicating respective objects of the plurality of regions set in the image.

9. The information processing device according to claim 8, wherein the circuitry is further configured to

obtain a candidate or candidates for the identification information indicating the respective objects of the plurality of regions based on a result of identification of one of the objects of the plurality of regions.

10. The information processing device according to claim 9, wherein the circuitry is further configured to

obtain the candidate or candidates for the identification information indicating the respective objects of the plurality of regions based on a result of identification of the one of the objects of the plurality of regions that has been updated, when a region of the one of the objects of the plurality of regions has been updated.

11. The information processing device according to claim 8, wherein

the second object is a dish, and

the at least one region is specified based on the result of recognition of the container of the second object in which the dish is served.

12. The information processing device according to claim 5, wherein the circuitry is further configured to

obtain the one or more candidates for the identification information from an external server.

13. The information processing device according to claim 5, wherein

the identification information indicating the second object is estimated based on a co-occurrence probability indicating a probability with which an object indicated by each of the one or more candidates for the identification information co-occurs with the first object.

14. The information processing device according to claim 5, wherein the circuitry is further configured to

control the display to display a correctness of a result of estimation of the identification information indicating the second object in an identifiable fashion.

15. The information processing device according to claim 1, further comprising:

an image sensor configured to capture the image.

18. The information processing device according to claim 15, wherein the image sensor is a camera.

16. An information processing system comprising:

a terminal including a display; and

a server including circuitry configured to

obtain an image including a plurality of objects,

control the display to display the image, and

obtain one or more candidates for identification information indicating a second object, wherein

after an operation has been performed on a first object of the plurality of objects, the circuitry of the server controls identification information associated with the second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, the identification information indicating the second object, and

at least one region of a plurality of regions set in the image is specified based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

17. A non-transitory computer-readable storage medium having a program stored therein, the program causing a computer to execute:

obtaining an image including a plurality of objects;

after an operation has been performed on a first object of the plurality of objects, controlling identification information associated with a second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, and the identification information indicating the second object;

obtaining one or more candidates for identification information indicating the second object; and

setting at least one region of a plurality of regions in the image based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.