INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING SYSTEM, AND STORAGE MEDIUM STORING PROGRAM

• US 20140375860A1
• Filed: 05/19/2014
• Published: 12/25/2014
• Est. Priority Date: 06/21/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: SATO, Tatsuhito
• Granted Patent: US 9,531,955 B2
• Time in Patent Office: Days
• US Class Current: 348/333.01
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators

Abstract

There is provided an information processing device including an image obtaining unit configured to obtain an image including a plurality of objects, and a display control unit configured to, after an operation has been performed on a first object of the plurality of objects, control identification information associated with a second object, the identification information indicating the second object.

Claims

1. An information processing device comprising:

an image obtaining unit configured to obtain an image including a plurality of objects; and

a display control unit configured to, after an operation has been performed on a first object of the plurality of objects, control identification information associated with a second object, the identification information indicating the second object.

2. The information processing device according to claim 1, wherein

the display control unit controls the identification information based on a result of identification of the first object on which the operation has been performed.

3. The information processing device according to claim 2, wherein

the operation performed on the first object is an operation of specifying a region corresponding to the first object in the image.

4. The information processing device according to claim 1, wherein

the operation performed on the first object is an operation of setting identification information indicating the first object.

5. The information processing device according to claim 1, further comprising:

an identification information obtaining unit configured to obtain one or more candidates for identification information indicating the second object, wherein

after the operation has been performed on the first object, the display control unit displays, as the identification information, a candidate or candidates estimated from the one or more candidates.

6. The information processing device according to claim 5, wherein

the display control unit displays one or more candidates for identification information indicating the second object in association with the second object, and after the operation has been performed on the first object, updates the identification information indicating the second object based on identification information indicating a candidate or candidates estimated from the one or more candidates.

7. The information processing device according to claim 5, wherein

the identification information obtaining unit obtains the one or more candidates for identification information indicating the first object, and

after one candidate has been selected from the one or more candidates for the identification information indicating the first object, identification information indicating the second object is estimated from the one candidates for the identification information indicating the second object, based on the one candidate that has been selected.

8. The information processing device according to claim 5, wherein

the identification information obtaining unit obtains one or more candidates for identification information indicating the object included in each of a plurality of regions set in the image.

9. The information processing device according to claim 8, wherein

the identification information obtaining unit obtains a candidate or candidates for identification information indicating the object extracted based on a result of identification of the object included in the region.

10. The information processing device according to claim 9, wherein

when the region has been updated, the identification information obtaining unit obtains a candidate or candidates for identification information indicating the object extracted based on a result of identification of the object included in the region that has been updated.

11. The information processing device according to claim 8, wherein

at least one of the plurality of regions is specified based on an image analysis process performed on the image.

12. The information processing device according to claim 11, wherein

the object is a dish, and

the at least one region is specified based on a result of recognition of a container in which the dish is served.

13. The information processing device according to claim 11, wherein

the object is a human, and

the at least one region is specified based on a result of recognition of a face of the human.

14. The information processing device according to claim 5, wherein

the identification information obtaining unit obtains one or more candidates for the identification information from an external server.

15. The information processing device according to claim 5, wherein

the identification information indicating the second object is estimated based on a co-occurrence probability indicating a probability with which an object indicated by each of one or more candidates for the identification information co-occurs with the first object.

16. The information processing device according to claim 5, wherein

the display control unit displays a correctness of a result of estimation of identification information indicating the second object in an identifiable fashion.

17. The information processing device according to claim 1, further comprising:

an image capture unit configured to capture the image.

18. An information processing system comprising:

a terminal including a display unit; and

a server including an image obtaining unit configured to obtain an image including a plurality of objects, and a display control unit configured to display the image on the display unit, wherein

after an operation has been performed on a first object of the plurality of objects, the display control unit controls identification information associated with a second object, the identification information indicating the second object.

19. A non-transitory computer-readable storage medium having a program stored therein, the program causing a computer to execute:

obtaining an image including a plurality of objects; and

after an operation has been performed on a first object of the plurality of objects, controlling identification information associated with a second object, the identification information indicating the second object.