INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND COMPUTER PROGRAM

• US 20170003933A1
• Filed: 03/23/2015
• Published: 01/05/2017
• Est. Priority Date: 04/22/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: KOBAYASHI, Kenichiro
• Granted Patent: US 10,474,426 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

There is provided an information processing device capable of deciding process content of image information according to content of language information input by users, the information processing device including: an image region specifying unit configured to specify a region in an image based on input language information, and a process content specifying unit configured to specify content of a process using the image in regard to the region specified in the image by the image region specifying unit based on the input language information.

Claims

1. An information processing device comprising:

an image region specifying unit configured to specify a region in an image based on input language information; and

a process content specifying unit configured to specify content of a process using the image in regard to the region specified in the image by the image region specifying unit based on the input language information.

2. The information processing device according to claim 1,

wherein the process content specifying unit specifies that a recognition process for an object in the region specified in the image by the image region specifying unit is performed based on the input language information.

3. The information processing device according to claim 2,

wherein the image region specifying unit specifies a region in the image based on further input language information using the object recognized in the specified region in the image as a standard.

4. The information processing device according to claim 1,

wherein the process content specifying unit specifies that a process of acquiring information regarding an object included in the region specified in the image by the image region specifying unit is performed based on the input language information.

5. The information processing device according to claim 4,

wherein the process content specifying unit specifies that a process of acquiring a name of the object as the information regarding the object is performed.

6. The information processing device according to claim 4,

wherein the image region specifying unit specifies a region in the image based on further input language information using the object for which the information is acquired in the specified region in the image as a standard.

7. The information processing device according to claim 1,

wherein, when the image region specifying unit specifies the region specified in the image and subsequently language information indicating cancellation of the specifying is input, the image region specifying unit cancels the immediately previous specifying of the region in the image.

8. The information processing device according to claim 1,

wherein, when language information indicating limitation of a time on the image is input as the language information, the process content specifying unit limits the time of the image which is a target of a process using the image.

9. The information processing device according to claim 1, further comprising:

an object recognition unit configured to recognize an object of the image based on a process specified by the process content specifying unit.

10. The information processing device according to claim 9, further comprising:

a language generation unit configured to generate language information indicating a result of the recognition by the object recognition unit.

11. The information processing device according to claim 10,

wherein, based on the process specified by the process content specifying unit, the language generation unit generates the language information by adding a feature of the recognized object when an object is not uniquely specifiable from the input language information as a result obtained by the object recognition unit performing the process of recognizing the object of the image.

12. The information processing device according to claim 10,

wherein, based on the process specified by the process content specifying unit, the language generation unit generates the language information according to an extent of an object recognition result based on the input language information by the object recognition unit as a result obtained by the object recognition unit performing the process of recognizing the object of the image.

13. The information processing device according to claim 1, further comprising:

a recognition region display unit configured to superimpose and display the region specified by the image region specifying unit on the image.

14. The information processing device according to claim 1,

wherein the image region specifying unit divides the image into a predetermined number of regions based on the input language information and specifies the region in the image using each of the divided regions.

15. The information processing device according to claim 1,

wherein, when the input language information includes an adverb indicating a degree, the image region specifying unit specifies the region in the image with reference to the adverb.

16. An information processing method comprising:

specifying a region in an image based on input language information; and

specifying content of a process using the image in regard to the specified region in the image based on the input language information.

17. A computer program causing a computer to perform:

specifying a region in an image based on input language information; and

specifying content of a process using the image in regard to the specified region in the image based on the input language information.