INFORMATION PROCESSING APPARATUS, PHRASE OUTPUT METHOD, AND PROGRAM

• US 20130027535A1
• Filed: 07/18/2012
• Published: 01/31/2013
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi, Nashida, Tatsushi
• Granted Patent: US 9,361,316 B2
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: G06F 16/2452 Query translation
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/56 Natural language generation
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In one aspect, an information processing system for determining complimentary phrases to present to a recipient is provided. The information processing system may receive an input image depicting a subject. A difference in appearance between the subject depicted in the input image and a model subject may be determined. One or more phrases (e.g., complimentary phrases) may be selected from a plurality of categorized phrase candidates based on the identified difference in appearance between the subject and the model subject. The difference in appearance may be determined by comparing selected features (e.g., skin, hair, eyes) of the subject with one or more predetermined features of the model subject. The model subject may be the same or different than the subject depicted in the input image.

Claims

1. An information processing system comprising:

one or more processors configured so as to;

receive an input image captured by an image sensor;

analyze the input image to identify a difference in appearance between a subject depicted in the input image and a model subject;

select one or more phrases from a plurality of phrase candidates based on the identified difference in appearance between the subject and a model subject; and

,

output, to an output device, at least one of the one or more selected phrases for presentment to a recipient.

2. The information processing system of claim 1, wherein the one or more processors are further configured to identify the difference in appearance between the subject depicted in the input image and the model subject by comparing one or more features of the subject extracted from the analysis of the input image with one or more predetermined features of the model subject.

3. The information processing system of claim 1, wherein the one or more processors are further configured to

select the one or more phrases from the plurality of phrase candidates based on a determined category of the identified difference in appearance between the subject depicted in the input image and the model subject.

4. The information processing system of claim 1, wherein the one or more processors are further configured to select the model subject based on a prior image or images of the subject depicted in the input image.

5. The information processing system of claim 1, wherein the one or more processors are further configured to select the model subject based on an image or images of one or more average subjects, the one or more average subjects being different from the subject depicted in the input image.

6. The information processing system of claim 1, wherein the one or more processors are further configured to:

display the input image depicting the subject to a user on a display device;

determine a feature of the subject selected by the user; and

,

display, on the display device, one or more phrase candidates from the plurality of phrase candidates for further selection by the user, the one or more phrase candidates being displayed for further selection by the user based on the feature of the subject selected by the user.

7. The information processing system of claim 1, wherein the one or more processors are further configured to exclude a given phrase from the one or more phrases selected from the plurality of phrase candidates, the given phrase being excluded based upon a determination by the one or more processors that the given phrase was previously or recently output to the output device for presentment to the recipient.

8. The information processing system of claim 1, wherein the one or more processors are further configured to control a timing of the output of the at least one of the one or more selected phrases to the output device based on a condition of the subject determined from the analysis of the input image.

9. The information processing system of claim 8, wherein the condition of the subject determined from the analysis of the input image includes a specific expression, posture, or gesture of the subject depicted in the input image.

10. The information processing system of claim 1, wherein the one or more processors are further configured to output the at least one of the one or more selected phrases to the output device based on a determined location of the subject depicted in the input image.

11. The information processing system of claim 10, wherein the one or more processors are further configured to output the at least one of the one or more selected phrases to the output device using a particular dialect associated with the determined location.

12. The information processing system of claim 1, wherein the at least one of the one or more selected phrases output to the output device is a complimentary or positive phrase that is selected from the plurality of phrase candidates based on the identified difference in appearance between the subject depicted in the input image and the model subject.

13. The information processing system of claim 1, wherein the one or more processors are further configured to determine a degree of the identified difference in appearance between the subject and a model subject.

14. The information processing system of claim 13, wherein the one or more processors are further configured to select the one or more phrases from the plurality of phrase candidates when the determined degree of the identified difference in appearance between the subject and a model subject exceeds a predetermined threshold.

15. The information processing system of claim 1, wherein the model subject is selected from one of a plurality of selectable model subjects based on input received from a user.

16. The information processing system of claim 1, wherein the one or more processors are configured to output audio of the at least one of the one or more selected phrases to the output device for presentment to the recipient.

17. The information processing system of claim 16, wherein the output device is a directional speaker for directing the audio of the at least one of the one or more selected phrases in a determined direction of the recipient.

18. The information processing system of claim 1, wherein the output device is part of an information processing device associated with the recipient.

19. A computer-implemented method comprising:

receiving an input image captured by an image sensor;

analyzing, with a processor, the input image to identify a difference in appearance between a subject depicted in the input image and a model subject;

selecting one or more phrases from a plurality of phrase candidates based on the identified difference in appearance between the subject and a model subject; and

,

outputting, to an output device, at least one of the one or more selected phrases for presentment to a recipient.

20. A non-transitory storage unit on which computer-readable instructions of a program are stored, the instructions, when executed by one or more processors, causing the one or more processors to:

receive an input image captured by an image sensor;

analyze the input image to identify a difference in appearance between a subject depicted in the input image and a model subject;

select one or more phrases from a plurality of phrase candidates based on the identified difference in appearance between the subject and a model subject; and

,

output, to an output device, at least one of the one or more selected phrases for presentment to a recipient.