System and method for a communication exchange with an avatar in a media communication system

• US 9,462,321 B2
• Filed: 12/08/2014
• Issued: 10/04/2016
• Est. Priority Date: 10/01/2008
• Status: Active Grant

• Current Assignee: LYFT Incorporated
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Roberts, Linda, Schroeter, Horst Juergen, Chang, E-Lee, Clayton, Darnell, Khandelwal, Madhur
• Primary Examiner(s): SCHNURR, JOHN R
• Application Number:
  US14/563,129
• Publication Number:
  US 20150095930A1
• Time in Patent Office: 666 Days
• Field of Search: 725/10, 725/12, 725/37, 725/38, 725/46, 725/48, 725/61, 715/706, 706/15, 706/16, 704/246, 704/250, 704/251, 704/270, 704/272
• US Class Current: 1/1
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system that incorporates teachings of the present disclosure may include, for example, a processor that causes a STB to present an avatar. The processor can receive from the STB a response of the user, detect from the response a change in an emotional state of the user, adapt a search for media content according to the change in the emotional state of the user, and adapt a portion of the characteristics of the avatar relating to emotional feedback according to the change in the emotional state of the user. The processor can cause the STB to present the adapted avatar presenting content from a media content source identified from the adapted search for media content. Other embodiments are disclosed.

Claims

1. A system, comprising:

a memory that stores instructions; and

at least one processor coupled to the memory, wherein responsive to executing the instructions, the at least one processor performs operations comprising;

receiving audio content of a user that is captured during a communication exchange between the user and an avatar presented by a set-top box;

determining whether the audio content includes a search request for media content from the user;

responsive to determining that the audio content includes the search request for the media content;

performing an initial search for the media content according to the search request;

presenting search results from the initial search;

capturing images of the user during the communication exchange between the avatar and the user during and after the presenting of the search results;

identifying a change in an emotional state of the user based on an analysis of speech of the user determined from the audio content and from the images of the user during and after the presenting of the search results;

providing data to the set-top box for adapting characteristics of the avatar to generate an adapted avatar according to the identifying of the change in the emotional state of the user;

performing an updated search for the media content, wherein the updated search is modified according to the change in the emotional state of the user; and

causing the set-top box to present the adapted avatar presenting content from a media content source according to the updated search.

2. The system of claim 1, wherein the operations further comprise identifying the change in the emotional state of the user based on an analysis of a physiological expression of the user determined from an image recognition applied to the images.

3. The system of claim 1, wherein the analysis of speech includes analysis of a grammatical structure of speech of the user.

4. The system of claim 1, wherein the operations further comprise retrieving a profile associated with the set-top box.

5. The system of claim 4, wherein the adapting of the characteristics of the avatar is according to the profile.

6. The system of claim 1, wherein the operations further comprise retrieving a profile associated with the user, wherein the avatar has characteristics that correlate to the profile.

7. The system of claim 1, wherein the operations further comprise detecting a negative disposition in the emotional state of the user.

8. The system of claim 7, wherein the operations further comprise:

identifying from a profile and the negative disposition an alternative search procedure to counteract the negative disposition; and

adjusting the updated search to generate an adjusted adapted search according to the alternative search procedure.

9. The system of claim 8, wherein the negative disposition corresponds to a state of hostility, a state of melancholy, a state of apathy, a state of tension, or a combination thereof.

10. The system of claim 8, wherein the adjusting of the updated search is according to monitored media consumption behavior associated with the user.

11. The system of claim 1, wherein the operations further comprise:

presenting search results of the updated search; and

assessing an accuracy of search results of the updated search according to a change in the emotional state of the user after presenting the search results.

12. A method, comprising:

receiving, by a system including a processor, an audio input including a speech of a user, wherein the speech includes a search request and a communication exchange between the user and an avatar presented by a set-top box;

providing, by the system, data to the set-top box for adapting characteristics of the avatar to generate an adapted avatar;

performing, by the system, a user-initiated search for media content;

providing, by the system, results from the user-initiated search to the user;

identifying, by the system, a change in an emotional state of the user based on an analysis of the communication exchange between the user and the avatar after the providing of the results to the user, wherein the communication exchange includes an analysis of the speech of the user and an image of the user, wherein the system is remote from the set-top box, and wherein the system is in communication with the set-top box over a network; and

generating an adapted search according to the identifying of the change in the emotional state of the user from an initial result of the user-initiated search.

13. The method of claim 12, wherein the analysis of the speech of the user includes an analysis of one of a context of the speech of the user, a prosody of the speech of the user, a grammatical structure of the speech of the user, or a combination thereof.

14. The method of claim 12, wherein the analysis of the image of theuser comprises analyzing, by the system, a physiological expression of the user from the image, wherein the change in the emotional state of the user is identified based on the physiological expression, and

wherein the method further comprises retrieving a profile associated with the set-top box, wherein the avatar has characteristics that are described in the profile.

15. The method of claim 14, wherein the profile comprises demographic profiling information of the user, psychographic profiling information of the user, user preferences of the user, or a combination thereof.

16. The method of claim 14, wherein the profile comprises demographic profiling information of the user, and

wherein the demographic profiling information of the user is determined from monitored media consumption behavior of the user.

17. The method of claim 12, further comprising adapting, by the system, the avatar into an adapted avatar based on presenting content from a media content source according to the identifying of the change in the emotional state of the user.

18. A non-transitory, machine-readable storage medium, comprising instructions, wherein responsive to executing the instructions, a processor performs operations comprising:

providing avatar information to a set-top box to enable the set-top box to present an avatar at a display device, wherein the processor is remote from the set-top box, and wherein the processor is in communication with the set-top box over a network;

receiving a communication exchange from between a user and the avatar, wherein the communication exchange includes a response to results from a search request from the user;

identifying a change in an emotional state of the user by analyzing the communication exchange between the avatar and the user, wherein the analyzing includes an analysis of images of the user and one of a context of speech of the user, a prosody of speech of the user, a grammatical structure of speech of the user, or any combination thereof;

generating an alternative search request for the user responsive to detecting a negative change in the emotional state of the use;

presenting the alternative search request to the user via the set-top box; and

adapting characteristics of the avatar to generate an adapted avatar according to the change in the emotional state of the user.

19. The non-transitory, machine-readable storage medium of claim 18, wherein the operations further comprise:

capturing the images of the user during the communication exchange; and

analyzing a physiological expression of the user detected via utilizing image recognition applied to the images captured of the user during the communication exchange, and

wherein the identifying of the change in the emotional state is according to the analyzing of the physiological expression.

20. The non-transitory, machine-readable storage medium of claim 18, wherein the operations further comprise:

detecting a negative change in the emotional state of the user;

adapting characteristics of the avatar to counteract the negative change;

identifying from a profile and the negative change an another alternative search procedure to counteract the negative change, the profile being associated with the set-top box; and

adjusting the search request for media content to generate other adjusted adapted search according to the other alternative search procedure.