Method of selecting a second content based on a user's reaction to a first content

• US 9,513,699 B2
• Filed: 10/24/2007
• Issued: 12/06/2016
• Est. Priority Date: 10/24/2007
• Status: Expired due to Fees

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Inventors: Jung, Edward K. Y., Levien, Royce A., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US11/977,752
• Publication Number:
  US 20090113298A1
• Time in Patent Office: 3,331 Days
• Field of Search: 715/829
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06Q 30/0212 Chance discounts or incentives

Abstract

Embodiments include an apparatus, a system, a device, a computer program product, and a method. A method embodiment includes a method implemented in an environment that includes a person interacting with an electronic device via a user device. The method includes detecting a reaction by the person to a displayed first content. The method also includes determining a content attribute of the displayed first content. The method further includes facilitating a search for a second content based on the detected reaction and on the determined content attribute. The method includes displaying the second content in a manner perceivable by the person.

Claims

1. A method, comprising:

providing a computing device, the computing device including at least;

at least one processing device;

at least one memory;

at least one display;

at least one microphone;

at least one touch-sensitive keyboard; and

at least one optical sensor;

displaying a first content on the at least one display;

detecting a reaction by a person to the displayed first content, including at least;

acquiring at least some physiological-based data associated with the person, including at least (i) at least one sub-vocalization and at least one audio level associated with the at least one sub-vocalization from the at least one microphone, (ii) at least one keyed command and at least some key pressure data associated with the at least one keyed command from the at least one touch-sensitive keyboard, and (iii) at least a sensed gaze and a sensed dwell time associated with the sensed gaze from the at least one optical sensor; and

applying a pattern matching algorithm to the at least some physiological-based data associated with the person, the pattern matching algorithm operable to detect a change in physiological state indicative of the reaction by the person to the displayed first content;

searching for a second content at least partially based on the displayed first content and the detected reaction by the person to the displayed first content, including at least;

determining a first attribute, the first attribute including at least one of a file type, a category, or a classification associated with the displayed first content;

determining a second attribute, the second attribute including at least one of a recognized image object, a user tag, a subject, a color, a texture, a theme, or a description associated with the displayed first content;

identifying at least one correlation between the first attribute, the second attribute, and the detected reaction, the identified correlation including at least one of a positive reaction to the displayed first content or a negative reaction to the displayed first content;

causing a search for a second content, including at least;

causing, responsive to a positive reaction to the displayed first content, a search for a second content including at least the common first attribute and the common second attribute;

or

causing, responsive to a negative reaction to the displayed first content, a search for a second content having one of (a) a common first attribute and a different second attribute or (b) a different first attribute and a common second attribute;

storing, in the at least one memory, one or more results of the caused search; and

selecting, from the one or more results of the caused search, a second content distinct from the first content; and

displaying the selected second content on the at least one display.

2. The method of claim 1, wherein the displaying a first content on the at least one display comprises:

displaying the first content on the at least one display, including at least displaying the first content in a manner perceivable by the person.

3. The method of claim 1, further comprising:

maintaining informational data corresponding to the second content.

4. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least one of sensing, identifying, or recognizing the reaction by the person to the displayed first content.

5. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least detecting a response by the person to the displayed first content.

6. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least detecting a physical reaction by the person to the displayed first content.

7. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least detecting an emotional reaction by the person to the displayed first content.

8. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least directly detecting from the person a response of the person to the displayed first content.

9. The method of claim 1, wherein the detecting a reaction by a person to the displayed first content comprises:

detecting the reaction by the person to the displayed first content, including at least detecting a reaction state of the person to the displayed first content.

10. The method of claim 1, wherein the causing a search for a second content comprises:

causing the search for the second content, including at least searching a local data store for the second content.

11. The method of claim 1, wherein the causing a search for a second content comprises:

causing the search for the second content, including at least facilitating a search by a search engine for the second content.

12. The method of claim 1, wherein the causing a search for a second content comprises:

causing the search for the second content, including at least facilitating a search by a Web search engine for the second content.

13. The method of claim 1, wherein the causing a search for a second content comprises:

causing the search for the second content, including at least facilitating a search for the second content by a search algorithm responsive to the detected reaction.

14. A system, comprising:

a device, the device including at least;

at least one processing device;

at least one memory;

at least one display;

at least one microphone;

at least one touch-sensitive keyboard; and

at least one optical sensor; and

one or more instructions that, when executed on the device, cause the device to at least;

display a first content on the at least one display;

detect a reaction by a person to the displayed first content, including at least;

acquiring at least some physiological-based data associated with the person, including at least (i) at least one sub-vocalization and at least one audio level associated with the at least one sub-vocalization from the at least one microphone, (ii) at least one keyed command and at least some key pressure data associated with the at least one keyed command from the at least one touch-sensitive keyboard, and (iii) at least a sensed gaze and a sensed dwell time associated with the sensed gaze from the at least one optical sensor; and

applying a pattern matching algorithm to the at least some physiological-based data associated with the person, the pattern matching algorithm operable to detect a change in physiological state indicative of the reaction by the person to the displayed first content;

search for a second content at least partially based on the displayed first content and the detected reaction by the person to the displayed first content, including at least;

determining a first attribute, the first attribute including at least one of a file type, a category, or a classification associated with the displayed first content;

determining a second attribute, the second attribute including at least one of a recognized image object, a user tag, a subject, a color, a texture, a theme, or a description associated with the displayed first content;

identifying at least one correlation between the first attribute, the second attribute, and the detected reaction, the identified correlation including at least one of a positive reaction to the displayed first content or a negative reaction to the displayed first content;

causing a search for a second content, including at least;

causing, responsive to a positive reaction to the displayed first content, a search for a second content including at least the common first attribute and the common second attribute;

or

causing, responsive to a negative reaction to the displayed first content, a search for a second content having one of (a) a common first attribute and a different second attribute or (b) a different first attribute and a common second attribute;

storing, in the at least one memory, one or more results of the caused search; and

selecting, from the one or more results of the caused search, a second content distinct from the first content; and

displaying the selected second content on the at least one display.

15. The system of claim 14, wherein the device comprises:

the device including at least one of a personal digital assistant (PDA), a mobile wireless communication device, a cell phone, a mobile communications device, a handheld communications device, or a portable computing device.

16. A system, comprising:

at least one processing device;

at least one memory;

at least one display;

at least one microphone;

at least one touch-sensitive keyboard;

at least one optical sensor;

circuitry configured for displaying a first content on the at least one display;

circuitry configured for detecting a reaction by a person to the displayed first content, including at least;

circuitry configured for acquiring at least some physiological-based data associated with the person, including at least (i) at least one sub-vocalization and at least one audio level associated with the at least one sub-vocalization from the at least one microphone, (ii) at least one keyed command and at least some key pressure data associated with the at least one keyed command from the at least one touch-sensitive keyboard, and (iii) at least a sensed gaze and a sensed dwell time associated with the sensed gaze from the at least one optical sensor;

circuitry configured for applying a pattern matching algorithm to the at least some physiological-based data associated with the person, the pattern matching algorithm operable to detect a change in physiological state indicative of the reaction by the person to the displayed first content;

circuitry configured for searching for a second content at least partially based on the displayed first content and the detected reaction by the person to the displayed first content, including at least;

circuitry configured for determining a first attribute, the first attribute including at least one of a file type, a category, or a classification associated with the displayed first content;

circuitry configured for determining a second attribute, the second attribute including at least one of a recognized image object, a user tag, a subject, a color, a texture, a theme, or a description associated with the displayed first content;

circuitry configured for identifying at least one correlation between the first attribute, the second attribute, and the detected reaction, the identified correlation including at least one of a positive reaction to the displayed first content or a negative reaction to the displayed first content;

circuitry configured for causing a search for a second content, including at least;

circuitry configured for causing, responsive to a positive reaction to the displayed first content, a search for a second content including at least the common first attribute and the common second attribute;

or

circuitry configured for causing, responsive to a negative reaction to the displayed first content, a search for a second content having one of (a) a common first attribute and a different second attribute or (b) a different first attribute and a common second attribute;

circuitry configured for storing, in the at least one memory, one or more results of the caused search; and

circuitry configured for selecting, from the one or more results of the caused search, a second content distinct from the first content; and

circuitry configured for displaying the selected second content on the at least one display.

17. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, the displayed first content including at least one image within at least one email received by the system.

18. The system of claim 16, wherein the circuitry configured for displaying a first content on the at least one display comprises:

the circuitry configured for displaying the first content on the at least one display, including at least displaying the first content in a manner perceivable by the person.

19. The system of claim 18, wherein the circuitry configured for displaying the first content on the at least one display, including at least displaying the first content in a manner perceivable by the person comprises:

the circuitry configured for displaying the first content on the at least one display, including at least displaying the first content in the manner perceivable by the person and in a manner designed to facilitate a detectable reaction from the person.

20. The system of claim 18, wherein the displaying the first content on the at least one display, including at least displaying the first content in a manner perceivable by the person comprises:

displaying the first content on the at least one display, including at least displaying the first content in the manner perceivable by the person and in a manner designed to facilitate a detectable reaction from the person.

21. The system of claim 16, further comprising:

circuitry configured for maintaining informational data corresponding to the second content.

22. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least one of sensing, identifying, or recognizing the reaction by the person to the displayed first content.

23. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content including at least detecting at least one of a positive or negative reaction by the person to the displayed first content.

24. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content at least partially based at least one indication that the person is viewing the displayed first content at least partially based on (i) the sensed gaze and (ii) the sensed gaze dwell time.

25. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least detecting a response by the person to the displayed first content.

26. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least detecting a physical reaction by the person to the displayed first content.

27. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least detecting an emotional reaction by the person to the displayed first content.

28. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least directly detecting from the person a response of the person to the displayed first content.

29. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least detecting a reaction state of the person to the displayed first content.

30. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, the displayed first content including at least one or more of at least some displayed search results, at least some Internet search results, at least some sports results, at least some query results, at least some program lists, at least some music lists, at least some file lists, or at least some directory search results.

31. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, the displayed first content including at least one or more of at least one displayed image, at least one avatar, at least one icon, at least one name, at least one title, at least one descriptor, or at least one broadcasted sound.

32. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, the displayed first content including at least one or more of at least one visual-based first content, at least one image-based first content, at least one text-based first content, or at least one sound-based first content.

33. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, the displayed first content including at least the content displayed by one or more of at least one mobile communications device, at least one handheld communications device, at least one desktop computing device, at least one limited resources computing device, at least one thin computing device, or at least one portable computing device.

34. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least searching a local data store for the second content.

35. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least facilitating a search by a search engine for the second content.

36. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least facilitating a search by a Web search engine for the second content.

37. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least facilitating a search for the second content by a search algorithm responsive to the detected reaction.

38. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least facilitating a search for at least two instances of second content.

39. The system of claim 16, wherein the circuitry configured for causing a search for a second content comprises:

the circuitry configured for causing the search for the second content, including at least facilitating a search via communicating with an Internet based search service.

40. The system of claim 16, wherein the circuitry configured for displaying the selected second content on the at least one display comprises:

the circuitry configured for displaying the selected second content on the at least one display, including at least displaying the selected second content in a manner perceivable by the.

41. The system of claim 16, wherein the circuitry configured for applying a pattern matching algorithm to the at least some physiological-based data associated with the person, the pattern matching algorithm operable to detect a change in physiological state indicative of the reaction by the person to the displayed first content comprises:

the circuitry configured for applying the pattern matching algorithm to the at least some physiological-based data associated with the person, including at least transmitting to a requestor at least one of raw sensor data, partially processed sensor data, or processed sensor data indicative of a response by the person to the displayed first content and receiving from the requestor data indicative of at least one content attribute of the displayed first content determined at least partially using the at least one of raw sensor data, partially processed sensor data, or processed sensor data indicative of a response by the person to the displayed first content.

42. The system of claim 16, wherein the circuitry configured for determining a first attribute, the first attribute including at least one of a file type, a category, or a classification associated with the displayed first content comprises:

the circuitry configured for determining the first attribute, including at least receiving data indicative of the first attribute at least partially via at least one of by network or by Internet, and

wherein the circuitry configured for determining a second attribute, the second attribute including at least one of a recognized image object, a user tag, a subject, a color, a texture, a theme, or a description associated with the displayed first content includes at least;

the circuitry configured for determining a second attribute, including at least receiving data indicative of the second attribute at least partially via the at least one of by network or by Internet.

43. The system of claim 16, wherein the circuitry configured for detecting a reaction by a person to the displayed first content comprises:

the circuitry configured for detecting the reaction by the person to the displayed first content, including at least determining at least one of interest or disinterest of the person in the displayed first content.