Generating actions based on a user's mood

• US 10,248,850 B2
• Filed: 02/26/2016
• Issued: 04/02/2019
• Est. Priority Date: 02/27/2015
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Rihn, William S., Weddle, Amaya Becvar, Birnbaum, David M.
• Primary Examiner(s): Potts, Ryan P
• Application Number:
  US15/054,587
• Publication Number:
  US 20160253552A1
• Time in Patent Office: 1,131 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/52 including functional features of a camera
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A system determines a mood of an associated user. Based on the determined mood, an action to be performed by the system is determined. The system then initiates the determined action by transmitting an object that corresponds to the determined mood to another system.

Claims

1. A method of operating an electronic device, the method comprising:

determining a mood of a first user associated with a first electronic device based on a physical attribute of the first user, wherein the physical attribute comprises an input pressure applied by the first user to the first electronic device, and wherein said determining a mood of the first user includes determining a deviation of the input pressure from a normal input in an input profile;

determining an action to be performed by the first electronic device based on the determined mood;

initiating the determined action, wherein the initiating of the determined action comprises transmitting an object that corresponds to the determined mood to a second electronic device, and wherein the object includes a haptic effect that reflects the determined mood; and

modulating the determined action to be generated for a second user associated with the second electronic device based on mood information of the second user detected prior to the transmitting of the object to the second electronic device,

wherein the modulating of the determined action is performed by a processor of the first electronic device.

2. The method of claim 1, wherein the physical attribute further comprises facial cues of the first user that is determined based on a camera on the first electronic device.

3. The method of claim 1, wherein the physical attribute further comprises at least one of a sensed biomarker of the first user, or a voice of the first user.

4. The method of claim 1, wherein the initiating of the determined action comprises automatically selecting and attaching the object comprising an emoticon or an electronic sticker to a message prepared by the first user.

5. The method of claim 4, wherein the determining of the action further comprises modifying the emoticon or electronic sticker based on the determined mood.

6. The method of claim 1, wherein the initiating of the determined action further comprises automatically transmitting to the second electronic device at least one of a visual effect that reflects the determined mood, or an audio effect that reflects the determined mood.

7. The method of claim 1, wherein the determining of the action is further based on a location of the first user.

8. The method of claim 1, wherein the modulating of the determined action includes accentuating, diminishing or altering a parameter of the determined action.

9. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to operate an electronic device, the operating comprising:

determining a mood of a first user associated with a first electronic device based on a physical attribute of the first user, wherein the physical attribute comprises an input pressure applied by the first user to the first electronic device, and wherein said determining a mood of the first user includes determining a deviation of the input pressure from a normal input pressure in an input profile;

determining an action to be performed by the first electronic device based on the determined mood;

initiating the determined action, wherein the initiating of the determined action comprises transmitting an object that corresponds to the determined mood to a second electronic device, and wherein the object includes a haptic effect that reflects the determined mood; and

modulating the determined action to be generated for a second user associated with the second electronic device based on mood information of the second user detected prior to the transmitting of the object to the second electronic device.

10. The computer readable medium of claim 9, wherein the physical attribute further comprises facial cues of the first user that is determined based on a camera on the first electronic device.

11. The computer readable medium of claim 9, wherein the physical attribute further comprises at least one of a sensed biomarker of the first user, or a voice of the first user.

12. The computer readable medium of claim 9, wherein the initiating of the determined action comprises automatically selecting and attaching the object comprising an emoticon or an electronic sticker to a message prepared by the first user.

13. The computer readable medium of claim 12, wherein the determining of the action further comprises modifying the emoticon or electronic sticker based on the determined mood.

14. The computer readable medium of claim 9, wherein the initiating of the determined action further comprises automatically transmitting to the second electronic device at least one of a visual effect that reflects the determined mood, or an audio effect that reflects the determined mood.

15. The computer readable medium of claim 9, wherein the determining of the action is further based on a location of the first user.

16. An apparatus, comprising:

a sensor for collecting first mood information for a first user associated with the apparatus;

a processor generating (i) a determined mood based on the first mood information based on a physical attribute of the first user, wherein the physical attribute comprises an input pressure applied by the first user to the apparatus, and wherein said processor generates the determined mood by determining a deviation of the input pressure from a normal input in an input profile, (ii) a determined action to initiate based on the determined mood, and (iii) a modulated action by modulating the determined action to be generated for a second user associated with a second apparatus based on second mood information of the second user detected prior to transmitting an object that corresponds to the determined mood to the second apparatus,

wherein the processor transmits the object that corresponds to the determined mood to the second apparatus, and

wherein the object includes a haptic effect that reflects the determined mood.

17. The apparatus of claim 16, further comprising:

a camera, wherein the physical attribute further comprises facial cues of the first user that is determined using the camera.

18. The apparatus of claim 16, wherein the physical attribute further comprises at least one of a sensed biomarker of the first user, or a voice of the first user.

19. The apparatus of claim 16, wherein the processor modulates the determined action by accentuating, diminishing or altering a parameter of the determined action.