Perpetual memoire

• US 9,043,423 B2
• Filed: 04/19/2013
• Issued: 05/26/2015
• Est. Priority Date: 06/05/2012
• Status: Expired due to Fees

• Current Assignee: Forget You Not, Llc
• Original Assignee: Forget You Not, Llc
• Inventors: Mansfield, Richard J. W., Shani, Nissim, Shani, Daniel
• Primary Examiner(s): Osman, Ramy M
• Application Number:
  US13/866,748
• Publication Number:
  US 20140280634A1
• Time in Patent Office: 767 Days
• Field of Search: 709203-206, 709/217, 709/224, 706/11, 706/17, 455/412.1, 455/466
• US Class Current: 709/206
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests

Abstract

Among other things, an intelligent automated proxy for an party who wants to communicate a multimedia message about a life event an integrated, conversational manner using natural language dialog to a second party and provides information from which the life event, the communication, the manner of delivery, the future time, and the recipient can be determined.

Claims

1. A method comprising:

maintaining information characterizing one or more of an appearance, a voice, or a behavior of a person;

receiving information indicative of (a) content that is to be part of a message to be delivered to a recipient on behalf of the person, (b) a relationship between the person and the recipient, and (c) a delivery time for delivery of the message, in which the content, the delivery time, or both are not present in the received information;

inferring one or more of (i) the content based on the received information indicative of the content, including inferring at least some of the content at the delivery time, (ii) an identity of the recipient based on the received information indicative of the relationship between the person and the recipient, or (iii) the delivery time based on the received information indicative of the delivery time; and

delivering the message to the recipient at the delivery time on behalf of the person, the message including the content, the delivering including providing a customized natural language response to an input received from the recipient, the providing of the response comprising using a digital representation of the person generated based on one or more of the appearance, the voice, or the behavior of the person.

2. The method of claim 1, in which delivering the message includes delivering a multimedia message.

3. The method of claim 1, comprising generating the digital representation of the person based on one or more of the appearance, the voice, or the behavior of the person.

4. The method of claim 1, in which the digital representation of the person includes a representation of one or more of the following:

the voice of the person, the behavior of the person, or the appearance of the person.

5. The method of claim 1, in which providing a customized natural language response includes responding to a question or statement from the recipient.

6. The method of claim 5, in which providing a customized natural language response to the input received from the recipient includes forming a response to the question or statement based on one or more of (a) one or more of the appearance of the person, the voice of the person, or the behavior of the person, (b) information about a time period during which the person lived, or (c) autobiographical information about the person.

7. The method of claim 1, comprising generating the message based on (a) the information characterizing the appearance, the voice, or the behavior of the person, (b) the information indicative of the content that is to be part of the message, or (c) both (a) and (b).

8. The method of claim 1, in which receiving the information indicative of an identity of the recipient includes receiving a specification of the identity of the recipient.

9. The method of claim 1, in which receiving the information indicative of the delivery time includes receiving a specification of the delivery time.

10. The method of claim 1, in which receiving the information indicative of the delivery time includes receiving an identification of an event.

11. The method of claim 1, in which receiving the information indicative of the delivery time includes receiving a definition of a condition for occurrence of an event.

12. The method of claim 1, in which receiving the information indicative of the content that is to be part of the message includes receiving a specification of the content that is to be part of the message.

13. The method of claim 1, in which receiving the content that is to be part of the message includes receiving autobiographical information about the person.

14. The method of claim 1, comprising receiving information indicative of a manner of delivery of the message.

15. The method of claim 1, in which delivering the message to the recipient includes delivering the message when the person is not alive or not competent.

16. The method of claim 1, in which receiving the information indicative of the content that is to be part of the message, the identity of the recipient, and the delivery time includes receiving the information when the recipient is not alive or not competent.

17. The method of claim 1, comprising receiving at least some of the information characterizing one or more of the appearance, the voice, or the behavior of the person from the person.

18. The method of claim 17, in which receiving the information characterizing one or more of the appearance, the voice, or the behavior of the person comprises:

presenting a question to the person and receiving an answer to the question from the person.

19. The method of claim 17, in which receiving the information characterizing one or more of the appearance, the voice, or the behavior of the person includes conducting a natural language interaction with the person.

20. The method of claim 1, comprising conducting an automated analysis of publicly available online information to obtain at least some of the information characterizing one or more of the appearance, the voice, or the behavior of the person.

21. The method of claim 1, comprising maintaining information about a time period during which the person lived, and in which providing the customized natural language response includes providing the customized natural language response based on the information about the time period during which the person lived.

22. The method of claim 1, comprising maintaining autobiographical information about the person, and in which providing the customized natural language response includes providing the customized natural language response based on the autobiographical information about the person.

23. The method of claim 1, comprising receiving the input from the recipient.

24. The method of claim 23, comprising delivering a portion of the message to the recipient prior to receiving the input from the recipient.

25. The method of claim 1, in which the customized natural language response comprises a response that is prepared specifically for the recipient.

26. The method of claim 1, in which the customized natural language response comprises a response that is prepared specifically in response to a question, statement, or request by the recipient.

27. The method of claim 1, in which one or more of the content, the identity of the recipient, or the delivery time are inferred based at least in part on results of an automated analysis of publicly available online information.

28. A method comprising:

receiving (a) information characterizing one or more of an appearance, a voice, or a behavior of a person and (b) information indicative of a relationship between the person and a recipient;

inferring an identity of the recipient based on the received information indicative of the relationship between the person and the recipient; and

providing a customized natural language response to an input received from the recipient, the providing of the response comprising using a digital representation of the person that is generated based on one or more of the appearance, the voice, or the behavior of the person,

in which the person is not alive or not competent when the natural language interaction is conducted.

29. The method of claim 28, in which providing the natural language response includes generating the natural language response based on one or more of (a) one or more of the appearance, the voice, or the behavior of the person, (b) information about a time period during which the person lived, or (c) autobiographical information about the person.

30. The method of claim 28, comprising determining a context of the natural language response based on one or more of (a) one or more of the appearance, the voice, or the behavior of the person, (b) information about a time period during which the person lived, or (c) autobiographical information about the person.

31. The method of claim 30, in which the context of the natural language response includes a time at which the natural language response is to be provided, a style of the natural language response, or both.

32. The method of claim 28, comprising determining a content of the natural language response based on one or more of (a) one or more of the appearance, the voice, or the behavior of the person, (b) information about a time period during which the person lived, or (c) autobiographical information about the person.

33. The method of claim 32, in which the content of the natural language response includes autobiographical information about the person.

34. The method of claim 28, in which the digital representation of the person includes a representation of one or more of the following:

the voice of the person, the behavior of the person, or the appearance of the person.

35. The method of claim 28, comprising receiving the input from the recipient.

36. The method of claim 28, comprising receiving the information indicative of the identity of the recipient when the recipient is not alive or not competent.

37. A system comprising:

a storage device for maintaining information characterizing one or more of an appearance, a voice, or a behavior of a person; and

an analytics engine for;

receiving information indicative of (a) content that is to be part of a message to be delivered to a recipient on behalf of the person, (b) a relationship between the person and the recipient, and (c) a delivery time for delivery of the message, in which the content, the delivery time, or both are not present in the received information,

inferring one or more of (i) the content based on the received information indicative of the content, including inferring at least some of the content at the delivery time, (ii) an identity of the recipient based on the received information indicative of the relationship between the person and the recipient, or (iii) the delivery time based on the received information indicative of the delivery time, and

delivering the message to the recipient at the delivery time on behalf of the person, the message including the content, the analytics engine configured to provide a customized natural language response to an input received from the recipient, the providing of the response comprising using a digital representation of the person generated based on one or more of the appearance, the voice, or the behavior of the person.

38. The system of claim 37, in which the analytics engine is configured to generate the digital representation of the person for display on a user interface.

39. The system of claim 37, in which providing a natural language response to an input received from the recipient includes responding to a question or statement from the recipient.

40. A system comprising:

a communication engine for receiving (a) information characterizing one or more of an appearance, a voice, or a behavior of a person and (b) information indicative of a relationship between the person and a recipient; and

an analytics engine for;

inferring the identity of the recipient based on the received information indicative of the relationship between the person and the recipient, and

providing a customized natural language response to an input received from the recipient, the providing of the response comprising using a digital representation of the person that is generated based on one or more of the appearance, the voice, or the behavior of the person,

in which the person is not alive or not competent when the natural language interaction is conducted.

41. The system of claim 40, in which the analytics engine is configured to generate the digital representation of the person for display on a user interface.

42. A method comprising

receiving information from which at least one of the following can be derived:

content of a message to be delivered from a first party to a second party about a life event, a manner of delivery of the message, a future time when the message is to be delivered, or the identity of the second party, in which the received information includes information indicative of a relationship between the first party and the second party, in which the content, the future time, or both are not present in the received information,

inferring one or more of the content, the manner of delivery, the future time, or the identity of the second party based at least in part on at least some of the received information, including inferring the identity of the second party based on the received information indicative of the relationship between the first party and the second party,

automatically on behalf of the first party, forming, based on the received information and one or more of the inferred content or the inferred manner of delivery, an integrated, conversational multimedia message that is to be part of a customized natural language dialog with the second party.

43. The method of claim 42, in which the integrated, conversational multimedia message is automatically formed by an intelligent proxy on behalf of the first party.

44. The method of claim 42, in which the integrated, conversational multimedia messages is formed to be responsive to natural language communication received from the second party.

45. The method of claim 43, in which the intelligent proxy enables a user to interact with online services to obtain information related to the message.

46. The method of claim 42, in which the automatic forming of the message comprises imbuing a digital surrogate with qualities associated with the first party, the manner of delivery of the message, the time of delivery of the message, or the second party.

47. The method of claim 42, comprising receiving the information interactively.

48. The method of claim 47, comprising receiving the information by an interrogation avatar.

49. The method of claim 42, comprising receiving the information the form of one or more of images, video, voice, or behavioral gestures of the first party.

50. The method of claim 42, comprising forming the message in response to a conventionally asked question from the second party.

51. The method of claim 42, in which the customized natural language dialog comprises an interactive obituary or a digitized life history of the first party.

52. A method comprising

maintaining digital information that enables the formation of an interactive digital surrogate of an originating person based on digital audio or video information derived from the originating person,

inferring an identity of a receiving person based at least in part on information provided by the originating person, the information indicative of a relationship between the originating person and the receiving person, and

at a time when the originating person is not alive or otherwise not available, causing the digital surrogate to engage in a customized natural language dialog with the receiving person.

53. The method of claim 52, in which the context of the natural language dialog is determined based on information that had been provided by the originating person.

54. The method of claim 53 in which the context comprises the time of the natural language dialog or the style of the natural language dialog.

55. A method comprising:

maintaining information characterizing one or more of an appearance, a voice, or a behavior of a person;

receiving information indicative of (a) a relationship between the person and a recipient and (b) a delivery time for delivery of a message to be delivered to the recipient on behalf of the person, in which the delivery time is not present in the received information;

inferring one or more of (i) an identity of the recipient based on the received information indicative of the relationship between the person and the recipient or (ii) the delivery time based on the received information indicative of the delivery time; and

delivering the message to the recipient at the delivery time on behalf of the person, the delivering including providing a customized natural language response to an input received from the recipient, the natural language response comprising a digital representation of the person based on at least some of the information characterizing one or more of the appearance, the voice, or the behavior of the person.