Personalized messaging determined from detected content

• US 7,921,037 B2
• Filed: 04/01/2002
• Issued: 04/05/2011
• Est. Priority Date: 04/01/2002
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Hertling, William Edward, Whitmarsh, Michael Dean
• Primary Examiner(s): Weiss; John G
• Assistant Examiner(s): Dagnew; Saba
• Application Number:
  US10/113,397
• Publication Number:
  US 20030187733A1
• Time in Patent Office: 3,291 Days
• Field of Search: 707/102, 707/516, 379/266.01, 379/90, 348/460, 358/1.15, 704/235
• US Class Current: 705/14.67
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0271 Personalized advertisement

Abstract

Personalized messages can be generated according to contents detected in communications between parties to a commercial transaction. The information streams between parties is monitored; spoken keywords, images, video or textual data are detected by pattern recognition, voice recognition or text matching. One or more subjects of the communication detected from recognized keywords, images, video or text data are used to generate a personalized message to one or more participants according to the detected subjects.

Claims

1. A method of providing personalized messages from detected content in an information stream sent between participants comprising the steps of:

receiving an information stream including at least one of;

an audio stream;

a video stream;

a still image frame;

textual data, the information stream received from a customer of a print service provider and received by a print brokering server, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server;

detecting in said information stream, at least one of a predetermined;

a spoken keyword;

an image;

or character string;

determining a subject in said information stream from said at least one spoken keyword, image, or character string;

sending to at least one participant including the customer of the print service provider, a personalized message related to said subject, the personalized message further related to services provided by the print service provider to the customer, wherein the personalized message is sent in a manner other than by being printed as part of the print job by the print service provider.

2. The method of claim 1 wherein said step of receiving said information stream includes the step of monitoring a voice communication between the customer and the print services provider.

3. The method of claim 1 wherein said step of receiving said information stream includes the step of:

monitoring a voice-over-internet protocol (VOIP) communication between the customer and the print services provider.

4. The method of claim 1 wherein said step of receiving said information stream includes the steps of:

monitoring a voice communication between the customer and the print services provider;

identifying spoken words by way of speech recognition.

5. The method of claim 1 wherein said step of receiving said information stream includes the step of monitoring a video signal between the customer and the print services provider.

6. The method of claim 1 wherein said step of receiving said information stream includes the steps of:

monitoring a video signal carried between the customer and the print services provider, said video signal being comprised of video frames;

identifying images by pattern matching in at least one video frame of said video signal.

7. The method of claim 1 wherein said step of receiving said information stream includes the steps of:

monitoring a video signal carried between the customer and the print services provider via a data network, said video signal being comprised of video frames;

identifying images by pattern matching in at least one video frame of said video signal.

8. The method of claim 1 wherein said step of receiving said information stream includes the step of monitoring a data stream of characters between said customer and the print services provider.

9. The method of claim 1 wherein said step of sending to at least one participant, a personalized message particularly related to said subject of said information stream includes the step of sending a personalized advertising message selected according to said keyword, image, or character string.

10. The method of claim 1 wherein said step of sending to at least one participant, a personalized message particularly related to said subject of said information stream includes the step of providing a personalized service according to said keyword, image, or character string.

11. The method of claim 1 wherein said step of sending to at least one participant, a personalized message particularly related to said subject of said information stream includes the step of adjusting the price of a service or product according to said spoken keyword, image, or character string.

12. The method of claim 1, further including generating participant profile information according to association of said keyword, image, or character string with participant identity.

17. The apparatus of claim 1 wherein said record comprises at least one of:

recognized utterances;

recognized images; and

, recognized character strings.

13. A method of receiving personalized messages that are generated from content detected in an information stream exchanged between a participant and a print service provider comprising the steps of:

sending an information stream from a participant to print service provider via a print brokering server, said information stream including at least one of;

an audio stream;

a video stream;

a still image frame;

textual data that is related to a subject of interest to said participant, the participant being a customer of the print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server;

receiving from said print brokering server, a personalized message that is related to said subject, the personalized message received by the customer, the personalized message further related to services provided by the print service provider to the customer, wherein the personalized message is sent in a manner other than by being printed as art of the print job by the print service provider.

14. The method of claim 13 wherein said step of sending an information stream includes the step of:

sending a voice-over-internet protocol (VOIP) communication between said participant and said print brokering server.

15. An apparatus for providing personalized messages from content identified using information in data sent from a first party to a second party via a network comprised of:

a print brokering server, said print brokering server being operably programmed to;

receive an information-bearing data stream from a customers computer via a data network;

detect in said information-bearing data stream at least one of;

spoken utterances, an image, or a character string;

identify at least one subject from detected utterances, image or character string; and

sending to the customers computer, a message related to said subject of said information stream,

wherein the first party is a customer of a print service provider, and the second party is the print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server, and

wherein the message is personalized and is related to services provided by the print service provider to the customer, and the personalized message is sent to the customer in a manner other than by being printed as part of the print job by the print service provider.

16. The apparatus of claim 15 further comprised of:

a customer communications database, operably coupled to said print brokering server, said customer communications database storing a record of at least one of;

recognized utterances;

recognized images;

recognized character strings.

18. The apparatus of claim 15 further comprised of:

a personalized message database, operably coupled to a first computer, said personalized message database storing at least one message to send to said customer'"'"'s computer from said print brokering server via said data network in response to the first computer'"'"'s identification of a subject of said information stream.

19. A system for providing customized messages that are created using information in data sent from a first party to a second party via a data network comprised of:

a first computer, operably coupled to a data network by which information streams can be routed, said first computer generating an information stream and sending said information stream to a print brokering server via said data network;

a print brokering server, said print brokering server being operably coupled to said data network and receiving there from, said information stream from said first computer, said print brokering server being operably programmed to;

detect in said data stream at least one of;

spoken utterances, an image, or a character string;

identify at least one subject from detected utterances, image or character string and sending to at least one participant, a message related to said subject of said information stream,

wherein the first party is a customer of a print service provider and the second party is the print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server, and

wherein the message is personalized and is related to services provided by the print service provider to the customer, and the personalized message is sent to the customer in a manner other than by being printed as part of the print job by the print service provider.

20. A computer storage medium, storing computer program instructions enabling a computer to:

receive an information-bearing data stream from another computer of a customer of a print service provider via a data network, the information-bearing data stream received by a print brokering server for a print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server;

detect in said data stream at least one of;

spoken utterances, an image, or a character string;

identify at least one subject from detected utterances, image or character string and

send to said other computer, a message related to said subject of said information stream, the message being personalized and received by the customer of the print service provider, the message related to services provided by the print service provider to the customer, wherein the personalized message is sent in a manner other than by being printed as art of the print job by the print service provider.

21. A computer storage medium containing program instructions enabling a computer to:

send information-bearing data to a print brokering computer via a data network, the information-bearing data sent by a customer of a print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering computer;

include in said data;

a spoken utterance, an image, or a character string usable by the print brokering computer to identify at least one subject; and

receive from said print brokering computer a personalized message related to the at least one subject, the personalized message being received by the customer, and is related to services provided by the print service provider to the customer, wherein the personalized message is sent to the customer in a manner other than by being printed as part of the print job by the print service provider.

22. A print brokering server comprised of:

means for receiving an information-bearing data stream from a customer'"'"'s computer via a data network, the information-bearing data stream received by a print brokering computer for a print service provider, the customer being a customer of the print service provider, the print service provider to print a print job received from the customer, the print service provider receiving the print job from a web server other than the print brokering computer;

means for detecting in said information-bearing data stream at least one of;

spoken utterances, an image, or a character string;

means for identifying at least one subject from detected utterances, image or character string; and

means for sending to the customer'"'"'s computer, a message related to said subject of said information stream, the message being a personalized message received by the customer, and is related to services provided by the print service provider to the customer, wherein the personalized message is sent in a manner other than by being printed as part of the print job by the print service provider.

23. The print brokering server of claim 22 wherein said means for receiving, said means for detecting, said means for identifying and said means for sending, are comprised of at least one processor and executable program instructions.

24. In a print brokering system, a client computer comprised of:

means for sending an information stream from a participant to print service provider via a print brokering server, said information stream including at least one of;

an audio stream;

a video stream;

a still image frame;

textual data that is related to a subject of interest to said participant, where the participant from which the information stream is received is a customer of the print service provider, the print service provider to print a print job received from the customer, the information stream specifically being received by the print brokering server, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server;

means for receiving from said print brokering server, a personalized message that is related to said subject, the personalized message received by the customer of the print service provider, the personalized message related to services provided by the print service provider to the customer, the personalized message sent to the customer in a manner other than printed as part of the print job by the print service provider.

25. The print brokering system of claim 24 wherein said means for receiving, and said means for sending, are comprised of at least one processor and executable program instructions.

26. In a print brokering system, a client computer comprised of:

a processor, capable of sending an information stream from a print service provider via a print brokering server, said information stream including at least one of;

an audio stream;

a video stream;

a still image frame;

textual data that is related to a subject of interest to said participant and for receiving from said print brokering server, a personalized message that is related to said subject,

wherein the information stream is sent by a customer of the print service provider, the print service provider to print a print job received from the customer, the print service provider being a business, the print service provider receiving the print job from a web server other than the print brokering server, and

wherein the personalized message is related to services provided by the print service provider to the customer, the personalized message being sent to the customer in a manner other than by being printed as part of the print job by the print service provider.