Method and apparatus for detecting events indicative of inappropriate activity in an online community

• US 9,137,318 B2
• Filed: 01/16/2009
• Issued: 09/15/2015
• Est. Priority Date: 01/16/2008
• Status: Active Grant

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Hong, Jack L.
• Primary Examiner(s): DINH, KHANH Q
• Application Number:
  US12/355,137
• Publication Number:
  US 20090182872A1
• Time in Patent Office: 2,433 Days
• Field of Search: 709/223, 709/227, 709/229, 715/706, 705/76
• US Class Current: 1/1
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: H04L 63/1416 Event detection, e.g. attack signature detection
• CPC Class Codes: H04L 63/30 for supporting lawful interception, monitoring or retaining of communications or communication related information circuit switched telephony call monitoring H04M3/2281
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method of detecting events in a computer-implemented online community includes providing a computer-implemented event processor, providing the computer-implemented event processor with a description of at least one event to be detected, automatically analyzing messages of the online community with the computer-implemented event processor to detect the at least one event, and issuing a notification of a detected event. Also an apparatus for carrying out the method.

Claims

1. A method of detecting events in a computer-implemented online community comprising:

providing a computer-implemented event processor;

providing the computer-implemented event processor with a description of at least one event to be detected;

automatically analyzing messages of the online community with the computer-implemented event processor to detect the at least one event; and

issuing a notification of the detected at least one event,

wherein providing a computer-implemented event processor comprises providing a computer processor configured to receive a stream of data and determine that the at least one event has occurred only when a plurality of conditions, including at least one condition based on the content of the stream of data, have been satisfied.

2. The method of claim 1 wherein the computer-implemented event processor is configured to analyze the data in real time.

3. The method of claim 1 wherein the at least one condition includes a question regarding a person'"'"'s age.

4. The method of claim 3 wherein the at least one condition includes a question about a person'"'"'s gender.

5. The method of claim 1 wherein the at least one condition comprises a request for an in-person meeting.

6. The method of claim 1 wherein providing a computer-implemented event processor comprises providing a computer processor configured to receive a stream of data and search for predetermines strings of data in real time.

7. The method of claim 1 wherein the messages include data identifying a sender of the messages and including analyzing a database of user profiles to select a first set of users and wherein the event to be detected comprises a string of data from a user in the first set of users.

8. The method of claim 1 wherein the messages include data identifying a sender of the messages and wherein the event to be detected comprises a plurality of data strings generated by a given sender in a plurality of messages.

9. The method of claim 1 wherein the online community comprises a social networking site.

10. The method of claim 1 wherein the online community comprises a virtual world.

11. The method of claim 1 wherein the online community comprises a massively multiplayer role-playing game.

31. The method of claim 1, including identifying a message associated with the at least one detected event, wherein issuing a notification comprises sending a notification message to an address that is not an address of a sender of the message associated with the at least one detected event and that is not an address of a designated recipient of the message associated with the at least one detected event.

12. A method of detecting a possible pedophile in a computer-implemented online community comprising:

providing a computer-implemented event processor;

providing the computer-implemented event processor with a description of events indicative of pedophile activity;

automatically analyzing data streams of the online community to detect the events;

issuing a notification of a detected event,

identifying all messages generated by a given user, determining an age of the given user, and determining ages of the recipients of messages from the given user and wherein automatically analyzing data streams of the online community to detect the events comprises analyzing the data streams to detect when the age of the given user is greater than a first age and the ages of the recipients of messages from the given user are less than a second age.

13. The method of claim 12 including detecting in the data streams of the online community potentially inappropriate requests, said potentially inappropriate requests being selected from the group consisting of requests for a person'"'"'s age, requests for a person'"'"'s gender, and requests for an in-person meeting.

14. The method of claim 12 including detecting in the data streams of the online community potentially inappropriate words, said potentially inappropriate words being selected from the group consisting of words related to an in-person meeting and words identifying a geographic location.

15. The method of claim 13 including identifying all messages generated by a given user and wherein detecting an event comprises detecting more than a given number of potentially inappropriate requests in the messages generated by the given user.

16. The method of claim 13 including identifying all messages generated by a given user and wherein detecting an event comprises detecting that more than a given proportion of the all messages generated by a given user comprise potentially inappropriate requests.

17. The method of claim 12 wherein the online community comprises a social networking site.

18. The method of claim 12 wherein the online community comprises a virtual world.

19. The method of claim 12 wherein the online community comprises a massively multiplayer role-playing game.

32. The method of claim 12, including identifying messages associated with the detected events, wherein issuing a notification comprises sending a notification message to an address that is not an address of a sender of the messages associated with the at least one detected event and that is not an address of a designated recipient of the messages associated with the at least one detected event.

20. An apparatus comprising:

a computer-implemented event processor;

means for providing the computer-implemented event processor with message data from an online community; and

means for providing the computer-implemented event processor with a description of at least one event to be detected, the event comprising first and second conditions being satisfied, the first condition being based on the message data;

wherein the computer-implemented event processor is configured to automatically analyze messages of the online community to detect the at least one event and issue a notification only when the first and second conditions have been satisfied.

21. The apparatus of claim 20 wherein the means for providing the computer-implemented event processor with a description of at least one event comprises a database in communication with the computer-implemented event processor storing the description of the at least one event.

22. The apparatus of claim 20 wherein the computer-implemented event processor comprises a computer processor programmed to receive a stream of data and search for predetermines strings of data in real time.

23. The apparatus of claim 20 including a database storing information used by the event processor when determining whether messages of the online community comprise an event.

33. The apparatus of claim 20, wherein the computer-implemented event processor is further configured to identify a message associated with the at least one event to be detected and to send a notification message to an address that is not an address of a sender of the message associated with the at least one event to be detected and that is not an address of a designated recipient of the message associated with the at least one event to be detected.

24. An article of manufacture comprising a non-transitory computer usable medium having a computer readable code means embodied therein for causing a computer to detect events in an online community, the computer readable code in said article of manufacture comprising:

computer readable code means for implementing an event processor;

computer readable code means describing at least one event to be detected;

computer readable code means for causing the event processor to automatically analyze messages of the online community;

computer readable code means for causing the event processor to issue a notification only when at least two conditions related to a given message have been satisfied.

34. The article of manufacture of claim 24, wherein the computer readable code means for causing the event processor to issue a notification comprises computer readable code means for causing the event processor to send a notification message identifying the given message to an address that is not an address of a sender of the given message and that is not an address of a designated recipient of the given message.

25. An article of manufacture comprising a computer usable medium having a computer readable code means embodied therein for causing a computer to detect events indicative of pedophile activity in an online community, the computer readable code in said article of manufacture comprising:

computer readable code means for implementing an event processor;

computer readable code means describing at least one event indicative of pedophile activity to be detected;

computer readable code means for automatically analyzing data streams of the online community to detect the at least one event;

computer readable code means for identifying all messages generated by a given user;

computer readable code means for determining an age of the given user, and determining ages of the recipients of messages from the given user; and

computer readable code means for issuing a notification that the at least one event has been detected,

wherein automatically analyzing data streams of the online community to detect the events comprises analyzing the data streams to detect when the age of the given user is greater than a first age and the ages of the recipients of messages from the given user are less than a second age.

35. The article of manufacture of claim 25, wherein the computer readable code means for issuing a notification comprises computer readable code means for sending a notification message to an address that is not an address of the given user and that is not an address of one of the recipients of said all messages.

26. A method of detecting events in a computer-implemented online community comprising:

automatically analyzing messages from at least one sender to at least one recipient with a computer-implemented event processor;

detecting words or phrases in the messages potentially indicative of inappropriate activity;

detecting an aggravating condition; and

issuing an event notification based on the detected words or phrases only if the aggravating condition is also detected.

27. The method of claim 26 wherein the aggravating condition comprises information from a user profile of the at least one recipient.

28. The method of claim 26 wherein the aggravating condition comprises information from a user profile of the at least one sender.

29. The method of claim 26, wherein the aggravating condition comprises information regarding previous actions of the at least one sender.

30. The method of claim 26 wherein issuing an event notification comprises issuing a notification to a person other than the at least one sender and the at least one recipient.

36. The method of claim 26, including identifying a message including the detected words or phrases, wherein issuing an event notification comprises sending a notification message to an address that is not an address of the at least one sender and that is not an address of the at least one recipient.