Method, apparatus, and system for object recognition, object segmentation and knowledge acquisition

• US 7,785,180 B1
• Filed: 07/14/2006
• Issued: 08/31/2010
• Est. Priority Date: 07/15/2005
• Status: Expired due to Fees

• Current Assignee: Carnegie Mellon University
• Original Assignee: Carnegie Mellon University
• Inventors: von Ahn, Luis, Liu, Ruoran, Veloso, Maria Manuela, Blum, Manuel, Efros, Alexei A.
• Primary Examiner(s): Vo; Peter DungBa
• Assistant Examiner(s): Lim; Seng Heng
• Application Number:
  US11/486,561
• Time in Patent Office: 1,509 Days
• Field of Search: 463/9, 273236-243, 273/270, 273/282.1, 434/322, 446/414
• US Class Current: 463/9
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/80 Special adaptations for executing a specific game genre or game mode
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method, comprising displaying an image to a first player, displaying a portion of the image to a second player wherein the portion of the image displayed to the second player is less than all of the image and wherein the portion of the image displayed to the second player is determined by an action of the first player, allowing the second player to submit a word, and determining whether the word submitted by the second player is related to the image. The present invention also includes apparatuses and systems.

Claims

1. A computer readable memory device having computer-readable instructions recorded thereon which, when executed by a processor, causes the processor to perform a method, comprising:

displaying, on a first I/O device, an image to a first player;

associating, by the processor, a word with the image;

displaying, on the first I/O device, the word to the first player;

selecting, via the first I/O device, a portion of the image to be displayed on a second I/O device to a second player, wherein selecting the portion of the image is performed by the first player after displaying the word and the image on the first I/O device to the first player;

displaying, on the second I/O device, the portion of the image to the second player, wherein the portion of the image displayed to the second player is less than all of the image, wherein the portion of the image displayed to the second player is less than the image displayed to the first player, and wherein the portion of the image displayed to the second player is determined by an action of the first player;

allowing, by the processor, the second player to submit a word in response to displaying, on the second I/O device, the portion of the image to the second player, wherein the portion of the image displayed to the second player is less than the image displayed to the first player; and

determining, by the processor, whether the word submitted by the second player is related to the image.

2. The method of claim 1, wherein determining whether the word submitted by the second player is related to the image includes determining whether the word submitted by the second player is the word associated with the image.

3. The method of claim 2, wherein associating the word with the image is selected from a group comprising associating the word with the image prior to displaying the image to the first player, allowing the first player to associate the word with the image, and associating a plurality of words with the image.

4. The method of claim 2, wherein determining whether the word submitted by the second player is the word associated with the image is selected from a group comprising determining whether the word submitted by the second player is a misspelled form of the word associated with the image, and determining whether the word submitted by the second player is a synonym for the word associated with the image.

5. The method of claim 1, further comprising:

displaying an additional portion of the image to the second player, wherein the additional portion of the image displayed to the second player is determined by an action of the first player, and wherein the additional portion of the image is displayed to the second player if it is determined that the word submitted by the second player is not related to the image;

allowing the second player to submit an additional word; and

determining whether the additional word submitted by the second player is related to the image.

6. The method of claim 1, further comprising:

identifying an image and a corresponding word submitted by the second player that were determined to be related to each other;

identifying additional information associated with the word and image; and

storing to a memory the word, the image, and the additional information associated with the word and the image.

7. The method of claim 6, wherein identifying additional information associated with the word and image is selected from a group comprising identifying the word with a portion of the image revealed to the second player, identifying the word with a portion of the image that was “

pinged”

by the first player, and identifying a hint given by the first player to the second player with the word and image.

8. The method of claim 1, wherein the action of the first player that determines the portion of the image displayed to the second player is clicking on the portion of the image with a computer pointer.

9. The method of claim 1 wherein the second player includes a plurality of second players, and wherein:

displaying a portion of the image includes displaying a portion of the image to each of the plurality of second players, wherein the portion of the image displayed to each of the plurality of second players is less than all of the image and wherein the portion of the image displayed to each of the second players is determined by an action of the first player;

allowing the second player includes allowing each of the second players to submit a word; and

determining includes determining for each of the plurality of second players whether the word submitted is related to the image.

10. The method of claim 1, wherein displaying a portion of the image to a second player includes preventing at least one predetermined portion of the image from being displayed to the second player.

11. The method of claim 1, further comprising allowing the first player to provide a hint to the second player regarding the word associated with the image.

12. The method of claim 1, further comprising allowing the first player to identify to the second player a particular part of the portion of the image displayed to the second player.

13. The method of claim 1, wherein at least one player is a computer.

14. The method of claim 1, wherein displaying a portion of the image to the second player includes a computer performing predetermined actions to display a portion of the image to the second player.

15. A system, comprising:

a network;

a first I/O device connected to the network;

a second I/O device connected to the network;

a processor and a memory connected to at least one of the network, the first I/O device, and the second I/O device, wherein the memory includes computer-readable instruction which, when executed, cause;

the processor to associate a word with an image;

the first I/O device to display the image;

the first I/O device to display the word;

the first I/O device to receive an input from a first player indicative of a portion of the image to be displayed on the second I/O device to a second player, wherein the input is received after the first I/O device displays the image and the word to the first player;

the second I/O device to display a portion of the image, wherein the portion of the image displayed on the second I/O device is less than all of the image, wherein the portion of the image displayed on the second I/O device is less than the image displayed to the first I/O device, and wherein the portion of the image displayed on the second I/O device is determined by the input received by the first I/O device;

the second I/O device to receive an input from the second player after the portion of the image is displayed on the second I/O device, wherein the portion of the image displayed on the second I/O device is less than the image displayed on the first I/O device; and

the processor to determine whether the input from the second I/O device is related to the image.

16. The system of claim 15, wherein the memory includes computer-readable instruction which, when executed, further cause:

the processor to determine whether the input from the second I/O device is the word associated with the image.

17. The system of claim 15, wherein the memory includes computer-readable instruction which, when executed, further cause:

the second I/O device to display an additional portion of the image, wherein the additional portion of the image displayed on the second I/O device is determined by the input received by the first I/O device and wherein the additional portion of the image is displayed on the second I/O device if it is determined that the input from the second I/O device is not related to the image;

the second I/O device to receive an additional input after the additional portion of the image is displayed on the second I/O device; and

the processor to determine whether the additional input from the second I/O device is related to the image.

18. The system of claim 15, further comprising a memory including computer-readable instruction which, when executed, cause:

a processor to identify an image and a corresponding input submitted at the second I/O device that were determined to be related to each other;

the processor to identify additional information associated with the input and image; and

the memory to store the input, the image, and the additional information associated with the input and the image.

19. An apparatus, comprising:

a processor;

first and second I/O devices connected to the processor;

a memory connected to the processor, wherein the memory includes computer-readable instruction which, when executed, cause;

the processor to associate a word with an image;

the first I/O device to display the word;

the first I/O device to display the image;

the first I/O device to receive an input from a first player indicative of a portion of the image to be displayed on the second I/O device to a second player, wherein the input is received after the first I/O device displays the image and the word to the first player;

the second I/O device to display a portion of the image, wherein the portion of the image displayed on the second I/O device is less than all of the image, wherein the portion of the image displayed on the second I/O device is less than the image displayed to the first I/O device, and wherein the portion of the image displayed on the second I/O device is determined by the input received by the first I/O device;

the second I/O device to receive an input from the second player after the portion of the image is displayed on the second I/O device, wherein the portion of the image displayed on the second I/O device is less than the image displayed on the first I/O device; and

the processor to determine whether the input from the second I/O device is related to the image.

20. The apparatus of claim 19, wherein the first and second I/O devices are the same device which is shared by first and second people using the apparatus.

21. The apparatus of claim 19, wherein the memory includes computer-readable instruction which, when executed, further cause:

the processor to determine whether the input from the second I/O device is the word associated with the image.

22. The apparatus of claim 19, wherein the memory includes computer-readable instruction which, when executed, further cause:

the second I/O device to display an additional portion of the image, wherein the additional portion of the image displayed on the second I/O device is determined by an additional input received by the first I/O device;

the second I/O device to receive an additional input after the additional portion of the image is displayed on the second I/O device; and

the processor to determine whether the additional input from the second I/O device is related to the image.

23. The apparatus of claim 19, further comprising a memory includes computer-readable instruction which, when executed, cause:

a processor to identify an image and a corresponding input submitted at the second I/O device that were determined to be related to each other;

the processor to identify additional information associated with the input and image; and

the memory to store the input, the image, and the additional information associated with the input and the image.