Animated toy utilizing artificial intelligence and facial image recognition

• US 7,062,073 B1
• Filed: 01/19/2000
• Issued: 06/13/2006
• Est. Priority Date: 01/19/1999
• Status: Expired due to Fees

• Current Assignee: Intelligent Verification Systems LLC
• Original Assignee: Intelligent Verification Systems LLC
• Inventors: Tumey, David M., Xu, Tianning
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US09/488,390
• Time in Patent Office: 2,337 Days
• Field of Search: 382116-127, 382/100, 382/276, 446/175, 700/31
• US Class Current: 382/118
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/28 Arrangements of sound-producing means in dolls; Means in dolls for producing sounds

Abstract

An articulated and animated toy capable of recognizing human users and selected inanimate objects and interacting therewith which includes a computer-based device having stored thereon encoded first human or human-like facial images, a video camera and video digitizer for acquiring data representative of a second human or human-like facial image, and software resident within said computer-based device for facial recognition, which includes Principal Component Analysis, Neural Networks, or another equivalent algorithm for comparing said first human or human-like facial images with said second human or human-like facial image and producing an output signal therefrom for use in identifying said human users. The apparatus can further include software for recognizing speech, generating speech and controlling animation of the articulated toy. In addition, said computer-based device is capable of learning and storing information pertaining to each of said human users such as name, age, sex, favorite color, etc., and to interact with each of said human users on an individual basis, providing entertainment tailored specifically to each of said human users.

Claims

1. An interactive entertainment apparatus operable to biometrically identify an imaged one of a plurality of animate or inanimate objects having facial or face-like characteristics by measuring the facial or face-like characteristics of the imaged object, the interactive entertainment apparatus comprising:

an entertainment device positionable in proximity to said plurality of animate or inanimate objects, the entertainment device being capable of providing entertaining interaction with said plurality of animate or inanimate objects;

an acquisition device associated with said entertainment device, said acquisition device being adapted to acquire a representation of a facial characteristic of an object in proximity to said entertainment device, and said acquisition device being adapted to produce a signal relative to the acquired representation; and

a processor associated with said acquisition device in a manner to receive the produced signal from said acquisition device, said processor being adapted to compare the produced signal relative to data stored in memory and to provide an output signal indicative of a facial recognition of a particular one of said animate or inanimate objects;

wherein the entertainment device provides said entertaining interaction in response to said output signal indicative of recognition.

2. The interactive entertainment apparatus of claim 1, wherein said entertainment device comprises a toy.

3. The interactive entertainment apparatus of claim 2, wherein said toy comprises a doll and said acquisition device is mounted to said doll.

4. The interactive entertainment apparatus of claim 2, wherein:

said toy comprises a doll; and

said acquisition device includes a camera contained within the head of said doll, said camera being situated to view objects located in front of the face of said doll.

5. The interactive entertainment apparatus of claim 4, wherein:

said processor is mounted inside said doll.

6. The interactive entertainment apparatus of claim 4, wherein:

said doll is a teddy bear; and

said camera is mounted within the head of said teddy bear in a position to view objects through the eye of said teddy bear.

7. The interactive entertainment apparatus of claim 1, wherein said entertainment device comprises a video game.

8. The interactive entertainment apparatus of claim 1, wherein:

said acquisition device comprises a camera for acquiring a representation of all objects in proximity to said entertainment device;

said acquisition device is adapted to produce a signal relative to the acquired representation of all objects in proximity to said entertainment device; and

said processor is adapted to locate a characteristic portion of said produced signal, the characteristic portion being a portion that corresponds to a facial characteristic of one of the objects in proximity to said entertainment device.

9. The interactive entertainment apparatus of claim 8, wherein:

said processor is further adapted to store representations of produced signals received from said acquisition device; and

said processor is adapted to compare a representation of a received signal relative to signal representations previously stored by said processor, to determine whether the received signal corresponds with a previous signal, and, if so, to provide an output signal indicative of recognition.

10. The interactive entertainment apparatus of claim 9, wherein:

said processor utilizes artificial intelligence to compare signal representations and determine whether the received signal corresponds with a previous signal.

11. An interactive entertainment apparatus comprising:

an entertainment device positionable in proximity to a person, the entertainment device capable of providing entertaining interaction with the person;

an acquisition device associated with said entertainment device, said acquisition device being adapted to acquire a representation of a facial characteristic of the person in proximity to said entertainment device, and said acquisition device being adapted to produce a signal relative to the acquired representation; and

a processor associated with said acquisition device in a manner to receive the produced signal from said acquisition device, said processor being adapted to compare the produced signal relative to data stored in memory and to provide an output signal indicative of facial recognition of a particular person;

wherein the entertainment device provides said entertaining interaction in response to said output signal indicative of recognition.

12. A toy comprising:

a camera and digitizer for acquiring representations of human facial images;

a CPU associated with said camera and digitizer and capable of manipulating signals therefrom;

a speaker and sound controls whereby sounds produced by said toy may be controlled;

a computer readable medium having instructions for locating and biometrically recognizing said human facial images and providing an output facial image recognition signal indicative of a particular person;

wherein the toy provides entertaining interaction in response to said output facial image recognition signal;

said computer readable medium further having instructions capable of recognizing expressions in said facial images and providing a facial expression recognition signal indicative of recognition of said expressions; and

wherein said sound controls are responsive to said facial expression recognition signal to modify the sounds produced by said toy in relation to said facial expression recognition signal.

13. The toy of claim 12, wherein:

said toy further comprises a microphone for the detection of sounds in the proximity of said toy; and

said computer readable medium further having instructions adapted to recognize human speech included in sounds detected by said microphone and control the toy in response to recognized human speech.

14. The toy of claim 13, wherein:

said sound controls include software controls included in said software, said software controls being adapted to produce synthesized speech; and

said toy further comprises animation controls adapted to control one or more motions of the toy; and

said animation controls are responsive to said facial expression recognition signal to animate said toy in relation to said facial expression recognition-signal; and

said computer readable medium further having instructions adapted to produce synthesized speech choreographed with mechanical animation in response to recognition of said facial images and in response to recognition of said expressions.

15. The toy of claim 14, wherein said computer readable medium has instructions adapted for sending and receiving E-mail and providing other Internet-related interaction once said facial image is recognized.