Obtaining person-specific images in a public venue

• US 6,819,783 B2
• Filed: 11/14/2003
• Issued: 11/16/2004
• Est. Priority Date: 09/04/1996
• Status: Expired due to Term

• Current Assignee: Hysterical Sunset Limited
• Original Assignee: Centerframe, LLC
• Inventors: Goldberg, David A., Goldberg, Miriam D., Goldberg, Benjamin M., Goldberg, Martha B.
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US10/714,517
• Publication Number:
  US 20040156535A1
• Time in Patent Office: 368 Days
• Field of Search: 382/103, 382/115-119, 340/5.1, 340/5.2, 340/5.32, 340/5.83, 340/5.53, 340/5.7, 235/386, 235/382, 235/382.5, 386/117, 713/168
• US Class Current: 382/115
• CPC Class Codes: G03D 15/001 Counting; Classifying; Marking
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G07C 11/00 Arrangements, systems or apparatus for checking, e.g. the occurrence of a condition, not provided for elsewhere
• CPC Class Codes: G07C 2011/02 related to amusement parks
• CPC Class Codes: G07C 2011/04 related to queuing systems
• CPC Class Codes: G07C 9/253 visually
• CPC Class Codes: G07F 17/00 Coin-freed apparatus for hiring articles; Coin-freed facilities or services
• CPC Class Codes: G07F 17/26 for printing, stamping, franking, typing or teleprinting apparatus ticket printing or the like apparatus G07F17/42
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00137 Transmission
• CPC Class Codes: H04N 1/00143 Ordering
• CPC Class Codes: H04N 1/00145 : from a remote location
• CPC Class Codes: H04N 1/00148 : Storage information retrieval G06F16/00
• CPC Class Codes: H04N 1/00151 : with selective access
• CPC Class Codes: H04N 1/00167 : Processing or editing H04N1/00196 - H04N1/00201 take precedence
• CPC Class Codes: H04N 1/00172 : directly from a still digital camera or from a storage medium mounted in a still digital camera H04N1/0018 takes precedence
• CPC Class Codes: H04N 1/00188 : Printing, e.g. prints or reprints H04N1/0019, H04N1/00196 take precedence
• CPC Class Codes: H04N 1/0019 : on souvenir-type products or the like, e.g. T-shirts or mugs
• CPC Class Codes: H04N 1/00193 : to a portable storage medium, e.g. a read-writable compact disk
• CPC Class Codes: H04N 1/00209 : Transmitting or receiving image data, e.g. facsimile data, via a computer, e.g. using e-mail, a computer network, the internet, I-fax
• CPC Class Codes: H04N 1/00286 : with studio circuitry, devices or equipment, e.g. television cameras television studio circuitry, devices or equipment per se H04N5/222
• CPC Class Codes: H04N 1/00299 : with a television transmission apparatus, e.g. a videophone, a teletext system or a digital television system
• CPC Class Codes: H04N 1/00342 : with a radio frequency tag transmitter or receiver storage of additional information in an RFID tag attached to an image bearing paper sheet H04N1/32138
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence

Abstract

Collecting images of a patron in an entertainment venue is performed by facial recognition of the patron'"'"'s face within the images, simplifying the storage and distribution of the images for a patron. In order to enhance the reliability of the facial recognition system, information about the patron that is not directly related to most facial recognition systems, including clothes, height, other associated people, use of glasses and jewelry, disposition of facial hair, and more, can be used. Some of the characteristics used can be specific to a particular date or event, and which will not be more generally characteristic of the patron. The facial recognition system can also be used to identify the patron requesting images to be collected. The present invention also relates to the use of facial recognition in sorting and collecting images from an electronically-stored image collection, enabling the easy retrieval of images that are related to a particular person or set of people.

Claims

1. A method of distributing to a user a specific electronic image comprising a representation of a specific person from among a collection of electronic images containing representations of many persons, the method comprising the steps of:

performing facial recognition analysis on each electronic image in the image collection by which a facial identifier is determined for each face represented within each electronic image;

storing each electronic image in association with the facial identifier of each person represented within the electronic image;

obtaining a reference facial identifier from a source electronic image in which the specific person is represented;

selecting the specific electronic image for distribution on the basis of the similarity of the reference facial identifier to a facial identifier associated with the specific electronic image in conjunction with additional information that can be derived from the collection of electronic images, wherein the additional information comprises the association of the specific electronic image for distribution with a facial identifier of a second person.

2. The method of claim 1, wherein the second person'"'"'s facial identifier is associated with more than one electronic image in the collection with wich the specific person'"'"'s facial identifier is also associated.

3. The method of claim 1, wherein the specific person'"'"'s identifier is associated with a second electronic image in the collection with which a third person'"'"'s facial identifier is also associated, and in which the second and third person'"'"'s facial identifiers are associated with a third electronic image in the collection.

4. The method of claim 1, wherein the additional information further comprises characteristics of a temporary feature of the specific person, wherein the characteristics of the the feature can be determined from the distribution image.

5. The method of claim 4, wherein the temporary feature is selected from the group consisting of colors of clothes, presence of eyeglasses, colors of eyeglasses, hair color, makeup color, jewelry, hat shape, hat color, and facial hair distribution.

6. The method of claim 1, wherein the additional information further comprises membership of the facial identifier within a first cluster of facial identifier that has been formed using cluster analysis on facial identifiers from electronic images within the image collection.

7. The method of claim 6, wherein the first cluster of facial identifiers is modified by joining the first cluster and a second cluster using manual input from the user following visual inspection of at least one image from each of the first and second clusters.

8. The method of claim 6, wherein the first cluster of facial identifiers is sorted on the basis of age, and wherein additional facial identifiers are added to the cluster on the basis of their similarity to a predetermined number of facial identifiers selected from the group consisting of the oldest images, most recent images, or most dissimilar images.

9. The method of claim 8, wherein the predetermined number of facial identifiers is less than 5.

10. The method of claim 1, wherein the source electronic image is not within the collection.

11. The method of claim 10, wherein the source electronic image is transmitted via the Internet.

12. The method of claim 1, wherein the source electronic image is within the collection, and wherein the user manually chooses the specific person representation from the source image following visual inspection of the image.

13. The method of claim 12, wherein images from the collection are sorted for presentation to the user on the basis of the facial identifiers associated with the images.

14. The method of claim 13, wherein images with the largest number of facial identifiers that the user has not previously been presented are presented to the user, wherein the user can efficiently locate the specific person in the collection of images by inspecting only a subset of the images.

15. The method of claim 1, wherein images for distribution are selected on the basis of the number of facial identifiers associated with the images.

16. The method of claim 1, wherein the step of selecting utilizes a similarity metric for relating the likelihood of match of two different facial identifiers, wherein the value of the similarity metric relative to a predetermined value determines whether the facial identifiers are considered to match.

17. The method of claim 16, wherein the additional information alters the similarity metric between the reference facial identifier and a facial identifier associated with the distribution image.

18. The method of claim 1, wherein the reference facial identifier is determined from the analysis of multiple images comprising facial representations of the specific person.

19. The method of claim 18, wherein the one of the multiple images was previously selected from the image collection in a step of selecting.

20. A system for distributing to a user a specific electronic image comprising a representation of a specific person from among a colletion of electronic images containing representations of many persons, comprising:

a facial recognizer that generates a facial identifier for each facial representation within each image;

a storage device that stores each electronic image in association with the facial identifier of each person represented within the electronic image;

a reference facial identifier, which is obtained from a source electronic image in which the specific person is represented; and

a selector which receives the facial identifiers associated wich each image from the storage device and which further receives the reference facial identifier and which determines which image to distribute, wherein the selector selects the specific electronic image for distribution on the basis of the similarity of the reference facial identifier to a facial identifier associated wich the specific electronic image in conjunction with additional information that can be derived from the collection of electronic images,

wherein the additional information comprises the association of the specific electronic image for distribution with a facial identifier of a second person.

21. The system of claim 20, wherein the second person'"'"'s facial identifier is associated with more than one electronic image in the collection with which the specific person'"'"'s facial identifier is also associated.

22. The of claim 20, wherein the specific person'"'"'s facial identifier is associated with a second electronic in the collection with which a third person'"'"'s facial identifier is also associated, and in which the second and third person'"'"'s facial identifiers era associated with a third electronic image in the collection.

23. The system of claim 20, additionally comprising a camera, wherein the camera obtains a reference image of the specific person and the reference facial identifier is obtained from the reference image by the facial recognizer.

24. The system of claim 20, additionally comprising an Internet connection, wherein the selector receives the source electronic image from the user through the Internet connection.