Event classification method using lit candle detection

• US 8,634,660 B2
• Filed: 09/07/2011
• Issued: 01/21/2014
• Est. Priority Date: 09/07/2011
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Stubler, Peter O., Blose, Andrew C., Gallagher, Andrew Charles
• Primary Examiner(s): SHAH, UTPAL D
• Application Number:
  US13/226,842
• Publication Number:
  US 20130058542A1
• Time in Patent Office: 867 Days
• Field of Search: 382/100, 382/224
• US Class Current: 382/224
• CPC Class Codes: G06V 20/36 Indoor scenes

Abstract

A method for determining an event classification for digital images, comprising: receiving one or more digital images; detecting one or more lit candles within the one or more digital images; using a data processor to automatically determine an event classification responsive to analyzing a spatial arrangement of the detected lit candles in the one or more digital images; and storing metadata in a processor-accessible memory associating the determined event classification with each of the one or more digital images.

Claims

1. A method for determining an event classification for digital images, comprising:

receiving one or more digital images;

detecting one or more lit candles within the one or more digital images;

using a data processor to automatically determine an event classification responsive to analyzing a spatial arrangement of the detected lit candles in the one or more digital images; and

storing metadata in a processor-accessible memory associating the determined event classification with each of the one or more digital images.

2. The method of claim 1 wherein the one or more digital images are related digital images that were captured at a single event.

3. The method of claim 1 wherein the spatial arrangement of the detected lit candles is analyzed to detect the presence of a celebration cake.

4. The method of claim 3 further including:

determining an expected cake region based upon the spatial arrangement of the detected lit candles;

detecting the presence of a celebration cake in the expected cake region; and

extracting identifying features for the detected celebration cake;

wherein the determination of the event classification is further responsive to the extracted identifying features.

5. The method of claim 4 further including:

identifying an additional cake region in another digital image containing identifying features matching the identifying features for the detected celebration cake; and

extracting additional identifying features from the additional cake region;

wherein the determination of the event classification is further responsive to the additional identifying features.

6. The method of claim 4 wherein the extraction of the identifying features includes:

identifying a cake surface region; and

performing text recognition on the identified cake surface region to determine text features.

7. The method of claim 6 wherein a rectification transformation is applied to the identified cake surface region to correct projective distortion prior to performing the text recognition.

8. The method of claim 4 further including detecting one or more faces in the vicinity of the detected celebration cake, and wherein the determination of the event classification is further responsive to a spatial arrangement of the detected faces.

9. The method of claim 8 wherein one or more of the detected faces are identified to be guests of honor associated with the celebration event.

10. The method of claim 9 wherein a face recognition process is used to determine the identity of the guest of honor.

11. The method of claim 4 wherein the identifying features for the detected celebration cake are used to classify the celebration cake as a birthday cake, and in response the event classification is determined to be a birthday celebration.

12. The method of claim 4 wherein the identifying features for the detected celebration cake are used to classify the celebration cake as an anniversary cake, and in response the event classification is determined to be an anniversary celebration.

13. The method of claim 1 wherein the lit candles have associated candle flames, and wherein the analysis of the spatial arrangement of the detected lit candles includes computing a feature related to an orientation of one or more of the candle flames.

14. The method of claim 13 wherein the orientation of the candle flames is used to determine that the lit candles are being blown out.

15. The method of claim 1 wherein the determination of the event classification is further responsive to a calendar of known event dates and to a capture date for at least one of the digital images.

16. The method of claim 1 further including determining candle features related to the size, type, color or pattern of the lit candles wherein the determination of the event classification is further responsive to the determined candle features.

17. The method of claim 1 wherein the determined event classification is a birthday celebration event classification, a wedding event classification, an anniversary event classification, a ceremony event classification, or a holiday event classification.

18. The method of claim 1 wherein the spatial arrangement of the detected lit candles is analyzed to detect a pattern of candles associated with a particular holiday or ceremony.

19. The method of claim 18 wherein the spatial arrangement of the detected lit candles corresponds to an advent wreath and the event classification is determined to be a Christmas event classification.

20. The method of claim 18 wherein the spatial arrangement of the detected lit candles corresponds to a menorah and the event classification is determined to be a Hanukah event classification.

21. The method of claim 18 wherein the spatial arrangement of the detected lit candles corresponds to a wedding unity candle arrangement and the event classification is determined to be a wedding event classification.

22. The method of claim 1 wherein the determined event classification is used to classify at least one additional digital image that is determined to be related to the one or more digital images.

23. The method of claim 1 further including producing a photo product associated with the determined event classification using one or more of the digital images.

24. A non-transitory computer readable medium having instructions stored thereon that upon execution by a computing device, cause the computing device to perform operations comprising:

receiving one or more digital images;

detecting one or more lit candles within the one or more digital images;

automatically determining an event classification responsive to analyzing a spatial arrangement of the detected lit candles in the one or more digital images; and

storing metadata associating the determined event classification with each of the one or more digital images.

25. An apparatus comprising:

a processor configured to detect one or more lit candles within one or more digital images and automatically determine an event classification responsive to analyzing a spatial arrangement of the detected lit candles in the one or more digital images; and

a processor-accessible memory configured to store metadata associating the determined event classification with each of the one or more digital images.