Mood based virtual photo album

• US 6,931,147 B2
• Filed: 12/11/2001
• Issued: 08/16/2005
• Est. Priority Date: 12/11/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Trajkovic, Miroslav, Gutta, Srinivas, Colmenarez, Antonio
• Primary Examiner(s): Cougo, Jose L.
• Assistant Examiner(s): Lu, Tom Y.
• Application Number:
  US10/014,231
• Publication Number:
  US 20030108241A1
• Time in Patent Office: 1,344 Days
• Field of Search: 382/181, 382305-306, 382/100, 382/115, 382/118, 707 1- 5, 707/104.1
• US Class Current: 382/118
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation

Abstract

A method and system for providing a mood based virtual photo album which provides photos based upon a sensed mood the viewer. The method may include the steps of capturing a first image of a facial expression of a viewer by a camera, providing the image to a pattern recognition module of a processor, determine a mood of the viewer by comparing the facial expression with a plurality of previously stored images of facial expressions having an associated emotional identifier that indicates a mood of each of the plurality of previously stored images, retrieving a set of photos from storage for transmission to the viewer based on the emotional identifier associated with the determined mood, and transmitting the set of photos in the form of an electronic photo album. A system includes a camera, a user interface for transmitting a first image of a facial expression of a viewer captured by the camera, a processor for receiving the transmitted image by the user interface, and including a pattern recognition module for comparing the image received by the processor with a plurality of images of facial expressions from a storage area to determine a mood of the viewer. A retrieval unit retrieves a set of electronic photos corresponding to the mood of the viewer, and transmits the set of electronic photos for display as a virtual photo album.

Claims

1. A method for providing a mood based virtual photo album, said method comprising the steps of:

(a) capturing a first image of a facial expression of a viewer by a camera;

(b) providing the image of said facial expression to a pattern recognition module of a processor;

(c) determining a mood of said viewer having an associated emotional identifier by comparing the facial expression with a plurality of previously stored images of facial expressions having an associated emotional identifier that indicates a mood of each of said plurality of previously stored images;

(d) retrieving from storage a set of photos to be transmitted to said viewer based on the emotional identifier associated with the mood determined in step (c); and

(e) transmitting the set of photos retrieved in step (d) to said viewer for display in the form of an electronic photo album.

2. The method according to claim 1, wherein the set of photos in step (e) is transmitted over the Internet to said viewer, and said electronic photo album comprising a virtual photo album.

3. The method according to claim 1, wherein the pattern recognition module in step (b) is a locally attached computer.

4. The method according to claim 2, wherein the pattern recognition module in step (b) is a web-based processor.

5. The method according to claim 1, wherein the previously stored images in step (c) are facial expressions of the viewer.

6. The method according to claim 4, further comprising providing the previously stored images of the facial expression of the viewer with emotional identifiers.

7. The method according to claim 6, wherein the emotional identifiers are supplied by the viewer to designate a particular mood for the facial expression for each respective image of said plurality of previously stored images.

8. The method according to claim 4, wherein the previously stored images in step (c) are facial expressions of the viewer.

9. The method according to claim 8, further comprising providing the previously stored images of the facial expression of the viewer with emotional identifiers.

10. The method according to claim 9, where in the emotional identifiers are supplied by the viewer to designate a particular mood for the facial expression for each respective image of said plurality of previously stored images.

11. The method according to claim 4, further comprising:

(f) capturing a second image of a facial expression of the viewer subsequent to said viewer looking at least at one photo of said set of photos transmitted in step (e);

(g) updating the set of photos transmitted in step (e) by repeating steps (c), (d) and (e) according to the second image of the facial expression captured in step (f).

12. The method according to claim 4, wherein the image of the facial expression is captured as one of a JPEG image, TIFF image, BMP image and PCX image.

13. The method according to claim 4, wherein the image of the facial expression is a video sequence.

14. The method according to claim 13, wherein said video sequence comprises an MPEG sequence.

15. The method according to claim 4, wherein step (c) includes (1) modifying the emotional identifier associated with the mood of the viewer according to at least one of:

(i) local weather;

(ii) other people adjacent to the viewer;

(iii) illumination adjacent the viewer;

(iv) time of day;

(v) date; and

(vi) preferred activities of the viewer.

16. The method according to claim 15, wherein step (d) includes transmitting an order of the set of photos according to the modification to the emotional identifier in step (c)(1).

17. A system for a mood based virtual photo album comprising:

a camera;

user interface means for transmitting a first image of a facial expression of a viewer captured by said camera;

a processor for receiving the transmitted image of the facial expression of said viewer;

said processor comprising a pattern recognition module for comparing the image received by said processor with a plurality of images of facial expressions stored in a storage area, and for determining a mood of the viewer according to the first image of the facial expression captured by said camera;

retrieval means for retrieving a set of electronic photos corresponding to the mood of the viewer determined according to the first image of the facial expression and transmitting said set of electronic photos to said viewer; and

a display for displaying said set of photos to the viewer as a virtual photo album.

18. The system according to claim 17, wherein said user interface means includes feedback means for transmitting subsequent images of said viewer'"'"'s facial expression after a display of at least one photo of said set of photos;

wherein said pattern recognition module of said processor compares said subsequent images of said viewer'"'"'s facial expression for determining the mood of the viewer according to said subsequent images; and

said retrieval means retrieves a respective set of electronic photos corresponding to the mood of the viewer determined according to each of said subsequent images of the viewer'"'"'s facial expression.

19. The system according to claim 17, wherein said user interface means transmits said first image to said processor as one of a JPEG image, TIFF image, BMP image and PCX image.

20. The system according to claim 18, wherein said user interface means transmits said subsequent images to said processor as at least one of JPEG images, TIFF images, BMP images and PCX images.

21. The system according to claim 17, wherein said processor comprises a host site, and said camera and said user interface means for transmitting said captured image communicate with said processor over the Internet.

22. The system according to claim 18, wherein said processor comprises a host site, and said camera and said user interface means for transmitting said captured image communicate with said processor over the Internet.

23. The system according to claim 21, wherein said set of electronic photos transmitted by said retrieval means to said viewer comprises a virtual photo album.

24. The system according to claim 22, wherein said set of electronic photos transmitted by said retrieval means to said viewer comprises a virtual photo album.

25. The system according to claim 20, wherein at least one of said first image and said subsequent images comprises video sequences.

26. The system according to claim 25, wherein a format of said video sequences is one of MPEG, MPEG-1, MPEG-2 and MPEG-3.

27. The system according to claim 17, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.

28. The system according to claim 18, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.

29. The system according to claim 21, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.

30. The system according to claim 22, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.

31. The system according to claim 25, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.

32. The system according to claim 26, wherein said user interface means includes means for initially inputting photos of facial expressions of said viewer for storage in said storage area of said processor, each one of said photos having an associated emotional identifier that indicates a mood represented by each respective facial expression of said each one of said photos.