IMAGING METHOD AND SYSTEM

• US 20070201731A1
• Filed: 04/30/2007
• Published: 08/30/2007
• Est. Priority Date: 11/25/2002
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Carolyn Zacks, Dan Harel, Elena Fedorovskaya, Frank Marino, Karen Taxier, Kenneth A. Parulski, Michael Telek, Serguei Endrikhovski, Tomasz Matraszek
• Inventors: Endrikhovski, Serguei, Marino, Frank, Harel, Dan, Parulski, Kenneth, Telek, Michael, Matraszek, Tomasz, Fedorovskaya, Elena, Zacks, Carolyn, Taxier, Karen
• Granted Patent: US 7,418,116 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

Methods for determining affective information are provided as are imaging systems that determine affective information. In accordance with one method, affective signals are obtained containing facial characteristics and physiological characteristics of a person. The facial characteristics are analyzed and the physiological characteristics are analyzed. The emotional state of the person is determined based upon analysis of the facial and physiological characteristics of the person.

Claims

1. A method for determining affective information comprising the steps of

obtaining affective signals including facial characteristics and physiological characteristics of a user of an image capture system;

analyzing the facial characteristics;

analyzing the physiological characteristics; and

,

determining an emotional state based upon the analysis of the facial physiological characteristics of the user.

2. The method of claim 1, wherein the step of obtaining affective information comprises obtaining affective information at capture of an image.

3. The method of claim 2, further comprising the step of storing the affective information with the captured image.

4. The method of claim 1, wherein the step of collecting affective information includes manually entering the user'"'"'s reaction.

5. The method of claim 1, further comprising the steps of capturing al image of a scene being observed by the user at the time that the affective signals are obtained, wherein the step of determining an emotional state is further based upon analysis of the scene image.

6. The method of claim 1, wherein the determined emotional state comprises an emotional category of the user determined from facial characteristics of the user obtained from the image of the photographer, and a degree of distinctiveness of the emotional category separately determined from the facial characteristics of the user.

7. An imaging system comprising:

an image capture system adapted to capture an image selected by a user, a memory which stores the image, and a set of sensors adapted to capture affective signals from the user at capture including facial characteristics and physiological characteristics of the user; and

a processor adapted to determine an emotional state of the user based upon analysis of the affective signals and to associate the affective information with the captured image.

8. The imaging system of claim 7, wherein the set of sensors is further adapted to capture user identification data.

9. The imaging system of claim 7, wherein the processor is adapted to determine a user identity based upon analysis of the user identification data.

10. The imaging system of claim 9, wherein the processor further comprises a transmitter transmitting a signal containing at least one captured image in association with affective information and the user identification data.

11. The imaging system of claim 7, wherein the processor is further adapted to process affective information captured by the set of sensors to provide further affective information.

12. The imaging system of claim 7, wherein the image capture system further comprises at least one source of non-affective information.

13. The imaging system of claim 12, wherein the processor is further adapted non-affective information from the at least one source and determines a degree of relative importance based upon the affective signals and the non-affective information.

14. The imaging system of claim 7, further comprising a second image capture system adapted to capture an image of at least a part of the user.

15. A method for determining affective information comprising the steps of:

obtaining affective signals including facial characteristics and physiological characteristics of a person;

analyzing the facial characteristics to determine a degree of determining a degree of excitement based upon the physiological characteristics,

determining a degree of interest based upon the eye images;

determining a relative degree of importance of the scene image based at least in part upon the determined degree of interest, degree of excitement, or degree of preference; and

associating the determined affective information with an environmental stimulus to which the person was exposed about the time that the effective signals were obtained.

16. An image capture system comprising:

an image capture system adapted to capture an image selected by a user, a memory which stores the image, and a set of sensors adapted to capture affective signals from the user at capture, including at least one of facial characteristics, eye images, and physiological characteristics; and

a processor adapted to determine affective information based upon the captured affective signals and to associate the affective information with the captured image, wherein said processor is adapted to determine at least one of

a degree of preference based upon the captured facial characteristics;

a degree of excitement based upon the physiological characteristics;

or

a degree of interest based upon the eye images.

17. The image capture system of claim 16, wherein said processor is further adapted to determine a relative degree of importance of the scene image based at least in part upon the determined degree of interest, degree of excitement, or degree of preference.

18. The image capture system of claim 16, wherein the image capture system is adapted to delete a captured image based upon the determined degree of interest, degree of excitement, degree of preference, or relative degree of importance.