Image storage processing apparatus, image search apparatus, image storage processing method, image search method and program

• US 8,687,925 B2
• Filed: 04/07/2008
• Issued: 04/01/2014
• Est. Priority Date: 04/10/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Tsuruta, Masaaki, Ozaki, Nozomu, Asukai, Masamichi, Ito, Taiji, Sugino, Akinobu, Sekizawa, Hidehiko, Sako, Yoichiro, Tabata, Hideko
• Primary Examiner(s): DULANEY, KATHLEEN YUAN
• Application Number:
  US12/080,932
• Publication Number:
  US 20080253695A1
• Time in Patent Office: 2,185 Days
• Field of Search: 382/115, 382/305, 382/160, 382/312, 707/825, 707/830, 600/27, 725/12
• US Class Current: 382/305
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety

Abstract

An image storage processing apparatus includes an image acquisition means for acquiring taken image data imaged at an imaging apparatus unit, a bio-information acquisition means for acquiring bio-information of a user of the imaging apparatus unit at the time of imaging the taken image data acquired by the image acquisition means, a subject information acquisition means for acquiring subject information as an image analysis result of the taken image data acquired by the image acquisition means and a storage processing means for performing processing of recording the taken image data acquired by the image acquisition means, the bio-information acquired by the bio-information acquisition means and the subject information acquired by the subject information acquisition means in a recording medium in a state in which they are associated with one another.

Claims

1. An image storage processing apparatus, comprising:

an image acquisition means for acquiring taken image data imaged at an imaging apparatus unit;

a user information acquisition means for acquiring first user information relating to at least one first physical measurement taken from a body of a user of the imaging apparatus unit at a time of taking an image and thereby generating the taken image data, the user of the imaging apparatus unit being a first user;

a subject information acquisition means for acquiring, as subject information, an image analysis result of analyzing the taken image data;

a storage processing means for recording the taken image data acquired by the image acquisition means, the first user information acquired by the user information acquisition means, and the subject information acquired by the subject information acquisition means in at least one recording medium in such a manner that the taken image data is associated with the first user information and the subject information; and

a search processing means for generating one or more search conditions using second user information relating to at least one second physical measurement taken from a body of a second user different from the first user, the at least one second physical measurement being taken at a time of searching, and for using the one or more search conditions to search for image data stored in association with corresponding user information and/or subject information that matches the one or more search conditions, wherein the search processing means is configured to generate the one or more search conditions in response to a determination that the second user is in one of one or more designated psychological states.

2. The image storage processing apparatus according to claim 1, further comprising the imaging apparatus unit, wherein the imaging apparatus unit is integral with the image storage processing apparatus, and wherein the image acquisition means is configured to acquire the taken image data by an imaging operation in the imaging apparatus unit.

3. The image storage processing apparatus according to claim 1, wherein the imaging apparatus unit is an external imaging apparatus unit, and the image acquisition means is configured to acquire the taken image data by an imaging operation in the external imaging apparatus unit.

4. The image storage processing apparatus according to claim 1, wherein the user information acquisition means is configured to use one or more sensors to acquire biosensor detection information as the first user information.

5. The image storage processing apparatus according to claim 1, wherein the user information acquisition means is configured to generate psychological information of the first user as the first user information by using biosensor detection information.

6. The image storage processing apparatus according to claim 1, wherein the subject information acquisition means is configured to analyze whether a face image of a person is included in the taken image data to obtain face presence information, and wherein the subject information comprises the face presence information.

7. The image storage processing apparatus according to claim 1, wherein the subject information acquisition means is configured to analyze a face image of a person in the taken image data to obtain face analysis result information, and wherein the subject information comprises the face analysis result information.

8. The image storage processing apparatus according to claim 7, wherein the face analysis result information comprises information indicating expression, gender, or an age bracket.

9. The image storage processing apparatus according to claim 1, further comprising:

an output processing means for performing output processing of a search processing result by the search processing means.

10. The image storage processing apparatus according to claim 9, wherein the search processing means is further configured to generate the one or more search conditions based at least in part on user input.

11. The image storage processing apparatus of claim 1, wherein the second user information relates to a plurality of physical measurements taken respectively from a plurality of users, the plurality of users comprising the second user.

12. An image search apparatus, comprising:

a user information acquisition means for acquiring current user information relating to at least one current physical measurement taken from a body of a first user;

a search processing means for generating one or more search conditions based at least in part on the current user information and for using the one or more search conditions to search at least one recording medium to identify taken image data that is stored in association with prior user information and/or subject information that matches the one or more search conditions, wherein;

the search processing means is configured to generate the one or more search conditions in response to a determination that the first user is in one of one or more designated psychological states;

the taken image data was imaged by an imaging apparatus unit used by a second user different from the first user;

the prior user information relates to at least one prior physical measurement taken from a body of the second user at a time of taking an image and thereby generating the taken image data; and

the subject information comprises an image analysis result of analyzing the taken image data; and

an output processing means for performing output processing of a search processing result by the search processing means.

13. The image search apparatus according to claim 12, wherein the search processing means is further configured to use user input for generating the one or more search conditions.

14. An image storage processing method, comprising acts of:

acquiring taken image data imaged at an imaging apparatus unit;

acquiring first user information relating to at least one first physical measurement taken from a body of a user of the imaging apparatus unit at a time of taking an image and thereby generating the taken image data, the user of the imaging apparatus unit being a first user;

acquiring, as subject information, an image analysis result of analyzing the taken image data;

using at least one processor to record the taken image data, the first user information, and the subject information in at least one recording medium in such a manner that the taken image data is associated with the first user information and the subject information;

generating one or more search conditions using second user information relating to at least one second physical measurement taken from a body of a second user different from the first user, the at least one second physical measurement being taken at a time of searching, wherein the act of generating the one or more search conditions is performed in response to a determination that the second user is in one of one or more designated psychological states; and

using the one or more search conditions to search for image data stored in association with corresponding user information and/or subject information that matches the one or more search conditions.

15. An image search method, comprising acts of:

acquiring current user information relating to at least one current physical measurement taken from a body of a first user;

using, in response to a determination that the first user is in one of one or more designated psychological states, at least one processor to generate one or more search conditions based at least in part on the current user information and to use the one or more search conditions to search at least one recording medium to identify taken image data that is stored in association with prior user information and/or subject information that matches the one or more search conditions, wherein;

the taken image data was imaged by an imaging apparatus unit used by a second user different from the first user;

the prior user information relates to at least one prior physical measurement taken from a body of the second user at a time of taking an image and thereby generating the taken image data; and

the subject information comprises an image analysis result of analyzing the taken image data; and

performing output processing of a search result.

16. The image search method of claim 15, wherein the current user information comprises current psychological information indicative of a current psychological state of the first user, and wherein the act of acquiring the current user information comprises:

in response to the determination that the first user is in one of one or more designated psychological states, using at least one biosensor to take the at least one current physical measurement from the body of the first user; and

generating the current psychological information based at least in part on the at least one current physical measurement taken from the body of the first user.

17. The image search method of claim 16, wherein the act of performing output processing of the search result comprises an act of displaying the search result to the first user, and wherein the one or more search conditions are generated to identify one or more images likely to influence the current psychological state of the first user.

18. The image search method of claim 15, wherein the at least one processor is configured to generate the one or more search conditions in response to a determination that the first user is in a state of being depressed or a state of being excited.

19. At least one non-transitory recording medium which records a program allowing an information processing apparatus to execute the steps of:

acquiring taken image data imaged at an imaging apparatus unit;

acquiring first user information relating to at least one first physical measurement taken from a body of a user of the imaging apparatus unit at a time of taking an image and thereby generating the taken image data, the user of the imaging apparatus unit being a first user;

acquiring, as subject information, an image analysis result of analyzing the taken image data;

recording the taken image data, the first user information, and the subject information in at least one recording medium in such a manner that the taken image data is associated with the first user information and the subject information;

generating one or more search conditions using second user information relating to at least one second physical measurement taken from a body of a second user different from the first user, the at least one second physical measurement being taken at a time of searching, wherein the program allows the information processing apparatus to execute the step of generating the one or more search conditions in response to a determination that the second user is in one of one or more designated psychological states; and

using the one or more search conditions to search for image data stored in association with corresponding user information and/or subject information that matches the one or more search condition.

20. At least one non-transitory recording medium which records a program allowing an information processing apparatus to execute the steps of:

acquiring current user information relating to at least one current physical measurement of taken from a body of a first user;

generating one or more search conditions based at least in part on the current user information and using the one or more search conditions to search at least one recording medium to identify taken image data that is stored in association with prior user information and/or subject information that matches the one or more search conditions, wherein;

the program allows the information processing apparatus to execute the step of generating the one or more search conditions in response to a determination that the first user is in one of one or more designated psychological states;

the taken image data was imaged by an imaging apparatus unit used by a second user different from the first user;

the prior user information relates to at least one prior physical measurement taken from a body of the second user at a time of taking an image and thereby generating the taken image data; and

the subject information comprises an image analysis result of analyzing the taken image data; and

performing output processing of a search result.

21. An image storage processing apparatus, comprising:

an image acquisition unit configured to acquire taken image data imaged at an imaging apparatus unit;

a user information acquisition unit configured to acquire first user information relating to at least one first physical measurement taken from a body of a user of the imaging apparatus unit at a time of taking an image and thereby generating the taken image data, the user of the imaging apparatus unit being a first user;

a subject information acquisition unit configured to acquire, as subject information, an image analysis result of analyzing the taken image data;

a storage processing unit configured to record the taken image data, the first user information, and the subject information in at least one recording medium in such a manner that the taken image data is associated with the first user information and the subject information; and

a search processing unit for generating one or more search conditions using second user information relating to at least one second physical measurement taken from a body of a second user different from the first user, the at least one second physical measurement being taken at a time of searching, and for using the one or more search conditions to search for image data stored in association with corresponding user information and/or subject information that matches the one or more search conditions, wherein the search processing unit is configured to generate the one or more search conditions in response to a determination that the second user is in one of one or more designated psychological states.

22. An image search apparatus, comprising:

a user information acquisition unit configured to acquire current user information relating to at least one current physical measurement of taken from a body of a first user;

a search processing unit configured to generate one or more search conditions based at least in part on the current user information and to use the one or more search conditions to search at least one recording medium to identify taken image data that is stored in association with prior user information and/or subject information that matches the one or more search conditions, wherein;

the search processing unit is configured to generate the one or more search conditions in response to a determination that the first user is in one of one or more designated psychological states;

the taken image data was imaged by an imaging apparatus unit used by a second user different from the first user;

the prior user information relates to at least one prior physical measurement taken from a body of the second user at a time of taking an image and thereby generating the taken image data, and

the subject information comprises an image analysis result of analyzing the taken image data; and

an output processing unit configured to perform output processing of a search processing result by the search processing unit.