System, method, and medium indexing photos semantically

• US 20090123021A1
• Filed: 01/26/2007
• Published: 05/14/2009
• Est. Priority Date: 09/27/2006
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Kim, Ji Yeun, Jung, Yong Ju, Lee, Jae Won, Kim, Sang Kyun, Han, Ick Sang
• Application Number:
  US11/698,203
• Publication Number:
  US 20090123021A1
• Time in Patent Office: Days
• US Class Current: 382/100
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A system, method and medium indexing a plurality of photos semantically based on a user'"'"'s annotation. The method includes analyzing the user'"'"'s annotation and extracting a shared index from the user'"'"'s annotation, detecting a situation change in the plurality of photos, and indexing the plurality of photos according to the situation change based on the shared index.

Claims

1. A method of indexing a plurality of photos semantically based on a user'"'"'s annotation, the method comprising:

analyzing the user'"'"'s annotation and extracting a shared index from the user'"'"'s annotation;

detecting a situation change in the plurality of photos; and

indexing the plurality of photos according to the situation change based on the shared index.

2. The method of claim 1, further comprising:

receiving the plurality of photos; and

receiving an annotation of at least one photo of the plurality of photos from the user.

3. The method of claim 2, wherein the photo comprises source location information and source time information.

4. The method of claim 1, wherein the detecting of the situation change detects any one or more of a visual change, a face change, a location change, and a time change of the plurality of photos, and further comprises determining the situation change of the plurality of photos according to the detected visual change, face change, location change, and time change.

5. The method of claim 4, wherein the detecting of the visual change comprises:

calculating a visual similarity of the plurality of photos; and

detecting the situation change as the visual change between a standard photo and a comparison photo, when a visual difference between the standard photo and the comparison photo is greater than a predetermined value, according to the calculated visual similarity.

6. The method of claim 4, wherein the detecting of the face change comprises:

comparing a face between a standard photo and a comparison photo from the plurality of photos; and

detecting the situation change as the face change between the standard photo and the comparison photo, when a face difference between the standard photo and the comparison photo is greater than a predetermined value, according to a result of the comparing.

7. The method of claim 4, wherein the detecting of the location change comprises:

calculating a location proximity between a standard photo and a comparison photo from the plurality of photos; and

detecting the situation change as the location change between the standard photo and the comparison photo, when a location difference between the standard photo and the comparison photo is greater than a predetermined value, according to the calculated location proximity.

8. The method of claim 4, wherein the detecting of the time change comprises:

calculating a time proximity between a standard photo and a comparison photo from the plurality of photos; and

detecting the situation change as the time change between the standard photo and the comparison photo, when a time difference between the standard photo and the comparison photo is greater than a predetermined value, according to the calculated time proximity.

9. The method of claim 1, further comprising:

deducing any one of a date and a time (when), a location (where), a person (who), an event (what occasion), an object (with which thing), a behavior and a pose (which action), and a category (which category), according to the situation change.

10. The method of claim 1, further comprising:

automatically generating a file name for one or more of the plurality of photos according to a result of the indexing.

11. At least one medium comprising computer readable code to control at least one processing element to implement a method of indexing a plurality of photos semantically based on a user'"'"'s annotation, the method comprising:

analyzing the user'"'"'s annotation and extracting a shared index from the user'"'"'s annotation;

detecting a situation change in the plurality of photos; and

indexing the plurality of photos according to the situation change based on the shared index.

12. The medium of claim 11, further comprising:

receiving the plurality of photos; and

receiving an annotation of at least one photo of the plurality of photos from the user.

13. The medium of claim 11, wherein the detecting of the situation change detects any one or more of a visual change, a face change, a location change, and a time change of the plurality of photos, and further comprises determining the situation change of the plurality of photos according to the detected visual change, face change, location change, and time change.

14. The medium of claim 11, further comprising:

deducing any one of a date and a time (when), a location (where), a person (who), an event (what occasion), an object (with which thing), a behavior and a pose (which action), and a category (which category), according to the situation change.

15. The medium of claim 11, further comprising:

automatically generating a file name for one or more of the plurality of photos according to a result of the indexing.

16. A system for indexing a plurality of photos semantically based on a user'"'"'s annotation, the system comprising:

a shared index extraction unit to analyze the user'"'"'s annotation and extract a shared index from the user'"'"'s annotation;

a situation change detection unit to detect a situation change; and

an indexing unit to index the plurality of photos according to the situation change based on the shared index.

17. The system of claim 16, further comprising a receiving unit comprising:

a photo receiving unit to receive the plurality of photos; and

a user'"'"'s annotation input unit to receive an annotation of at least one photo of the plurality of photos from the user.

18. The system of claim 17, wherein the photo receiving unit comprises:

a photo sensor to photograph the plurality of photos;

a location measurement sensor to measure a source location where the plurality of photos are taken; and

a photo encoding unit to encode the photo.

19. The system of claim 18, wherein the photo encoding unit comprises:

an image encoder to encode an image of the photo; and

a photo information encoder to encode photo information including source location information and source time information of the photo.

20. The system of claim 17, wherein the shared index extraction unit comprises:

a user'"'"'s annotation analyzer to analyze the user'"'"'s annotation; and

a shared index extraction unit to extract the shared index according to a result of the analyzing.

21. The system of claim 17, wherein the situation change detection unit detects one or more of a visual change, a face change, a location change, and a time change of the plurality of photos, and determines the situation change of the plurality of photos according to the detected visual change, face change, location change, and time change.

22. The system of claim 21, wherein the situation change detection unit comprises:

a visual similarity calculation unit to calculate a visual similarity of the plurality of photos; and

a visual change determination unit to determine the situation change as the visual change, when a visual difference between a standard photo and a comparison photo greater than a predetermined value according to the calculated visual similarity.

23. The system of claim 21, wherein the situation change detection unit comprises:

a face comparison unit comparing a face between a standard photo and a comparison photo from the plurality of photos; and

a face change determination unit determining the situation change as the face change, when a face difference between the standard photo and the comparison photo is greater than a predetermined value according to a result of the comparing.

24. The system of claim 21, wherein the situation change detection unit comprises:

a location proximity calculation unit comparing location information of a standard photo and a comparison photo from the plurality of photos, and calculating a location proximity between the standard photo and the comparison photo; and

a location change determination unit determining the situation change as the location change, when a location difference between the standard photo and the comparison photo is greater than a predetermined value according to the calculated location proximity.

25. The system of claim 21, wherein the situation change detection unit comprises:

a time proximity calculation unit calculating a time proximity between a standard photo and a comparison photo from the plurality of photos; and

a time change determination unit determining the situation change as the time change, when a time difference between the standard photo and the comparison photo is greater than a predetermined value according to the calculated time proximity.

26. The system of claim 21, further comprising:

an individual situation inference unit analyzing the inputted photo and automatically deducing an image index including any one or more of a date and a time (when), a location (where), a person (who), an event (what occasion), an object (with which thing), a behavior and a pose (which action), and a category (which category).

27. The system of claim 17, further comprising:

an indexing unit to automatically generate a file name for at least one of the plurality of photos according to a result of the indexing.