Method and apparatus for retrieving dynamic images and method of and apparatus for managing images

• US 6,606,636 B1
• Filed: 07/27/1994
• Issued: 08/12/2003
• Est. Priority Date: 07/29/1993
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Sato, Hiroaki, Okazaki, Hiroshi
• Primary Examiner(s): Jung, David
• Application Number:
  US08/281,007
• Time in Patent Office: 3,303 Days
• Field of Search: 345/1-358, 345/794-804, 707/1-513, 382/254-260
• US Class Current: 1/1
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A scene change automatic detection unit detects a scene change at the time of input storage of a dynamic image in a storage unit, to retrieve the dynamic image as a search key, and a characteristic amount unit calculates a characteristic amount of each scene. The characteristic amount is stored together with the dynamic image in the storage unit. In a retrieval operation, a scene change automatic detection unit detects a scene change of a dynamic image entered and a scene change automatic detection unit calculates a characteristic amount of each scene. A correspondence determination unit compares a characteristic amount of a stored dynamic image and a characteristic amount of a dynamic image entered as a search key and determines the correspondence of these characteristic amounts.

Claims

1. An image retrieval system comprising:

a first characteristic sequence extraction means for extracting a first scene change characteristic sequence for a moving image in accordance with a scene change of each scene of the moving image;

a storage means for storing the moving image with the extracted first characteristic scene change sequence for the moving image;

a second characteristic sequence extraction means for extracting a second scene change characteristic sequence in accordance with a scene change from an entered search moving image; and

a comparison means for comparing the first scene change characteristic sequence of the stored moving image with the scene change characteristic sequence of the search moving image to determine if the stored moving image corresponds to the search moving image.

2. An image retrieval system according to claim 1, wherein the first characteristic amount and the scene change characteristic amount each comprises a number of frames between scene changes.

3. An image retrieval system according to claim 1, wherein the first characteristic amount and the scene change characteristic amount each comprises a vector composed of a plurality of components, and the comparison by said comparison means is made in accordance with a distance in a vector space between a characteristic amount extracted by said first characteristic amount extraction means and a scene change characteristic amount extracted by said second characteristic amount extraction means.

4. An image retrieval system according to claim 1, further comprising:

means for storing relational information for each characteristic amount extracted by said first characteristic amount extraction means.

5. An image retrieval system according to claim 1, further comprising:

a display means for displaying relational information in accordance with the entered search moving image according to the comparison made by said comparison means.

6. An image retrieval system according to claim 5, wherein a moving image corresponding to the entered search moving image is displayed with the relational information according to the comparison made by the comparison means.

7. An image retrieval system according to claim 1, wherein the scene change is automatically extracted.

8. An image retrieval method comprising:

a first characteristic sequence extraction step, of extracting a first scene change characteristic sequence for a moving image in accordance with a scene change of each scene of the moving image;

a storage step, of storing in a storage means the moving image with the extracted first characteristic scene change sequence for the moving image;

a second characteristic sequence extraction step, of extracting a second scene change characteristic sequence in accordance with a scene change from an entered search moving image; and

a comparison step, of comparing the first scene change characteristic sequence of the stored moving image with the second scene change characteristic sequence of the search moving image to determine if the stored moving image corresponds to the search moving image.

9. An image retrieval method according to claim 8, wherein the first characteristics amount and the scene change characteristic amount each comprises a number of frames between scene changes.

10. An image retrieval method according to claim 8, wherein the first characteristic amount and the scene change characteristic amount each comprises a vector composed of a plurality of components and the comparison by said comparison means is made in accordance with a distance in a vector space between a characteristic amount extracted by said first characteristic amount extraction step and a scene change characteristic amount extracted by said second characteristic amount extraction step.

11. An image retrieval method according to claim 8, further comprising:

a storing step of storing relational information for each characteristic amount extracted by said first characteristic amount extraction step.

12. An image retrieval method according to claim 8, further comprising:

a display step of displaying relational information in accordance with the entered search moving image according to the comparison made by said comparison step.

13. An image retrieval method according to claim 12, wherein a moving image corresponding to the entered search moving image is displayed with the relational information according to the comparison made by the comparison step.

14. An image retrieval method according to claim 8, wherein the scene change is automatically extracted.

15. An image retrieval apparatus comprising:

a characteristic sequence extraction means for extracting a scene change characteristic sequence in accordance with a scene change from an entered search moving image; and

a comparison means for comparing a scene change characteristic sequence of a moving image, stored together with the moving image in storage means, with the scene change characteristic sequence of the search moving image to determine if the moving image stored in said storage means corresponds to the search moving image.

16. An apparatus according to claim 15, wherein the scene change characteristic amount is a number of frames between scene changes.

17. An apparatus according to claim 15, wherein said extraction means extracts the scene change according to difference between two continuous frames.

18. An apparatus according to claim 15, wherein said storage means is a hard disc.

19. An apparatus according to claim 15, wherein said storage means stores at least one of name, kind and input date information of the moving image.

20. An apparatus according to claim 19, further comprising display means, and wherein said display means displays at least one of name, kind and input date of the moving image when it is determined by said comparison means that the moving image stored in said storage means corresponds to the search moving image.

21. An image retrieval method comprising:

extracting a scene change characteristic sequence in accordance with a scene change from an entered search moving image; and

comparing a scene change characteristic sequence of a moving image, stored together with the moving image in storage means, with the scene change characteristic sequence of the search moving image to determine if the moving image stored in the storage means corresponds to the search moving image.

22. The method according to claim 21, wherein the scene change characteristic amount is a number of frames between scene changes.

23. The method according to claim 21, wherein said extractions step extracts the scene change according to difference between two continuous frames.

24. The method according to claim 21, wherein said storage means is a hard disc.

25. The method according to claim 21, wherein said storage means stores at least one of name, kind and input date information of the moving image.

26. The method according to claim 25, further comprising a display step, and wherein said display step displays at least one of name, kind and input date of the moving image when it is determined by said comparison step that the moving image stored in said storage means corresponds to the search moving image.