INTELLIGENT VIDEO INFORMATION RETRIEVAL APPARATUS AND METHOD CAPABLE OF MULTI-DIMENSIONAL VIDEO INDEXING AND RETRIEVAL

• US 20110302130A1
• Filed: 06/02/2011
• Published: 12/08/2011
• Est. Priority Date: 06/03/2010
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Chung, Yun-Su, Moon, Ki-Young, Park, So-Hee, LEE, Han-Sung, Kim, Jeong-Nyeo, Lee, Yong-Jin
• Application Number:
  US13/151,718
• Publication Number:
  US 20110302130A1
• Time in Patent Office: Days
• US Class Current: 707/602
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content

Abstract

Provided is an intelligent video information retrieval apparatus capable of multi-dimensional video indexing and retrieval. The intelligent video information retrieval apparatus includes an event detector configured to detect pieces of event information from footage collected by a plurality of video capture devices, a data mart builder configured to generate a data cube using the detected pieces of event information, and capture time and capture location information related to the pieces of event information, and store and manage the generated data cube, and a video retriever configured to receive an event retrieval condition from a user to retrieve event information corresponding to the received event retrieval condition using the data cube, and output the retrieval result to the user.

Claims

1. An apparatus for retrieving video information, comprising:

an event detector configured to detect pieces of event information from footage collected by a plurality of video capture devices;

a data mart builder configured to generate a data cube using the detected pieces of event information, capture time and capture location information related to the pieces of event information, and store and manage the generated data cube; and

a video retriever configured to receive an event retrieval condition from a user to retrieve event information corresponding to the received event retrieval condition using the data cube, and output the retrieval result to the user.

2. The apparatus according to claim 1, wherein the detected pieces of event information, capture time and capture location information correspond to dimensions of the data cube.

3. The apparatus according to claim 2, wherein the dimensions of the data cube have hierarchical structures, respectively.

4. The apparatus according to claim 3, wherein the capture time information corresponds to a hierarchical structure of seconds, minutes, days, weeks, months, and years.

5. The apparatus according to claim 4, wherein the capture location information corresponds to a hierarchical structure of street, village, town, city, county, and state.

6. The apparatus according to claim 5, wherein the video retriever hierarchically retrieves event information corresponding to the received event retrieval condition using at least one dimension of the data cube.

7. The apparatus according to claim 5, wherein the video retriever is implemented using an online analytical processing (OLAP) engine.

8. The apparatus according to claim 1, wherein the detected pieces of event information correspond to at least one of motion of a captured object, a face, a clothing color, a vehicle type, a vehicle model, a vehicle color, and a vehicle license plate.

9. The apparatus according to claim 8, wherein the event detector comprises a human detector which detects event information related to human from the footage collected by the plurality of video capture devices and a vehicle detector which detects event information related to vehicles from the footage.

10. The apparatus according to claim 9, wherein the data mart builder generates the data cube using metadata included in the footage.

11. A method of retrieving video information, comprising:

detecting pieces of event information from footage collected by a plurality of video capture devices;

generating a data cube using the detected pieces of event information, and capture time and capture location information related to the pieces of event information;

receiving an event retrieval condition from a user;

retrieving event information corresponding to the received event retrieval condition using the data cube; and

outputting the retrieval result to the user.

12. The method according to claim 11, wherein the detected pieces of event information, and capture time and capture location information correspond to dimensions of the data cube and the dimensions of the data cube have hierarchical structures, respectively.

13. The method according to claim 12, wherein the capture time information corresponds to a hierarchical structure of seconds, minutes, days, weeks, months, and years.

14. The method according to claim 13, wherein the capture location information corresponds to a hierarchical structure of street, village, town, city, county, and state.

15. The method according to claim 14, wherein the retrieving the event information retrieves the event information corresponding to the received event retrieval condition using at least one dimension of the data cube.

16. The method according to claim 11, wherein the detected pieces of event information correspond to at least one of motion of a captured object, a face, a clothing color, a vehicle type, a vehicle model, a vehicle color, and a vehicle license plate.

17. The method according to claim 16, wherein the generating the data cube generates the data cube using metadata included in the footage.