Indexing and searching according to attributes of a person

• US 9,342,594 B2
• Filed: 10/29/2008
• Issued: 05/17/2016
• Est. Priority Date: 10/29/2008
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Brown, Lisa M., Cooke, Raymond A., Feris, Rogerio S., Hampapur, Arun, Kjeldsen, Frederik C. M., Milite, Christopher S., Russo, Stephen R., Shu, Chiao-Fe, Tian, Ying-li, Zhai, Yun, Lu, Zuoxuan
• Primary Examiner(s): Badawi, Sherief
• Assistant Examiner(s): Raab, Christopher J
• Application Number:
  US12/260,418
• Publication Number:
  US 20100106707A1
• Time in Patent Office: 2,757 Days
• Field of Search: 707/711, 348/143
• US Class Current: 1/1
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 18/41 Interactive pattern learning with a human teacher

Abstract

An approach that indexes and searches according to a set of attributes of a person is provided. In one embodiment, there is an extensible indexing and search tool, including an extraction component configured to extract a set of attributes of a person monitored by a set of sensors in a zone of interest. An index component is configured to index each of the set of attributes of the person within an index of an extensible indexing and search tool. A search component is configured to enable a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person.

Claims

1. A method for indexing and searching according to a set of attributes of a person comprising:

extracting a set of attributes of a person monitored by a set of sensors in a zone of interest, the set of attributes of the person comprising visual physical attributes, behavioral attributes, and physiological attributes;

indexing each of the set of attributes of the person within an index of an extensible indexing and search tool, the indexing comprising relating each attribute of the set of attributes of the person to corresponding attribute in a canonical person model having a plurality of attribute types that distinguish one person from another, the plurality of attribute types including facial features, hair features, and clothing features, and dynamically incorporating, into a schema of the extensible indexing and search tool, a plurality of simultaneously received, different data types for each of the set of attributes, each of the plurality of simultaneously received, different data types having a unique set of application specific indexing requirements to incorporate new keywords, new concepts and new structures to an existing source language definition for each of the set of attributes;

enabling a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person to identify an instance of the person captured within received sensor data; and

searching the index of the extensible indexing and search tool according to at least one of the set of attributes using the canonical person model to locate video data from the set of sensors containing an instance of a person having the at least one of the set of attributes.

2. The method according to claim 1, further comprising searching the index of the extensible indexing and search tool using a graphical user interface that allows a user to specify a query to the index of the extensible indexing and search tool, and view a result of the query.

3. The method according to claim 2, the result of the query comprising at least one of the following:

an identification of a sensor used to capture the person in the zone of interest, a timestamp indicating a date and time that the person is captured in the zone of interest, an image capture of the person depicted in a video image, or a representation of sensor data received from at least one of the set of sensors.

4. The method according to claim 1, the indexing further comprising relating each of the set of attributes of the person to a canonical person model using a set of extensible indexing schemes.

5. The method according to claim 1, the indexing each of the set of attributes of the person further comprising indexing each of the set of attributes annotated with metadata information including identification of one or more of the set of sensors used to capture the attribute and a timestamp indicating the time and date that the attribute was captured.

6. A system for indexing and searching according to a set of attributes of a person comprising:

a set of sensors for monitoring a zone of interest;

at least one processing unit;

memory operably associated with the at least one processing unit; and

an extensible indexing and search tool storable in memory and executable by the at least one processing unit, the extensible indexing and search tool comprising;

an extraction component configured to receive sensor data from at least one of the set of sensors and extract a set of attributes of a person monitored by a set of sensors in a zone of interest, the set of attributes of the person comprising visual physical attributes, behavioral attributes, and physiological attributes;

an index component configured to index each of the set of attributes of the person within an index of an extensible indexing and search tool, the indexing comprising relating each attribute of the set of attributes of the person to corresponding attribute in a canonical person model having a plurality of attribute types that distinguish one person from another, the plurality of attribute types including facial features, hair features, and clothing features, and dynamically incorporating, into a schema of the extensible indexing and search tool, a plurality of simultaneously received, different data types for each of the set of attributes, each of the plurality of simultaneously received, different data types having a unique set of application specific indexing requirements to incorporate new keywords, new concepts and new structures to an existing source language definition for each of the set of attributes; and

a search component configured to;

enable a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person to identify an instance of the person captured within received sensor data; and

search the index of the extensible indexing and search tool using the canonical person model according to at least one of the set of attributes to locate video data from the set of sensors containing an instance of a person having the at least one of the set of attributes.

7. The system according to claim 6, the search component comprising a query component configured to enable a query to the index of the extensible indexing and search tool.

8. The system according to claim 7, the search component further configured to search the index of the extensible indexing and search tool using a graphical user interface that enables a user to specify the query to the index of the extensible indexing and search tool, and view a result of the query.

9. The system according to claim 8, wherein the search component is extensible.

10. The system according to claim 8, the result of the query comprising at least one of the following:

an identification of a sensor used to capture the person in the zone of interest, a timestamp indicating the time and date that the person is captured in the zone of interest, an image capture of the person in a video image, or a representation of sensor data received from at least one of the set of sensors.

11. The system according to claim 7, wherein the query component is extensible.

12. The system according to claim 6, the index component further configured to relate each of the set of attributes of the person to a canonical person model using a set of extensible indexing schemes.

13. The system according to claim 6, the indexing component further configured to index each of the set of attributes of the person annotated with metadata information including identification of one or more of the set of sensors used to capture the attribute and a timestamp indicating the time and date that the attribute was captured.

14. A computer storage medium storing computer instructions, which when executed, enables a computer system to index and search according to a set of attributes of a person, the computer instructions comprising:

extracting a set of attributes of a person monitored by a set of sensors in a zone of interest, the set of attributes of the person comprising visual physical attributes, behavioral attributes, and physiological attributes;

indexing each of the set of attributes of the person within an index of an extensible indexing and search tool, the indexing comprising relating each attribute of the set of attributes of the person to corresponding attribute in a canonical person model having a plurality of attribute types that distinguish one person from another, the plurality of attribute types including facial features, hair features, and clothing features, and dynamically incorporating, into a schema of the extensible indexing and search tool, a plurality of simultaneously received, different data types for each of the set of attributes, each of the plurality of simultaneously received, different data types having a unique set of application specific indexing requirements to incorporate new keywords, new concepts and new structures to an existing source language definition for each of the set of attributes;

enabling a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person to identify an instance of the person captured within received sensor data; and

searching the index of the extensible indexing and search tool using the canonical person model according to at least one of the set of attributes to locate video data from the set of sensors containing an instance of a person having the at least one of the set of attributes.

15. The computer storage medium according to claim 14 further comprising computer instructions for searching the index of the extensible indexing and search tool using a graphical user interface that allows a user to specify a query to the index of the extensible indexing and search tool, and view a result of the query.

16. The computer storage medium according to claim 15, the result of the query comprising at least one of the following:

an identification of a sensor used to capture the person in the zone of interest, a timestamp indicating a date and time that the person is captured in the zone of interest, an image capture of the person depicted in a video image, or a representation of sensor data received from at least one of the set of sensors.

17. The computer storage medium according to claim 14, the indexing further comprising computer instructions for relating each of the set of attributes of the person to a canonical person model using a set of extensible indexing schemes.

18. The computer storage medium of claim 14, the computer instructions for indexing each of the set of attributes of the person further comprising indexing each of the set of attributes annotated with metadata information including identification of one or more of the set of sensors used to capture the attribute and a timestamp indicating the time and date that the attribute was captured.

19. A method for deploying an extensible indexing and search tool for use in a computer system that provides for indexing and searching according to a set of attributes of a person, comprising:

providing a computer infrastructure operable to;

extract a set of attributes of a person monitored by a set of sensors in a zone of interest, the set of attributes of the person comprising visual physical attributes, behavioral attributes, and physiological attributes;

index each of the set of attributes of the person within an index of an extensible indexing and search tool, the indexing comprising relating each attribute of the set of attributes of the person to corresponding attribute in a canonical person model having a plurality of attribute types that distinguish one person from another, the plurality of attribute types including facial features, hair features, and clothing features, and dynamically incorporating, into a schema of the extensible indexing and search tool, a plurality of simultaneously received, different data types for each of the set of attributes, each of the plurality of simultaneously received, different data types having a unique set of application specific indexing requirements to incorporate new keywords, new concepts and new structures to an existing source language definition for each of the set of attributes;

enable a search of the index of the extensible indexing and search tool based on at least one of the set of attributes of the person to identify an instance of the person captured within received sensor data;

search the index of the extensible indexing and search tool using the canonical person model according to at least one of the set of attributes to locate video data from the set of sensors containing an instance of a person having the at least one of the set of attributes.

20. The method according to claim 19, the computer infrastructure further operable to relate each of the set of attributes of the person to a canonical person model using a set of extensible indexing schemes.