Information processing device

• US 9,213,891 B2
• Filed: 01/19/2012
• Issued: 12/15/2015
• Est. Priority Date: 02/17/2011
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Kamei, Shinichiro, Shiraishi, Nobuhisa, Arikuma, Takeshi
• Primary Examiner(s): Li, Ruiping
• Application Number:
  US14/000,159
• Publication Number:
  US 20140037150A1
• Time in Patent Office: 1,426 Days
• Field of Search: 382/115, 701/301, 701/207, 701/736
• US Class Current: 1/1
• CPC Class Codes: G06F 18/254 of classification results, e.g. of results related to same input data
• CPC Class Codes: G06V 10/809 of classification results, e.g. where the classifiers operate on the same input data
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

An information processing device 200 of the present invention includes: a recognition result acquiring means 201 for acquiring respective recognition result information outputted by a plurality of recognition engines 211, 212 and 213 executing different recognition processes on recognition target data; and an integration recognition result outputting means 202 for outputting a new recognition result obtained by integrating the respective recognition result information acquired from the plurality of recognition engines. The recognition result acquiring means 201 is configured to acquire the respective recognition result information in a data format common to the plurality of recognition engines, from the plurality of recognition engines. The integration recognition result outputting means 202 is configured to integrate the respective recognition result information based on the respective recognition result information, and output as the new recognition result.

Claims

1. An information processing device including a processor comprising:

a recognition result acquiring unit implemented by the processor, for acquiring respective recognition result information outputted by a plurality of recognition engines executing different recognition processes on recognition target data; and

an integration recognition result outputting unit implemented by the processor, for outputting a new recognition result obtained by integrating the respective recognition result information acquired from the plurality of recognition engines, wherein;

the recognition result acquiring unit is configured to acquire the respective recognition result information in a graph-structured or tree-structured data format being previously defined, from the plurality of recognition engines; and

the integration recognition result outputting unit is configured to, when the respective recognition result information include information corresponding to each other in accordance with a predetermined standard, integrate each part of the respective recognition result information so as to be related to each other, and output in the graph structured or tree-structured data format as the new recognition result, and further,

the recognition result acquiring unit is configured to acquire the recognition result information from an object recognition engine that recognizes an object from the recognition target data and a flow recognition engine that recognizes a flow representing a trajectory of a predetermined object from the recognition target data respectively; and

the integration recognition result outputting unit is configured to, based on the recognition result information acquired from the object recognition engine and the recognition result information acquired from the flow recognition engine, examine an identity of a person identification information and an object identification information, the person identification information being included in the recognition result information acquired from the object recognition engine and the object identification information being included in the recognition result information acquired from the flow recognition engine, in a case that both the recognition result information are coincident with each other integrate by relating flow information of a predetermined object with object information and output as the new recognition result, the flow information being the recognition result information acquired from the flow recognition engine, and the object information being the recognition result information acquired from the object recognition engine.

2. The information processing device according to claim 1, comprising a definition information storing unit for storing:

recognition result definition information that defines a data format of the recognition result information acquired by the recognition result acquiring unit from each of the plurality of recognition engines; and

integration definition information that defines an integration format in which the integration recognition result outputting unit integrates the respective recognition result information, wherein;

the recognition result acquiring unit is configured to acquire the respective recognition result information in the data format defined by the recognition result definition information; and

the integration recognition result outputting unit is configured to integrate the respective recognition result information in the integration format defined by the integration definition information, and output the new recognition result.

3. The information processing device according to claim 1, wherein the recognition result information acquired by the recognition result acquiring unit from each of the plurality of recognition engines is in a graph-structured or tree-structured data format.

4. The information processing device according to claim 1, wherein:

the recognition result acquiring unit is configured to;

acquire the recognition result information including location information representing a position of an object recognized from the recognition target data by the object recognition engine and also representing a date and time when the object is recognized, from the object recognition engine; and

also acquire flow information of a predetermined object recognized from the recognition target data by the flow recognition engine, from the flow recognition engine; and

the integration recognition result acquiring unit is configured to, when the flow information acquired from the flow recognition engine includes information that corresponds to the location information acquired from the object recognition engine in accordance with a predetermined standard, integrate by relating the flow information that is the recognition result acquired from the flow recognition engine with object information identified by the recognition result information that is acquired from the object recognition engine and that includes the information corresponding to the location information, and output as the new recognition result.

5. A non-transitory computer-readable medium storing a computer program comprising instructions for causing an information processing device to realize:

a recognition result acquiring unit for acquiring respective recognition result information outputted by a plurality of recognition engines executing different recognition processes on recognition target data; and

an integration recognition result outputting unit for outputting a new recognition result obtained by integrating the respective recognition result information acquired from the plurality of recognition engines,

the computer program also comprising instructions for;

causing the recognition result acquiring unit to acquire the respective recognition result information in a graph-structure or tree-structured data format being previously defined, from the plurality of recognition engines; and

causing the integration recognition result outputting unit to, when the respective recognition result information include information corresponding to each other in accordance with a predetermined standard, integrate each part of the respective recognition result information so as to be related to each other and output in the graph-structured or tree-structured data format as the new recognition result, and further,

acquiring the recognition result information from an object recognition engine that recognizes an object from the recognition target data and a flow recognition engine that recognizes a flow representing a trajectory of a predetermined object from the recognition target data, respectively; and

causing the recognition result outputting unit to, based on the recognition result information acquired from the object recognition engine and the recognition result information acquired from the flow recognition engine, examine an identity of a person identification information and an object identification information, the person identification information being included in the recognition result information acquired from the object recognition engine and the object identification information being included in the recognition result information acquired from the flow recognition engine, in a case that both the recognition result information are coincident with each other, integrate by relating flow information of a predetermined object with object information and output as the new recognition result, the flow information being the recognition result information acquired from the flow recognition engine and the object information being the recognition result information acquired from the object recognition engine.

6. The non-transitory computer-readable storing medium storing the computer program according to claim 5, comprising instructions for causing the integration recognition result outputting unit to, when the respective recognition result information include information that correspond to each other in accordance with a predetermined standard, integrate the respective recognition result information and output as the new recognition result.

9. The non-transitory computer-readable storing medium storing the computer program according to claim 6, comprising instructions for:

causing the recognition result acquiring unit to acquire the recognition result information from an object recognition engine that recognizes an object from the recognition target data and a flow recognition engine that recognizes a flow representing a trajectory of a predetermined object from the recognition target data, respectively; and

causing the integration recognition result outputting unit to integrate by relating flow information of a predetermined object with object information and output as the new recognition result, the flow information being the recognition result information acquired from the flow recognition engine, and the object information being the recognition result information acquired from the object recognition engine.

7. An information processing method comprising:

acquiring respective recognition result information outputted by a plurality of recognition engines executing different recognition processes on recognition target data, the respective recognition result information being in a graph-structured or tree-structured data format being previously defined; and

when the respective recognition result information include information corresponding to each other in accordance with a predetermined standard, integrating each part of the respective recognition result information so as to be related to each other acquired from the plurality of recognition engines, and outputting in the graph-structured or tree-structured data format as a new recognition result, and further,

acquiring the recognition result information from an object recognition engine that recognizes an object from the recognition target data and a flow recognition engine that recognizes a flow representing a trajectory of a predetermined object from the recognition target data, respectively; and

an integration recognition result outputting unit to, based on the recognition result information acquired from the object recognition engine and the recognition result information acquired from the flow recognition engine, examine an identity of a person identification information and an object identification information, the person identification information being included in the recognition result info ion acquired from the object recognition engine and the object identification information being included in the recognition result information acquired from the flow recognition engine, in a case that both the recognition result information are coincident with each other, integrate by relating flow information of a predetermined object with object information and output as the new recognition result, the flow information being the recognition result information acquired from the flow recognition engine, and the object information being the recognition result information acquired from the object recognition engine.

8. The information processing method according to claim 7, comprising:

integrating the respective recognition result information and outputting as the new recognition result, when the respective recognition result information include information that correspond to each other in accordance with a predetermined standard.

10. The information processing method according to claim 8, comprising:

acquiring the recognition result information from an object recognition engine that recognizes an object from the recognition target data and a flow recognition engine that recognizes a flow representing a trajectory of a predetermined object from the recognition target data, respectively; and

integrating by relating flow information of a predetermined object with object information and output as the new recognition result, the flow information being the recognition result information acquired from the flow recognition engine, and the object information being the recognition result information acquired from the object recognition engine.