INFORMATION DISPLAY APPARATUS, METHOD THEREOF AND PROGRAM THEREOF

• US 20130127906A1
• Filed: 11/12/2012
• Published: 05/23/2013
• Est. Priority Date: 11/11/2011
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kaoru Sugita, Masahiro Sekine, Masashi Nishiyama
• Inventors: SUGITA, Kaoru, NISHIYAMA, Masashi, SEKINE, Masahiro
• Granted Patent: US 9,324,304 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06V 10/757 Matching configurations of points or features
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

An information display apparatus creates determination image which indicates the fact that a reference object in a plurality of objects arranged in a row satisfies a predetermined rule or that the reference object does not satisfy the rule, creates an image to be displayed by superimposing the determination image on the acquired image, and displays the image to be displayed.

Claims

1. An information display apparatus comprising:

an image acquiring unit configured to acquire an image including objects arranged in a row;

a recognizing unit configured to recognize identification information and the position of each of the objects in the image;

a storing unit configured to store the identification information of one of the objects arranged in a same row with another one of the objects and a rule indicating the positional relationship between the one of the objects and the another one of the objects in advance on an object-to-object basis;

a recognizing unit configured to recognize the identification information of a reference object which is one of the objects to be determined whether or not the arrangement of the objects is correct, the identification information of a target object which is the object arranged in a same row with the reference object, and recognition information including the positional relationship between the reference object and the target object from the image;

a determining unit configured to determine whether or not the reference object satisfies the rule using the recognition information relating to the reference object and the rule;

a superimposing unit configured to create a determination image indicating that the reference object satisfies the rule or that the reference object does not satisfy the rule, and create an image to be displayed by superimposing the determination image on the image; and

a display unit configured to display the image to be displayed.

2. The apparatus according to claim 1, wherein the image acquired by the image acquiring unit is a moving image;

the determining unit performs the determination on the moving image on a frame-to-frame basis; and

the information display apparatus further comprises an integrating unit configured to integrate the frame-to-frame basis determination into one determination.

3. The apparatus according to claim 1, wherein a second object which specifies the position of the objects is included in the image acquired by the image acquiring unit;

the storing unit stores identification information of the second object and a second rule indicating a positional relationship between the objects and the second object;

the determining unit determines whether or not the reference object satisfies the rules using the recognition information relating to the reference object, the rule and the second rule.

4. The apparatus according to claim 1, wherein the positional relationship is a relative position, a relative direction or a direction vector between the reference object and the target object.

5. The apparatus according to claim 1, wherein the objects are cables.

6. The apparatus according to claim 5, wherein the second object is a terminal block to which the cables are connected.

7. An information display method comprising:

acquiring an image including objects arranged in a row;

recognizing identification information and the position of each of the objects in the image;

storing the identification information of one of the objects arranged in a same row with another one of the objects and a rule indicating the positional relationship between the one of the objects and the another one of the objects in advance on an object-to-object basis;

recognizing the identification information of a reference object which is one of the objects to be determined whether or not the arrangement of the objects is correct, the identification information of a target object which is the object arranged in a a same row with the reference object, and recognition information including the positional relationship between the reference object and the target object from the image;

determining whether or not the reference object satisfies the rule using the recognition information relating to the reference object and the rule;

creating a determination image indicating that the reference object satisfies the rule or that the reference object does not satisfy the rule, and create an image to be displayed by superimposing the determination image on the image; and

displaying the image to be displayed.

8. A program stored in a computer readable non-temporary medium in order to cause the computer to implement:

acquiring an image including objects arranged in a row;

recognizing identification information and the position of each of the objects in the image;

storing the identification information of one of the objects arranged in a same row with another one of the objects and a rule indicating the positional relationship between the one of the objects and the another one of the objects in advance on an object-to-object basis;

recognizing the identification information of a reference object which is one of the objects to be determined whether or not the arrangement of the objects is correct, the identification information of a target object which is the object arranged in a same row with the reference object, and recognition information including the positional relationship between the reference object and the target object from the image;

determining whether or not the reference object satisfies the rule using the recognition information relating to the reference object and the rule;

creating a determination image indicating that the reference object satisfies the rule or that the reference object does not satisfy the rule, and create an image to be displayed by superimposing the determination image on the image; and

displaying the image to be displayed.