Method, system, and computer program product for identifying device

• US 10,643,111 B2
• Filed: 08/29/2019
• Issued: 05/05/2020
• Est. Priority Date: 09/27/2018
• Status: Active Grant

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Xu, Wei Feng
• Primary Examiner(s): Casillas, Roland J
• Application Number:
  US16/555,028
• Publication Number:
  US 20200104649A1
• Time in Patent Office: 250 Days
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 10/80 Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level multimodal speaker identification or verification G10L17/10
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

A method, apparatus, system, storage medium, processor, and terminal for identifying a device are disclosed. The method for identifying a device includes: acquiring image data or video data that includes a device to be identified; acquiring, based on the image data or video data, characteristic information about the device to be identified; acquiring CAD model data about a plurality of device types; acquiring, based on the characteristic information and CAD model data, type information about a target type that identifies the device to be identified; acquiring a device layout document, the device layout document indicating a layout relationship among a plurality of devices that are of a plurality of device types; and acquiring, based on the target type and the layout relationship, target device information about the device to be identified. As such, field devices are identified efficiently by pattern recognition technology, device model, and layout design document data.

Claims

1. A method for identifying target device information about the device to be identified, comprising:

acquiring image data or video data including a device to be identified;

acquiring, based on the image data or video data acquired, characteristic information about the device to be identified;

acquiring CAD model data about a plurality of device types;

acquiring, based on the characteristic information and the CAD model data acquired, type information about a target type identifying the device to be identified;

acquiring a device layout document, the device layout document indicating a layout relationship among a plurality of devices of a plurality of device types; and

acquiring, based on the target type and the layout relationship, the target device information about the device to be identified.

2. The method of claim 1, wherein the acquiring of the target device information about the device to be identified comprises:

determining, based on the layout document, that a plurality of devices are of the target type;

determining, based on the layout document, a number of device types associated with at least one relationship between devices of the target type and a related device;

determining a first relationship that has a relatively largest number of associated device types;

acquiring image data or video data about the related device associated with the first relationship;

acquiring, based on the image data or video data about the related device, characteristic information about the related device;

acquiring, based on the characteristic information about the related device and the CAD model data, type information that identifies the related device; and

comparing type information about the related device and the first relationship with the layout relationship expressed by the layout document to determine that the device to be identified is a target device expressed in the layout document associated with the related document by the first relationship.

3. The method of claim 1, wherein the acquiring of the image data or video data including a device to be identified comprises:

detecting whether a plurality of devices exist in the image data or video data;

displaying, upon detecting that the plurality of devices exist, an interactive interface for selecting one device from the plurality of devices as the device to be identified;

receiving input for selecting one device from the plurality of devices; and

determining, based on the input, that the selected device is the device to be identified.

4. The method of claim 1, further comprising:

generating, based on identification information about the device to be identified, attribute information about the device to be identified; and

displaying the attribute information.

5. The method of claim 1, wherein the characteristic information is a characteristic point or characteristic shape of the device to be identified extracted from the image data or video data.

6. A non-transitory computer-readable medium storing a computer-executable instruction, the computer-executable instruction, when executed, causing at least one processor to implement the method of claim 1.

7. The method of claim 2, further comprising:

generating, based on identification information about the device to be identified, attribute information about the device to be identified; and

displaying the attribute information.

8. The method of claim 2, wherein the characteristic information is a characteristic point or characteristic shape of the device to be identified extracted from the image data or video data.

9. The method of claim 3, further comprising:

generating, based on identification information about the device to be identified, attribute information about the device to be identified; and

displaying the attribute information.

10. The method of claim 3, wherein the characteristic information is a characteristic point or characteristic shape of the device to be identified extracted from the image data or video data.

11. A system for identifying a device, comprising:

a model database, containing CAD model data about a plurality of device types;

a layout design document database, containing a device layout document, the device layout document expressing a layout relationship among a plurality of devices of the plurality of device types; and

an apparatus to identify a device, the apparatus comprising

an image acquisition unit, configured to acquire image data or video data that includes the device to be identified,

a target identification unit, comprising;

a characteristic extraction module, configured to acquire, based on the image data or video data acquired, characteristic information about the device to be identified;

a model acquisition module, configured to acquire the CAD model data from the model database;

a type identification module, configured to acquire, based on the characteristic information and the CAD model data, type information about a target type that identifies the device to be identified;

a layout acquisition module, configured to acquire the device layout document from the layout design document database; and

a device identification module, configured to acquire, based on the target type and the layout relationship, target device information about the device to be identified.

12. The system of claim 11, further comprising:

a supervisory control and data acquisition system, configured to acquire identification information from the target identification unit and, based on the identification information about the device to be identified, generate attribute information about the device to be identified; and

an information display unit, configured to display the attribute information.