Visual image database search engine which allows for different schema

• US 5,911,139 A
• Filed: 03/28/1997
• Issued: 06/08/1999
• Est. Priority Date: 03/29/1996
• Status: Expired due to Term

• Current Assignee: Micro Focus LLC (Open Text Corporation)
• Original Assignee: Virage, Inc. (HP Inc.)
• Inventors: Bach, Jeffrey R., Horowitz, Bradley, Jain, Ramesh, Gupta, Amarnath, Shu, Chiao-fe, Fuller, Charles E.
• Primary Examiner(s): Kulik, Paul V.
• Assistant Examiner(s): HOMERE, JEAN RAYMOND
• Application Number:
  US08/828,360
• Time in Patent Office: 802 Days
• Field of Search: 707/3, 707/102, 707/104, 345/348, 345/346, 345/355
• US Class Current: 1/1
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5862 using texture
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A system and method for content-based search and retrieval of visual objects. A base visual information retrieval (VIR) engine utilizes a set of universal primitives to operate on the visual objects. An extensible VIR engine allows custom, modular primitives to be defined and registered. A custom primitive addresses domain specific problems and can utilize any image understanding technique. Object attributes can be extracted over the entire image or over only a portion of the object. A schema is defined as a specific collection of primitives. A specific schema implies a specific set of visual features to be processed and a corresponding feature vector to be used for content-based similarity scoring. A primitive registration interface registers custom primitives and facilitates storing of an analysis function and a comparison function to a schema table. A heterogeneous comparison allows objects analyzed by different schemas to be compared if at least one primitive is in common between the schemas. A threshold-based comparison is utilized to improve performance of the VIR engine. A distance between two feature vectors is computed in any of the comparison processes so as to generate a similarity score.

Claims

1. In a system comprising a search engine in communication with a database including a plurality of visual objects, a method of object comparison which allows for different and new schema, wherein a schema is a set of attributes, comprising the steps of:

extracting a first set of attributes from a first visual object;

accessing a second set of attributes from a second visual object, wherein the first set of attributes has different members than the second set of attributes; and

comparing only those attributes common to both of the visual objects.

2. The method defined in claim 1, wherein each attribute for any one of the visual objects is operated on by a primitive.

3. The method defined in claim 2, additionally including the step of defining a schema of primitives for a specific domain of visual objects.

4. The method defined in claim 1, wherein the comparison function determines a distance between the two sets of extracted attributes.