System and method for enriching a concept database with homogenous concepts

• US 10,691,642 B2
• Filed: 09/07/2017
• Issued: 06/23/2020
• Est. Priority Date: 10/26/2005
• Status: Active Grant

• Current Assignee: Cortica Ltd.
• Original Assignee: Cortica Ltd.
• Inventors: Harel, Adam, Raichelgauz, Igal, Odinaev, Karina, Zeevi, Yehoshua Y
• Primary Examiner(s): Hwa, Shyue Jiunn
• Application Number:
  US15/698,317
• Publication Number:
  US 20170371893A1
• Time in Patent Office: 1,020 Days
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A system and method for enriching a concept database with homogenous concepts. The method includes determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept; generating a reduced representation of the first MMCE, wherein the reduced representation excludes the signatures of the first MMCE that match the at least one first concept; comparing the reduced representation to signatures representing a plurality of second MMCEs to select a first plurality of top matching second MMCEs; generating, based on the reduced representation and the first plurality of top matching second MMCEs, at least one second concept; determining, for each second concept, whether the second concept is a homogenous concept, wherein each homogenous concept uniquely represents the same content; and adding each homogenous concept to the concept database.

Claims

1. A method for enriching a concept database, comprising:

determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept matches at least a portion of the signatures of the first MMCE;

generating a reduced representation of the first MMCE, wherein the reduced representation excludes the signatures of the first MMCE that match the at least one first concept;

comparing the reduced representation to signatures representing a plurality of second MMCEs to select a first plurality of top matching second MMCEs;

generating, based on the reduced representation and the first plurality of top matching second MMCEs, at least one second concept;

determining, for each second concept, whether the second concept is a homogenous concept, wherein each homogenous concept uniquely represents the same content; and

adding each homogenous concept to the concept database; and

wherein each MMCE is at least one of;

an image, a graphic, a video stream, a video clip, a video frame, a photograph, and an image of signals;

wherein the image of signals is an image of any of medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals.

2. The method of claim 1, wherein each second concept includes a plurality of signatures, wherein determining whether each second concept is a homogenous concept further comprises:

determining, based on the plurality of signatures of the second concept, a homogeneity score for the second concept, wherein the determining includes matching among the plurality of signatures of the second concept, wherein whether the second concept is homogenous is determined based on the homogeneity score for the second concept.

3. The method of claim 2, wherein determining whether each second concept is a homogenous concept further comprises:

determining whether the homogeneity score for the second concept is above a homogeneity threshold.

4. The method of claim 1, further comprising, for each second concept that is determined as not homogenous:

selecting a second plurality of top matching MMCEs, wherein the second plurality of top matching MMCEs includes fewer MMCEs than the first plurality of top matching MMCEs;

generating a third concept based on the second plurality of top matching MMCEs; and

determining whether the third concept is a homogenous concept.

5. The method of claim 1, wherein determining the at least one first concept further comprises:

performing a cleaning process, wherein the cleaning process includes removing at least one signature of the first MMCE, wherein each removed signature matches signatures of one of the at least one first concept above a predetermined threshold.

6. The method of claim 3 comprising determining the homogeneity threshold based on a portion of the plurality of second MMCEs .

7. The method of claim 6, wherein the portion of the plurality of second MMCEs comprises second MMCEs that follow the first plurality of top matching second MMCEs.

8. The method of claim 1, wherein each concept is a collection of signatures and metadata representing the concept.

9. The method of claim 1, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

10. A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process for enriching a concept database, the process comprising:

determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept matches at least a portion of the signatures of the first MMCE;

generating a reduced representation of the first MMCE, wherein the reduced representation excludes the signatures of the first MMCE that match the at least one first concept;

comparing the reduced representation to signatures representing a plurality of second MMCEs to select a first plurality of top matching second MMCEs;

generating, based on the reduced representation and the first plurality of top matching second MMCEs, at least one second concept;

determining, for each second concept, whether the second concept is a homogenous concept, wherein each homogenous concept uniquely represents the same content; and

adding each homogenous concept to the concept database; and

wherein each MMCE is at least one of;

an image, a graphic, a video stream, a video clip, a video frame, a photograph, and an image of signals;

wherein the image of signals is an image of any of medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals.

11. A system for enriching a concept database, comprising:

a processing circuitry; and

a memory connected to the processing circuitry, the memory containing instructions that, when executed by the processing circuitry, configure the system to;

determine, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept matches at least a portion of the signatures of the first MMCE;

generate a reduced representation of the first MMCE, wherein the reduced representation excludes the signatures of the first MMCE that match the at least one first concept;

compare the reduced representation to signatures representing a plurality of second MMCEs to select a first plurality of top matching second MMCEs;

generate, based on the reduced representation and the first plurality of top matching second MMCEs, at least one second concept;

determine, for each second concept, whether the second concept is a homogenous concept, wherein each homogenous concept uniquely represents the same content; and

add each homogenous concept to the concept database; and

wherein each MMCE is at least one of;

an image, a graphic, a video stream, a video clip, a video frame, a photograph, and an image of signals;

wherein the image of signals is an image of any of medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals.

12. The system of claim 11, wherein each second concept includes a plurality of signatures, wherein the system is further configured to:

determine, based on the plurality of signatures of the second concept, a homogeneity score for the second concept, wherein the determining includes matching among the plurality of signatures of the second concept, wherein whether the second concept is homogenous is determined based on the homogeneity score for the second concept.

13. The system of claim 12, wherein the system is further configured to:

determine whether the homogeneity score for the second concept is above a homogeneity threshold.

14. The system of claim 11, wherein the system is further configured to, for each second concept that is determined as not homogenous:

select a second plurality of top matching MMCEs, wherein the second plurality of top matching MMCEs includes fewer MMCEs than the first plurality of top matching MMCEs;

generate a third concept based on the second plurality of top matching MMCEs; and

determine whether the third concept is a homogenous concept.

15. The system of claim 11, wherein the system is further configured to:

perform a cleaning process, wherein the cleaning process includes removing at least one signature of the first MMCE, wherein each removed signature matches signatures of one of the at least one first concept above a predetermined threshold.

16. The system of claim 11, wherein each concept is a collection of signatures and metadata representing the concept.

17. The system of claim 11, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

18. The system of claim 11, wherein the system further comprises the concept database.