System and method for enriching a concept database

• US 10,635,640 B2
• Filed: 09/05/2017
• Issued: 04/28/2020
• Est. Priority Date: 10/26/2005
• Status: Active Grant

• Current Assignee: Cortica Ltd.
• Original Assignee: Cortica Ltd.
• Inventors: Harel, Adam, Raichelgauz, Igal, Odinaev, Karina, Zeevi, Yehoshua Y
• Primary Examiner(s): Al-Hashemi, Sana A
• Application Number:
  US15/695,665
• Publication Number:
  US 20180121462A1
• Time in Patent Office: 966 Days
• Field of Search: 707607, 707609, 707705, 707790, 707813, 707821
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A system and method for enriching a concept database. The method includes determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept is one of the plurality of existing concepts matching a portion of the first MMCE; generating a reduced representation of the first MMCE, wherein the generation of the reduced representation includes removing the at least one portion of the first MMCE matching the determined at least one first concept; comparing the reduced representation to signatures representing a plurality of second MMCEs to determine a plurality of matching second MMCEs; generating, based on the reduced representation and the plurality of matching second MMCEs, at least one second concept; and adding the generated at least one second concept to the concept database.

Claims

1. A method for enriching a concept database, comprising:

determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept is one of the plurality of existing concepts matching a portion of the first MMCE;

generating a reduced representation of the first MMCE, wherein the generation of the reduced representation includes removing the at least one portion of the first MMCE matching the determined at least one first concept;

comparing the reduced representation to signatures representing a plurality of second MMCEs to determine a plurality of matching second MMCEs;

generating, based on the reduced representation and the plurality of matching second MMCEs, at least one second concept; and

adding the generated at least one second concept to the concept database.

2. The method of claim 1, wherein determining the at least one first concept further comprises:

performing a cleaning process, wherein the cleaning process includes removing at least one signature of the first MMCE, wherein each removed signature matches signatures of one of the at least one first concept above a predetermined threshold.

3. The method of claim 2, wherein the cleaning process is performed recursively when each first concept is determined.

4. The method of claim 1, wherein each second concept includes at least a portion of the reduced representation and at least a portion of the signatures representing the plurality of second MMCEs.

5. The method of claim 1, wherein each MMCE is at least one of:

an image, a graphic, a video stream, a video clip, a video frame, a photograph, and an image of signals.

6. The method of claim 5, wherein the image of signals is an image of any of:

medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals.

7. The method of claim 1, wherein each concept is a collection of signatures and metadata representing the concept.

8. The method of claim 1, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

9. The method of claim 8, wherein generating the at least one signature further comprises:

sending the image to the signature generator system; and

receiving, from the signature generator system, the at least one signature.

10. A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process for enriching a concept database, the process comprising:

determining, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept is one of the plurality of existing concepts matching a portion of the first MMCE;

generating a reduced representation of the first MMCE, wherein the generation of the reduced representation includes removing the at least one portion of the first MMCE matching the determined at least one first concept;

comparing the reduced representation to signatures representing a plurality of second MMCEs to determine a plurality of matching second MMCEs;

generating, based on the reduced representation and the plurality of matching second MMCEs, at least one second concept; and

adding the generated at least one second concept to the concept database.

11. A system for enriching a concept database, comprising:

a processing circuitry; and

a memory connected to the processing circuitry, the memory containing instructions that, when executed by the processing circuitry, configure the system to;

determine, based on signatures of a first multimedia content element (MMCE) and signatures of a plurality of existing concepts in the concept database, at least one first concept, wherein each first concept is one of the plurality of existing concepts matching a portion of the first MMCE;

generate a reduced representation of the first MMCE, wherein the generation of the reduced representation includes removing the at least one portion of the first MMCE matching the determined at least one first concept;

compare the reduced representation to signatures representing a plurality of second MMCEs to determine a plurality of matching second MMCEs;

generate, based on the reduced representation and the plurality of matching second MMCEs, at least one second concept; and

add the generated at least one second concept to the concept database.

12. The system of claim 11, wherein the system is further configured to:

perform a cleaning process, wherein the cleaning process includes removing at least one signature of the first MMCE, wherein each removed signature matches signatures of one of the at least one first concept above a predetermined threshold.

13. The system of claim 12, wherein the cleaning process is performed recursively when each first concept is determined.

14. The system of claim 11, wherein each second concept includes at least a portion of the reduced representation and at least a portion of the signatures representing the plurality of second MMCEs.

15. The system of claim 11, wherein each MMCE is at least one of:

an image, a graphic, a video stream, a video clip, a video frame, a photograph, and an image of signals.

16. The system of claim 15, wherein the image of signals is an image of any of:

medical signals, geophysical signals, subsonic signals, supersonic signals, electromagnetic signals, and infrared signals.

17. The system of claim 11, wherein each concept is a collection of signatures and metadata representing the concept.

18. The system of claim 11, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

19. The system of claim 18, wherein the system is further configured to:

send the image to the signature generator system; and

receive, from the signature generator system, the at least one signature.

20. The system of claim 11, wherein the system further comprises the concept database.