System and method for creating user profiles based on multimedia content

• US 10,193,990 B2
• Filed: 09/08/2016
• Issued: 01/29/2019
• Est. Priority Date: 10/26/2005
• Status: Active Grant

• Current Assignee: Cortica Ltd.
• Original Assignee: Cortica Ltd.
• Inventors: Raichelgauz, Igal, Odinaev, Karina, Zeevi, Yehoshua Y
• Primary Examiner(s): Stevens, Robert
• Application Number:
  US15/259,907
• Publication Number:
  US 20160378755A1
• Time in Patent Office: 873 Days
• Field of Search: 707737
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

A system and method for creating user profiles based on multimedia content. The method may include identifying a plurality of multimedia content elements associated with a user; generating at least one signature for each of the plurality of multimedia content elements; analyzing the at least one signature to identify at least one concept matching the multimedia content elements; generating, based on the at least one matching concept, at least one contextual insight, wherein each contextual insight indicates a preference of the user; and generating, based on the at least one contextual insight, a user profile for the user.

Claims

1. A method for creating user profiles based on multimedia content, comprising:

identifying a plurality of multimedia content elements associated with a user;

generating at least one signature for each of the plurality of multimedia content elements;

analyzing the at least one signature to identify at least one concept matching the multimedia content elements;

generating, based on the at least one matching concept, at least one contextual insight, wherein each contextual insight indicates a preference of the user; and

generating, based on the at least one contextual insight, a user profile for the user.

2. The method of claim 1, wherein each concept is a collection of signatures representing at least one conceptually related multimedia content element and metadata describing the concept, wherein the collection of signatures is a signature reduced cluster generated by inter-matching signatures generated for the at least one multimedia content element.

3. The method of claim 1, further comprising:

determining at least one profile variable; and

associating the determined at least one profile variable with the at least one contextual insight, wherein the user profile indicates associations between the determined at least one profile variable with the at least one contextual insight.

4. The method of claim 3, further comprising:

identifying metadata associated with each identified multimedia content element; and

analyzing the identified metadata, wherein the at least one profile variable is determined based on the identified metadata.

5. The method of claim 1, wherein each signature is generated by a signature generator including a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores, wherein the properties of each computational core are set independently of the properties of each other core.

6. The method of claim 1, wherein the computational cores are configured such that each generated signature is robust to noise and distortion.

7. The method of claim 1, further comprising:

identifying, in real-time, at least one subsequently captured or stored multimedia content element; and

updating the user profile based on the at least one subsequently captured or stored multimedia content element.

8. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute a method, the method comprising:

identifying a plurality of multimedia content elements associated with a user;

generating, by a signature generator, at least one signature for each of the plurality of multimedia content elements, wherein the signature generator includes a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores;

analyzing the at least one signature to identify at least one concept matching the multimedia content elements;

generating, based on the at least one matching concept, at least one contextual insight, wherein each contextual insight indicates a preference of the user; and

generating, based on the at least one contextual insight, a user profile for the user.

9. A system for creating user profiles based on multimedia content, comprising:

a signature generator, wherein the signature generator includes a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores;

a processing circuitry; and

a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to;

identify a plurality of multimedia content elements associated with a user;

generate, by the signature generator, at least one signature for each of the plurality of multimedia content elements;

analyze the at least one signature to identify at least one concept matching the multimedia content elements;

generate, based on the at least one matching concept, at least one contextual insight, wherein each contextual insight indicates a preference of the user; and

generate, based on the at least one contextual insight, a user profile for the user.

10. The system of claim 9, wherein each concept is a collection of signatures representing at least one conceptually related multimedia content element and metadata describing the concept, wherein the collection of signatures is a signature reduced cluster generated by inter-matching signatures generated for the at least one multimedia content element.

11. The system of claim 9, wherein the system is further configured to:

determine at least one profile variable; and

associate the determined at least one profile variable with the at least one contextual insight, wherein the user profile indicates associations between the determined at least one profile variable with the at least one contextual insight.

12. The system of claim 11, wherein the system is further configured to:

identify metadata associated with each identified multimedia content element; and

analyze the identified metadata, wherein the at least one profile variable is determined based on the identified metadata.

13. The system of claim 9, wherein each signature is generated by a signature generator including a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores, wherein the properties of each computational core are set independently of the properties of each other core.

14. The system of claim 9, wherein the computational cores are configured such that each generated signature is robust to noise and distortion.

15. The system of claim 9, wherein the system is further configured to:

identify, in real-time, at least one subsequently captured or stored multimedia content element; and

update the user profile based on the at least one subsequently captured or stored multimedia content element.

16. A method for generating a user profile based on multimedia content, comprising:

identifying a plurality of multimedia content elements associated with a user;

analyzing at least one signature generated for each multimedia content element;

generating, based on the signature analysis, at least one contextual insight, wherein each contextual insight indicates a preference of the user;

determining at least one profile variable, wherein each profile variable is associated with at least one of;

the user, and a user device associated with the user;

determining, by an interest analyzer, at least one current user interest based on the at least one profile variable and the at least one contextual insight;

generating a user profile for the user, wherein the user profile indicates the at least one current user interest.

17. The method of claim 16, wherein analyzing the at least one signature generated for each multimedia content element further comprises:

identifying at least one concept matching the multimedia content elements, wherein each concept is a collection of signatures representing at least one conceptually related multimedia content element and metadata describing the concept.

18. The method of claim 17, wherein analyzing the at least one signature generated for each multimedia content element further comprises:

correlating between concepts of the at least one concept; and

determining, based on the correlation, at least one context of the plurality of multimedia content elements.

19. The method of claim 18, further comprising:

identifying a source of each multimedia content element, wherein the at least one context is determined further based on each identified source.

20. The method of claim 16, further comprising:

analyzing metadata associated with the user, wherein the at least one profile variable is determined based on the metadata analysis.

21. The method of claim 16, further comprising:

generating, by a signature generator, the at least one signature for each multimedia content element, wherein the signature generator includes a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores.

22. The method of claim 16, further comprising:

identifying, in real-time, at least one subsequently captured or stored multimedia content element; and

updating the user profile based on the at least one subsequently captured or stored multimedia content element.

23. A system for generating a user profile based on multimedia content, comprising:

an interest analyzer configured to at least determine current user interests based on contextual insights;

a processing circuitry; and

a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to;

identify a plurality of multimedia content elements associated with a user;

analyze at least one signature generated for each multimedia content element;

generate, based on the signature analysis, at least one contextual insight, wherein each contextual insight indicates a preference of the user;

determine at least one profile variable, wherein each profile variable is associated with at least one of;

the user, and a user device associated with the user;

determine, by the interest analyzer, at least one current user interest based on the at least one profile variable and the at least one contextual insight;

generate a user profile for the user, wherein the user profile indicates the at least one current user interest.

24. The method of claim 23, wherein the system is further configured to:

identify at least one concept matching the multimedia content elements, wherein each concept is a collection of signatures representing at least one conceptually related multimedia content element and metadata describing the concept.

25. The system of claim 24, wherein the system is further configured to:

correlate between concepts of the at least one concept; and

determine, based on the correlation, at least one context of the plurality of multimedia content elements.

26. The system of claim 25, wherein the system is further configured to:

identify a source of each multimedia content element, wherein the at least one context is determined further based on each identified source.

27. The system of claim 23, wherein the system is further configured to:

analyze metadata associated with the user, wherein the at least one profile variable is determined based on the metadata analysis.

28. The system of claim 23, further comprising:

a signature generator including a plurality of computational cores, each computational core having properties that are at least partially statistically independent of properties of the other computational cores, wherein the system is further configured to;

generate, by the signature generator, the at least one signature for each multimedia content element.

29. The system of claim 23, wherein the system is further configured to:

identify, in real-time, at least one subsequently captured or stored multimedia content element; and

update the user profile based on the at least one subsequently captured or stored multimedia content element.