Method and system for browsing, searching and sharing of personal video by a non-parametric approach
First Claim
1. A method comprising:
- obtaining a query being a media portion;
obtaining at least one media reference set being a set of media portions;
obtaining a descriptors reference set being a set of local descriptors extracted from the at least one media reference set, wherein the descriptors are defined over a descriptors space;
extracting descriptor space representatives from the descriptors reference set;
calculating a non-parametric probability density estimation of the descriptor space representatives, given at least one of the media reference sets;
extracting a set of query descriptors from the query;
calculating for at least some of the query descriptors, at least one of their nearest descriptor space representatives;
calculating a non-parametric probability density estimation for at least some of the query descriptors, given at least one of the reference sets, using a weighted average of the non-parametric probability density estimations of the nearest descriptor space representatives, wherein the weights are determined based on the respective distances in the descriptor space, between the query descriptors and the corresponding descriptor space representatives;
calculating a non-parametric probability density estimation of the query, given at least one of the reference sets, by applying an operator to at least some of the calculated non-parametric probability density estimations of the query descriptors;
determining a saliency level of the query, based on the calculated non-parametric probability density estimation of the query given the at least one reference set, so that a lower level of the calculated non-parametric probability density estimation is indicative of a higher level of saliency of the query;
using the saliency level of the query as a criteria for selecting a sequence of media portions of interest; and
generating an audiovisual media stream based on at east some of the selected media portions of interest,wherein any of the obtaining, the calculating, the determining, the extracting, and the generating are executed by a computer processor.
9 Assignments
0 Petitions
Accused Products
Abstract
A method for determining a predictability of a media entity portion, the method includes: receiving or generating (a) reference media descriptors, and (b) probability estimations of descriptor space representatives given the reference media descriptors; wherein the descriptor space representatives are representative of a set of media entities; and calculating a predictability score of the media entity portion based on at least (a) the probability estimations of the descriptor space representatives given the reference media descriptors, and (b) relationships between the media entity portion descriptors and the descriptor space representatives. A method for processing media streams, the method may include: applying probabilistic non-parametric process on the media stream to locate media portions of interest; and generating metadata indicative of the media portions of interest.
-
Citations
12 Claims
-
1. A method comprising:
-
obtaining a query being a media portion; obtaining at least one media reference set being a set of media portions; obtaining a descriptors reference set being a set of local descriptors extracted from the at least one media reference set, wherein the descriptors are defined over a descriptors space; extracting descriptor space representatives from the descriptors reference set; calculating a non-parametric probability density estimation of the descriptor space representatives, given at least one of the media reference sets; extracting a set of query descriptors from the query; calculating for at least some of the query descriptors, at least one of their nearest descriptor space representatives; calculating a non-parametric probability density estimation for at least some of the query descriptors, given at least one of the reference sets, using a weighted average of the non-parametric probability density estimations of the nearest descriptor space representatives, wherein the weights are determined based on the respective distances in the descriptor space, between the query descriptors and the corresponding descriptor space representatives; calculating a non-parametric probability density estimation of the query, given at least one of the reference sets, by applying an operator to at least some of the calculated non-parametric probability density estimations of the query descriptors; determining a saliency level of the query, based on the calculated non-parametric probability density estimation of the query given the at least one reference set, so that a lower level of the calculated non-parametric probability density estimation is indicative of a higher level of saliency of the query; using the saliency level of the query as a criteria for selecting a sequence of media portions of interest; and generating an audiovisual media stream based on at east some of the selected media portions of interest, wherein any of the obtaining, the calculating, the determining, the extracting, and the generating are executed by a computer processor. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. system comprising:
-
an input module configured to obtain;
a query being a media portion;
at least one media reference set being a set of media portions; and
descriptors reference set being a set of descriptors extracted from the at least one media reference set, wherein the descriptors are defined over a descriptors space; anda computer processor configured to; extract descriptor space representatives from the descriptors reference set; calculate a non-parametric probability density estimation of the descriptor space representatives, given at least one of the media reference sets; extract a set of query descriptors from the query; calculate for at least some of the query descriptors, at least one of their nearest descriptor space representatives; calculate a non-parametric probability density estimation for at least some of the query descriptors, given at least one of the reference sets, using a weighted average of the non-parametric probability density estimations of the nearest descriptor space representatives, wherein the weights are determined based on the respective distances in the descriptor space, between the query descriptors and the corresponding descriptor space representatives; calculate a non-parametric probability density estimation of the query, given at least one of the reference sets, by applying an operator to at least some of the calculated non-parametric probability density estimations of the query descriptors; determine a saliency level of the query, based on the calculated non-parametric probability density estimation of the query given the at least one reference set, so that a lower level of the calculated non-parametric probability den estimation is indicative of a higher level of saliency of the query; use the saliency level of the query as a criteria for selecting a sequence of media portions of interest; and generate an audiovisual media stream based on at least some of the selected media portions s of interest.
-
-
12. A tangible computer program product comprising:
a non-transitory computer readable storage medium having computer readable program embodied therewith, the computer readable program comprising; computer readable program configured to obtain a query being a media portion; computer readable program configured to obtain at least one media reference set being a set of media portions; computer readable program configured to obtain a descriptors reference set being a set of descriptors extracted from the at least one media reference set, wherein the descriptors are defined over a descriptors space; computer readable program configured to extract descriptor space representatives from the descriptors reference set; computer readable program configured to calculate a non-parametric probability density estimation of the descriptor space representatives, given at least one of the media reference sets; computer readable program configured to extract a set of query descriptors from the query; computer readable program configured to calculate for at least some of the query descriptors, at least one of their nearest descriptor space representatives; computer readable program configured to calculate a non-parametric probability density estimation for at least some of the query descriptors, given at least one of the reference sets, using a weighted average of the non-parametric probability density estimations of the nearest descriptor space representatives, wherein the weights are determined based on the respective distances in the descriptor space, between the query descriptors and the corresponding descriptor space representatives; computer readable program configured to calculate a non-parametric probability density estimation of the query, given at least one of the reference sets, by applying an operator to at least some of the calculated non-parametric probability density estimations of the query descriptors; computer readable program configured to determine a saliency level of the query, based on the calculated non-parametric probability density estimation of the query given the at least one reference set, so that a lower level of the calculated non-parametric probability density estimation is indicative of a higher level of saliency of the query; computer readable program configured to use the saliency level of he query as a criteria for selecting a sequence of media portions of interest; and computer readable program configured to generate an audiovisual media stream based on at least some of the selected media portions of interest.
Specification