Systems and methods for generating a comprehensive user attention model
First Claim
Patent Images
1. A method for generating a comprehensive user attention model, the method comprising:
- extracting feature components from a video data sequence;
generating attention data based on application of multiple attention models to the feature components; and
integrating the attention data to create the comprehensive user attention model.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods to generate an attention model for computational analysis of video data are described. In one aspect, feature components from a video data sequence are extracted. Attention data is generated by applying multiple attention models to the extracted feature components. The generated attention data is integrated into a comprehensive user attention model for the computational analysis of the video data sequence.
165 Citations
41 Claims
-
1. A method for generating a comprehensive user attention model, the method comprising:
-
extracting feature components from a video data sequence;
generating attention data based on application of multiple attention models to the feature components; and
integrating the attention data to create the comprehensive user attention model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer-readable medium comprising computer-executable instructions executable by a processor to generate a comprehensive user attention model, the computer-executable instructions comprising instructions for:
-
extracting feature components from a video data sequence;
generating attention data based on application of multiple attention models to the feature components; and
integrating the attention data to create the comprehensive user attention model.
-
-
15. A computer-readable medium comprising computer-executable instructions executable by a processor to generate an attention model, the computer-executable instructions comprising instructions for:
-
extracting feature components from a video data sequence;
generating attention data based on application of at least visual and audio attention models to the feature components; and
linearly combining the attention data to generate a generic user attention model that integrates results of the multiple visual, audio, and linguistic attention models. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A computing device for creating a comprehensive user attention model, the computing device comprising:
-
a processer;
a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for;
generating visual, audio, and linguistic attention data based on application of multiple attention models to a plurality of video data sequence feature components, the feature components comprising image sequence, audio, and text-related features;
integrating the visual, audio, and linguistic attention data to create the comprehensive user attention model; and
wherein the comprehensive user attention model is a computational representation of elements of the video data sequence that attract user attention. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A computing device for generating an attention model, the computing device comprising:
-
means for extracting image sequence, audio, and text-related feature components from a video data sequence;
means for generating attention data by applying visual, audio, and linguistic attention models to the feature components; and
means for integrating the attention data via into a comprehensive user attention model. - View Dependent Claims (38, 39, 40, 41)
-
Specification