VIDEO SEARCH SYSTEM AND METHOD OF USE

• US 20130173635A1
• Filed: 12/30/2011
• Published: 07/04/2013
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Original Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Inventors: SANJEEV, Kumar
• Granted Patent: US 8,892,572 B2
• Time in Patent Office: Days
• US Class Current: 707/748
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335

Abstract

A system and method identifies a video file in response to a video based search query. A video imaging device in a mobile device captures a video file, and sends the video file to a search engine. A database associated with the search engine stores pre-indexed metadata of pre-indexed frames of video. A video analyzer separates the received video file into individual frames, analyzes the individual frames received from the mobile device by converting the individual frames into metadata, and compares the metadata to the pre-indexed metadata of the pre-indexed frames stored in the database. The video analyzer then sends a message containing information about the identified pre-existing video back to the mobile device based on the comparison of metadata. The metadata of the file and/or the metadata in the database may include one or more of pixel information, histogram information, image recognition information and audio information for each individual frame.

Claims

1. A system, comprising:

a network interface configured to enable a mobile device to capture a video file comprising a plurality of frames, and to send said video file through a mobile communication network to a server;

a processor configured to execute computer-implemented programs;

a storage device configured to store pre-indexed metadata of pre-indexed frames of pre-existing videos; and

a program associated with the server, wherein execution of the program by the processor configures the system to perform functions, including functions to separate the video file received from the mobile device into individual frames, convert the individual frames into metadata for the video file, compare the metadata for the video file to the pre-indexed metadata of the pre-indexed frames of pre-existing videos stored in the database, identify a pre-existing video based on the comparison of the metadata, and send a message containing information about the identified pre-existing video based on the results of the comparison back to the mobile device.

2. The system of claim 1, wherein the metadata for the video file and for the pre-indexed metadata includes pixel information, histogram information, image recognition information and audio information for each individual frame and for each pre-indexed frame for the pre-existing videos, respectively.

3. The system of claim 2, wherein the program assigns a numeric value to each comparison of the metadata for an individual frame of the video file to the pre-indexed metadata based on an amount to which the individual frame matches the pixel information, the histogram information, the image recognition information and the audio information of each pre-indexed frame.

4. The system of claim 3, wherein in assigning the numeric values of each comparison of the metadata of the video file and the pre-indexed metadata, the relative values of the pixel information, the histogram information, the image recognition information and the audio information are weighted.

5. The system of claim 3, wherein in the step of comparing the metadata, the numeric value having the greatest value identifies a best match.

6. The system of claim 5, wherein after the best match is identified based on the numeric values of each comparison, a second individual frame immediately following the individual frame of the video file is compared with the next frame in the database of pre-indexed frames.

7. The system of claim 3, wherein in the step of comparing the metadata, a numeric value being greater than a predetermined threshold identifies a match.

8. The system of claim 7, wherein when a match is identified, a second individual frame immediately following the individual frame of the video file is compared with the next frame in the database of pre-indexed frames.

9. A method, comprising the steps of:

receiving a video file comprising a plurality of frames from a mobile device,

separating the video tile into a plurality of individual frames,

converting each individual frame into metadata for the video file,

comparing the metadata of the video file to pre-indexed metadata of pre-indexed frames of pre-existing videos stored in a database,

identifying one of the pre-existing videos as corresponding to the received video file based on the comparison between the metadata of the video file to each pre-indexed metadata of the pre-indexed frames, and

sending a message containing information about the identified pre-existing video based on the results of the comparison back to the mobile device.

10. The method of claim 9, wherein the metadata for the video file and for the pre-indexed metadata includes pixel information, histogram information, image recognition information and audio information for each individual frame and for each pre-indexed frame for the pre-existing videos, respectively.

11. The method of claim 10, wherein in the step of comparing the metadata of the video file to pre-indexed metadata, a numeric value is assigned for each comparison by an individual frame of the video file to the pre-indexed metadata based on an amount by which the individual frame matches the pixel information, the histogram information, the image recognition information and the audio information of each pre-indexed frame.

12. The method of claim 11, wherein in assigning the numeric values of each comparison of the metadata of the individual frame of the video file and the metadata for the pre-indexed frame, the relative values of the pixel information, the histogram information, the image recognition information and the audio information are weighted.

13. The method of claim 11, wherein in the step of comparing the metadata, the numeric value having the greatest value identifies a best match.

14. The method of claim 13, wherein after the best match is identified based on the numeric values of each comparison, a second individual frame immediately following the individual frame of the video file is compared with the next frame in the database of pre-indexed frames.

15. The method of claim 11, wherein in the step of comparing the metadata, a numeric value being greater than a predetermined threshold identifies a match.

16. The method of claim 15, wherein when a match is identified, a second individual frame immediately following the individual frame of the video file is compared with the next frame in the database of pre-indexed frames.

17. An article of manufacture comprising a non-transitory machine readable medium and executable instruction embodied in the medium for configuring a computer to perform the method of claim 9.

18. A system, comprising:

a video imaging device configured to capture a video file comprising a plurality of frames;

a mobile device coupled to the video imaging device configured to send said video file through a mobile communication network to a server;

a database configured to store pre-indexed metadata of pre-indexed frames of pre-existing videos;

a video analyzer associated with the server, configured to separate the video file received from the wireless communication device into individual frames, convert the individual frames into metadata for the video file, compare the metadata for the video file to the pre-indexed metadata of the pre-indexed frames of pre-existing videos stored in the database, and send a message containing information about the identified pre-existing video back to the mobile device.

19. The system of claim 18, wherein the metadata for the video file and the pre-indexed metadata includes pixel information, histogram information, image recognition information and audio information for each individual frame and for each pre-indexed frame for the pre-existing videos, respectively.

20. The system of claim 19, wherein the video analyzer assigns a numeric value to each comparison of the metadata for each individual frame of the video file to the pre-indexed metadata based on an amount by which each individual frame matches the pixel information, the histogram information, the image recognition information and the audio information of each pre-indexed frame.

21. The system of claim 20, wherein in assigning the numeric values of each comparison of the metadata for each individual frame of the video file and the pre-indexed metadata, the relative values of the pixel information, the histogram information, the image recognition information and the audio information are weighted.

22. The system of claim 20, wherein in the step of comparing the metadata, the numeric value having the greatest value identifies a best match.

23. The system of claim 22, wherein after the best match is identified based on the numeric values of each comparison, a second individual frame immediately following the individual frame of the video tile is compared with the next frame in the database of pre-indexed frames.

24. The system of claim 20, wherein in the step of comparing the metadata, a numeric value being greater than a predetermined threshold identifies a match.

25. The system of claim 24, wherein when a match is identified, a second individual frame immediately following the individual frame of the video file is compared with the next frame in the database of pre-indexed frames.