Determining redundancies in content object directories

• US 7,035,867 B2
• Filed: 11/28/2001
• Issued: 04/25/2006
• Est. Priority Date: 11/28/2001
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Aerocast.com Incorporated
• Inventors: Raciborski, Nathan F., Thompson, Mark R.
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US10/002,290
• Publication Number:
  US 20030101162A1
• Time in Patent Office: 1,609 Days
• Field of Search: 707/2, 707/102, 707/104.1, 707/200, 707/205, 707/101, 708403-405, 382/100, 382/280, 704/205, 704/236
• US Class Current: 1/1
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A system for identifying files can use fingerprints to compare various files and determine redundant files. Frequency representations of portions of files can be used, such as Fast Fourier Transforms, as the fingerprints.

Claims

1. A computer implemented method of eliminating a redundant video file, said method comprising:

obtaining a first frequency representation of a selected video file;

accessing a first unknown file, wherein the entire data set of said unknown file is stored in computer-readable storage media;

obtaining a second frequency representation of said unknown file;

comparing said first frequency representation with said second frequency representation; and

determining from said comparing whether said unknown file is said selected video file;

eliminating the entire data set of said unknown file from said computer-readable storage media as a redundant file.

2. The method as described in claim 1 wherein said obtaining said first frequency representation of said desired video file comprises:

performing a Fast Fourier Transform algorithm.

3. The method as described in claim 1 wherein said obtaining said first frequency representation comprises performing a Discrete Fourier Transform.

4. The method as described in claim 1 wherein said comparing said first frequency representation with said second frequency representation comprises:

comparing a range of frequencies of said first and second frequency representations.

5. The method as described in claim 1 and further comprising:

decoding said unknown file.

6. A computer implemented method of determining redundancies in a content object directory, said method comprising:

accessing a plurality of files stored on a memory, wherein each of said files is configured so as to be identified by a fingerprint;

for each of said files, determining said fingerprint;

establishing a redundancy standard so as to indicate whether any two of said fingerprints of said files having non-identical fingerprints are redundant of one another, wherein a user determines a criteria to be used for the standard from a set of different characteristics;

comparing said fingerprints determined for each of said files;

determining redundant files based upon said comparing said fingerprints and said redundancy standard.

7. The method as described in claim 6 and further comprising:

deleting at least one redundant file from said memory.

8. The method as described in claim 6 and further comprising:

utilizing a Fast Fourier Transform algorithm to compute said fingerprint.

9. The method as described in claim 6 and further comprising:

utilizing a watermark as said fingerprint.

10. The method as described in claim 6 and further comprising:

utilizing cyclical redundancy check data as said fingerprint.

11. The method as described in claim 6 wherein said accessing a plurality of files comprises:

accessing a plurality of files comprising video data.

12. The method as described in claim 6 wherein said accessing a plurality of files comprises:

accessing a plurality of files comprising audio data.

13. The method as described in claim 6 wherein said establishing a redundancy standard comprises:

determining a range of frequencies in a pattern of frequencies from a Fast Fourier Transform for comparison of said fingerprints.

14. The method as described in claim 6 and further comprising:

appending a fingerprint as metadata to at least one directory listing.

15. The method as described in claim 6 and further comprising:

cataloging in a database said fingerprint with the file from which said fingerprint was generated.

16. The method as described in claim 6 and further comprising:

obtaining said plurality of files from a caching server utilized as part of a video streaming network.

17. The method as described in claim 6 and further comprising:

providing a master database upon which video files are stored for video distribution; and

wherein said accessing a plurality of files comprises accessing a plurality of video filed stored on said master database.