Method and apparatus for uploading, indexing, analyzing, and searching media content

• US 6,374,260 B1
• Filed: 02/28/2000
• Issued: 04/16/2002
• Est. Priority Date: 05/24/1996
• Status: Expired due to Term

• Current Assignee: The Procter & Gamble Company
• Original Assignee: Magnifi, Inc. (Emmperative Marketing, Inc.)
• Inventors: Strull, Brian, Cremin, Karl, Hoffert, Eric M., Smoot, Stephen R., Ali, Adnan
• Primary Examiner(s): Lintz, Paul R.
• Assistant Examiner(s): Colbert, Ella
• Application Number:
  US09/514,576
• Time in Patent Office: 778 Days
• Field of Search: 707/101, 707/102, 707/103, 707/104, 707/500, 707/3, 707/10, 345/339, 345/716, 382/296
• US Class Current: 1/1
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 2210/046 for differentiation between music and non-music signals, based on the identification of musical parameters, e.g. based on tempo detection
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/066 MPEG audio-visual compression file formats, e.g. MPEG-4 for coding of audio-visual objects
• CPC Class Codes: G10H 2240/135 Library retrieval index, i.e. using an indexing scheme to efficiently retrieve a music piece
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method and apparatus for uploading, analyzing, searching and displaying multimedia files based on the context and content of the multimedia files.

Claims

1. A method comprising:

a) transferring files identified by a user from a source location at which the user found the files to a central location specified by the user, the files comprising media content;

b) generating multiple files having transcoded formats for each of the files;

c) receiving user annotations comprising free form textual comments and selected data regarding the media content of the files;

d) storing the user annotations as metadata in association with the files;

e) indexing for each one of the files textual data from within the file, a filename for the file, and the metadata;

f) generating multiple types of previews for each of the files;

g) receiving queries from a user regarding the metadata and media content at the central location;

h) selecting files comprising media content responsive to the user queries;

i) providing the transcoded formats of the files; and

j) providing the multiple types of previews of the selected files, and metadata associated therewith, for retrieval by the user.

2. The method of claim 1, wherein the source location comprises a file folder on a server accessible to the user.

3. The method of claim 1, wherein the source location comprises a hypertext markup language (HTML) directory on a hypertext transfer protocol (HTTP) server accessible to the user.

4. The method of claim 1, wherein the transferring files identified by the user comprises transferring copies of the files to the central location.

5. The method of claim 1, wherein the source location comprises a permanent storage device accessible to the user.

6. The method of claim 1, wherein the source location comprises a file server accessible to the user.

7. The method of claim 1, wherein the multiple types of previews comprise thumbnail previews.

8. The method of claim 1, wherein the multiple types of previews comprise filmstrip previews.

9. The method of claim 1, wherein the multiple types of previews comprise storyboard previews.

10. The method of claim 1, wherein the method is performed by a multi-tier application service comprising logical components of an application server, web server, database server, and media server.

11. The method of claim 10, wherein the logical components reside on a distinct physical server.

12. The method of claim 10, wherein each tier of the multi-tier application is replicated one or more times in a clustered representation and runs on separate physical servers.

13. The method of claim 10, wherein the web server is in a physical location separate from the applications server and the database server, and the web server is connected to the application server and the database server via dedicated, high-speed network connections.

14. The method of claim 1, wherein one or more of the files identified by the user reside in disparate geographic locations.

15. The method of claim 1, wherein the generating multiple files having transcoded formats for each of the files comprises converting the media content of the files to multiple alternative representations while preserving the media content of the files.

16. The method of claim 1, wherein the metadata further comprises content attributes.

17. The method of claim 1, wherein the media content comprises corporate, office, and rich media multi-image content distribution and text.

18. The method of claim 17, wherein the media content comprises one or more of the following:

a Microsoft PowerPoint presentation, an Excel spreadsheet, and a Word document.

19. The method of claim 1, wherein the media content supported includes complex content type.

20. The method of claim 1, wherein the multiple types of previews comprise steaming previews.

21. The method of claim 1, wherein the multiple types of preview comprise low-bandwidth preview of high bandwidth files.

22. A method comprising:

a) a computer uploading files from a source location to a central location specified by a user and accessible to the computer, the files comprising media content;

b) the computer receiving user input to monitor the source location for new media content at the source location;

c) the computer automatically uploading files comprising new media content from the source location when the new media content is detected by the computer;

d) the computer receiving queries from a user regarding the media content;

e) the computer selecting media content responsive to the user queries; and

f) the computer providing a preview of the selected media content for retrieval by the user.

23. The method of claim 22, wherein the computer receiving user input to monitor the source location for new media content at the source location comprises the computer receiving user input setting forth a set of predetermined characteristics other than a set of predetermined characteristics that were received as input to the computer in uploading files comprising media content from the source location to the central location.

24. The method of claim 22, wherein the computer receiving user input to monitor the source location for new media content at the source location comprises the computer receiving user input setting forth a set of predetermined characteristics that were received as input to the computer in uploading files comprising media content from the source location to the central location.

25. The method of claim 22, wherein the computer receiving user input to monitor the source location for new media content at the source location comprises the computer invoking an agent to monitor the source location for new media content at the source location in response to the user input.

26. The method of claim 22, wherein the computer automatically uploading files comprising new media content from the source location when the new media content is detected by the computer, comprises the computer from the source location when the new media content is detected by the computer, comprises the computer automatically uploading files comprising new media content from the source location when a comparison by the computer of the attributes associated with the files at the source location and metadata associated with the files at the central location indicate the existence of new media content.

27. The method of claim 22 further comprising the computer providing a plurality of transcoded file formats containing the selected media content for retrieval by the user.

28. The method of claim 22 further comprising the computer providing multiple types of previews of the selected media content for retrieval by the user.

33. The method of claim 22, wherein a file finder application traverses all paths within the file system directory in search for the files.

29. A method comprising:

a) receiving input from a user, the input comprising one or more source directories from which to transfer files comprising media content, and a central location identifying where to transfer the files;

b) traversing all paths within the one or more source directories in search for the files;

c) transferring all the files comprising media content found within the one or more source directories to the central location;

d) transferring metadata associated with the files to a metadata database at the central location;

e) receiving user annotations comprising free form textual comments and selected data regarding the media content of the files;

f) storing the user annotations as metadata in association with the files;

g) indexing for each one of the files textual data from within the file, a filename for the file, and the metadata;

h) generating multiple types of previews for each of the files;

i) receiving queries from a user regarding the metadata and media content at the central location;

j) selecting files comprising media content responsive to the user queries; and

k) providing the multiple types of previews of the selected files, and metadata associated therewith, for retrieval by the user.

30. The method of claim 29, wherein the one or more source directories comprise a hypertext markup language (HTML) directory.

31. The method of claim 30, wherein a web browser application traverses all paths within the HTML directory in search for the files.

32. The method of claim 29, wherein the one or more source directories comprise a file system directory.

34. The method of claim 29 further comprising:

generating multiple files having transcoded formats for each of the files; and

providing the transcoded formats of the files.

35. A computer readable medium in or over which instructions are received, that when executed by a processor, cause the processor to:

a) transfer files identified by a user from a source location at which the user found the files to a central location specified by the user, the files comprising media content;

b) generate multiple files having transcoded formats for each file;

c) receive user annotations comprising free form textual comments and selected data regarding the media content of the files;

d) store the user annotations as metadata in association with the files;

e) index for each one of the files textual data from within the file, a filename for the file, and the metadata;

f) generate multiple types of previews for each of the files;

g) receive queries from a user regarding the metadata and media content at the central location;

h) select files comprising media content responsive to the user queries;

i) provide the transcoded formats for the files; and

j) provide the multiple types of previews of the selected files, and metadata associated therewith, for retrieval by the user.

36. The computer readable medium of claim 35, wherein the source comprises a file folder on a server accessible to the user.

37. The computer readable medium of claim 35, wherein the source comprises a hypertext markup language (HTML) directory on a hypertext transfer protocol (HTTP) server accessible to the user.

38. The computer readable medium of claim 35, wherein the transferring files identified by the user comprises transferring copies of the files to the central location.

39. The computer readable medium of claim 35, wherein the source location comprises a permanent storage device accessible to the user.

40. The computer readable medium of claim 35, wherein the source location comprises a file server accessible to the user.

41. The computer readable medium of claim 35, wherein the multiple types of previews comprise thumbnail previews.

42. The computer readable medium of claim 35, wherein the multiple types of previews comprise filmstrip previews.

43. The computer readable medium of claim 35, wherein the multiple types of previews comprises storyboard previews.

44. The computer readable medium of claim 35, wherein the method is performed by a multi-tier application service comprising logical components of an application server, web server, database server and media server.

45. The computer readable medium of claim 35, wherein the method is performed by a multi-tier application service comprising logical components of an application server, web server, database server and media server, where each logical component resides on a distinct physical server.

46. The computer readable medium of claim 35, wherein the method is performed by a multi-tier application service comprising logical components of an application server, web server, database server and media server, where each logical component resides on a distinct physical server and each tier of the application is replicated one or more times in a clustered representation and runs on separate physical servers.

47. The computer readable medium of claim 35, wherein the application and web servers are separate physical servers, and the database server is at a separate, central location.

48. A computer readable medium in or over which instructions are received, that when executed by a processor, cause the processor to:

a) receive input from a user, the input comprising one or more source directories from which to transfer files comprising media content, and a central location identifying where to transfer the files;

b) traverse all paths within the one or more source directories in search for the files;

c) transfer all the files comprising media content found at the one or more source directories to the central location;

d) transfer metadata associated with the files to a metadata database at the central location;

e) generate multiple files having transcoded formats for each of the files;

f) receive user annotations comprising free form textual comments and selected data regarding the media content of the files;

g) store the user annotations as metadata in association with the files;

h) index for each one of the files textual data from within the file, a filename for the file, and the metadata;

i) generate multiple types of previews for each of the files;

j) receive queries from a user regarding the metadata and media content at the central location;

k) select files comprising media content responsive to the user queries;

l) provide the transcoded formats for the files; and

m) provide the multiple types of previews of the selected files, and metadata associated therewith, for retrieval by the user.

49. The computer readable medium of claim 48, wherein the user input comprising the source directory comprises a hypertext markup language (HTML) directory.

50. The computer readable medium of claim 48, wherein a web browser application traverses all paths within the HTML directory in search for the files.

51. The computer readable medium of claim 48, wherein the user input comprising the source directory comprises a file system directory.

52. The computer readable medium of claim 51, wherein a file finder application traverses all paths within the file system directory in search for the files.

53. A computer-implemented method comprising:

a) uploading files from a source location to a central location specified by a user and accessible to a computer, the files comprising media content;

b) receiving user input to monitor the source location for new media content at the source location;

c) automatically uploading files comprising new media content from the source location when the new media content is detected by the computer;

d) receiving queries from a user regarding the media content;

e) selecting media content responsive to the user queries; and

f) providing a preview of the selected media content for retrieval by the user.

54. The method of claim 53, wherein the receiving user input to monitor the source location for new media content at the source location comprises receiving user input setting forth a set of predetermined characteristics other than a set of predetermined characteristics that were received as input in uploading files comprising media content from the source location to the central location.

55. The method of claim 53, wherein the receiving user input to monitor the source location for new media content at the source location comprises receiving user input setting forth a set of predetermined characteristics that were received as input in uploading files comprising media content from the source location to the central location.

56. The method of claim 53, wherein receiving user input to monitor the source location for new media content at the source location comprises invoking an agent to monitor the source location for new media content at the source location in response to the user input.

57. The method of claim 53, wherein the automatically uploading files comprising new media content from the source location when the new media content is detected, comprises automatically uploading files comprising new media content from the source location when a comparison of the attributes associated with the files at the source location and metadata associated with the files at the central location indicate the existence of new media content.

58. The method of claim 53 further comprising providing a plurality of transcoded file formats containing the selected media content for retrieval by the user.

59. The method of claim 53 further comprising providing multiple types of previews of the selected media content for retrieval by the user.