Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval

• US 7,778,438 B2
• Filed: 01/08/2007
• Issued: 08/17/2010
• Est. Priority Date: 09/30/2002
• Status: Expired due to Fees

• Current Assignee: MyPort, Inc.
• Original Assignee: MyPort Technologies, Inc.
• Inventors: Malone, Michael F.
• Primary Examiner(s): SHERALI, ISHRAT I
• Application Number:
  US11/621,062
• Publication Number:
  US 20070150517A1
• Time in Patent Office: 1,317 Days
• Field of Search: 382/100, 382/305, 382/284, 382/232, 382116-118, 382/124, 713/176, 380/210, 380/252, 380/287, 380/54, 707 1- 6, 707/104.1, 709/217, 709/219, 348460-467, 348/500, 348/423.1, 386/108, 386/124, 704/235, 704/270, 704/273
• US Class Current: 382/100
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: H04L 2209/60 Digital content management, e.g. content distribution
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/14 using a plurality of keys or algorithms
• CPC Class Codes: H04L 9/3263 involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823
• CPC Class Codes: H04L 9/3271 using challenge-response
• CPC Class Codes: H04L 9/3297 involving time stamps, e.g. generation of time stamps
• CPC Class Codes: H04N 21/25816 involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/26613 for generating or managing keys in general key distribution for secret or secure communication involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] H04L9/083; network support of key management H04L63/06; key management for network security in communication control or processing H04W12/04
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 21/4108 characterised by an identification number or address, e.g. local network address protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/835 Generation of protective data, e.g. certificates protecting software against unauthorised usage in a vending or licensing environment G06F21/10
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/9201 : involving the multiplexing of an additional signal and the video signal

Abstract

This invention relates to the storage and search retrieval of all types of digital media files, whether allowing the user to create index keys, metatags within each media file(s), provides search and indexing capability. The search terms and index keys are based on contextual elements within the media, including meta data such as time, date and location, but including as well elements within the media itself, such as people or elements (car, animals, street, events, historical location and other) within a picture or a video, audio, voice, spoke word, instruments used in a musical work, or scenes in a movie. An authorized client can then retrieve the media from the remote location. Specific works can then be referenced by means of the generated search terms and index keys. When the user transmits these media files via e-mail, FTP, public server, or copies to a digital media or other distribution method, these index keys are contained within the media files, therefore allowing the third party to search and retrieve the media files based on metatags.

Claims

1. A method for storing and indexing information, said information consisting of a primary part and a secondary part, comprising the steps of:

receiving a received set of information that is comprised of a first set of information in a first format and a second set of information in a second format to provide the received set of information in a combination format;

extracting the first set of information and the second set of information in their respective first and second formats from the received set of information;

converting said second set of information to an intermediate set of information in an intermediate format; and

combining the first set of information and the intermediate set of information into a combination data set; and

indexing and storing the combination data set such that the combination data set can be subsequently searched.

2. The method of claim 1, wherein the step of combining the intermediate set of information with the first set of information in the first format embeds the intermediate set of information within the first set of information.

3. The method of claim 1, wherein the information in the first set of information comprises information from one of video information or image information.

4. The method of claim 3, wherein the second set of information includes audio information.

5. The method of claim 1, wherein the first and second sets of information comprise first and second digitally formatted data having a file number associated therewith.

6. The method of claim 5, in which the digitally formatted data further includes time stamps associated with the first and second sets of information.

7. The method of claim 1, wherein the second set of information is embedded within the first set of information.

11. The method of claim 1, wherein the step of indexing and storing the combination data set provides an index to such combination data set as part of a stored set of indices.

8. A method for storing and indexing information, comprising the steps of:

receiving a combined set of information in a combination format comprised of the combination of captured image information in a digitized image format and captured audio information in a digitized audio format;

extracting the digitized image and audio information in the respective digital image and audio formats from the combined set of information in the combination format;

converting the digitized audio information to an intermediate set of information that represents at least a portion of the information in the extracted audio information;

combining the intermediate set of information with the digitized image information in a digital combination format supporting the combination of digitized image information and the intermediate set of information to provide a modified digitized image with embedded information as a combination data set that represents substantially all of the extracted audio information; and

indexing and storing the combination data set such that the combination data set can be subsequently indexed and searched.

9. The method of claim 8, wherein the intermediate set of information comprises metatags.

10. The method of claim 8, wherein the digitized audio and video information each have a file naming structure.

12. The method of claim 8, wherein the step of indexing is such that the intermediate set of information represents substantially all of the information in the extracted audio information.