Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval

• US 8,135,169 B2
• Filed: 08/16/2010
• Issued: 03/13/2012
• Est. Priority Date: 09/30/2002
• Status: Expired due to Fees

• Current Assignee: MyPort IP, Inc. (MyPort Technologies, Inc.)
• Original Assignee: MyPort Technologies, Inc.
• Inventors: Malone, Michael F.
• Primary Examiner(s): Ishrat, Sherali
• Application Number:
  US12/857,358
• Publication Number:
  US 20100303288A1
• Time in Patent Office: 575 Days
• Field of Search: 382/100, 382/305, 382115-119, 382/124, 713160-181, 380/54, 380/246, 380252-255, 705 50- 55, 705 57- 62, 705 64- 70, 705 75- 76, 348/460, 348/552, 709217-219, 707 1- 7, 707/104.1, 341/50, 341/155, 704 1- 10, 704/200, 704/231, 704/235, 704/246, 704/260
• US Class Current: 382/100
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: H04L 2209/60 Digital content management, e.g. content distribution
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/14 using a plurality of keys or algorithms
• CPC Class Codes: H04L 9/3263 involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823
• CPC Class Codes: H04L 9/3271 using challenge-response
• CPC Class Codes: H04L 9/3297 involving time stamps, e.g. generation of time stamps
• CPC Class Codes: H04N 21/25816 involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/26613 for generating or managing keys in general key distribution for secret or secure communication involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] H04L9/083; network support of key management H04L63/06; key management for network security in communication control or processing H04W12/04
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 21/4108 characterised by an identification number or address, e.g. local network address protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/835 Generation of protective data, e.g. certificates protecting software against unauthorised usage in a vending or licensing environment G06F21/10
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/9201 : involving the multiplexing of an additional signal and the video signal

Abstract

This invention relates to an apparatus for capturing data a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set. A second capture device is provided interfacing with a secondary data source to capture data therefrom for storage into a secondary data set. An associating device is then operable to associate the converted data set with the primary data set. A data converter converts the data stored in the second data set to a different and converted form as a converted data set.

Claims

1. An apparatus for capturing data:

a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set;

a second capture device interfacing with a secondary data source to capture data therefrom for storage into a secondary data set;

a data converter for converting the data stored in the secondary data set to a different and inverted converted form as a converted data set, which converted data set is searchable with a searchable algorithm compatible with such converted data set;

an associating device for associating the converted data set with the primary data set to

provide a searchable composite data set with the converted data set closely associated with the primary data set in the searchable composite data set; and

a transmitter for transmitting the searchable composite data set to a remote storage facility over a wireless communication path.

2. The apparatus of claim 1 wherein the first capture device is a camera capable of capturing data into a primary data set composed of an image.

3. The apparatus of claim 1 wherein the second capture device is a microphone capable of capturing data into a secondary data set composed of audio.

4. The apparatus of claim 1 wherein the second capture device is a keypad capable of capturing data representing a keypad output and the data converter is operable to convert the keypad output to a text form.

5. The apparatus of claim 1 wherein the data converter converts the secondary data set to a data form that is a function of a process that identifies features in the primary data set.

6. The process of claim 5 wherein the feature identification process is confirmed by a user instruction with a user input device.

7. The apparatus of claim 1 wherein the second capture device is a location-determining device capable of capturing location information.

8. The apparatus of claim 1 wherein the second capture device is an identification device capable of providing identification information.

9. The apparatus of claim 1 wherein the composite data set is an e-mail message.

10. The apparatus of claim 1 wherein the composite data set is an image with embedded tags.

11. The apparatus of claim 1 wherein the composite data set is a compressed archive.

12. The apparatus of claim 1 in which the form of the converted data set is plain text format.

13. The apparatus of claim 1 in which the form of the converted secondary data set is XML format.

14. The apparatus of claim 1 in which the primary and secondary data sets are stored in a storage medium.

15. The apparatus of claim 3 in which the data converter converts the secondary data set to text by an algorithmic process to identify speech elements in the recorded audio.

16. The apparatus of claim 15 in which the text converted from speech is further converted to searchable tags.

17. A portable apparatus for capturing media information, comprising:

a camera for capturing media information for storage into a primary data set at a time of capture when it was fixed as a captured image in the camera;

a capture device interfacing with a data source to capture data from a media source having associated therewith information different than the media information captured by the camera for storage into a secondary data set;

a data converter for converting the data stored in the secondary data set to a different and converted form as a converted data set, which converted data set is searchable with a searchable algorithm compatible with such converted data set; and

an associating device for associating the converted data set with the primary data set to provide a searchable composite data set with the converted data set closely associated with the primary data set in the searchable composite data set, the associating device also associating the time of capture with at least the primary data set in close association therewith such that the time of capture can be differentiated from the time that the second capture device captures data; and

a transmitter for transmitting the searchable composite data set to a remote storage facility over a wireless communication path.

18. The apparatus of claim 17 wherein the capture device is a microphone capable of capturing audio into a secondary data set.

19. The apparatus of claim 17 wherein the capture device is a keypad capable of capturing data representing a keypad output and the data converter is operable to convert the keypad output to a text form.

20. The apparatus of claim 17 wherein the data converter converts the secondary data set to a data form that is a function of a process that identifies features in the primary data set.

21. The apparatus of claim 17 wherein the capture device is a location-determining device capable of capturing location information.

22. The apparatus of claim 17 in which the primary and secondary data sets are stored in a storage medium.