Apparatus for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval

• US 10,237,067 B2
• Filed: 11/28/2017
• Issued: 03/19/2019
• Est. Priority Date: 09/30/2002
• Status: Expired due to Term

• Current Assignee: MyPort, Inc.
• Original Assignee: MyPort Technologies, Inc.
• Inventors: Malone, Michael F.
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/824,087
• Publication Number:
  US 20180083779A1
• Time in Patent Office: 476 Days
• Field of Search: 382100, 382305
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: H04L 2209/60 Digital content management, e.g. content distribution
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 9/14 using a plurality of keys or algorithms
• CPC Class Codes: H04L 9/3263 involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823
• CPC Class Codes: H04L 9/3271 using challenge-response
• CPC Class Codes: H04L 9/3297 involving time stamps, e.g. generation of time stamps
• CPC Class Codes: H04N 21/25816 involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/26613 for generating or managing keys in general key distribution for secret or secure communication involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] H04L9/083; network support of key management H04L63/06; key management for network security in communication control or processing H04W12/04
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 21/4108 characterised by an identification number or address, e.g. local network address protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/835 Generation of protective data, e.g. certificates protecting software against unauthorised usage in a vending or licensing environment G06F21/10
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/44 : Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/9201 : involving the multiplexing of an additional signal and the video signal

Abstract

This invention relates to a network interface device. A first capture device interfaces with a first external information source to capture first external information. A processor processes the captured first external information and stores it in a first media. The processor initiates the storage of the first captured information at an initial time and completes storage of the first captured information at a completion time, thus providing a stored defined set of first captured information. A transmitter transmits the defined set of stored captured information to a remote location on a network. A remote processing system is disposed at the remote node on the network and includes a database and a receiver for receiving the transmitted defined set of first captured information. A data converter is operable to convert the received defined set of first captured information to a second format. The database stores the set of converted captured information.

Claims

1. A system for capturing image and audio information for storage in a database at a location on a network, comprising:

a microphone interfaceable with an external audio information source that generates external audio information and a first data converter for capturing the external audio information from the microphone,

a camera interfacing with an external image source to capture an image therefrom;

the first data converter processing the captured external audio information and storing it in a first digital audio format as stored digital audio within the capture device, the camera for processing the captured image and storing it as a stored digital image;

a data capture device for capturing, as captured data, location information and time information associated with at least the capture of the image and storing the captured data as stored captured data;

a data combiner for combining the stored digital audio, stored digital image and stored captured data as a composite data set;

an encryptor for encrypting the composite data set as an encrypted composite data set;

a transmitter for transmitting the encrypted composite data set to the location on the network; and

a system disposed at the location on the network and including;

a receiver for receiving the transmitted encrypted composite data set from the transmitter,

a decryptor decrypting the received encrypted composite data set as a decrypted composite data set to provide the decrypted composite data set as a received set of decrypted captured information,

a system data converter for converting the received digital audio in the decrypted composite data set to a text based searchable file as a text context tag and creating an image recognition searchable context tag with image recognition of at least a portion of the digital image in the decrypted composite data set and associating the text and image recognition context tags with the digital image in the received decrypted composite data set, and

the database storing the digital image in the decrypted composite data set in association with the text and image recognition context tags as a stored context based digital image and in association with the received captured data in the decrypted composite data set.

2. The system of claim 1, wherein the first data converter captures the first external audio information from the microphone during generation thereof.

3. The system of claim 1, wherein the camera captures the image from the external image source at an instant in time.

4. The system of claim 1, wherein the first data converter processes the captured external audio information from a start event representing the time that capture of the external audio information is initiated to a stop event representing the time that capture of the external audio information is complete.

5. The system of claim 4, wherein the transmitter transmits the encrypted composite data set to the location on the network after at least the stop event associated with the processing of the captured external audio information.

6. A system for capturing image and audio information for storage, comprising:

a capture device having;

internal storage;

a microphone interfaceable with and external audio information source that generates external audio information and a first data converter for capturing the first external audio information from the microphone,

a camera interfacing with and external image source to capture an image therefrom;

the first data converter processing the captured external audio information and storing it in a first digital audio format as stored digital audio in internal storage within the capture device, the camera for processing the captured image and storing it as a stored digital image in internal storage;

a data capture device for capturing, as captured data, location information, and time information associated with at least the capture of the image and storing the captured data as stored captured data;

a media data converter for converting the the received digital audio to a text based searchable file as a text context tag and creating an image recognition searchable context tag with image recognition of at least a portion of the digital image and associating the text and image recognition context tags with the digital image and the captured data, and

the internal storage storing the digital image in association with the text and image recognition context tags in addition to the stored captured data.

7. The system of claim 6, wherein the first data converter captures the first external audio information from the microphone during generation thereof.

8. The system of claim 6, wherein the camera captures the image from the external image source at an instant in time.

9. The system of claim 6, wherein the first data converter processes the captured external audio information from a start event representing the time that capture of the external audio information is initiated to a stop event representing the time that capture of the external audio information is complete.

10. The system of claim 6, and further including:

a transmitter associated with the capture device for transmitting the composite data set to the location on the network;

a system disposed at the location on a network and including;

a receiver for receiving the transmitted composite data set from the transmitter associated with the capture device as a received set of captured information,

a database, and

the database storing the received composite data set.

11. The system of claim 10, wherein the first data converter processes the captured external audio information from a start event representing the time that capture of the external audio information is initiated to a stop event representing the time that capture of the external audio information is complete.

12. The system of claim 11, wherein the transmitter transmits the received composite data set to the location on the network after at least the stop event associated with the processing of the captured external audio information.

13. A system for capturing image and audio information for storage, comprising:

internal storage;

a microphone interfaceable with an external audio information source that generates external audio information and a first data converter for capturing the external audio information from the microphone;

a camera interfacing with an image source to capture an image therefrom;

a data capture device for capturing, as captured data, location information and time information associated with at least the capture of the image and storing the captured data as stored captured data;

the first data converter processing the captured external audio information and storing it in a first digital audio format as stored digital audio within the capture device, the camera for processing the captured image and storing it as a stored digital image;

a second data converter for converting the received digital audio to a text based searchable file as a text context tag and creating an image recognition searchable context tag with image recognition of at least a portion of the digital image and associating the text and image recognition context tags with the digital image and with the stored captured data; and

the internal storage storing the digital image in association with the text and image recognition context tags in addition to the stored captured data.

14. The system of claim 13, wherein the image source is an external image source.

15. The system of claim 13, wherein the first data converter captures the first external audio information from the microphone during generation thereof.

16. The system of claim 13, wherein the camera captures the image from the image source at an instant in time.

17. The system of claim 13, wherein the first data converter processes the captured external audio information from a start event representing the time that capture of the external audio information is initiated to a stop event representing the time that capture of the external audio information is complete.