Report generation system and method for capturing prose, audio, and video by voice command and automatically linking sound and image to formatted text locations

• US 5,995,936 A
• Filed: 02/04/1997
• Issued: 11/30/1999
• Est. Priority Date: 02/04/1997
• Status: Expired due to Fees

• Current Assignee: Colin Brenan, Louis Brais, Madden, Peter
• Original Assignee: Colin Brenan, Louis Brais, Madden, Peter
• Inventors: Brenan, Colin, Madden, Peter, Brais, Louis
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Storm, Donald L.
• Application Number:
  US08/794,950
• Time in Patent Office: 1,029 Days
• Field of Search: 704/200, 704/235, 704/251, 704/270, 704/275, 704/276, 704/278, 707/529, 707/512, 369/25
• US Class Current: 704/275
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G11B 31/006 with video camera or receiver
• CPC Class Codes: H04N 5/9206 the additional signal being a character code signal
• CPC Class Codes: H04N 5/9265 with processing of the sound signal

Abstract

A system and method of automatically assembling voice information and image information into reports or data bases is disclosed. The system uses a microphone connected to a computer for converting spoken words into text and then parses the text to distinguish commands for execution from text information for the report. Commands for image acquisition cause digital images to be inserted within the report or within a database file. Images are associated with text information or with specific locations within the text information. In dependence upon the commands and the associations, a report is automatically generated from pre-recorded information.

Claims

1. A method of automatically generating a report performed by an electronic system in dependence upon captured information comprising the steps of providing prose to a portable information gathering system;

storing the prose in retrievable locations for retrieval;

capturing concurrently image data using a portable image capture device to provide a representation of the image to the portable information gathering system;

storing the representation of the image in the portable information gathering system;

while providing prose, associating an identifier with a stored representation and a retrievable location;

processing the prose to automatically provide information in a predetermined format using a processor;

automatically inserting, within the processed information, the representation identified by the identifier at a predetermined location in dependence upon the associated retrievable location;

and providing the formatted processed information with the inserted representation to an output device.

2. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein the information in a predetermined format is text information.

3. A method of automatically generating a report in dependence upon captured information as defined in claim 2 wherein the information in a predetermined format comprises electronic text generated using a speech to text means.

4. A method of automatically generating a report in dependence upon captured information as defined in claim 3 wherein the representation of the image is recorded in response to a voice command.

5. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein the predetermined location is proximate the associated location.

6. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein the prose is provided as spoken voice information.

7. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein the representation of the image is recorded in response to a voice command.

8. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein a speech to text means converts spoken prose into alphanumeric text during information gathering and stores the alphanumeric text at a current insertion point within a file.

9. A method of automatically generating a report in dependence upon captured information as defined in claim 8 wherein the associated retrievable location is a current insertion point within the file.

10. A method of automatically generating a report in dependence upon captured information as defined in claim 1 wherein a speech to text means converts spoken prose into alphanumeric text after information gathering is completed.

11. A method of automatically generating a report performed by an electronic system in dependence upon captured information comprising the steps of:

providing concurrently recorded information comprising audio recording information and image recording information to a processor;

using a speech to text means, automatically processing the audio recording information to extract commands and to extract information;

using a processor, automatically formatting the processed audio recording information and the image recording information in dependence upon extracted commands; and

,

providing the formatted processed information to an output device.

12. A method of automatically generating a report performed by an electronic system in dependence upon captured information comprising the steps of providing spoken prose to means for converting speech to text;

automatically converting the spoken prose to electronic text prose and storing the electronic text prose stored in retrievable locations for retrieval;

providing spoken commands to the means for converting speech to text;

converting the spoken commands to electronic commands;

in response to an electronic command, capturing image data concurrently with the spoken prose using a capture means and providing a representation of the image to a processor;

storing the representation of the image in non-volatile storage;

in response to an electronic command, associating a representation and a retrievable location within the electronic text prose and an identifier;

storing the identifier in non-volatile storage means;

using a processor, processing the electronic text prose and providing information in a predetermined format and providing commands;

automatically inserting, within the information in a predetermined format, the representation identified by the stored identifier at a predetermined location in dependence upon the associated retrievable location; and

storing the formatted processed information with the inserted representation in nonvolatile memory.