Camera on-board voice recognition

• US 5,546,145 A
• Filed: 08/30/1994
• Issued: 08/13/1996
• Est. Priority Date: 08/30/1994
• Status: Expired due to Fees

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: McIntyre, Dale F., Wolcott, Dana W., Dunsmore, Clay A., Bernardi, Bryan D.
• Primary Examiner(s): Gellner, Michael L.
• Assistant Examiner(s): Dalakis, Michael
• Application Number:
  US08/298,014
• Time in Patent Office: 714 Days
• Field of Search: 354/105, 354/106, 354/75, 354/76
• US Class Current: 396/312
• CPC Class Codes: G03B 17/24 with means for separately producing marks on the film, e.g. title, time of exposure
• CPC Class Codes: G03B 2206/002 using detachable memory means
• CPC Class Codes: G03B 2217/244 Magnetic devices
• CPC Class Codes: G03B 2217/246 Details of the markings
• CPC Class Codes: G03B 31/06 in which sound track is associated with successively-shown still pictures
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

In a camera, apparatus and methods for recording or storing voiced in messages in message memory associated with an exposed image frame for reproduction as an annotation with prints made from the exposed image frames. The camera includes a voice recognition system for voice recognition of words spoken by the user before the words are stored in message memory. Fixed and adjustable vocabularies are provided for use in the voice recognition. The adjustable vocabulary may be loaded into the camera by a vocabulary memory card or through an interface with a docking station of a personal computer or vending machine so that an adjustable vocabulary of words of interest to the camera user or related to a scene or event of photographic interest may be employed in the voice recognition. The messages may be recorded on magnetic film layers or stored in camera on-board memory or in detachable message memory modules to be forwarded with the exposed film strip to a photofinisher for read out and printing on the prints. The messages may be stored or recorded by the user in real time with each exposure or at an earlier or later time.

Claims

1. In a photographic camera including an optical lens, a photographic filmstrip transport mechanism for advancing the filmstrip in a path of travel to and through an image frame exposure gate with respect to said optical lens, and an exposure system for making an exposure of the filmstrip image frame in the exposure gate, apparatus for recording a voice message composed by the camera user related to the exposure made or to be made for playback in conjunction with making prints from the photographic images captured in the image frames of the filmstrip to provide for the printing of the voice message therewith comprising:

speech input means into which a camera user may speak words of the message to be stored with respect to the filmstrip image frames;

sound processing means for processing the words spoken into the speech input means as voice digital data;

means for providing reference voice digital data corresponding to a reference word vocabulary;

speech recognition means for comparing the processed voice digital data to the reference voice digital data and recognizing processed voice digital data corresponding to the reference voice digital data while rejecting voice digital data not finding correspondence with the reference voice digital data;

message memory means having memory locations related to each image frame of the filmstrip for storing recognized voice digital data; and

means for storing the recognized voice digital data in said message memory means, wherein said means for providing reference voice digital data corresponding to a word vocabulary further comprises;

first vocabulary memory means for storing a fixed vocabulary of words that cannot be altered by the user; and

second vocabulary memory means for storing a adjustable vocabulary of words selected by the user, wherein said first vocabulary memory means comprises a read only memory stored with said fixed vocabulary from which said fixed vocabulary may be read by said speech recognition means; and

said second vocabulary memory means comprises a read and write memory into which said adjustable vocabulary may be written in and from which said adjustable vocabulary may be read by said speech recognition means;

and further comprising interface mean for receiving said adjustable vocabulary from an external source and for writing said adjustable vocabulary into said second vocabulary memory means.

2. The recording apparatus of claim 1 wherein:

said memory means comprises a virtually transparent magnetic layer on said filmstrip having a plurality of longitudinally extending parallel tracks therein; and

said storing means further comprises a recording head arranged in said path of travel of said filmstrip and means for effecting magnetic recording of said recognized voice digital data in selected tracks for playback in conjunction with making prints from the photographic images captured in the image frames of the filmstrip and a film write interface circuit responsive to the for energizing the recording head.

3. The recording apparatus of claim 1 wherein:

said filmstrip is attached at one end to a filmstrip cartridge and is adapted to be enclosed within said cartridge upon completion of exposure of all image frames for removal from said camera for transfer to a photofinisher to make prints therefrom; and

said memory means comprises a memory module associated with the filmstrip cartridge for storing said recognized voice digital data.

4. The recording apparatus of claim 3 wherein said memory module is detachable from said cartridge.

5. The recording apparatus of claim 1 particularly adapted to receive said adjustable vocabulary from an external source associated with an event or attraction of photographic interest through said interface means and wherein said source may further comprise a camera docking station for receiving said camera and coupling said interface means to an input means.

6. The recording apparatus of claim 5 wherein:

said input means comprises a user operated keyboard for keying in the alphanumeric characters of words of particular interest to the user; and

said interface means is operable to convert and store the alphanumeric characters of keyed in words as said adjustable vocabulary.

7. The recording apparatus of claim 5 wherein:

said input means comprises a vending machine operable on user selection to down load a data set of words of particular interest to an event or an attraction of interest to be photographed and selected by the user; and

said interface means is operable to convert and store the down loaded data set of words as said adjustable vocabulary in said second vocabulary memory means.

8. The recording apparatus of claim 1 wherein:

said first vocabulary memory means comprises a read only memory in a detachable, interchangeable memory card stored with said fixed vocabulary to be compared with a spoken word by said speech recognition means; and

said apparatus further comprises;

card receiving means in said camera for receiving said read only memory card for making connection with said speech recognition means.

9. The recording apparatus of claim 1 wherein:

said second vocabulary memory means comprises a read and write memory in a detachable, interchangeable memory card stored with said adjustable vocabulary to be compared with a spoken word by said speech recognition means; and

said apparatus further comprises;

card receiving means in said camera for receiving said read and write memory card for making connection with said speech recognition means.

10. The recording apparatus of claim 1 wherein:

said first vocabulary memory means comprises a read only memory stored with a portion of said fixed vocabulary with speaker independent training and a further read only memory stored with a further portion of said fixed vocabulary and a read and write memory for speaker dependent training of said further portion of said fixed vocabulary to be compared with a spoken word by said speech recognition means.

11. The recording apparatus of claim 1 further comprising:

means for indicating the un-recognized word of processed voice digital data to the speaker and for prompting the speaker to repeat the corresponding un-recognized word.

12. The recording apparatus of claim 11 further comprising:

means for playing back and audibly reproducing the recognized and stored voice digital data for each image frame; and

means operable by the speaker for editing the stored voice digital data by speaking the words of the message desired to replace the processed and stored voice digital data into said speech input means, whereby the spoken words are again subjected to processing and speech recognition.

13. The recording apparatus of claim 12 further comprising:

means operable by the speaker to indicate the acceptance of the edited words of the message; and

wherein;

said storing means is responsive to the acceptance indication for storing the voice digital data corresponding thereto in said memory means.

14. The recording apparatus of claim 11 further comprising:

means for displaying the words spoken one at a time in a visible display; and

means operable by the speaker for editing the stored voice digital data by speaking the words of the message desired to replace the processed and stored voice digital data into said speech input means, whereby the spoken words are again subjected to processing and speech recognition.

15. The recording apparatus of claim 14 further comprising:

means operable by the speaker to indicate the acceptance of the edited words of the message; and

wherein;

said storing means is responsive to the acceptance indication for storing the voice digital data corresponding thereto in said memory means.

16. The recording apparatus of claim 1 further comprising:

means for playing back and audibly reproducing the recognized and stored voice digital data; and

means operable by the speaker to erase the stored voice digital data and repeat the speech input in an editing of the message to be printed in relation to the image frame.

17. The recording apparatus of claim 16 further comprising:

means operable by the speaker to indicate the acceptance of the edited words of the message; and

wherein;

said storing means is responsive to the acceptance indication for storing the voice digital data corresponding thereto in said memory means.

18. The recording apparatus of claim 16 further comprising:

means operable by the speaker for editing the stored voice digital data by speaking the words of the message desired to replace the processed and stored voice digital data into said speech input means, whereby the spoken words are again subjected to processing and speech recognition.

22. The recording apparatus of claim 1 wherein:

said first vocabulary memory means comprises a read only memory in a detachable, interchangeable memory card stored with said fixed vocabulary with speaker independent training to be compared with a spoken word by said speech recognition means and a further read only memory stored with a further portion of said fixed vocabulary and a read and write memory for speaker dependent training of said further portion of said fixed vocabulary to be compared with a spoken word by said speech recognition means; and

said apparatus further comprises;

card receiving means in said camera for receiving said read only memory card for making connection with said speech recognition means.

19. In a photographic camera including an optical lens, a photographic filmstrip transport mechanism for advancing the filmstrip in a path of travel to and through an image frame exposure gate with respect to said optical lens, and an exposure system for making an exposure of the filmstrip image frame in the exposure gate, a method of recording a voice message related to the exposure made for reproduction in conjunction with making prints from the photographic images captured in the image frames of the filmstrip, including the printing of the associated message, comprising the steps of:

processing spoken words of a message to be stored with respect to each exposure of an image frame into a camera speech input means at the time of making the image frame exposure as voice digital data;

providing reference voice digital data corresponding to a word vocabulary;

in a speech recognition operation, comparing the processed voice digital data to reference voice digital data and recognizing processed voice digital data corresponding to the reference voice digital while rejecting voice digital data not finding correspondence with the reference voice digital data; and

storing the recognized voice digital data into memory locations related to each image frame of the filmstrip of a memory means detachable from the camera to accompany the filmstrip in the printing of the image frames, wherein said step of providing a reference word vocabulary further comprises the steps of;

providing a fixed vocabulary of words associated with data related to the photographic exposure of filmstrip image frames in a fixed vocabulary memory; and

providing an adjustable vocabulary of words selected by the user in a adjustable vocabulary memory, wherein said step of providing an adjsutable vocabulary comprises;

providing a vocabulary source in the memory of a docking station for receiving the camera and making a connection with said camera adjustable vocabulary memory;

inserting the camera into the docking station to make the connection between the docking station memory and said camera adjustable vocabulary memory; and

down loading the adjustable vocabulary from said docking station memory into said camera adjustable vocabulary memory.

20. The method of claim 19 wherein said step of providing a adjustable vocabulary comprises:

providing sets of adjustable vocabulary sources in interchangeable memory cards;

selecting a memory card related to an event or attraction of photographic interest; and

inserting the interchangeable memory card in a card receiving slot of said camera to thereby provide said camera adjustable vocabulary memory.

21. In a photographic camera including an optical lens, a photographic filmstrip transport mechanism for advancing the filmstrip in a path of travel to and through an image frame exposure gate with respect to said optical lens, and an exposure system for making an exposure of the filmstrip image frame in the exposure gate, a method of recording a voice message related to the exposure made for reproduction in conjunction with making prints from the photographic images captured in the image frames of the filmstrip, including the printing of the associated message, comprising the steps of:

processing spoken words of a common message to be stored with respect to the exposures of more than one image frame into a camera speech input means, at a time prior to making or in association with making at least one of the image frame exposures, as voice digital data;

providing reference voice digital data corresponding to a word vocabulary;

in a speech recognition operation, comparing the processed voice digital data to reference voice digital data and recognizing processed voice digital data corresponding to the reference voice digital data while rejecting voice digital data not finding correspondence with the reference voice digital data;

at the time of exposure of image frames, selectively storing the recognized voice digital data corresponding to the common message into memory locations related to each image frame of the filmstrip in a memory means detachable from the camera to accompany the filmstrip in the printing of the image frames; and

selecting the number of image frames that the common message is to be stored with at the time that the voiced words of the common message are processed.