Automatic annotation filler system and method for use in ultrasound imaging

• US 6,988,990 B2
• Filed: 05/29/2003
• Issued: 01/24/2006
• Est. Priority Date: 05/29/2003
• Status: Expired due to Fees

• Current Assignee: GE Medical Systems Global Technology Company LLC (GE Healthcare Technologies, Inc.)
• Original Assignee: General Electric Company
• Inventors: Pan, Lihong, Yudkovitch, Laurence M., Doherty, John T.
• Primary Examiner(s): Imam, Ali
• Application Number:
  US10/447,350
• Publication Number:
  US 20040242998A1
• Time in Patent Office: 971 Days
• Field of Search: 600407-472, 73625-626, 345/157, 345/171, 703/11, 704/1, 704/208, 704/260, 704/276, 128/916, 128/925, 367/7, 367/11, 367/130, 367/138
• US Class Current: 600/437
• CPC Class Codes: A61B 8/461 Displaying means of special interest
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/468 allowing annotation or message recording
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/228 of application context

Abstract

The present invention provides a method and system for using the computer keyboard and/or speech recognition technology to automatically fill an image annotation during an ultrasound scan. More specifically, it provides a method and a system for annotating a displayed ultrasound image using commands that is comprised of; providing an annotation vocabulary sorted in descending order of usage frequency providing a method to select a subset of words from the vocabulary that are relevant to the imaged anatomy, detecting the initial command, selecting a suggestion list from the selected sub-vocabulary, and displaying the suggestion list to the user for optional acceptance or further specification.

Claims

1. A method for annotating a displayed ultrasound image using commands comprising the steps of:

providing an annotation vocabulary sorted in descending order of usage frequency;

providing a method to select a subset of words from the vocabulary that are relevant to the imaged anatomy;

detecting the initial command;

selecting a suggestion list from the selected subset of words from the vocabulary; and

displaying the suggestion list to the user for optional acceptance or further specification.

2. The method of claim 1 wherein the commands comprise keyboard entries corresponding to partial annotations.

3. The method of claim 2 wherein the vocabulary is comprised of words and word pairs that are commonly used in annotations.

4. The method of claim 3 wherein the vocabulary is dynamically generated from words typed into the system.

5. The method of claim 1 wherein the usage frequency of each entry in the vocabulary list is updated dynamically based on usage on the system.

6. The method of claim 1 wherein each entry in the vocabulary is associated with one or more subvocabularies.

7. The method of claim 6 wherein each entry has an independent frequency related to usage with each subvocabulary.

8. The method of claim 7 wherein each independent frequency is dynamically updated based on system usage.

9. The method of claim 8 wherein the suggestion list is determined from all entries in the selected subvocabulary that have a partial match with the command characters entered.

10. The method of claim 9 wherein the partial match includes all characters of the command entered, and at least the first character of the vocabulary entry.

11. A method for annotating a displayed ultrasound image using commands comprising the steps of:

providing an annotation vocabulary sorted in descending order of usage frequency;

providing a method to select a subset of words from the vocabulary that are relevant to the imaged anatomy;

detecting an initial command to annotate an image;

selecting a suggestion list from the selected subset of works from the vocabulary; and

displaying the suggestion list to the user for optional acceptance or further specification

detecting an annotation; and

transcribing the annotation onto the image.

12. The method of claim 11 wherein the initial command consists of a keyword.

13. The method of claim 11 wherein the initial command is issued by a voice, keyboard or system state changing device.

14. The method of claim 13 wherein the body of the annotation is detected using a speech recognition technique.

15. A method for using a keyboard to initiate the annotation of ultrasound images comprising the steps of:

providing a main directory of annotations corresponding to each of the scans an ultrasound machine is likely to perform;

providing a sub-directory of annotations likely to be used in the context of an ultrasound scan for item in the main directory;

detecting at least one signal from the keyboard command and selecting from the main directory of annotations;

detecting at least one signal from the keyboard command and selecting one or more appropriate complete annotations corresponding to the subdirectory and the signal;

displaying the annotations on the ultrasound image.

16. A system for annotating a displayed ultrasound image using initiating commands comprising:

means for providing a vocabulary of commands specifying the anatomy being scanned, said vocabulary including a number of sub-vocabularies, wherein each of the sub-vocabularies contains a list of commands relevant to the anatomy being scanned;

means for detecting a signal from at least one command;

selecting at least one of the sub-vocabularies in response to the command;

selecting at least one annotation from the at least one subvocabulary, and

displaying the annotation corresponding to the command.

17. The system of claim 16 wherein the system includes means for permitting commands in the form of keyboard entries corresponding to annotations and means for permitting commands in the form of voice commands.

18. The system of claim 17 wherein the system includes means for permitting operation by keyboard entry concurrently with voice commands.

19. The system of claim 16 wherein said signal detecting means includes means for recognizing a spoken voice command and translating the spoken voice command into said signal using the subvocabulary.

20. The system of claim 16 including a plurality of voice command determining states, each of said states corresponding to one sub-vocabulary, wherein said selecting steps select a sub-vocabulary that corresponds with the voice command.

21. A system for using keyboard commands to annotate ultrasound images comprising:

means for providing a vocabulary of commands for inserting annotations on an ultrasound image;

means for providing a sub-vocabulary of commands for inserting annotations on an ultrasound;

means for detecting at least one signal from a command and selecting the sub-vocabulary associated with the command;

means for detecting at least one signal from a command and selecting the associated annotation;

means for placing the annotation in the appropriate location on the ultrasound image and means for displaying the annotation an the image.

22. The system of claim 21 including means for processing voice commands and wherein the system permits keyboard entries corresponding to annotations to be entered concurrently with voice commands.

23. The system of claim 22 wherein the system permits operation by a non-voice activated device concurrently with a voice commands.

24. The system of claim 23 wherein said detecting means includes means for recognizing a spoken voice command and translating the spoken voice command into said signal using the subvocabulary.

25. The system of claim 24 wherein said ultrasound system has a plurality of voice command determining states, each of said states corresponding to one sub-vocabulary, wherein said selecting means includes means for selecting a sub-vocabulary that corresponds with the voice command.

26. A system for using keyboard commands to annotate ultrasound images comprising:

a main directory of annotations corresponding to each of the scans and ultrasound machine is likely to perform;

one or more sub-directories of annotations likely to be used in the context of an ultrasound scan for item in the main directory;

means for detecting at least one signal from at least one keyboard command;

means for selecting from the main directory of annotations;

means for detecting at least one signal from the keyboard command and selecting the appropriate annotation corresponding to the subdirectory and the signal; and

means for displaying the annotation with the ultrasound image.