System and method for annotation on a moving image

• US 7,119,814 B2
• Filed: 05/20/2002
• Issued: 10/10/2006
• Est. Priority Date: 05/18/2001
• Status: Expired due to Term

• Current Assignee: Given Imaging Limited (Medtronic Plc)
• Original Assignee: Given Imaging Limited (Medtronic Plc)
• Inventors: Meron, Gavriel, Glukhovsky, Arkady
• Primary Examiner(s): Tung, Kee M.
• Assistant Examiner(s): Wang, Jin-Cheng
• Application Number:
  US10/150,019
• Publication Number:
  US 20020171669A1
• Time in Patent Office: 1,604 Days
• Field of Search: 345/619, 345/440, 715/500.1, 715/853, 600/427, 600/523, 600/109, 600/309, 600/424, 600/300, 607/30, 607/28, 709/236, 705/3, 382/107, 382/128
• US Class Current: 345/619
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/0004 for electronic operation
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A system and method allows for the annotation of an image stream, which may be produced by, for example, an ingestible capsule. A workstation accepts images acquired by the capsule and displays the images on a monitor as a moving image. A user inputs an annotation which corresponds to a portion of the moving image, and the annotation is recorded in a database associated with the selected portion. The annotation may include, for example, textual notes regarding the image portion. The annotations may be displayed at a later time.

Claims

1. A method for annotating an image stream, the method comprising:

accepting images acquired by a swallowable capsule directly capturing the images while traversing a body lumen;

creating a stream of images;

displaying the images on a monitor in the form of the stream of images;

accepting an annotation from a user, the annotation corresponding to one or more frames within the stream of images;

recording the annotation in a database;

associating the annotation with one or more frames within the stream of images thereby creating an annotated image;

displaying to a user a time chart of the stream of images; and

displaying to the user annotation summaries corresponding to times on the time chart, and displaying for each annotated image at least one thumbnail image of said annotated image.

2. The method of claim 1, wherein one or more frames within the stream of images comprises a single image.

3. The method of claim 1, wherein one or more frames within the stream of images comprises a subset of the stream of images.

4. The method of claim 1, wherein the step of accepting the annotation includes at least the step of accepting a text comment.

5. The method of claim 1, wherein the step of accepting the annotation includes at least the step of marking a portion of the stream of images.

6. The method as in claim 1 wherein the images are images from a gastrointestinal tract.

7. The method as in claim 1, wherein the step of accepting the annotation includes at least the steps of:

accepting a create annotation command from a user;

marking a set of frames of the stream of images;

accepting text from the user; and

storing the text in a record associated with the set of frames.

8. The method as in claim 1, further comprising:

accepting from a user an indication of an annotation to view; and

displaying the annotation and said one or more frames within the stream of images corresponding to said annotation.

9. A method for displaying images captured by a swallowable capsule, the method comprising:

forming a moving stream of images from a plurality of images captured by a swallowable capsule traversing a body lumen;

after said step of forming, displaying the moving stream of images;

selecting at least one image from said stream of images to form at least an annotated image; and

displaying said at least one annotated image together with an annotation wherein said annotation comprises at least one thumbnail image of said annotated image.

10. The method of claim 9, wherein the at least one image within the stream of images comprises a subset of the stream of images.

11. The method of claim 9, wherein the annotation includes at least a text comment.

12. The method of claim 9, wherein the step of annotating includes at least the step of marking a portion of the stream of images.

13. The method as in claim 9, wherein the images are images from a gastrointestinal tract.

14. The method as in claim 9, wherein the step of annotating includes at least the steps of:

accepting a create annotation command from a user;

marking a set of frames of the stream of images;

accepting text from the user; and

storing the text in a record associated with the set of frames.

15. The method as in claim 9, comprising:

displaying to a user a time chart of the stream of images; and

displaying to the user annotation summaries corresponding to times on the time chart.

16. A system for displaying images, comprising:

a swallowable capsule to capture a plurality of images;

a controller to;

form a moving stream of images from the images captured;

after forming the moving stream of images, display the moving stream of images;

select at least one image from the stream of images;

annotate said at least one image to form an annotated image; and

display said annotated image together with an annotation, wherein said annotation comprises at least one thumbnail image of said annotated image.

17. The system of claim 16, comprising a set of links linking each annotation with a subset of the images.

18. The system of claim 16, wherein each annotation includes at least a text comment.

19. The system of claim 16, wherein each annotation includes at least a marker.

20. The system of claim 16, wherein the images are images from a gastrointestinal tract.