System and method for displaying an image stream

• US 10,405,734 B2
• Filed: 06/27/2013
• Issued: 09/10/2019
• Est. Priority Date: 06/29/2012
• Status: Active Grant

• Current Assignee: Given Imaging Limited (Medtronic Plc)
• Original Assignee: Given Imaging Limited (Medtronic Plc)
• Inventors: Krupnik, Hagai
• Primary Examiner(s): Uhl, Lindsay J
• Application Number:
  US14/411,161
• Publication Number:
  US 20150320299A1
• Time in Patent Office: 2,266 Days
• Field of Search: None
• CPC Class Codes: A61B 1/00016 using wireless means
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging

Abstract

Systems and methods for displaying an image stream captured by an in vivo imaging device are presented. A method comprises receiving a stream of image frames captured by the in vivo device, each frame comprising a plurality of pixels. A summarized image presentation comprising summarized data elements may be generated, each summarized data element corresponding to at least one frame from the image stream. Summarized data elements are generated by ordering pixels of one or more image frames according to a first sorting parameter, sampling the ordered pixels according to a predetermined sampling scheme to acquire a subset of ordered pixels; and combining or appending sampled pixels to form a summarized data element. The summarized data elements are combined to form a summarized image presentation.

Claims

1. A computer-implemented method for displaying an image stream captured by an in vivo imaging device, the method comprising:

receiving an image stream captured by the in vivo device, the image stream comprising a plurality of image frames, each image frame comprising a plurality of pixels;

automatically generating a dynamic preview bar, wherein said dynamic preview bar comprises;

a series of adjacent data elements;

a detailed data segment comprising an adjacent series of data elements of the series of adjacent data elements, each data element in the detailed data segment providing data which represents one or more image frames from a first portion of the image stream;

a reduced data segment comprising an adjacent series of data elements of the series of adjacent data elements, each data element in the reduced data segment providing data which represents a plurality of image frames from a second portion of the image stream, wherein the number of image frames corresponding to a data element of the reduced data segment is greater than the number of image frames corresponding to a data element of the detailed data segment, and wherein said detailed data segment is generated for each of the at least one image frames being displayed in each time slot in the video display; and

displaying, on the visual display, the dynamic preview bar along the video display of the image stream, wherein the display of the dynamic preview bar is continuously updated by displaying in each time slot the detailed data segment generated for the at least one image frame currently being displayed in the video display.

2. The method of claim 1 wherein the detailed data segment is generated for a sequence of image frames adjacent to the at least one frame currently being displayed in the video display.

3. The method of claim 1 wherein the detailed data segment is generated for segments of the image stream which are selected by a user, and wherein adjacent data elements of the detailed data segment correspond to sequential images from the image stream.

4. The method of claim 1 wherein the reduced data segment is generated for image frames which are not adjacent to the frame currently displayed in the video display.

5. The method of claim 1 wherein the detailed data segment is visually emphasized on the visual display unit.

8. The computer-implemented method for displaying an image stream captured by an in vivo imaging device of claim 1, wherein the data elements in the detailed data segment and the data elements in the reduced data segment are generated for at least a subset of the image frames, each data element in the detailed data segment and the data elements in the reduced data segment corresponding to at least one image frame from the subset of the image frames, wherein generating a data element in the detailed data segment and the data elements in the reduced data segment comprises:

ordering pixels of one or more image frames according to a first sorting parameter;

sampling the ordered pixels according to a predetermined sampling scheme to acquire a sampled set of ordered pixels; and

combining pixels of the sampled set of ordered pixels to form a data element.

9. The method of claim 8 wherein generating a data element in the detailed data segment and the data elements in the reduced data segment comprises selecting a subset of pixels from each of the one or more image frames according to a predetermined condition, and wherein ordering pixels comprises ordering the subset of pixels.

10. The method of claim 8 wherein said first sorting parameter is based on detecting a lumen hole in the image frames.

11. The method of claim 8 wherein pixels are represented in R,G,B (Red, Green, Blue) color space, and the first sorting parameter is computed based on a combination of R, G, and/or B values.

12. The method of claim 8 wherein generating a data element comprises re-ordering pixels of one or more image frames according to a second sorting parameter.

13. The method of claim 12 comprising:

dividing the sorted pixels into two sets based on the first sorting parameter,

arranging the first set in decreasing order according to the second sorting parameter, and

arranging the second set in increasing order according to the second sorting parameter.

14. The method of claim 8 wherein each data element in the detailed data segment and the data elements in the reduced data segment is a line of pixels.

15. The method of claim 8, wherein the subset of frames includes a sequence of consecutive image frames from the image stream.

16. The method of claim 8, comprising determining image properties or intestinal events based on the dynamic preview bar.

20. The method of claim 1, wherein each data element in the detailed data segment and each data elements in the reduced data segment summarizes information related to its corresponding one or more image frames.

21. The method of claim 1, wherein updating the detailed data segment is automatic.

23. The method of claim 1, wherein the series of adjacent data elements comprises image frame pixels.

6. A system for displaying an image stream captured by an in vivo imaging device, the system comprising:

a processor to;

receive an image stream captured by the in vivo device, the image stream comprising a plurality of image frames, each image frame comprising a plurality of pixels; and

generate a dynamic preview bar, wherein said dynamic preview bar comprises;

a series of adjacent data elements;

a detailed data segment comprising an adjacent series of data elements of the series of adjacent data elements, each data element in the detailed data segment providing data which represents one or more image frames from a first portion of the image stream; and

a reduced data segment comprising an adjacent series of data elements of the series of adjacent data elements, each data element in the reduced data segment providing data which represents a plurality of image frames from a second portion of the image stream, wherein the number of image frames corresponding to a data element of the reduced data segment is greater than the number of image frames corresponding to a data element of the detailed data segment, and wherein said detailed data segment is generated for each of the at least one image frames currently displayed in the video display; and

a visual display unit to display a video display of the image stream, wherein at least one image frame is displayed in each time slot, and the image frames are displayed sequentially according to their frame capture time, the visual display unit further to display the dynamic preview bar along the video display of the image stream, and

wherein the detailed data segment is continuously updated according to each of the the at least one image frame being displayed in the video display.

7. The system of claim 6 wherein the processor is to generate the detailed data segment for a sequence of image frames adjacent to the at least one image frame currently being displayed in the video display.

17. The system for displaying an image stream captured by an in vivo imaging device of claim 6, wherein the dynamic preview bar comprises data elements, and wherein the data elements are generated for at least a subset of the image frames, each data element corresponding to the at least one image frame from the image stream, wherein generating a data element comprises:

ordering pixels of one or more image frames according to a first sorting parameter;

sampling the ordered pixels according to a predetermined sampling scheme to acquire a subset of ordered pixels; and

combining pixels of the subset of ordered pixels to form a data element.

18. The system of claim 6 wherein each data element in the detailed data segment and the data elements in the reduced data segment comprises a line of pixels.

19. The system of claim 6, wherein each data element in the detailed data segment and each data element in the reduced data segment provides data representing a sequence of consecutive image frames from the image stream.

22. The system of claim 6, wherein updating the detailed data segment is automatic.

24. The system of claim 6, wherein the series of adjacent data elements comprises image frame pixels.