System and method for automatic navigation of a capsule based on image stream captured in-vivo

• US 9,545,192 B2
• Filed: 05/02/2013
• Issued: 01/17/2017
• Est. Priority Date: 05/04/2012
• Status: Active Grant

• Current Assignee: Given Imaging Limited (Medtronic Plc)
• Original Assignee: Given Imaging Limited (Medtronic Plc)
• Inventors: Braun, Ori, Ben Zriham, Yaniv, Rabinovitz, Elisha, Carmeli, Tomer, Gerber, Jeremy Pinchas
• Primary Examiner(s): Prince, Jessica M
• Assistant Examiner(s): NGUYEN, KATHLEEN V
• Application Number:
  US14/398,853
• Publication Number:
  US 20150138329A1
• Time in Patent Office: 1,356 Days
• Field of Search: 348/71
• US Class Current: 1/1
• CPC Class Codes: A61B 1/00016 using wireless means
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00158 using magnetic field
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 5/073 Intestinal transmitters
• CPC Class Codes: A61B 5/6861 Capsules, e.g. for swallowing or implanting
• CPC Class Codes: G06V 2201/034 of medical instruments
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Embodiments of the invention include a method and system for displaying an in vivo imaging procedure. The method includes receiving real-time image data captured by the capsule, and continuously generating an updated summarized color bar, said color bar comprising color strips and time scale marks. The color bar is calculated based on color values of received image data, and is updated continuously as new image data is received. The displayed time period is periodically updated, for example based on predetermined fixed time intervals, based on varying time intervals, or based on an accumulated amount of received image data. Other methods of determining the periodic updates may be used.

Claims

1. A method for displaying an in vivo imaging capsule procedure, the method comprising:

receiving real-time image data captured by the capsule during an in-vivo procedure;

generating a summarized color bar, said color bar comprising color strips and time scale marks, said color strips generated based on color values of image data as new image data is received, wherein the summarized color bar has a total maximal length L_T allotted for the summarized color bar;

updating said color strips, as new image data is received, by adding color strips representing new images received;

if the total maximal length L_T of the summarized color bar is filled with color strips;

reducing a resolution of said color strips,

updating a total time period represented by the total maximal length L_T, and

updating a time interval between said time scale marks according to a time passing from the beginning of the in-vivo procedure;

updating the summarized color bar according to one or more of;

any updated time interval between the time scale marks and any updated color strips; and

displaying a combined display comprising the summarized color bar and an image stream, the image stream comprising the real-time image data.

2. The method according to claim 1 comprising:

receiving real-time location data of the capsule, the location data indicating a position and orientation of the capsule in vivo;

analyzing the location data and image data in real-time to determine a suggested direction for maneuvering the capsule; and

displaying, on a current image displayed from the image stream, an indication of the suggested direction.

3. The method according to claim 1 wherein the updates to the time interval are based on predetermined fixed time intervals.

4. The method according to claim 1 wherein the updates to the time interval are based on varying time intervals.

5. The method according to claim 1 wherein the updates to the time interval depend on an amount of received image data.

6. The method according to claim 1 wherein updating sad color strips is triggered based on the amount of received image data.

7. The method according to claim 1, wherein updating color strips comprises adding color strips to the color bar.

8. The method according to claim 1, wherein updating color strips comprises representing additional images by each color strip.

9. The method according to claim 1, comprising updating the time interval based on the amount of received image data or a time elapsing from a beginning of the in-vivo imaging.

10. The method according to claim 1, wherein updating a time interval between time scale marks comprises increasing the time interval.

11. A system for displaying a real time in vivo imaging procedure, the system comprising:

a receiver for receiving real-time image data captured by an in vivo imaging device during an in-vivo procedure;

a processor to;

generate a summarized color bar, said color bar comprising color strips and time scale marks, said color strips based on color values of image data as new image data is received, wherein the summarized color bar has a total maximal length L_T allotted to the summarized color bar;

update said color strips, as new image data is received, by adding color strips representing new images received;

if the total maximal length L_T of the summarized color bar is filled with color strips;

reduce a resolution of said color strips,

update a total time period represented by the total maximal length L_T, and

update a time interval between said time scale marks according to a time passing from the beginning of the in-vivo procedure; and

update the summarized color bar according to one or more of;

any

updated time interval between the time scale marks and updated color strips; and

a display for displaying a combined display comprising the summarized color bar and an image stream, the image stream comprising the real-time image data.

12. The system according to claim 11 wherein the receiver is to receive real-time location data of the capsule, the location data indicating a position and orientation of the capsule in vivo, and wherein the processor is to analyze the location data and image data in real-time to determine a suggested direction for maneuvering the capsule and to display the suggested direction on a current image displayed from the image stream.

13. The system according to claim 11 wherein the updates to the time interval are based on predetermined fixed time intervals.

14. The system according to claim 11 wherein the updates to the time interval are based on varying time intervals.

15. The system according to claim 11 wherein the updates to the time interval depend on an amount of received image data.

16. The system according to claim 11 wherein the update to said color strips is triggered based on an amount of received image data.

17. A method for displaying in vivo imaging capsule information, the method comprising:

receiving image data captured by the capsule;

repeatedly generating an updated summary bar, said summary bar including color areas and time scale marks having time intervals between the time scale marks, said summary bar calculated based on color values of received image data, wherein said summary bar is updated as new image data is received, wherein the summary bar has a total maximal length L_T allotted for the summary bar;

updating said color areas, as new image data is received, by adding color areas representing new images received;

if the total maximal length L_T of the summary bar is filled with color areas;

reducing a resolution of said color areas,

updating a total time period represented by the total maximal length L_T, and

updating the time intervals between said time scale marks;

calculating an updated summary bar according to either of the updated time interval between the time scale marks and updated color areas; and

displaying the summary bar and an image stream, the image stream comprising the real-time image data.

18. The method according to claim 17 comprising:

receiving real-time location data of the capsule, the location data indicating a position and orientation of the capsule in vivo; and

analyzing the location data and image data in real-time to determine a suggested direction for maneuvering the capsule.