Detection of when a capsule camera enters into or goes out of a human body and associated operations

• US 8,187,174 B2
• Filed: 01/22/2007
• Issued: 05/29/2012
• Est. Priority Date: 01/22/2007
• Status: Active Grant

• Current Assignee: CapsoVision, Inc.
• Original Assignee: CapsoVision, Inc.
• Inventors: Wang, Kang-Huai
• Primary Examiner(s): Leubecker, John P
• Assistant Examiner(s): Sponheimer, Christopher
• Application Number:
  US11/625,647
• Publication Number:
  US 20080177136A1
• Time in Patent Office: 1,954 Days
• Field of Search: 600/109, 600/117, 600/118, 600/160, 600/412, 600/424, 600473-477, 348/69, 382/130
• US Class Current: 600/117
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 5/06 Devices, other than using radiation, for detecting or locating foreign bodies for removing same A61B17/50 ; determining position of probes within or on the body of the patient
• CPC Class Codes: A61B 5/42 Detecting, measuring or recording for evaluating the gastrointestinal, the endocrine or the exocrine systems A61B1/00, A61B5/4857, A61B5/486, A61B5/4866, A61B5/4869 take precedence
• CPC Class Codes: H04N 17/002 for television cameras

Abstract

A method for detecting a capsule camera entering into or exiting the GI tract, includes (a) taking a first test image under the condition that an illumination system of the capsule camera is disabled; (b) taking a second test image under the same condition as the first test image; (c) comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred; and (d) upon detecting the significant change in pixel values, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination. The appropriate operations performed after detecting the capsule camera'"'"'s exit from the GI tract includes stopping further taking or storing of images and, optionally, activating an audio signal to indicate the capsule camera has exited the GI tract. The appropriate operations performed after detecting the capsule camera'"'"'s entering into the GI tract includes entering into an imaging mode for a next section of the GI tract, which may be the esophagus.

Claims

1. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

determining if the capsule camera has previously been determined to have already entered the GI tract;

if the capsule camera has previously been determined to have already entered the GI tract, determining if a predetermined criterion is satisfied for initiating detection of whether or not the capsule camera has exited the GI tract;

if the capsule camera has not previously been determined to have already entered the GI tract, or if the predetermined criterion is already satisfied;

taking a first test image under the condition that an illumination system of the capsule camera is substantially disabled;

taking a second test image under the same condition as the first test image;

comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred; and

upon detecting the significant change in pixel values, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination.

2. A method as in claim 1, wherein the appropriate operations performed comprise stopping further taking or storing or transmitting of images.

3. A method as in claim 1, further comprising activating an audio signal to indicate the capsule camera has exited the GI tract.

4. A method as in claim 1, wherein the capsule camera stores image data in an on-board archival memory.

5. A method as in claim 1, wherein the capsule camera transmits image data by wireless when the images are taken, as the capsule camera travels along the GI tract.

6. A method as in claim 1, wherein the appropriate operations performed comprise entering into imaging mode for a next section of the GI tract.

7. A method as in claim 6, wherein the next section comprises one of:

the esophagus, the stomach, the small intestines and the colon.

8. A method as in claim 1, wherein the test image is exposed on an image sensor array.

9. A method as in claim 8, wherein a selected portion of the image sensor array is used in the comparing.

10. A method as in claim 1, further comprising recording each determination of the entrance or exit of the capsule camera in a history record of an on-board storage device, and examining the history record in a power-on self-test.

11. A method as in claim 10, wherein the self-test comprises a self-diagnosing function.

12. A method as in claim 1, further comprising performing a power-on self-test and providing a visual report of the self-test.

13. A method as in claim 12, wherein the visual report comprises a lighting pattern from the illumination system of the capsule camera.

14. A method as in claim 1, wherein the predetermined criterion is satisfied after a predetermined elapsed time from first determining that the capsule camera has entered into the GI tract.

15. A method as in claim 1, wherein the predetermined criterion is satisfied after a predetermined elapsed time from detecting that the capsule camera is powered on.

16. A method as in claim 15, wherein the elapsed time is empirically determined from statistics collected from a population of subjects whose GI tracts are imaged.

17. A method as in claim 1, wherein the predetermined criterion is satisfied after images taken by the capsule camera show a decrease of a red component in relation to other color components.

18. A method as in claim 1, further comprising determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a secondary sensor.

19. A method as in claim 18, wherein the secondary sensor comprises a thermometer.

20. A method as in claim 19, wherein the significant change is detected by comparing a temperature measured by the thermometer against a predetermined range.

21. A method as in claim 20, further comprising calibrating the capsule camera under test conditions to determine the predetermined range.

22. A method as in claim 21, wherein a separate predetermined range is determined for each test condition.

23. A method as in claim 21, where the predetermined range is stored in a storage device in the capsule camera.

24. A method as in claim 21, wherein results of the calibrating are recorded in a storage device in the capsule camera for subsequent retrieval in the temperature comparing step.

25. A method as in claim 19, where the comparisons are based on operation conditions.

26. A method as in claim 19, wherein the significant change is determined by comparing temperature measurements taken at different times.

27. A method as in claim 19, wherein more than two temperature measurements of different times are compared.

28. A method as in claim 19, wherein the thermometer comprises a first set of one or more devices connected in series with a second set of one or more devices, the first set of devices having a different temperature dependence than the second set of devices.

29. A method as in claim 19, wherein the thermometer operates by measuring a leakage current across a PN junction.

30. A method as in claim 1, wherein the predetermined criterion is satisfied when a predetermined number of images have been taken by the capsule camera since an occurrence of a predetermined event.

31. A method as in claim 1, wherein the predetermined criterion is satisfied when a predetermined number of frames have been skipped based on motion detection since an occurrence of a predetermined event.

32. A method as in claim 1, wherein the predetermined criterion is satisfied when a predetermined number of exposures have been made using the illumination system since the occurrence of a predetermined event.

33. A method as in claim 1, wherein the predetermined criterion is satisfied when a predetermined cumulative amount of an activity since an occurrence of a predetermined event.

34. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

taking a first test image under the condition that an illumination system of the capsule camera is substantially disabled;

taking a second test image under the same condition as the first test image;

comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred;

determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a thermometer; and

upon detecting the significant change in pixel values and the significant change in the capsule camera'"'"'s operating environment, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination,

wherein the thermometer comprises a first set of one or more devices connected in series with a second set of one or more devices, the first set of devices having a different temperature dependence than the second set of devices, and

wherein the first set of devices and the second set of devices each comprise one or more transistors.

35. A method as in claim 34, wherein the first set of devices are each biased to operate within a linear region, and wherein the second set of devices are biased to operate in a saturation region.

36. A method as in claim 35, further comprising an analog-to-digital converter sensing a voltage at an electrical node between the first set of devices and the second set of devices.

37. A method as in claim 36, wherein the predetermined period is set by the sampling time of the voltage at the analog-to-digital converter.

38. A method as in claim 35, wherein the first and second set of devices are connected to two reference voltages.

39. A method as in claim 38, wherein the reference voltages are the power supply voltage and the ground reference voltage.

40. A method as in claim 34, wherein the first and second set of devices operate with a strong inversion layer.

41. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

taking a first test image under the condition that an illumination system of the capsule camera is substantially disabled;

taking a second test image under the same condition as the first test image;

comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred;

determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a thermometer; and

upon detecting the significant change in pixel values and the significant change in the capsule camera'"'"'s operating environment, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination, wherein the thermometer operates according to a method for measuring a leakage current across a PN junction, comprising pre-charging the PN junction by applying a reverse bias voltage across the PN junction, and measuring a voltage of the PN junction after a predetermined time period.

42. A method as in claim 41, further comprising providing an analog-to-digital converter to provide a read-out of the voltage.

43. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

determining if the capsule camera has already entered the GI tract, and if the capsule camera has already entered the GI tract, further determining if a predetermined criterion is satisfied for initiating detection of whether or not the capsule camera has exited the GI tract;

if the capsule camera has not already entered the GI tract, or if the predetermined criterion is satisfied;

taking a test image under the condition that an illumination system of the capsule camera is substantially disabled;

comparing the pixel values of the first test image against a threshold value to determine if a significant event has occurred; and

upon detecting the significant event in pixel values, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination.

44. A method as in claim 43, wherein the appropriate operations performed comprise stopping further taking or storing or transmitting of images.

45. A method as in claim 44, further comprising activating an audio signal to indicate the capsule camera has exited the GI tract.

46. A method as in claim 43, wherein the capsule camera stores image data in an on-board archival memory.

47. A method as in claim 43, wherein the capsule camera transmits image data by wireless when the images are taken, as the capsule camera travels along the GI tract.

48. A method as in claim 43, wherein the appropriate operations performed comprise entering into imaging mode for a next section of the GI tract.

49. A method as in claim 48, wherein the next section comprises the esophagus.

50. A method as in claim 43, wherein the test image is exposed on an image sensor array.

51. A method as in claim 50, wherein a selected portion of the image sensor array is used in the comparing.

52. A method as in claim 43, further comprising recording each determination of the entrance or exit of the capsule camera in a history record of an on-board storage device, and examining the history record in a power-on self-test.

53. A method as in claim 52, wherein the self-test comprises a self-diagnosing function.

54. A method as in claim 43, further comprising performing a power-on self-test and providing a visual report of the self-test.

55. A method as in claim 54, wherein the visual report comprises a lighting pattern from the illumination system of the capsule camera.

56. A method as in claim 43, wherein the predetermined criterion is satisfied after a predetermined elapsed time from first determining that the capsule camera has entered into the GI tract.

57. A method as in claim 43, wherein the predetermined criterion is satisfied after a predetermined elapsed time from detecting the capsule camera is powered on.

58. A method as in claim 57, wherein the elapsed time is empirically determined from statistics collected from a population of subjects whose GI tracts are imaged.

59. A method as in claim 43, wherein the predetermined criterion is satisfied after images taken by the capsule camera show a decrease of red component in relation to other color components.

60. A method as in claim 43, further comprising determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a secondary sensor.

61. A method as in claim 60, wherein the secondary sensor comprises a thermometer.

62. A method as in claim 61, wherein the significant change is detected by comparing a temperature measured by the thermometer against a predetermined range.

63. A method as in claim 62, further comprising calibrating the capsule camera under test conditions to determine the predetermined range.

64. A method as in claim 63, wherein a separate predetermined range is determined for each test condition.

65. A method as in claim 63, where the predetermined range is stored in a storage device in the capsule camera.

66. A method as in claim 63, wherein results of the calibrating are recorded in a storage device in the capsule camera for subsequent retrieval in the temperature comparing step.

67. A method as in claim 61, where the comparisons are based on operation conditions.

68. A method as in claim 61, wherein the significant change is determined by comparing temperature measurements taken at different times.

69. A method as in claim 61, wherein more than two temperature measurements of different times are compared.

70. A method as in claim 61, wherein the thermometer comprises a first set of one or more devices connected in series with a second set of one or more devices, the first set of devices having a different temperature dependence than the second set of devices.

71. A method as in claim 61, wherein the thermometer operates by measuring a leakage current across a PN junction.

72. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

taking a test image under the condition that an illumination system of the capsule camera is substantially disabled;

comparing the pixel values of the first test image against a threshold value to determine if a significant event has occurred;

determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a thermometer; and

upon detecting the significant event in pixel values and the significant change in the capsule camera'"'"'s operating environment, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination,

wherein the thermometer comprises a first set of one or more devices connected in series with a second set of one or more devices, the first set of devices having a different temperature dependence than the second set of devices, and wherein the first set of devices comprise one or more short channel transistors, and wherein the second set of devices comprise one or more long channel devices.

73. A method as in claim 72, wherein the first set of devices are each biased to operate within a linear region, and wherein the second set of devices are biased to operate in a saturation region.

74. A method as in claim 73, further comprising an analog-to-digital converter sensing a voltage at an electrical node between the first set of devices and the second set of devices.

75. A method as in claim 74, wherein the predetermined period is set by the sampling time of the voltage at the analog-to-digital converter.

76. A method as in claim 73, wherein the first and second set of devices are connected between two reference voltages.

77. A method as in claim 76, wherein the reference voltages are the power supply voltage and the ground reference voltage.

78. A method as in claim 72, wherein the first and second set of devices operate with a strong inversion layer.

79. A method for detecting a capsule camera entering into or exiting the GI tract, comprising:

taking a test image under the condition that an illumination system of the capsule camera is substantially disabled;

comparing the pixel values of the first test image against a threshold value to determine if a significant event has occurred;

determining if a significant change in the capsule camera'"'"'s operating environment has occurred, as measured by a thermometer; and

upon detecting the significant event in pixel values and the significant change in the capsule camera'"'"'s operating environment, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination, wherein the thermometer operates according to a method for measuring a leakage current across a PN junction, comprising;

pre-charging the PN junction by applying a reverse bias voltage across the PN junction, and

measuring a voltage of the PN junction after a predetermined time period.

80. A method as in claim 79, further comprising providing an analog-to-digital converter to provide a read-out of the voltage.