ELECTROMAGNETIC DISTORTION DETECTION

• US 20190000560A1
• Filed: 06/25/2018
• Published: 01/03/2019
• Est. Priority Date: 06/28/2017
• Status: Active Grant

• Current Assignee: Auris Health, Inc. (Johnson & Johnson)
• Original Assignee: Auris Health, Inc. (Johnson & Johnson)
• Inventors: Berman, David Burdick, Sramek, Christopher K., Rafii-Tari, Hedyeh, Jeevan, Prasanth, Robert, Nicolas E.
• Granted Patent: US 11,395,703 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 1/00006 of control signals
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/0002 provided with data storages
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 2017/00477 Coupling A61B2017/0046 takes precedence
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/301 for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
• CPC Class Codes: A61B 2034/731 Arrangement of the coils or magnets
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/35 for telesurgery
• CPC Class Codes: A61B 34/73 Manipulators for magnetic surgery

Abstract

Systems and methods for electromagnetic distortion detection are disclosed. In one aspect, the system includes an electromagnetic (EM) sensor configured to generate an EM sensor signal in response to detection of the EM field. The system may also include a processor configured to calculate a baseline value of a metric indicative of a position of the EM sensor at a first time and calculate an updated value of the metric during a time period after the first time. The processor may be further configured to determine that a difference between the updated value and the baseline value is greater than a threshold value and determine that the EM field has been distorted in response to the difference being greater than the threshold value.

Claims

1. A system configured to detect electromagnetic (EM) distortion, the system comprising:

a first EM sensor configured to generate a first set of one or more EM sensor signals in response to detection of the EM field, the first EM sensor configured for placement, in use, on a patient;

a processor; and

a memory storing computer-executable instructions to cause the processor to;

calculate one or more baseline values of one or more metrics indicative of a position of the first EM sensor at a first time based on EM sensor signals from the first set of one or more EM sensor signals corresponding to the first time,

calculate one or more updated values of the one or more metrics during a time period after the first time based on EM sensor signals from the first set of one or more EM sensor signals corresponding to the time period after the first time,

determine that a difference between the one or more updated values and the one or more baseline values is greater than a threshold value, and

determine that the EM field has been distorted in response to the difference being greater than the threshold value.

2. The system of claim 1, further comprising:

an instrument comprising a second EM sensor and an image sensor, the second EM sensor and the image sensor located at a distal end of the instrument, the second EM sensor configured to generate a second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate an image signal,

wherein the memory further comprises computer-executable instructions to cause the processor to;

determine a position of the distal end of the instrument based on EM sensor signals from the second set of one or more EM sensor signals and the image signal, and

refrain from determining the position of the distal end of the instrument based on the second set of one or more EM sensor signals in response to determining that the EM field has been distorted.

3. The system of claim 1, further comprising:

an instrument comprising a second EM sensor and an image sensor, the second EM sensor and the image sensor located at a distal end of the instrument, the second EM sensor configured to generate a second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate an image signal,

wherein the memory further comprises computer-executable instructions to cause the processor to;

determine a position of the distal end of the instrument based on EM sensor signals from the second set of one or more EM sensor signals and the image signal,

calculate an amount of the distortion in the EM field based on the one or more updated values and the one or more baseline values,

encode an indication of the amount of the distortion, and

provide the encoded indication of the amount of distortion to a display configured to render encoded data.

4. The system of claim 1, further comprising:

an instrument comprising a second EM sensor and an image sensor, the second EM sensor and the image sensor located at a distal end of the instrument, the second EM sensor configured to generate a second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate an image signal,

wherein the memory further comprises computer-executable instructions to cause the processor to;

determine a position of the distal end of the instrument based on EM sensor signals from the second set of one or more EM sensor signals, the image signal, and one or more weight values used to weight the EM sensor signals from the second set of one or more EM sensor signals,

calculate an amount of the distortion in the EM field based on the one or more updated values and the one or more baseline values, and

alter the one or more weight values based on the calculated amount of the distortion in the EM field.

5. The system of claim 4, further comprising at least two additional EM sensors, the first EM sensor and the at least two additional EM sensors configured to be placed, in use, on the patient so as to surround an area of interest.

6. The system of claim 5, wherein the memory further comprises computer-executable instructions to cause the processor to:

determine an area in which the distortion in the EM field is greater than a threshold distortion value based on the one or more updated values and the one or more baseline values.

7. The system of claim 6, wherein the one or more weight values comprises a plurality of weight values respectively applied to the EM sensors, and the memory further comprises computer-executable instructions to cause the processor to:

identify one of the EM sensors as being located in the area, and

adjust the weight value applied to the identified one of the EM sensors.

8. The system of claim 4, wherein the one or more weight values comprises a plurality of weight values respectively applied to the EM sensors, and wherein the memory further comprises computer-executable instructions to cause the processor to:

access a model representative of a luminal network of the patient,

calculate a mapping between a coordinate frame of the EM field and a coordinate frame of the model based on at least one of;

(i) the one or more baseline values and (ii) the one or more updated values, and

refrain from using the one or more updated values in calculating the mapping in response to determining that the EM field has been distorted.

9. The system of claim 1, wherein the at least one metric is further indicative of at least one orientation of the EM sensor.

10. The system of claim 1, further comprising at least two additional EM sensors, the at least one metric comprising at least one of:

a relative position of the first EM sensor and the at least two additional EM sensors with respect to each other, a relative angle of at least one orientation of the first EM sensor and the at least two additional EM sensors with respect to each other, and an area of a space created by the first EM sensor and the at least two additional EM sensors.

11. The system of claim 1, wherein the memory further comprises computer-executable instructions to cause the processor to:

encode an indication that the EM field has been distorted in response to determining that the EM field has been distorted, and

provide the encoded indication to a display configured to render encoded data.

12. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause at least one computing device to:

calculate one or more baseline values of one or more metrics indicative of a position of a first electromagnetic (EM) sensor at a first time based on EM sensor signals from a first set of one or more EM sensor signals corresponding to the first time, the first EM sensor configured to generate the first set of one or more EM sensor signals in response to detection of an EM field;

calculate one or more updated values of the one or more metrics during a time period after the first time based on EM sensor signals from the first set of one or more EM sensor signals corresponding to the time period after the first time;

determine that a difference between the one or more updated values and the one or more baseline values is greater than a threshold value; and

determine that the EM field has been distorted in response to the difference being greater than the threshold value.

13. The non-transitory computer readable storage medium of claim 12, further having stored thereon instructions that, when executed, cause at least one computing device to:

determine a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals and an image signal, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal; and

refrain from determining the position of the distal end of the instrument based on the second set of one or more EM sensor signals in response to determining that the EM field has been distorted.

14. The non-transitory computer readable storage medium of claim 12, further having stored thereon instructions that, when executed, cause at least one computing device to:

determine a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals and an image signal, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal; and

refrain from determining the position of the distal end of the instrument based on the second set of one or more EM sensor signals in response to determining that the EM field has been distorted.

15. The non-transitory computer readable storage medium of claim 12, further having stored thereon instructions that, when executed, cause at least one computing device to:

determine a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals, an image signal, and one or more weight values used to weight the EM sensor signals from the second set of one or more EM sensor signals, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal;

calculate an amount of the distortion in the EM field based on the one or more updated values and the one or more baseline values; and

alter the one or more weight values based on the calculated amount of the distortion in the EM field.

16. The non-transitory computer readable storage medium of claim 15, wherein the one or more weight values comprises a plurality of weight values respectively applied to the first EM sensor and at least two additional EM sensors, the non-transitory computer readable storage medium further having stored thereon instructions that, when executed, cause at least one computing device to:

access a model representative of a luminal network of the patient,

calculate a mapping between a coordinate frame of the EM field and a coordinate frame of the model based on at least one of;

(i) the one or more baseline values and (ii) the one or more updated values, and

refrain from using the one or more updated values in calculating the mapping in response to determining that the EM field has been distorted.

17. The non-transitory computer readable storage medium of claim 12, further having stored thereon instructions that, when executed, cause at least one computing device to:

calculate at least one of;

a relative position of the first EM sensor and at least two additional EM sensors with respect to each other, a relative angle of at least one orientation of the first EM sensor and the at least two additional EM sensors with respect to each other, and an area of a space created by the first EM sensor and the at least two additional EM sensors.

18. A method of detecting electromagnetic (EM) distortion, the method comprising:

calculating one or more baseline values of one or more metrics indicative of a position of a first EM sensor at a first time based on EM sensor signals from a first set of one or more EM sensor signals corresponding to the first time, the first EM sensor configured to generate the first set of one or more EM sensor signals in response to detection of an EM field;

calculating one or more updated values of the one or more metrics during a time period after the first time based on EM sensor signals from the first set of one or more EM sensor signals corresponding to the time period after the first time;

determining that a difference between the one or more updated values and the one or more baseline values is greater than a threshold value; and

determining that the EM field has been distorted in response to the difference being greater than the threshold value.

19. The method of claim 18, further comprising:

determining a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals and an image signal, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal; and

refraining from determining the position of the distal end of the instrument based on the second set of one or more EM sensor signals in response to determining that the EM field has been distorted.

20. The method of claim 18, further comprising:

determining a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals and an image signal, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal; and

refraining from determining the position of the distal end of the instrument based on the second set of one or more EM sensor signals in response to determining that the EM field has been distorted.

21. The method of claim 18, further comprising:

determining a position of a distal end of an instrument based on EM sensor signals from a second set of one or more EM sensor signals, an image signal, and one or more weight values used to weight the EM sensor signals from the second set of one or more EM sensor signals, the instrument comprising the second EM sensor and an image sensor, the second EM sensor and the image sensor located at the distal end of the instrument, the second EM sensor configured to generate the second set of one or more EM sensor signals in response to detection of the EM field, and the image sensor configured to generate the image signal;

calculating an amount of the distortion in the EM field based on the one or more updated values and the one or more baseline values; and

altering the one or more weight values based on the calculated amount of the distortion in the EM field.

22. The method of claim 21, wherein the one or more weight values comprises a plurality of weight values respectively applied to the first EM sensor and at least two additional EM sensors, the method further comprising:

accessing a model representative of a luminal network of the patient,

calculating a mapping between a coordinate frame of the EM field and a coordinate frame of the model based on at least one of;

(i) the one or more baseline values and (ii) the one or more updated values, and

refraining from using the one or more updated values in calculating the mapping in response to determining that the EM field has been distorted.

23. The method of claim 18, further comprising:

calculating at least one of;

a relative position of the first EM sensor and at least two additional EM sensors with respect to each other, a relative angle of at least one orientation of the first EM sensor and the at least two additional EM sensors with respect to each other, and an area of a space created by the first EM sensor and the at least two additional EM sensors.

24. A system configured to detect electromagnetic (EM) distortion, comprising:

an EM sensor at a distal end of an instrument, the EM sensor configured to generate one or more EM sensor signals in response to detection of an EM field;

a processor; and

a memory storing computer-executable instructions to cause the processor to;

calculate one or more baseline values of one or more metrics indicative of a velocity of the distal end of the instrument at a first time based on EM sensor signals from the one or more EM sensor signals corresponding to the first time,

calculate one or more updated values of the one or more metrics during a time period after the first time based on EM sensor signals from the one or more EM sensor signals corresponding to the time period after the first time,

determine that a difference between the one or more updated values and the one or more baseline values is greater than a threshold value, and

determine that the EM field has been distorted in response to the difference being greater than the threshold value.

25. The system of claim 24, wherein the memory further comprises computer-executable instructions to cause the processor to:

refrain from determining a position of the distal end of the instrument based on the one or more EM sensor signals in response to determining that the EM field has been distorted.

26. The system of claim 24, further comprising wherein the memory further comprises computer-executable instructions to cause the processor to:

communicate with a robotic system having one or more instrument drivers configured to effect movement of the instrument.

27. The system of claim 26, wherein the memory further comprises computer-executable instructions to cause the processor to:

provide instructions to the robotic system to maintain the current position and orientation of the instrument during the time period after the first time,

wherein calculating the one or more updated values is performed in response to providing the instructions to the robotic system to maintain the current position and orientation of the instrument.

28. The system of claim 24, wherein the memory further comprises computer-executable instructions to cause the processor to:

calculate an amount of the distortion in the EM field based on the one or more updated values and the one or more baseline values,

encode an indication of the amount of the distortion, and

provide the encoded indication to a display configured to render encoded data.

29. The system of claim 24, wherein the memory further comprises computer-executable instructions to cause the processor to:

encode an indication that the EM field has been distorted in response to determining that the EM field has been distorted, and

provide the encoded indication to a display configured to render encoded data.

30. The system of claim 24, wherein the at least one metric comprises at least one of:

a linear velocity of the distal end of the instrument, an angular velocity of the distal end of the instrument, and a change in an indicator value.