SYSTEM AND METHOD FOR DISPLAYING AND INTERACTING WITH ULTRASOUND IMAGES VIA A TOUCHSCREEN

• US 20170090571A1
• Filed: 09/29/2015
• Published: 03/30/2017
• Est. Priority Date: 09/29/2015
• Status: Abandoned Application

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Bjaerum, Steinar, Torp, Anders Herman
• Application Number:
  US14/869,828
• Publication Number:
  US 20170090571A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 8/00 Diagnosis using ultrasonic, sonic or infrasonic waves imaging of objects using sonar G01S15/00
• CPC Class Codes: A61B 8/4254 using sensors mounted on the probe
• CPC Class Codes: A61B 8/4444 related to the probe
• CPC Class Codes: A61B 8/461 Displaying means of special interest
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/469 for selection of a region of interest
• CPC Class Codes: A61B 8/5207 involving processing of raw data to produce diagnostic data, e.g. for generating an image reconstruction G06T11/00
• CPC Class Codes: A61B 8/54 Control of the diagnostic device
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Methods and systems are provided for providing tactile feedback via a touch-sensitive display of an imaging system. In one embodiment, a method comprises acquiring medical imaging data with a medical imaging device, generating an image from the acquired data, displaying the image on a touch-sensitive display, and during user touching of the displayed image, outputting tactile feedback via the display based on the acquired data. In this way, a user may more easily understand and evaluate a displayed image.

Claims

1. A method, comprising:

acquiring medical imaging data with a medical imaging device;

generating an image from the acquired data;

displaying the image on a touch-sensitive display; and

during user touching of the displayed image, outputting tactile feedback via the display based on the acquired data.

2. The method of claim 1, wherein the acquired data includes one or more image parameters calculated for each pixel or group of pixels of the display and wherein outputting tactile feedback includes outputting tactile feedback that is a function of the one or more calculated image parameters for one or more pixels in a region of the display that displays the image and is touched by a user.

3. The method of claim 2, wherein the one or more calculated image parameters includes one or more of an intensity, velocity, color flow velocity, texture, graininess, contractility, deformation, and rate of deformation value.

4. The method of claim 2, wherein the tactile feedback includes a vibration output via the display in a region of the display touched by a user and wherein a degree of the vibration output via the display is based on the one or more calculated image parameters.

5. The method of claim 2, wherein a degree of the tactile feedback output via the display is based on the one or more calculated image parameters for the one or more pixels in the region of the display touched by the user and further comprising increasing or decreasing the degree of tactile feedback output via the display as a value of the one or more calculated image parameters of the one or more pixels increases.

6. The method of claim 2, wherein the tactile feedback includes an amount of heat output via the display in a region of the display touched by a user and wherein a degree of the heat output via the display is based on the one or more calculated image parameters.

7. The method of claim 2, wherein the tactile feedback includes an applied voltage output via the display and further comprising modulating said applied voltage to adjust frictional forces between a user touching the display and the display based on the one or more calculated image parameters.

8. The method of claim 1, further comprising adjusting the tactile feedback based on operating conditions of the medical imaging device, where the operating conditions include one or more of an imaging mode, user settings, screen size, a viewing angle of the image, a type of tissue being imaged, and a region of the display being touched by a user.

9. The method of claim 1, wherein outputting tactile feedback includes outputting a first tactile feedback via the display in response to a signal indicating a user is touching the displayed image in a region of the displayed image not corresponding to an edge within the image and further comprising in response to receiving a signal that the user is touching the displayed image in a region corresponding to the edge within the image, outputting a second tactile feedback, different than the first tactile feedback, via the display in the region that corresponds to the edge.

10. The method of claim 1, further comprising, in response to receiving an input for positioning an analytical tool on the displayed image, displaying the analytical tool on the displayed image, via the display, as signals are received from a user touching the displayed image and further comprising, during displaying of the analytical tool, continuing to provide tactile feedback to the user via the display.

11. The method of claim 10, wherein the analytical tool includes one or more of a region of interest, measurement calipers, and a Doppler sample volume and wherein the input for positioning the analytical tool includes one or more of a user selection of one or more user selectable elements displayed via the display, a user selection of one or more user selectable elements displayed after receiving an input that a user applied a force to the display, and an applied force to the display and corresponding unapplied force to the display upon selection of a desired analytical tool.

12. The method of claim 10, further comprising automatically adjusting placement of the analytical tool on the displayed image based on analysis of the generated image.

13. The method of claim 10, further comprising, during positioning of the analytical tool on the displayed image, providing tactile resistance via the display if a user attempts to position the analytical tool outside of a designated region, where the designated region is based on analysis of the generated image.

14. The method of claim 10, further comprising, after the analytical tool is positioned in a first position on the displayed image at a first feature of interest, providing tactile resistance via the display in response to a user moving the analytical tool away from the first position and decreasing the provided tactile resistance as the analytical tool approaches a second feature of interest in the displayed image.

15. A method, comprising:

acquiring medical imaging data with a medical imaging device; and

during the acquiring;

generating an image from the acquired data;

displaying the image on a touch-sensitive display; and

in response to receiving a signal indicating a user is touching a region of the displayed image on the display, outputting tactile feedback via the display based on data content of the acquired data corresponding to one or more pixels in the region touched by the user.

16. The method of claim 15, wherein the data content includes one or more image parameters calculated for each pixel of the display.

17. The method of claim 15, further comprising during the acquiring, continuously updating the displayed image and tactile feedback based on the acquired data.

18. An ultrasound imaging system, comprising:

an ultrasound probe;

a touch-sensitive display;

a controller with non-transitory memory including instructions for;

acquiring ultrasound data via the ultrasound probe;

generating an image from the acquired data;

displaying the image via the touch-sensitive display; and

upon receiving a signal from the touch-sensitive display indicating a user is touching a region of the image on the display, outputting tactile feedback in a form of one or more of heat, applied voltage, and vibration at the region, where an intensity of the heat, applied voltage, or vibration is based on one or more image parameters determined from the acquired data and assigned to one or more pixels in the region.

19. The system of claim 18, wherein the touch-sensitive display includes a first region for displaying the image and outputting the tactile feedback and a second region for displaying one or more user selectable elements.

20. The system of claim 19, wherein the user selectable elements includes one or more of inputs for adjusting tactile feedback settings, adjusting image display settings, and placing an analytical tool on the displayed image.