Multi-user wireless ulttrasound server

• US 20150313578A1
• Filed: 05/05/2014
• Published: 11/05/2015
• Est. Priority Date: 05/05/2014
• Status: Abandoned Application

• Current Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Original Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Inventors: Yu, Daphne, Kapoor, Ankur, Chefd'hotel, Christophe, Mountney, Peter, Diallo, Mamadou, Comaniciu, Dorin, Paladini, Gianluca
• Application Number:
  US14/270,118
• Publication Number:
  US 20150313578A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 8/4254 using sensors mounted on the probe
• CPC Class Codes: A61B 8/4427 Device being portable or laptop-like
• CPC Class Codes: A61B 8/4472 Wireless probes
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/5207 involving processing of raw data to produce diagnostic data, e.g. for generating an image reconstruction G06T11/00
• CPC Class Codes: A61B 8/523 for generating planar views from image data in a user selectable plane not corresponding to the acquisition plane
• CPC Class Codes: A61B 8/54 Control of the diagnostic device
• CPC Class Codes: A61B 8/565 involving data transmission via a network
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS

Abstract

Multiple users are supported with an ultrasound server. Tiling of images may be used to limit transmission and/or bandwidth. By transmitting parts of images that change and avoiding transmission of other parts, wireless and processing bandwidth may be optimized. On the server side, separate instances are used for scanning each patient or for each of the multiple transducer probes being used. Dynamic assignment of shared resources based on use of the transducer probes may provide further optimization. From an overall perspective, the server may beamform from data received by a transducer probe based on controls routed from a separate tablet used as a display and user input.

Claims

1. A method for supporting multiple users with an ultrasound server, the method comprising:

receiving, at a local area server, ultrasound scan data from a handheld transducer probe;

generating, by the local area server, an ultrasound image representing a rendering from the data, the ultrasound image comprising a plurality of tiles;

transmitting, from the local area server, the ultrasound image to a display;

receiving a change for the rendering;

determining a first sub-set of the tiles of the ultrasound image that are different due to the change and a second sub-set of the tiles that are not different;

rendering, by the local area server, the tiles of the first sub-set; and

transmitting, to the display, the rendered tiles of the first sub-set and not tiles of the second sub-set.

2. The method of claim 1 wherein receiving comprises receiving the ultrasound scan data as channel data from elements of the handheld transducer probe, and further comprising beamforming the ultrasound scan data.

3. The method of claim 1 wherein generating comprises volume rendering from a first view direction, wherein receiving the change comprises receiving a second view direction different than the first view direction, and wherein determining comprises determining the second sub-set as corresponding to tiles representing regions outside the scan region.

4. The method of claim 1 wherein transmitting the ultrasound image comprises transmitting the ultrasound image as the tiles, each tile representing a different two-dimensional region of the ultrasound image.

5. The method of claim 1 wherein determining the first sub-set comprises identifying regions of no change with a pre-computed three-dimensional geometry proxy.

6. The method of claim 1 wherein rendering the tiles comprises rendering only the first sub-set and not the second sub-set.

7. The method of claim 1 further comprising:

caching, by the display, the tiles of the ultrasound image;

compositing the rendered tiles of the first sub-set with cached tiles of the second sub-set.

8. The method of claim 1 wherein transmitting the rendered tiles comprises packing the rendered tiles of the first sub-set and compressing the packed, rendered tiles as a single image, and transmitting the compressed single image.

9. The method of claim 1 wherein transmitting the ultrasound image comprises transmitting the ultrasound image as a compressed image.

10. The method of claim 1 further comprising checking, by the local area server, for caching, by the display, of a sequence of two-dimensional images and transmitting only the two-dimensional images not cached.

11. The method of claim 1 wherein the ultrasound image comprises first and second layers, each layer corresponding to a different scan mode, and wherein determining the first sub-set of tiles comprises determining for the first layer, and further comprising determining tiling separately for the second layer.

12. The method of claim 1 further comprising operating multiple instances of an ultrasound system at the local area server, one of the multiple instances connected with the display and the handheld transducer probe, and other of the multiple instances connected with other displays and handheld transducer probes.

13. The method of claim 12 wherein operating the multiple instances comprises operating each of the multiple instances as a virtual instance, each virtual instance having a separate operating system instance.

14. The method of claim 1 wherein receiving the change comprises receiving accelerometer, gyroscope, inertia sensor, or light sensor input from the handheld transducer probe or the display.

15. The method of claim 1 wherein receiving comprises receiving three-dimensional data from the handheld transducer probe, wherein generating comprises generating the ultrasound image representing a volume rendering from the three-dimensional data, and wherein receiving the change comprises receiving the change for the volume rendering.

16. The method of claim 1 wherein receiving comprise receiving two-dimensional data from the handheld transducer probe, wherein generating comprises generating the ultrasound image representing a two-dimensional cross-sectional rendering from the ultrasound data, and wherein receiving the change comprises receiving the change as a location, orientation, or location and orientation of the two-dimensional cross-sectional rendering.

17. In a non-transitory computer readable storage medium having stored therein data representing instructions executable by a programmed processor for supporting multiple users with an ultrasound server, the storage medium comprising instructions for:

communicating, wirelessly, with multiple ultrasound transducer probes;

operating a separate instance of an image processing and control system for each of the ultrasound transducer probes; and

image processing, for each of the image processing and control systems as part of the operating, data from the ultrasound transducer probes.

18. The non-transitory computer readable storage medium of claim 17 wherein operating comprises operating the separate instances in separate respective virtual machines.

19. The non-transitory computer readable storage medium of claim 17 wherein operating comprises sharing hardware resources of a server among the separate instances based on idle and active status of the transducer probes.

20. The non-transitory computer readable storage medium of claim 17 wherein image processing comprise generating images with tiles and updating only sub-sets of the tiles for subsequent images.

21. The non-transitory computer readable storage medium of claim 17 wherein image processing comprises beamforming channel data from the ultrasound transducer probes, wherein communicating further comprises transmitting images to tablet displays separate from and paired with the ultrasound transducer probes, and wherein operating comprises controlling the image processing and the ultrasound transducer probes based on user inputs from the tablet displays.

22. A system for supporting multiple users with ultrasound processing, the system comprising:

a plurality of ultrasound probes configured to scan patients and wirelessly output channel data;

a plurality of tablet displays paired with the ultrasound probes, each of the tablet displays configured to operate as a user input for control of the paired ultrasound probe;

a server configured to receive the channel data from the ultrasound probes, beamform the channel data, create images from the beamformed channel data as a function of the user input from the tablet displays, and transmit the images to the tablet displays, and configured to control the ultrasound probes as a function of the user input.

23. The system of claim 22 wherein the tablet displays each comprise a cache configured to store tiles of displayed images, the server configured to create the images in tiles and avoid transmitting tiles for parts of the images that do not change over time, the tablet displays configured to create displays assembled from the tiles in cache from the displayed images and from tiles updated by the server, the tiles being specific to type of scan mode.

24. The system of claim 22 wherein the ultrasound probes, tablet displays, or ultrasound probes and tablet displays comprise one or more input sensors comprising touch sensors, video cameras, gyroscopes, accelerometers, inertia sensors, or combinations thereof, and wherein the server is configured to determine resource allocation as a function of input from the input sensors.

25. The system of claim 22 wherein the server is configured to produce data derived from images and associated metadata.