Image viewing station for picture archiving and communications systems (PACS)

• US 4,833,625 A
• Filed: 07/09/1986
• Issued: 05/23/1989
• Est. Priority Date: 07/09/1986
• Status: Expired due to Term

• Current Assignee: Arizona State of University
• Original Assignee: University of Arizona
• Inventors: Lamoreaux, Richard D., McNeil, Kevin M., Fisher, Henry D., Vercillo, Richard
• Primary Examiner(s): Harkcom, Gary V.
• Assistant Examiner(s): Lacasse, Randy W.
• Application Number:
  US06/883,731
• Time in Patent Office: 1,049 Days
• Field of Search: 364/518, 364/523, 358/111, 340/728, 340/731
• US Class Current: 345/668
• CPC Class Codes: H04N 1/2179 Interfaces allowing access to a plurality of users, e.g. connection to electronic image libraries
• CPC Class Codes: H04N 1/32358 using picture signal storage, e.g. at transmitter H04N1/17 takes precedence
• CPC Class Codes: H04N 1/32491 alternate storage in and retrieval from two parallel memories, e.g. using ping-pong buffers
• CPC Class Codes: H04N 1/3935 with modification of image resolution, i.e. determining the values of picture elements at new relative positions
• CPC Class Codes: H04N 2201/0087 Image storage device
• CPC Class Codes: H04N 2201/0089 Image display device
• CPC Class Codes: H04N 2201/3287 Storage of at least one complete document page or image frame
• CPC Class Codes: H04N 2201/3288 Storage of two or more complete document pages or image frames

Abstract

An image reviewing station for a picture archiving and communication system (PACS), having two functions of user interface and display of an image wherein base memory, image processor, and display memory architecture is used. The digitized image data at any size from any different modalities is stored in base memory in an original format, and read-out signals are processed appropriately in the image processor responsive to the command signals input by the user. The processed image data is then stored in a display memory before being supplied to a display via a digital-to-analog converter for the display. It provides the user with extensive, concise and easy interactive image manipulation and processing capabilities.

Claims

1. An image viewing system comprising:

first memory for storing raw image data corresponding to plural images to be displayed;

image processing means coupled to said memory means for performing predetermined processing operations on said raw image data and for providing corresponding display data, said image processing means including,

zoom means responsive to said stored raw image data for obtaining values of estimated image data at points along a line between said data by a fractional bilinear interpolating between the values of said raw image data to produce selectably continuous magnification or minification of the image;

second memory means coupled to said image processing means for storing the display data processed by said image processing means;

user input means for generating input signals indicative of selected images and image formats to be viewed;

display means coupled to said second memory means for displaying images based on the display signals stored in said second memory means; and

control processing means connected through an internal bus to said first memory means, image processing means, and second memory means for producing control signals responsive to said input signals from said user input means for controlling transfer of raw image data corresponding to selected images to be displayed from the first memory means to the image processing means, processing thereof by said image processing means, storage of the processed display signals into the second memory means, and transfer of the stored display signals to said display means for display of the user selected image.

2. An image viewing system, comprising:

first memory means for storing raw image data corresponding to a plurality of images to be displayed;

image processing means coupled to said first memory means for reading raw image data corresponding to selected of the images from said first memory means and performing selected processing operations on said raw image data to produce corresponding display data, said image processing means comprising zoom means for performing a fractional bilinear interpolation between values of image data representative of an image to produce selectably continuous magnification of minification of the image;

second memory means coupled to said image processing means for storing the display data;

display means coupled to said second memory means for displaying images and graphics represented by the display data;

user input means for generation input signals selecting particular images to be displayed by said display means and for selecting the processing operations to be performed by said image processing means;

control processing means coupled through an internal bus to said first memory means, said image processing means and said second memory means for producing control signals in response to said input signals for controlling transfer of raw image data corresponding to selected images to be displayed from the first memory means to the image processing means, processing thereof by said image processing means, storage of the processed display signals into the second memory means, and transfer of the stored display signals to said display means for display of the user selected image.

3. A system according to claim 2, wherein:

said first memory means comprises;

disk drive memory means for storing raw image data corresponding to a plurality of images; and

base memory means coupled to said disk drive memory means via said internal bus for storing raw image data corresponding to images most recently selected for display, said base memory means having an output port coupled to said image processing means whereby raw image data corresponding to images selected for display are transferred to said image processing means; and

said control processor means comprises means for controlling transfer of raw image data between said base memory means and said disk drive memory means in response to said input signals.

4. A system according to claim 3, wherein said base memory means comprises:

an array of random access memories defining plural data storage planes which are independently accessible so that graphics data and raw image data can be read from and written into selected of said data planes without affecting the raw image data stored in the other of said data planes.

5. A system according to claim 4, wherein:

said base memory comprises at least one multi-bit port for accessing the data storage planes of said array during reading and writing of raw image data from and into, respectively, said array; and

said control processor means comprises a control register for defining in correspondence with said input signals which of the bits of said multi-bit port respectively define raw image data and raw graphics data and which of the bits of said multi-bit port are involved in a read/write operation.

6. A system according to claim 4, wherein said base memory means comprises:

a double buffer random access memory for transferring raw image data from said array of random access memories to said image processing means via an output port.

7. A system according to claim 6, wherein said base memory means comprises an input port for receiving raw image and graphics data from an external communications network system.

8. A system according to claim 7, wherein said first memory means comprises:

a disk having plural cylinders and plural tracks per cylinder, wherein each track is formatted as a single data sector and an automatic track switch occurs once a revolution of the disk drive at an index pulse produced by the disk drive, and wherein an automatic seek to a next cylinder occurs after data stored on the last track of a cylinder is transferred.

9. A system according to claim 8, wherein said image processing means comprises:

subtractor means coupled to said first memory means for forming a difference between image signals corresponding to corresponding pixels of corresponding images.

10. A system according to claim 9, wherein said image processing image comprises:

a look-up table coupled to an output of said substractor means for converting image data of different modalities defined by different resolutions to a common resolution.

11. A system according to claim 10, wherein said look-up table is partially addressable in response to said control signals to vary the contrast of an image to be displayed.

12. A system according to claim 11, wherein said look-up table is partially addressable by said control signals to convert unsigned binary image data to two'"'"'s complement table,

13. A system according to claim 12, wherein said image processing means comprises:

variable spatial filtering means coupled to an output of said look-up table means for filtering image data in a range varying from low-pass filtering to high-pass filtering in response to said control signals.

14. A system according to claim 12, wherein said variable spatial filter means comprises:

a 32 delay finite impulse response (FIR) filter.

15. A system according to claim 13, wherein said zoom means is coupled to an output of said spatial filtering means.

16. A system according to claim 15, wherein said zoom means comprises:

means for producing interpolated image data for each pixel of a magnified image based on the weighted sum of grey levels present at each pixel'"'"'s four nearest neighboring pixels, based on the following relationship;

space="preserve" listing-type="equation">G=A+X(B-A)+Y(C-A)+XY(D-C-B+A),

where G represents image data of a pixel of a magnified image, A, B, C and D are the grey levels of image data of the four nearest neighboring pixels and X and Y are predetermined coefficients determined in response to said control signals to produce a predetermined magnification.

17. A system according to claim 16, wherein said zoom means in order to minify an image further comprises:

means for computing said coefficients X and Y to produce a predetermined image magnification, and means for discarding predetermined pixel image data to perform a division to a selected level of minification.

18. A system according to claim 17, wherein said image processing means comprises:

a histogram generator coupled to an output of said subtractor means for computing a histogram of gray levels represented by the image data associated with an image.

19. A system according to claim 17, wherein said second memory means comprises:

a pair of random access memories interconnected in a double buffer configuration between said image processing means and said display means such that display signals are written into one of said pair from the image processing means while display signals are read out to the display means from the other of said pair.

20. A system according to claim 19, wherein said input means comprises:

a touch screen command video monitor for displaying a command menu and for producing input signals indicative of a user'"'"'s touching of selected commands displayed on said touch screen command video monitor.

21. A system according to claim 20, wherein said input means comprises:

means for storing a list of images stored in said first memory means;

said touch screen command video monitor coupled to said storing means for displaying said list of stored image; and

trackball selection means for selecting an image to be displayed from the image list displayed on said touch screen command video monitor.

22. A system according to claim 20, wherein;

said display means comprises at least one touch screen display video monitor for displaying selected images; and

said input means comprises means for selecting an image for further processing and display based on a user'"'"'s touching of the selected image on the display video monitor.

23. A system according to claim 22, wherein:

said command menu displayed on said command video monitor includes a command for moving the location of a displayed image on the display video monitor,

said display video monitor includes means for producing location signals indicative of the last location at which the display video monitor is touched after a user touches an image to be moved and slidingly maintains contact with the screen while changing the location of screen touching, and

said control processing means includes means for producing location control signals indicative of the location of said last location so that the image data is re-stored in said second memory means and re-displayed at said last location.

24. A system according to claim 23, wherein said command menu comprises an image shuffling command by which a user can command the control processor means to automatically sequentially retrieve from said first memory means image data corresponding to respective images previously selected by the user for display, said control processor means being programmed to control said first memory means, said image processing means and said display means to shuffle through the previously selected images such that the previously selected images are sequentially each displayed in their entirety, said input means comprising means for stopping shuffling of images when a selected of the previously selected images is being displayed by said display means.

25. A system according to claim 4, wherein said base memory means comprises an input port for receiving raw image data from an external communications network system.

26. A system according to claim 2, wherein said first memory means comprises:

a disk drive having plural cylinders and plural tracks per cylinder, wherein each track is formatted as a single data sector and an automatic track switch occurs once a revolution of the disk drive at an index pulse produced by the disk drive, and wherein an automatic seek to a next cylinder occurs after data stored on the last track of a cylinder is transferred,

27. A system according to claim 2, wherein said image processing means comprises:

first address generator means for generating under the control of said control signals address signals applied to said first memory means for reading selected raw image data from the first memory means; and

second address generator means for generating address signals for storing processed display signals into selected locations in said second memory means and for reading out display signals stored in said second memory means for transfer to and display by said display means.

28. A system according to claim 2, wherein said image processing means comprises:

subtractor means coupled to said first memory means for forming a difference between image signals corresponding to corresponding pixels of corresponding images.

29. A system according to claim 28, wherein said image processing image comprises:

a look-up table coupled to an output of said substractor means for converting image data of different modalities defined by different resolutions to a common resolution.

30. A system according to claim 29, wherein said look-up table is partially addressable in response to said control signals to vary the contrast of an image to be displayed.

31. A system according to claim 30, wherein said look-up table is partially addressable by said control signals to convert unsigned binary image data to two'"'"'s complement table.

32. A system according to claim 31, wherein said image processing means comprises:

variable spatial filtering means coupled to an output of said look-up table means for filtering image data in a range varying from low-pass filtering to high-pass filtering in response to said control signals.

33. A system according to claim 32, wherein said variable spatial filter means comprises:

a 32 delay finite impulse response (FIR) filter.

34. A system according to claim 32, wherein said zoom means is coupled to an output of said spatial filtering means.

35. A system according to claim 34, wherein said zoom means comprises:

means for producing interpolated image data for each pixel of a magnified image based on the weighted sum of grey levels present at each pixel'"'"'s four nearest neighboring pixels, based on the following relationship;

space="preserve" listing-type="equation">G=A+X(B-A)+Y(C-A)+XY(D-C-B+A),

where G represents image data of a pixel of a magnified image, A, B, C and D are the grey levels of image data of the four nearest neighboring pixels, and X and Y are predetermined coefficients determined in response to said control signals to produce a predetermined magnification.

36. A system according to claim 35, wherein said zoom means in order to minify an image further comprises:

means for computing said coefficients X and Y to produce a predetermined image magnification, and means for discarding predetermined pixel image data to perform a division to a selected level of minification.

37. A system according to claim 28, wherein said image processing means comprises:

a histogram generator coupled to an output of said subtractor means for computing a histogram of gray levels represented by the image data associated with an image.

38. A system according to claim 2, wherein said image processing image comprises:

a look-up table for converting image data of different modalities defined by different resolutions to a common resolution.

39. A system according to claim 38, wherein said look-up table is partially addressable in response to said control signals to vary the contrast of an image to be displayed.

40. A system according to claim 39, wherein said look-up table is partially addressable by said control signals to convert unsigned binary image data to two'"'"'s complement table.

41. A system according to claim 2, wherein said image processing means comprises:

variable spatial filtering means for filtering image data in a range varying from low-pass filtering to high-pass filtering in response to said control signals.

42. A system according to claim 14, wherein said variable spatial filter means comprises:

a 32 delay finite impulse response (FIR) filter.

43. A system according to claim 2, wherein said zoom means comprises:

means for producing interpolated image data for each pixel of a magnified image based on the weighted sum of grey levels present at each pixel'"'"'s four nearest neighboring pixels, based on the following relationship;

space="preserve" listing-type="equation">G=A+X(B-A)+Y(C-A)+XY(D-C-B+A),

where G represents image data of a pixel of a magnified image, A, B, C and D are the grey levels of image data of the four nearest neighboring pixels and X and Y are predetermined coefficients determined in response to said control signals to produce a predetermined magnification.

44. A system according to claim 43, wherein said zoom means in order to minify an image further comprises:

means for computing said coefficients X and Y to produce a selected image magnification, and means for discarding predetermined pixel image data to perform a division to a selected level of minification.

45. A system according to claim 2, wherein said image processing means comprises:

a histogram generator for computing a histogram of gray levels represented by the image data associated with an image.

46. A system according to claim 2, wherein said second memory means comprises:

a pair of random access memories interconnected in a double buffer configuration between said image processing means and said display means such that display signals are written into one of said pair from the image processing means while display signals are read out to the display means from the other of said pair.

47. A system according to claim 2, wherein said input means comprises:

a touch screen command video monitor for displaying a command menu and for producing input signals indicative of a user'"'"'s touching of selected commands displayed on said touch screen command video monitor.

48. A system according to claim 47, wherein said input means comprises:

means for storing a list of images stored in said first memory means;

said touch screen command video monitor coupled to said storing means for displaying said list of stored image; and

trackball selection means for selecting an image to be displayed from the image list displayed on said touch screen command video monitor.

49. A system according to claim 47, wherein:

said display means comprises at least one touch screen display video monitor for displaying selected images; and

said input means comprises means for selecting an image for further processing and display based on a user'"'"'s touching of the selected image on the display video monitor.

50. A system according to claim 49, wherein:

said command menu displayed on said command video monitor includes a command for moving the location of a displayed image on the display video monitor,

said display video monitor includes means for producing location signals indicative of the last location at which the display video monitor is touched after a user touches an image to be moved and slidingly maintains contact with the screen while changing the location of screen touching, and

said control processing means includes means for producing location control signals indicative of the location of said last location, re-storing the image data in said second memory means, and re-displaying the image corresponding to said re-stored image data at said last location.

51. A system according to claim 47, wherein said command menu comprises an image shuffling command by which a user can command the control processor means to automatically sequentially retrieve from said first memory means image data corresponding to respective images previously selected by the user for display, said control processor means being programmed to control said first memory means, said image processing means and said display means to shuffle through the previously selected images such that the previously selected images are sequentially each displayed in their entirety, said input means comprising means for stopping shuffling of images when a selected of the previously selected images is being displayed by said display means.

52. An image viewing system, comprising:

first memory means for storing raw image data corresponding to a plurality of images to be displayed;

image processing means coupled to said first memory means for reading raw image data corresponding to selected of the image from said first memory means and performing selected processing operations on said raw image data to produce corresponding display data;

second memory means coupled to said image processing means for storing the display data;

display means coupled to said second memory means for displaying images and graphics represented by the display data;

user input means for generating input signals selecting particular images to be displayed by said display means and for selecting the processing operations to be performed by said image processing means, comprising

a touch screen command video monitor for displaying a command menu and for producing input signals indicative of a user'"'"'s touching of selected commands displayed on said touch screen command video monitor; and

control processing means coupled through an internal bus to said first memory means, said image processing means and said second memory means for producing control signals in response to said input signals for controlling transfer of raw image data corresponding to selected images to be displayed from the first memory means to the image processing means, processing thereof by said image processing means, storage of the processed display signals into the second memory means, and transfer of the stored display signals to said display means for display of the user selected image.

53. A system according to claim 52, wherein said input means comprises:

means for storing a list of images stored in said first memory means;

said touch screen command video monitor coupled to said storing means for displaying said list of stored image; and

trackball selection means for selecting an image to be displayed from the image list displayed on said touch screen command video monitor.

54. A system according to claim 52, wherein:

said display means comprises at least one touch screen display video monitor for displaying selected images; and

said input means comprises means for selecting an image for further processing and display based on a user'"'"'s touching of the selected image on the display video monitor.

55. A system according to claim 54, wherein:

said command menu displayed on said command video monitor includes a command for moving the location of a displayed image on the display video monitor,

said display video monitor includes means for producing location signals indicative of the last location at which the display video monitor is touched after a user touches an image to be moved and slidingly maintains contact with the screen while changing the location of screen touching, and

said control processing means includes means for producing location control signals indicative of the location of said last location, re-storing the image data in said second memory means and re-displaying the image corresponding to said re-stored data at said last location.

56. A system according to claim 52, wherein said command menu comprises an image shuffling command by which a user can command the control processor means to automatically sequentially retrieve from said first memory means image data corresponding to respective images previously selected by the user for display, said control processor means being programmed to control said first memory means, said image processing means and said display means to shuffle through the previously selected images such that the previously selected images are sequentially each displayed in their entirety, said input means comprising means for stopping shuffling of images when a selected of the previously selected images is being displayed by said display means.

57. An image viewing system, comprising:

first memory means for storing raw image data corresponding to a plurality of images to be displayed;

image processing means coupled to said first memory means for reading raw image data corresponding to selected of the images from said first memory means and performing selected processing operations on said raw image data to produce corresponding display data;

second memory means coupled to said image processing means for storing the display data;

display means coupled to said second memory means for displaying images represented by the display data;

said image processing means comprises means for normalizing the dynamic range of said raw image data of different images having different dynamic ranges to enable at least partially non-overlapping simultaneous display by said display means of said different images with a common dynamic range;

user input means for generating input signals selecting particular images to be displayed by said display means and for selecting the processing operations to be performed by said image processing means;

control processing means coupled through an internal bus to said first memory means, said image processing means and said second memory means for producing control signals in response to said input signals for controlling transfer of raw image data corresponding to selected images to be displayed from the first memory means to the image processing means, processing thereof by said image processing means, storage of the processed display signals into the second memory means, and transfer of the stored display signals to said display means for display of the user selected image.

58. A system according to claim 57, wherein said image processing means comprises:

subtractor means coupled to said first memory means for forming a difference between image data corresponding to corresponding pixels of corresponding images.

59. A system according to claim 57, wherein said means for normalizing comprises:

a look-up table for converting image data of different modalities defined by different resolutions to a common resolution.

60. A system according to claim 59, wherein said look-up table is partially addressable in response to said control signals to vary the contrast of an image to be displayed.

61. A system according to claim 60, wherein said look-up table is partially addressable by said control signals to convert unsigned binary image data to two'"'"'s complement table.

62. A system according to claim 57, wherein said image processing means comprises:

variable spatial filtering means for filtering image data in a range varying from low-pass filtering to high-pass filtering in response to said control signals.

63. A system according to claim 57, wherein said image processing means comprises:

zoom means for performing a fractional bilinear interpolation between values of image data representative of an image to produce continuously selectable magnification or minification of the image.

64. A system according to claim 63, wherein said zoom means comprises:

means for producing interpolated image data for each pixel of a magnified image based on the weighted sum of grey levels present at each pixel'"'"'s four nearest neighboring pixels, based on the following relationship;

space="preserve" listing-type="equation">G=A+X(B-A)+Y(C-A)+XY(D-C-B+A),

where G represents image data of a pixel of a magnified image, A, B, C and D are the grey levels of image data of the four nearest neighboring pixels and X and Y are predetermined coefficients determined in response to said control signals to produce a predetermined magnification.

65. A system according to claim 64, wherein said zoom means in order to minify an image further comprises:

means for computing said coefficients X and Y to produce a predetermined image magnification, and means for discarding selected pixel image data to perform a division to a selected level of minification.