Systems and methods for interactive image data acquisition and compression

• US 5,432,871 A
• Filed: 08/04/1993
• Issued: 07/11/1995
• Est. Priority Date: 08/04/1993
• Status: Expired due to Fees

• Current Assignee: Universal Systems & Technology, Inc. (Martin Marietta Corporation)
• Original Assignee: Universal Systems & Technology, Inc. (Martin Marietta Corporation)
• Inventors: Novik, Dmitry A.
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): ANDERSON, DAVID
• Application Number:
  US08/101,057
• Time in Patent Office: 706 Days
• Field of Search: 382/61, 382/62, 382/54, 382/56, 382/6, 358/262.1, 358/436, 358/439, 358/442, 358/447, 358/453, 348/13, 348/17, 348/438, 348/408, 348/384, 348/399, 304/413.02, 304/413.22, 304/413.13, 128/903, 128/904
• US Class Current: 382/232
• CPC Class Codes: H04N 1/32771 in response to a request, e.g. for a particular document
• CPC Class Codes: H04N 1/3875 combined with enlarging or reducing enlarging or reducing per se H04N1/393
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 2201/3226 of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image

Abstract

An interactive image data transmission system uses the expertise of an image end user distant from the image collection point. An image with a wide angle field of view is transmitted to the end user in lossy-compressed form. The image is displayed at the receiving end with errors introduced by the lossy compression. The end user can select and specify a narrowed field of view, and the image capturing parameters are modified as necessary under end user control to capture a desired image of the narrow view field. The transmitting station transmits a lossy compressed version of the narrow view image which is displayed for the user, and the user selects at least one window of definite interest within the image. Then, additional image data sufficient to provide a correct display within the window(s) of interest is transmitted to the receiving station and the display is updated within the window(s). The additional data may be difference data in a variable length diagonal code.

Claims

1. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:

transmitting a user request for image data to the transmitting station;

obtaining a digitized image data set in a computing device at the transmitting station, said image data set defining an image with a spatial resolution;

performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;

storing the lossy compressed image data set at the transmitting station;

transmitting the lossy compressed image data set to a computing device at the receiving station with the same said spatial resolution as the digitized image data set;

decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;

displaying the lossy decompressed image data set on a display device visible to the user at the receiving station, in the form of an image having the said spatial resolution;

providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;

monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;

transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest, but inhibiting the performance of this step until the user interactively requests an accurate reproduction of the original image data in the currently selected window of interest;

using said additional image data received at the receiving station after the user requests an accurate reproduction of the original image data in the currently selected window of interest, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set, while maintaining the same said spatial resolution in the window of interest.

2. The method of claim 1 wherein the user request for image data includes a specification of initial image transmission parameters.

3. The method of claim 2 wherein the user request for image data specifies a desired image quality of the lossy compressed image data set.

4. The method of claim 3 wherein the user request for image data specifies a variable data compression ratio for initial data transmission.

5. The method of claim 2 wherein the user request for image data specifies a first spectral response for the initial image and including the further steps of:

receiving a user input selecting a second spectral response different from said first spectral response and transmitting information requesting said second spectral response to the transmitting station; and

transmitting, from the transmitting station to the receiving station, additional image data for said window of interest to provide a display having said second spectral response within said window of interest.

6. The method of claim 1 wherein a group of windows of interest are selected in different areas of the image and information defining the group of windows is transmitted to the transmitting station to cause transmission to the receiving station of additional image data pertaining to all of said windows in said group.

7. The method of claim 1 wherein said additional image data is a transmission of the portion of the original digitized data set defining the image in the window of interest.

8. The method of claim 7 including the further steps of losslessly compressing the additional image data at the transmitting station before transmission, and decompressing the received losslessly compressed additional image data at the receiving station.

9. The method of claim 1 comprising the further steps of:

providing an input device permitting the user at the receiving station to select a direction of interest;

receiving a user selected direction of interest different from a direction of collection of the digitized image data set and transmitting the selected direction of interest to the transmitting station, following the display of the lossy decompressed image data set at the receiving station;

obtaining a new digitized image data set at the transmitting station, collected in the specified direction of interest; and

repeating the steps of performing a lossy compression operation, transmitting the lossy compressed image data set, decompressing the image data set, and displaying the image data set using the new digitized image data set collected in the direction of interest before receiving the user selection of the window of interest.

10. The method of claim 1 wherein the transmitting station is located at a first geographic location and the receiving station is located at a second geographic location distinct from said first geographic location.

11. The method of claim 1 wherein the communications channel includes a transmission channel on a communications network linking a plurality of distant stations.

12. The method of claim 11 wherein the communications channel includes a telephone transmission link.

13. The method of claim 1 wherein the communications channel comprises a wireless communications link.

14. The method of claim 13 wherein the communications channel comprises a satellite communication link.

15. The method of claim 1 wherein the communications channel comprises a local area network link.

16. The method of claim 1 wherein said digitized image data set represents a single image and said window of interest specifies a portion of interest within said single image.

17. The method of claim 1 wherein said lossy decompressed image data set has the same number of pixels as the original digitized image data set.

18. The method of claim 1 wherein the user can selectively vary a shape of the selected window and said information transmitted to the transmitting station defining the window of interest includes information defining the selected shape of the window.

19. The method of claim 1 wherein said lossy decompressed image data set has the same pixel resolution as the digitized image data set prior to transmission.

20. The method of claim 1 comprising the further step of:

until the user requests enhancement of the window of interest to accurately reproduce the original image data, repeating the step of receiving a user selection of a window of interest, and in response to the selection, generating and transmitting a new lossy compressed image data set to provide a zoom image at the receiving station relating to the selected window of interest.

21. The method of claim 1 wherein the steps of receiving the user selection of the window of interest and transmitting information defining the window of interest to the transmitting station constitute the interactive instruction by the user to request an accurate reproduction of the original image data in the selected window of interest.

22. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:

transmitting a user request for image data to the transmitting station;

obtaining a digitized image data set in a computing device at the transmit fine station;

performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;

transmitting the lossy compressed image data set to a computing device at the receiving station;

decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;

displaying the lossy decompressed image data set on a display device visible to the user at the receiving station;

providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;

monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;

transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;

using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set, wherein said additional image data is difference data defining changes required to correct errors in the lossy decompressed image data set arising from the lossy compression operation and subsequent decompression; and

inhibiting the performance of the steps of transmitting additional image data and enhancing the display image until the user interactively indicates that an accurate reproduction of the original image data is desired in the currently selected window of interest.

23. The method of claim 22 wherein said difference data is encoded in a variable length diagonal code prior to said transmission.

24. The method of claim 22 including the further steps of losslessly compressing the additional image data at the transmitting station before transmission, and decompressing the received losslessly compressed additional image data at the receiving station.

35. The system of claim 24 wherein the communications channel includes a telephone transmission link.

25. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:

transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station, said original image data set defining an image having a spatial resolution, performing a lossy compression operation on the digitized image data set to produce a lossy compressed image data set defining an image having the same said spatial resolution as the original image data set, and storing said lossy compressed image data set at the transmitting station;

transmitting means for transmitting the lossy compressed image data set to the receiving station;

receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set, and displaying the lossy decompressed image data set as an image on a display device visible to the end user at the receiving station with the same said spatial resolution;

command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;

image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;

update inhibiting means for receiving a user command at the receiving station indicating that an accurate reproduction of the original image data is desired in the currently selected window of interest, and until said command is received, inhibiting the operation of said image updating means to transmit said additional image data pertaining exclusively to the image within said window of interest; and

window display enhancing means associated with said receiving station computing means for receiving said additional image data and, while maintaining the display of the window of interest at the same said spatial resolution, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original image data.

26. The system of claim 25 wherein the means for transmitting a user request includes means for specifying desired initial image transmission parameters.

27. The system of claim 26 wherein the means for transmitting a user request includes means for specifying a desired image quality of the lossy compressed image data set.

28. The system of claim 27 wherein the user request for image data specifies a variable data compression ratio for initial data transmission.

29. The system of claim 26 wherein the means for transmitting a user request includes means for specifying a spectral response for the initial image transmission and means for specifying a different spectral response for a subsequent image transmission of data within the selected window of interest.

30. The system of claim 25 wherein the command receiving means includes means for receiving end user selections of a window group comprising a plurality of windows of interest in different areas of the image and transmitting specifications of said group of windows of interest to the transmitting station.

31. The system of claim 25 wherein the image updating means comprises means for transmitting a portion of the original digitized data set defining the image in the window of interest as said additional data.

32. The system of claim 31 wherein the image updating means further comprises means for losslessly compressing the additional image data at the transmitting station before transmission, and the window display enhancing means further includes means for decompressing received losslessly compressed additional image data at the receiving station.

33. The system of claim 25 further comprising:

reorientation control means associated with the receiving station for receiving a selection of a direction of interest following display of the lossy compressed image data set; and

direction adjustment means associated with the transmitting station computing means for receiving a user selected direction of interest different from a direction of collection of the digitized image data set, obtaining a new digitized image data set collected in the specified direction of interest, performing a lossy compression operation on the new digitized image data set, and activating the transmitting means to transmit results of the lossy compression operation on the new digitized image data set to the receiving station.

34. The system of claim 25 wherein the transmitting station is located at a first geographic location and the receiving station is located at a second geographic location distinct from said first geographic location.

36. The system of claim 25 wherein the communications channel includes a transmission channel on a communications network linking a plurality of distant stations.

37. The system of claim 25 wherein the communications channel comprises a wireless communications link.

38. The system of claim 37 wherein the communications channel comprises a satellite communication link.

39. The system of claim 25 wherein the communications channel comprises a local area network link.

40. The system of claim 25 wherein said digitized image data set represents a single image and said window of interest specifies a portion of interest within said single image.

41. The system of claim 25 wherein said lossy decompressed image data set has the same number of pixels as the original digitized image data set.

42. The system of claim 25 wherein the command receiving means comprises window shape varying means for receiving a user instruction to vary a shape the selected window and transmitting information defining the selected shape of the window of interest to the transmitting station.

43. The system of claim 25 wherein said lossy decompressed image data set has the same pixel resolution as the digitized image data set prior to transmission.

44. The system of claim 25 further comprising zooming means, operating at the transmitting station, for receiving a zoom command from the user and sequentially actuating the image updating means and window enhancement means to generate and transmit a new lossy compressed zoom image to the receiving station relating to the currently selected window of interest.

45. The system of claim 25 wherein the update inhibiting means is connected with the command receiving means such that the operation of the command receiving means to receive the user selection of the window of interest and transmit information defining the window of interest to the transmitting station constitutes an interactive instruction by the user to request an accurate reproduction of the original image data in the selected window of interest.

46. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:

transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station and performing a lossy compression operation on the digitized image data set to produce a lossy compressed image data set;

transmitting means for transmitting the lossy compressed image data set to the receiving station;

receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set and displaying the lossy decompressed image data set as an image on a display device visible to the end user at the receiving station;

command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;

image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;

wherein the image updating means further comprises difference data computing means for computing difference data defining changes required to correct errors in the lossy decompressed image data set arising from the lossy compression operation and subsequent decompression, and said image updating means includes means for transmitting said difference data as said additional data;

update inhibiting means for receiving a user command at the receiving station indicating that an accurate reproduction of the original image data is desired in the currently selected window of interest; and

until said command is received, inhibiting the operation of said image updating means to transmit said additional image data pertaining exclusively to the image within said window of interest; and

window display enhancing means associated with said receiving station computing means for receiving said difference data and enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original image data.

47. The system of claim 46 wherein the image updating means further comprises encoding means for encoding said difference data in a variable length diagonal code prior to said transmission.

48. The system of claim 46 wherein the image updating means further comprises means for losslessly compressing the additional image data at the transmitting station before transmission, and the window display enhancing means further includes means for decompressing received losslessly compressed additional image data at the receiving station.

49. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:

transmitting a user request for image data to the transmitting station;

obtaining a digitized image data set in a computing device at the transmitting station;

performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;

storing the transmitted lossy compressed image data set at the transmitting station;

transmitting the lossy compressed image data set to a computing device at the receiving station;

decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;

displaying the lossy decompressed image data set on a display device visible to the user at the receiving station;

providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;

monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;

transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;

using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set; and

until the user indicates that an accurate reproduction of the original image data is desired in the currently selected window of interest, inhibiting the performance of the additional image data transmission and display enhancing steps and iteratively;

generating and transmitting, from the transmitting station to the receiving station, a new lossy compressed image data set relating to the window of interest, decompressing and displaying the lossy compressed image data set for the new image data set relating to the window of interest, and receiving user modifications of the specification of the window of interest.

50. A system for interactively transmitting detailed image data over a communications channel extending between a transmitting station and a receiving station under the control of an end user, comprising:

transmitting station computing means for receiving an end user request for image data, obtaining an original digitized image data set at the transmitting station and performing a lossy compression operation on the digitized image data set to produce a lossy compressed image data set;

storage means for storing the transmitted lossy compressed image data set at the transmitting station;

transmitting means for transmitting the lossy compressed image data set to the receiving station;

receiving station computing means for receiving the lossy compressed image data set, decompressing the lossy compressed image data set to produce a lossy decompressed image data set, and displaying the lossy decompressed image data set as an image on a display device visible to the end user at the receiving station;

command receiving means for receiving a selection by the end user of at least one window of interest within the displayed image and transmitting information defining the window of interest to the transmitting station;

image updating means associated with the transmission station computing means for receiving said information defining the window of interest and transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest; and

window display enhancing means associated with said receiving station computing means for receiving said additional image data and enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original image data; and

window selection iterating means associated with the transmitting station for receiving the window of interest information from the command receiving means, and until the user indicates that an accurate reproduction of the original image data is desired within the currently selected window of interest, iteratively inhibiting the operation of the image updating means and window display enhancing means, generating a new lossy compressed image data set defining an image within the window of interest, transmitting the new lossy compressed image data set to the receiving station computing means for display, and receiving a new window of interest selection from the user.

51. An interactive method of transmitting detailed image data to a user over a communications channel extending between a transmitting station and a receiving station, comprising the steps of:

transmitting a user request for image data to the transmitting station;

obtaining a digitized image data set in a computing device at the transmitting station;

performing a lossy compression operation on the digitized image data set, using the transmitting station computing device, to produce a lossy compressed image data set;

storing the lossy compressed image data set at the transmitting station;

transmitting the lossy compressed image data set to a computing device at the receiving station;

decompressing the lossy compressed image data set at the receiving station, using the receiving station computing device, to produce a lossy decompressed image data set;

displaying the lossy decompressed image data set on a display device visible to the user at the receiving station;

providing an input device permitting the user at the receiving station to select at least one window of interest within the displayed image data set;

monitoring the input device to receive a user selection of the window of interest and transmitting information defining the window of interest to the transmitting station;

transmitting, from the transmitting station to the receiving station, additional image data pertaining exclusively to the image within said window of interest;

using said additional image data, enhancing the displayed image within the window of interest to produce a display within the window of interest which accurately reproduces the original digitized image data set; and

until the user interactively indicates that an accurate reproduction of the original image data is desired in the currently selected window of interest, inhibiting the performance of the additional image data transmission and display enhancing steps.