Optimized image delivery over limited bandwidth communication channels

• US 10,356,211 B2
• Filed: 08/27/2017
• Issued: 07/16/2019
• Est. Priority Date: 12/27/2000
• Status: Expired due to Term

• Current Assignee: Bradium Technologies LLC (General Patent Corporation)
• Original Assignee: Bradium Technologies LLC (General Patent Corporation)
• Inventors: Levanon, Isaac, Lavi, Yonatan
• Primary Examiner(s): Lazaro, David R
• Application Number:
  US15/687,513
• Publication Number:
  US 20180084082A1
• Time in Patent Office: 688 Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 3/4092 Image resolution transcoding, e.g. by using client-server architectures
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context

Abstract

Large-scale images are retrieved over network communications channels for display on a client device by selecting an update image parcel relative to an operator controlled image viewpoint to display via the client device. A request is prepared for the update image parcel and associated with a request queue for subsequent issuance over a communications channel. The update image parcel is received from the communications channel and displayed as a discrete portion of the predetermined image. The update image parcel optimally has a fixed pixel array size, is received in a single and or plurality of network data packets, and were the fixed pixel array may be constrained to a resolution less than or equal to the resolution of the client device display.

Claims

1. A method of retrieving large-scale images over wireless network communications channel for display on a wireless portable device, the method comprising:

issuing a first request from the wireless portable device to a remote computer, the first request being for a first update data parcel, the first update data parcel and a second update data parcel being selected based on a same operator controlled image viewpoint on the wireless portable device relative to a predetermined image, the first update data parcel and the second update data parcel comprising data that is used to generate a display on the wireless portable device for the same operator controlled viewpoint;

processing source image data of the predetermined image to obtain a series K1-N of derivative images of progressively lower detail level, the step of processing being performed on the remote computer, wherein the step of processing comprises subdividing image Ko of the series into a regular array of data parcels that includes the first and the second update data parcels, wherein the step of processing further comprises compressing each data parcel of the regular array of data parcels, and wherein the step of processing further comprises storing each data parcel of the regular array of data parcels on the remote computer such that a data parcel of the regular array of data parcels can he located by specification of a set of (KD, X, Y) values that represents a data set detail level index D and image array coordinates;

receiving the first update data parcel sent in response to the first request from the remote computer over the wireless network communications channel, wherein the step of receiving the first update data parcel is performed by the wireless portable device;

displaying an image on the wireless portable device using the first update data parcel received by the wireless portable device, wherein the first update data parcel uniquely forms a discrete portion of the predetermined image with respect to the same operator controlled image viewpoint;

issuing a second request from the wireless portable device to the remote computer, the second request being for a the second update data parcel; and

receiving the second update data parcel sent in response to the second request from the remote computer over the wireless network communications channel, wherein the step of receiving the second update data parcel is performed by the wireless portable device;

wherein the first and second update data parcels are requested and received through a local embedded server, the local embedded server using a local image repository to store image parcels, the local embedded server providing access to at least some image parcels;

wherein the wireless portable device issues data parcel requests according to assigned priority values of the data parcel requests, the method further comprising determining the assigned priority values based on image detail level of the data parcels selected for same operator controlled image viewpoint.

2. The method of claim 1, wherein the wireless portable device is selected from the group consisting of a mobile computer system, a cellular computer system, a handheld computer system, a personal digital assistants, and an internet-capable digital phone.

3. The method of claim 1, wherein the wireless network communications channel is a packetized wireless network communications channel, and wherein the first update data parcel is received by the wireless portable device from the packetized wireless network communications channel in one or more data packets.

4. The method of claim 1, wherein the wireless network communications channel is a packetized wireless network communications channel, the method further comprising transmitting the data parcels of the regular array of data parcels from the remote computer to the wireless portable device in compressed form obtained in the step of processing.

5. The method of claim 4, wherein the first update data parcel comprises pixel data in a fixed size array independent of pixel resolution of the predetermined image.

6. The method of claim 1, wherein the wireless portable device issues data parcel requests according to prioritization from among a plurality of parcels selected for same operator controlled image viewpoint.

7. The method of claim 6, wherein there is a non-empty overlap area between areas of the first and the second data parcels, the second data parcel has detail level greater than the first data parcel, and the first data parcel is retrieved earlier than the second data parcel according to the prioritization, and at least a portion of the first data parcel is displayed in the non-empty overlap area before any data from the second data parcel, whereby enabling local enhancement of detail level in the overlap area.

8. The method of claim 1, wherein the step of issuing the first request and the step of issuing the second request occur at least in part concurrently, and the step of receiving the first update data parcel and the step of receiving the second update data parcel occur at least in part concurrently, thereby enabling efficient use of network bandwidth in conditions of network latency;

and wherein number of concurrently pending requests for data parcels for display on the wireless portable device at any time is limited to a pending requests maximum number.

9. A wireless portable device for displaying large-scale images retrieved over a wireless network channel, the wireless portable device comprising:

a display of defined screen resolution for displaying a defined image;

a memory providing for storage of a plurality of image data parcels displayable over respective portions of a mesh corresponding to the defined image;

a wireless network channel interface supporting retrieval of a first defined data parcel of the defined image and a second defined data parcel of the defined image over the wireless network channel;

a processor coupled to the display, the memory, and the wireless network channel interface, the processor being configured to select the first and the second defined data parcels for a same operator controlled viewpoint, retrieve the first defined data parcel via the wireless network channel interface, store the first defined data parcel in the memory, and render the first defined data parcel over a discrete portion of the mesh according to the same operator controlled image viewpoint to provide for detail level enhancement of the defined image on the display;

a local embedded server, the local embedded server using a local image repository to store image parcels, the local embedded server providing access to at least some image parcels, the retrieval of data parcels occurs through the local embedded server;

wherein the wireless portable device is coupled over the wireless network channel to a remote computer;

wherein the remote computer is configured to store a regular arrays of data parcels resulting from processing of source image data of a predetermined image to obtain a series K1-N of derivative images of progressively lower detail level, wherein the processing of the source image data comprises subdividing each respective image K of the series into a the regular array of data parcels, the regular arrays of data parcels comprising the first defined data parcel and the second defined data parcel, wherein the processing of the source image data further comprises compressing each data parcel of the regular array of data parcels, and wherein the processing of the source image data further comprises storing each data parcel of the regular array on the remote computer such that a data parcel of the regular array of data parcels can be located by specification of a set of (K_D, X, Y) values that represents data set detail level index D and image array coordinates;

wherein the processor is further configured to retrieve data parcels according to assigned priority values of the data parcels selected for the same operator controlled image viewpoint and to determine the assigned priority values based on image detail level of the data parcels.

10. The wireless portable device of claim 9, wherein selection of the defined data parcels is limited so that image detail level of selected defined data parcels is less than or equal to the defined screen resolution.

11. The wireless portable device of claim 9, wherein the processor is further configured to define the same operator controlled image viewpoint relative to the defined image in response to user navigation commands provided by a user, and to prioritize retrieval of the data parcels from among a plurality of parcels selected for the same operator controlled image viewpoint.

12. The wireless portable device of claim 9, wherein the wireless portable device includes functionality of at least one type of wireless portable devices selected from the group consisting of mobile computer systems, cellular computer systems, handheld computer systems, personal digital assistants, and internet-capable digital phones.

13. The wireless portable device of claim 9, wherein there is a non-empty overlap area between areas of the first and the second defined data parcels, the second defined data parcel has level of details greater than the first defined data parcel, and the processor is configured to prioritize retrieval and display for the image viewpoint such that the first defined data parcel is at least partially displayed in the non-empty overlap area before the second defined data parcel, therefore enabling local enhancement of detail level.

14. The wireless portable device of claim 9, wherein retrieval of the first defined data parcel and retrieval of the second defined data parcel by the processor occur at least in part concurrently, thereby enabling efficient use of network bandwidth in conditions of network latency;

and

wherein number of concurrently pending retrievals of data parcels by the processor for the display is limited to a pending retrievals maximum number.