Optimized image delivery over limited bandwidth communication channels

• US 10,367,915 B2
• Filed: 08/29/2017
• Issued: 07/30/2019
• Est. Priority Date: 12/27/2000
• Status: Expired due to Term

• Current Assignee: Bradium Technologies LLC (General Patent Corporation)
• Original Assignee: Bradium Technologies LLC (General Patent Corporation)
• Inventors: Levanon, Isaac, Lavi, Yonatan
• Primary Examiner(s): Lazaro, David R
• Application Number:
  US15/688,869
• Publication Number:
  US 20180084083A1
• Time in Patent Office: 700 Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 3/4092 Image resolution transcoding, e.g. by using client-server architectures
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context

Abstract

Large-scale images are retrieved over network communications channels for display on a client device by selecting an update image parcel relative to an operator controlled image viewpoint to display via the client device. A request is prepared for the update image parcel and associated with a request queue for subsequent issuance over a communications channel. The update image parcel is received from the communications channel and displayed as a discrete portion of the predetermined image. The update image parcel optimally has a fixed pixel array size, is received in a single and or plurality of network data packets, and were the fixed pixel array may be constrained to a resolution less than or equal to the resolution of the client device display.

Claims

1. A method of retrieving large-scale images over network communications channel for display on an internet-capable digital phone, the method comprising:

issuing a first request for a first image data parcel from the internet-capable digital phone to a remote computer, wherein the first image data parcel and a second image data parcel are selected based on a same operator controlled image viewpoint on the internet-capable digital phone relative to a predetermined image and the first and the second image data parcels contain data that are used to generate a display on the internet-capable digital phone according to the same operator controlled image viewpoint;

wherein the predetermined image is processed to obtain a series K_1-N of derivative images of progressively lower detail level, wherein each respective derivative image of the series is subdivided into a regular array wherein each resulting image data parcel of the regular array has a predetermined detail level, and wherein the resulting image data parcels are stored on the remote computer, the resulting image data parcels comprising the first and the second image data parcels;

receiving the first image data parcel from the remote computer over the network communications channels, the first image data parcel being sent by the remote computer in response to the first request;

displaying on the internet-capable digital phone at least part of the predetermined image using the first image data parcel received by the internet-capable digital phone, wherein the first image data parcel uniquely forms a discrete portion of the predetermined image according to the same operator controlled image viewpoint;

issuing a second request for the second image data parcel from the internet-capable digital phone to the remote computer; and

receiving the second image data parcel from the remote computer over the network communications channel, the second image data parcel being sent by the remote computer in response to the second request;

displaying on the internet-capable digital phone at least part of the predetermined image using the second image data parcel received by the internet-capable digital phone, wherein the second image data parcel uniquely forms a discrete portion of the predetermined image according to the same operator controlled image viewpoint;

wherein the first and the second requests are issued according to prioritization from among a plurality of image data parcels selected for same operator controlled viewpoint.

2. The method of claim 1, wherein the internet-capable digital phone issues requests for image data parcels according to assigned priority values of the requests for image data parcels selected for same operator controlled viewpoint, the assigned priority values being based on image detail level of image data parcels corresponding to the requests for data parcels.

3. The method of claim 1, further comprising storing the first image data parcel by the internet-capable digital phone so that size of the first image data parcel on the remote computer is different from size of the first image data parcel stored in the local store of the internet-capable digital phone.

4. The method of claim 1, wherein there is a non-empty overlap area between area of the first and the second image data parcels, the second image data parcel has detail level greater than the first image data parcel, and the first image data parcel is retrieved earlier than the second update data parcel according to the prioritization, and at least a portion of the first image data parcel is displayed in the non-empty overlap area before any data from the second image data parcel, whereby enabling local enhancement of detail level in the overlap area.

5. The method of claim 1, wherein the internet capable digital phone is connected through a local embedded server on the internet-capable digital phone, the local embedded server using a local image repository to store image data parcels, the local embedded server providing access to at least some image data parcels.

6. An internet-capable digital phone for displaying large-scale images retrieved over a limited bandwidth communications channel, the internet-capable digital phone comprising:

a display of defined screen resolution for displaying a defined image;

a memory configured to store a plurality of image data parcels displayable over respective portions of a mesh corresponding to the defined image;

a communications channel interface supporting retrieval of a first defined data parcel of the defined image and a second image data parcel of the defined image over the limited bandwidth communications channel;

a processor coupled to the display, the memory, and the communications channel interface, the processor being configured to;

select the first and the second image data parcels based on a same operator controlled image viewpoint,

prioritize retrieval among a plurality of image data parcels selected for same operator controlled viewpoint,

request the first and the second image data parcels according to the prioritization,

retrieve the first and the second image data parcels via the communications channel interface,

store the first and the second image data parcels retrieved via the communications channel interface in the memory,

render the first and the second image data parcels according to the same operator controlled image viewpoint to provide for detail level enhancement of the defined image on the display;

a local embedded server, the local embedded server using a local image repository to store image data parcels, the local embedded server providing access to at least some image data parcels, retrieval of image data parcels occurs through the local embedded server;

wherein the internet-capable digital phone is coupled over the limited bandwidth communications channel to a remote computer, the remote computer being configured to store data parcels obtained by processing of source image data of a predetermined image to obtain a series K1-N of derivative images of progressively lower detail level, wherein the processing of the source image data comprises subdividing each respective image K_o of the series into a regular array of data parcels, the regular arrays of data parcels comprising the first image data parcel and the second image data parcel.

7. The internet-capable digital phone of claim 6, wherein the processor is further configured to perform the prioritization according to assigned priority values of the requests for image data parcels selected for same operator controlled viewpoint.

8. The internet-capable digital phone of claim 6, wherein there is a non-empty overlap area between area of the first and the second image data parcels, the second image data parcel has detail level greater than the first image data parcel, and the first image data parcel is retrieved earlier than the second image data parcel according to the prioritization, and at least a portion of the first image data parcel is displayed in the non-empty overlap area before any data from the second image data parcel, whereby enabling local enhancement of detail level in the overlap area.

9. A remote computer for delivering large-scale images over limited bandwidth network communications channel for display on an internet-capable digital phone, the remote computer comprising a first processor configured to:

store data parcels obtained by processing of source image data of a predetermined image to obtain a series K_1-N of derivative images of progressively lower detail level, wherein the processing of the source image data comprises subdividing each respective image of the series into a regular array of data parcels, the regular arrays of data parcels comprising the first data parcel and the second image data parcel;

Send a first image data parcel and a second image data parcels to the internet-capable digital phone responsive respectively to a first and a second requests;

Provide to the internet-capable digital phone a client software, the client software comprising instructions to configure a second processor of the internet-capable digital phone to;

select the first image data parcel and the second image data parcel based on a same operator controlled image viewpoint on the internet-capable digital phone relative to a predetermined image,

prioritize the first and the second requests according to a prioritization from among a plurality of parcels selected for same operator controlled viewpoint;

issue the first request for the first image data parcel,

receive the first image data parcel from the remote computer, the first image data parcel being sent by the remote computer in response to the first request;

display on the internet-capable digital phone at least part of the predetermined image using the first image data parcel received by the internet-capable digital phone, wherein the first image data parcel uniquely forms a discrete portion of the predetermined image according to the same operator controlled image viewpoint;

issue a second request for the second image data parcel from the internet-capable digital phone to the remote computer; and

receiving the second image data parcel from the remote computer over the network communications channel, the second image data parcel being sent by the remote computer in response to the second request;

display on the internet-capable digital phone at least part of the predetermined image using the second image data parcel received by the internet-capable digital phone, wherein the second image data parcel uniquely forms a discrete portion of the predetermined image according to the same operator controlled image viewpoint.

10. The remote computer of claim 9, wherein there is a non-empty overlap area between area of the first and the second image data parcels, the second image data parcel has detail level greater than the first image data parcel, and the first image data parcel is retrieved earlier than the second image data parcel according to the prioritization, and at least a portion of the first image data parcel is displayed in the non-empty overlap area before any data from the second image data parcel, whereby enabling local enhancement of detail level in the overlap area.

11. The remote computer of claim 9, wherein the client software further comprising instructions to configure the internet capable digital phone to connect through a local embedded server on the internet-capable digital phone, the local embedded server using a local image repository to store image data parcels, the local embedded server providing access to at least some image data parcels.