Hybrid text and image based encoding

• US 8,648,858 B1
• Filed: 03/25/2010
• Issued: 02/11/2014
• Est. Priority Date: 03/25/2009
• Status: Active Grant

• Current Assignee: Otello Corp. ASA
• Original Assignee: Skyfire Labs Inc. (Otello Corp. ASA)
• Inventors: Swenson, Erik R., Kumar, Vijay
• Primary Examiner(s): Yang, Ryan R
• Assistant Examiner(s): Ge, Jin
• Application Number:
  US12/731,866
• Time in Patent Office: 1,419 Days
• Field of Search: 345/428
• US Class Current: 345/428
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution

Abstract

A configuration for encoding and decoding the data is disclosed herein. A server retrieves webpage content to filter and extract text and image data. The text data is encoded using a lossless encoder, whereas the image data is downsampled to a lower resolution and encoded using a lossy encoder. The encoded text and image data is transmitted over a network. Once the encoded data is received on the client device, the text and image data is decoded using an inverse encoding algorithm and resized at a resolution appropriate to the native resolution of the display device.

Claims

1. A method for encoding data within a webpage for display on a mobile device connected to a network, the method comprising:

retrieving webpage content;

identifying text data within the webpage content;

extracting text data from the webpage at a full resolution, the extracted text data comprising string text or an image of the text data;

applying a lossless encoder to the text data to generate encoded text data comprising compressed, full resolution text data;

identifying image data within the webpage content;

extracting the image data from the webpage content at the full resolution;

downsampling the image data from the full resolution to a lower resolution;

applying a lossy encoder to the downsampled image data to generate encoded image data comprising compressed, lower resolution image data;

dividing the webpage content into one or more thumbnail tiles, each thumbnail tile including the encoded full resolution text data and the encoded lower resolution image data;

transmitting the one or more thumbnail tiles to the mobile device, the webpage content reconstructable at the mobile device using the one or more thumbnail tiles so that the reconstructed webpage content includes the full resolution text data and the lower resolution image data; and

responsive to receiving an instruction to zoom in on a portion of the webpage content;

dividing each thumbnail tile into a plurality of desktop tiles, each desktop tile including the full resolution text data and the full resolution image data; and

transmitting a desktop tile corresponding to the portion of the webpage to the mobile device for reconstructing the full resolution webpage content using the desktop tile.

2. The method of claim 1, wherein extracting the text data further comprises copying the text data at a full resolution.

3. The method of claim 1, further comprising encoding the text data based on metadata associated with the webpage.

4. The method of claim 1, further comprising transmitting to the mobile device a text library corresponding to the text format capability of the mobile device.

13. The method of claim 1, wherein extracting the text data further comprises representing the text data in a text format.

14. The method of claim 1, further comprising encoding the text data based on an applied filtering mechanism.

5. A non-transitory computer readable medium configured to store instructions, the instructions when executed by a processor cause the processor to:

retrieve content of the webpage;

identify text data within the webpage content;

extract text data from the webpage at a full resolution, the extracted text data comprising string text or an image of the text data;

apply a lossless encoder to the text data to generate encoded text data comprising compressed, full resolution text data;

identify image data within the webpage content;

extract the image data from the webpage content at the full resolution;

downsample the image data from the full resolution to a lower resolution;

apply a lossy encoder to the downsampled image data to generate encoded image data comprising compressed, lower resolution image data;

divide the webpage content into one or more thumbnail tiles, each thumbnail tile including the encoded full resolution text data and the encoded lower resolution image data;

transmit the one or more thumbnail tiles to the mobile device, the webpage content reconstructable at the mobile device using the one or more thumbnail tiles so that the reconstructed webpage content includes the full resolution text data and the lower resolution image data; and

responsive to receiving an instruction to zoom in on a portion of the webpage content;

divide each thumbnail tile into a plurality of desktop tiles, each desktop tile including the full resolution text data and the full resolution image data and

transmit a desktop tile corresponding to the portion of the webpage to the mobile device for reconstructing the full resolution webpage content using the desktop tile.

6. The non-transitory computer readable medium of claim 5, wherein the instructions to extract the text data further comprises instructions that when executed by the processor cause the processor to copy the text data at a full resolution.

7. The non-transitory computer readable medium of claim 5, wherein the instructions to encode the text data further comprises instructions that when executed by the processor cause the processor to encode the text based on metadata associated with the webpage.

8. The non-transitory computer readable medium of claim 5, further comprising instructions that when executed by a processor cause the processor to transmit to the mobile device a text library corresponding to the identity and the text formatting capability of the mobile device.

15. The non-transitory computer readable medium of claim 5, wherein the instructions to extract the text data further comprises instructions that when executed by the processor cause the processor to represent the text data in a text format.

16. The non-transitory computer readable medium of claim 5, wherein the instructions to encode the text data further comprises instructions that when executed by the processor cause the processor to encode the text based on an applied filtering mechanism.

9. A method for viewing encoded data using an application executing on a mobile device, the method comprising:

receiving a thumbnail tile including encoded text and image data extracted from a webpage captured at a first resolution, the text data encoded at the first resolution and the image data encoded at a lower resolution;

decoding the received text data to produce text data at the first resolution;

decoding the received image data to produce image data at the lower resolution;

storing the decoded first resolution text data and the decoded lower resolution image data;

resizing the stored text and image data to a second resolution corresponding to a first zoom level of the application executing on the mobile device, the second resolution lower than the first resolution;

displaying, by the application executing on the mobile device, the resized text and image data at the second resolution;

receiving an instruction to change the first zoom level to a second zoom level corresponding to a third resolution, the third resolution greater than the second resolution;

resizing the stored text data to the third resolution; and

displaying, by the application executing on the mobile device, the resized text data at the third resolution and the resized image data at the second resolution.

10. The method of claim 9, further comprising:

sending a request to an encoding server to retrieve third resolution image data corresponding to the second zoom level.

17. The method of claim 9, further comprising:

receiving a desktop tile including image data encoded at the first resolution;

resizing the image data encoded at the first resolution to the third resolution; and

displaying the resized image data at the third resolution.

11. A non-transitory computer readable medium configured to store instructions, the instructions when executed by a processor cause the processor to:

receive a thumbnail tile including encoded text and image data extracted from a webpage captured at a first resolution, the text data encoded at the first resolution and the image data encoded at a lower resolution;

decode the received text data to produce text data at the first resolution;

decode the received image data to produce image data at the lower resolution;

store the decoded first resolution text data and the decoded lower resolution image data;

resize the stored text and image data to a second resolution corresponding to a first zoom level of the application executing on the mobile device, the second resolution lower than the first resolution;

display the resized text and image data at the second resolution;

receive an instruction to change the first zoom level to a second zoom level corresponding to a third resolution, the third resolution greater than the second resolution;

resize the stored text data to the third resolution; and

display the resized text data at the third resolution and the resized image data at the second resolution.

12. The non-transitory computer readable medium of claim 11, further comprising instructions that cause the processor to:

send a request to an encoding server to retrieve third resolution image data corresponding to the second zoom level.

18. The non-transitory computer readable medium of claim 11, further comprising instructions that when executed by the processor cause the processor to:

receive a desktop tile including image data encoded at the first resolution;

resize the image data encoded at the first resolution to the third resolution; and

display the resized image data at the third resolution.