Adaptive image maps

• US 8,064,727 B2
• Filed: 08/20/2010
• Issued: 11/22/2011
• Est. Priority Date: 09/22/2005
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lueck, Michael F.
• Primary Examiner(s): Repko; Jason M
• Assistant Examiner(s): Thirugnanam; Gandhi
• Application Number:
  US12/860,607
• Publication Number:
  US 20100316302A1
• Time in Patent Office: 459 Days
• Field of Search: 382/113, 382/173, 382/181, 715/200, 715/205, 715/234, 715/243, 715/246, 715/249, 715/253
• US Class Current: 382/286
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents

Abstract

A computer implemented method of processing an image for display on a mobile communication device includes extracting a portion of an image based on an image map. The image map relates to the portion of the image. The method also includes generating a document that comprises the extracted portion of the image and transmitting the generated document to a remote device for display. The method may also include assigning a selectable link to the extracted portion of the image and receiving a request from the remote device for an initial document having the image and image map. Additionally, the method may include storing in a database the generated document and transmitting the stored generated document in response to future requests for the initial document.

Claims

1. A method comprising:

receiving, at a computer system from a mobile computing device, a request for a first electronic document that includes an image;

determining coordinates of a plurality of portions of the image based on optical analysis of the image by the computer system, wherein the optical analysis identifies items in the image that are visually distinct from other items in the image;

using the determined coordinates, identifying a plurality of sub-images of the image in a first arrangement, the plurality of sub-images corresponding to the plurality of portions;

generating a second electronic document that includes the plurality of sub-images in a second arrangement, the second arrangement being different than the first arrangement, wherein the second arrangement groups the plurality of sub-images based on one or more attributes of the sub-images, wherein the one or more attributes based upon which the sub-images are grouped in the second arrangement include image size and image shape; and

providing the second electronic document to the computing device.

2. The method of claim 1, wherein the optical analysis comprises optical character recognition (OCR), and wherein the items identified by the optical analysis comprise text in the image.

3. The method of claim 1, wherein the optical analysis comprises facial recognition, and wherein the items identified by the optical analysis comprise faces in the image.

4. The method of claim 1, wherein the optical analysis comprises optical object recognition, and wherein the items identified by the optical analysis comprise visually distinct objects in the image.

5. The method of claim 4, wherein the optical object recognition identifies objects in the image based on areas of the image that have at least a threshold level of contrast.

6. The method of claim 1, further comprising generating an image map for the image based on the determined coordinates;

wherein the plurality of sub-images are created based on the generated image map.

7. The method of claim 1, further comprising modifying a pre-existing image map that is associated with the image based on the determined coordinates;

wherein the plurality of sub-images are created based on the modified image map.

8. The method of claim 7, wherein modifying the pre-existing image map comprises modifying coordinates contained in the pre-existing image map using the determined coordinates.

9. The method of claim 7, wherein modifying the pre-existing image map comprises supplementing coordinates contained in the pre-existing image map with the determined coordinates.

10. The method of claim 7, further comprising:

obtaining information that indicates a size of a display of the computing device;

based on the obtained information and the pre-existing image map, identifying one or more portions of the image defined by the image map that are too large for the display of the computing device;

for each of the identified portions of the image, selecting coordinates in the identified portion that correspond to one or more of the identified items that are at least partially located in the identified portion and that are determined to have at least a threshold level of relevance to a user of the computing device; and

cropping the identified portions based on the selected coordinates, wherein sub-images corresponding to the identified portions are created based on the cropped identified portions.

11. The method of claim 10, wherein the identified portions are cropped using the selected coordinates so that the one or more identified items determined to have at least the threshold level of relevance are centered in the resulting cropped portions.

12. The method of claim 10, wherein the identified portions are cropped to correspond to the size of the display of the computing device.

18. The method of claim 1, wherein the one or more attributes based upon which the sub-images are grouped in the second arrangement include content of the sub-images.

19. The method of claim 18, wherein the content comprises items that are depicted in the sub-images.

20. The method of claim 1, wherein the second arrangement includes sub-images with similar attributes being grouped together in the second electronic document.

13. A system for selecting portions of an image for display on a computing device, the system comprising:

a computer system;

an interface of the computer system that is configured to receive a request from a computing device for a first electronic document that includes an image;

means for determining coordinates of a plurality of portions of the image based on optical analysis of the image by the computer system, wherein the optical analysis identifies items in the image that are visually distinct from other items in the image;

an image extractor of the computer system that is configured to use the determined coordinates to identify a plurality of sub-images of the image in a first arrangement, the plurality of sub-images corresponding to the plurality of portions; and

a document generator of the computer system that is configured to generate a second electronic document that includes the plurality of sub-images in a second arrangement, the second arrangement being different than the first arrangement, wherein the second arrangement groups the plurality of sub-images based on one or more attributes of the sub-images, wherein the one or more attributes based upon which the sub-images are grouped in the second arrangement include image size and image shape;

wherein the interface is further configured to provide the generated second electronic document to the mobile computing device.

14. The system of claim 13, further comprising means for generating an image map for the image based on the determined coordinates;

wherein the plurality of sub-images are created based on the generated image map.

15. The system of claim 13, further comprising means for modifying a pre-existing image map that is associated with the image based on the determined coordinates;

wherein the plurality of sub-images are created based on the modified image map.

16. An apparatus comprising a non-transitory computer readable medium encoding instructions that, in response to execution by a computing device, cause the computing device to perform operations comprising:

receiving, at a computer system from a computing device, a request for a first electronic document that includes an image;

determining coordinates of a plurality of portions of the image based on optical analysis of the image by the computer system, wherein the optical analysis identifies items in the image that are visually distinct from other items in the image;

using the determined coordinates, identifying a plurality of sub-images of the image in a first arrangement, the plurality of sub-images corresponding to the plurality of portions;

generating a second electronic document that includes the plurality of sub-images in a second arrangement, the second arrangement being different than the first arrangement, wherein the second arrangement groups the plurality of sub-images based on attributes of the sub-images, wherein the one or more attributes based upon which the sub-images are grouped in the second arrangement include image size and image shape; and

providing the second electronic document to the computing device.

17. The computer-program product of claim 16, wherein the operations further comprise modifying a pre-existing image map that is associated with the image based on the determined coordinates;

wherein the plurality of sub-images are created based on the modified image map.