Image segmentation and warping for specialized display viewing

• US 20040004641A1
• Filed: 07/02/2002
• Published: 01/08/2004
• Est. Priority Date: 07/02/2002
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Gargi, Ullas
• Granted Patent: US 7,278,117 B2
• Time in Patent Office: Days
• US Class Current: 345/848
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 3/04 Context-preserving transformations, e.g. by using an importance map panospheric to cylindrical image transformations G06T3/12
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

A method, program product and system for warping image data, the method comprising in one embodiment: receiving image data for an image; segmentation of the image into a plurality of regions based on regional classification of the image; obtaining a set of warping rules; and warping the image based on the classification of each region and the warping rules.

Claims

1. A method for segmenting a fullsize 2-D or 3-D image, comprising the steps of:

obtaining image data for an image;

segmentation of the image into a plurality of regions based on regional classification of the image; and

transmitting the image data to a client with the classification of regions designated.

2. The method as defined in claim 1, further comprising:

receiving a user interaction with a warped image; and

translating the interaction to the image.

3. The method as defined in claim 2, further comprising passing the interaction back to an originating application that originated the image.

4. The method as defined in claim 1, wherein the segmentation step comprises determining a classification for each of a plurality of regions in the image based on a data type for data in the region.

5. The method as defined in claim 4, wherein the plurality of regions are indexed in a hierarchical data structure.

6. The method as defined in claim 5, wherein the classifications include at least two of a bitmap, graphic, text word, and text line.

7. The method as defined in claim 1, wherein the segmentation step includes the step of correlating each region to a set of coordinates.

8. The method as defined in claim 1, further comprising obtaining at least one warping rule.

9. The method as defined in claim 8, wherein the obtaining at least one rule step comprises obtaining a different set of rules based on whether the image is a graphics heavy web page or a text heavy web page.

16. The method as defined in claim 15, wherein the words are scaled and rearranged within the warped image, but maintaining adjacent words consecutive.

10. A method for displaying a segmented image, comprising:

receiving image data for an image with classification of regions;

obtaining rules for warping;

warping the image based on classification of each region and the rules for warping; and

displaying the warped image.

11. The method as defined in claim 10, further comprising:

receiving a user interaction with the warped image; and

translating the interaction to the image.

12. The method as defined in claim 11, further comprising passing the interaction in the image back to an originating application that originated the image data.

13. The method as defined in claim 10, wherein a warping rule obtained in said obtaining rules for warping step comprises applying an image scaling algorithm to all images to obtain scaled images.

14. The method as defined in claim 13, wherein a warping rule obtained in said obtaining rules for warping step comprises moving at least one scaled image to a predetermined location in the warped image.

15. The method as defined in claim 10, wherein a warping rule obtained in said obtaining rules for warping step comprises splitting at least one region classified as a text block into a plurality of lines, and splitting text lines into a plurality of words.

17. The method as defined in claim 10, wherein the obtaining rules for warping step comprises obtaining a different set of rules based on whether the image is a web page or a text document.

18. The method as defined in claim 10, wherein the obtaining rules for warping step comprises obtaining a different set of rules based on whether the image is a graphics heavy web page or a text heavy web page.

19. The method as defined in claim 10, wherein the obtaining rules for warping step comprises obtaining a set of rules via selection by a user.

20. The method as defined in claim 10, wherein the obtaining rules for warping step comprises obtaining rules from a user profile.

21. The method as defined in claim 10, wherein the obtaining rules for warping step comprises selecting rules based on an available bandwidth designation.

24. The method as defined in claim 21, wherein the segmentation of the image into a plurality of regions based on regional classification of the image step includes correlating each region to a set of coordinates.

28. The program product as defined in claim 24, wherein the segmentation of the image into a plurality of regions based on regional classification of the image step comprises determining a classification for each of a plurality of regions in the image based on a data type for data in the region.

29. The program product as defined in claim 28, wherein the plurality of regions are indexed in a hierarchical data structure.

30. The program product as defined in claim 29, wherein the classifications include at least two of a bitmap, graphic, text word, and text line.

22. A method for warping image data comprising the steps of:

receiving image data for an image;

segmentation of the image into a plurality of regions based on regional classification of the image;

obtaining a set of warping rules; and

warping the image based on the classification of each region and the warping rules.

23. The method as defined in claim 22, further comprising displaying the warped image.

25. A program product for segmenting an image for viewing comprising machine readable program code for causing a machine to perform the following method steps:

obtaining image data for an image;

segmentation of the image into a plurality of regions based on regional classification of the image; and

transmitting the image data to a client with the classification of regions designated.

26. The program product as defined in claim 25, further comprising program code for:

receiving a user interaction with a warped image; and

translating the interaction to the image.

27. The program product as defined in claim 26, further comprising code for passing the interaction in the image back to an originating application that originated the image.

31. The program product as defined in claim 25, wherein the segmentation of the image into a plurality of regions based on regional classification of the image step includes correlating each region to a set of coordinates.

32. A program product for displaying a segmented image, comprising machine readable program code for causing a machine to perform the following method steps of:

receiving image data for an image with classification of regions;

obtaining rules for warping;

warping the image based on the classification of each region and the rules for warping; and

displaying the warped image.

33. The program product as defined in claim 32, further comprising code for:

receiving a user interaction with the warped image; and

translating the interaction to the image.

34. The program product as defined in claim 33, further comprising code for passing the interaction in the image back to an originating application that originated the image data.

35. The program product as defined in claim 32, wherein a warping rule obtained in said obtaining rules for warping step comprises applying an image scaling algorithm to all images to obtain scaled images.

36. The program product as defined in claim 35, wherein a warping rule obtained in said obtaining rules for warping step comprises moving at least one scaled image to a predetermined location in the warped image.

37. The program product as defined in claim 32, wherein the obtaining rules for warping step comprises obtaining a set of rules via selection by a user.

38. The program product as defined in claim 32, wherein the obtaining rules for warping step comprises obtaining rules from a user profile.

39. The program product as defined in claim 32, wherein the obtaining rules for warping step comprises selecting rules based on an available bandwidth designation.

40. A program product for warping image data comprising machine readable program code for causing a machine to perform the following method:

receiving image data for an image;

segmentation of the image into a plurality of regions based on regional classification of the image;

obtaining a set of warping rules; and

warping the image based on the classification of each segment and the warping rules.

41. The program product as defined in claim 40, further comprising code for displaying the warped image.

42. The program product as defined in claim 40, wherein the segmentation of the image into a plurality of regions based on regional classification of the image step includes correlating each region to a set of coordinates.

43. The program product as defined in claim 40, further comprising code for:

receiving a user interaction with a warped image; and

translating the interaction to the image.

44. The program product as defined in claim 43, further comprising code for passing the interaction in the image back to an originating application that originated the image.

45. The program product as defined in claim 40, wherein the segmentation of the image into a plurality of regions based on regional classification of the image step comprises determining a classification for each of a plurality of regions in the image based on a data type for data in the region.

46. The program product as defined in claim 45, wherein the plurality of regions are indexed in a hierarchical data structure.

47. A system for segmenting an image for viewing, comprising:

a component for obtaining image data for an image;

a component for segmentation of the image into a plurality of regions based on regional classification of the image; and

a component for transmitting the image data to a client with the classification of regions designated.

48. The system as defined in claim 47, further comprising:

a component for receiving a user interaction with a warped image; and

a component for translating the interaction to the image.

49. The system as defined in claim 47, wherein the segmentation component determines a classification for each of a plurality of regions in the image based on a data type for data in the region.

50. The system as defined in claim 49, wherein the plurality of regions are indexed in a hierarchical data structure.

51. A system for displaying a segmented image, comprising:

a component for receiving image data for an image with classification of regions;

a component for obtaining rules for warping;

a component for warping the image based on the classification of each region and the rules for warping; and

a component for displaying the warped image.

52. The system as defined in claim 51, further comprising:

a component for receiving a user interaction with the warped image; and

a component for translating the interaction to the image.

53. The system as defined in claim 51, wherein the obtaining rules component obtains a different set of rules based on whether the image is a web page or a text document.

54. The system as defined in claim 51, wherein the obtaining rules component obtains rules from a user profile.

55. The system as defined in claim 51, wherein the obtaining rules component selects rules based on an available bandwidth designation.

56. A system for warping image data comprising:

a component for receiving image data;

a component for segmentation of the image into a plurality of regions based on regional classification of the image;

a component for obtaining a set of warping rules; and

a component for warping the image based on the classification of each region and the warping rules.