SYSTEM AND METHOD FOR REFLOW OF TEXT IN MIXED CONTENT DOCUMENTS

• US 20150121183A1
• Filed: 10/25/2013
• Published: 04/30/2015
• Est. Priority Date: 10/25/2013
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Saund, Eric, Mahoney, James V., Janssen, William C. Jr.
• Granted Patent: US 10,296,570 B2
• Time in Patent Office: Days
• US Class Current: 715/205
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/163 Handling of whitespace
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A method and system is provided to author an electronic document having content including document objects, the documents objects including at least text objects and graphical objects, the graphical objects including at least one of image objects, structured graphics, digital ink, and hyperlinks. The method and system modifies the content of the electronic document, and applies an automatic hybrid reflow process to reflow at least one of the text objects of the electronic document in accordance with the applied automatic hybrid reflow process. The applied automatic hybrid reflow process acting to position the text objects and the graphical objects on the electronic document.

Claims

1. A method of authoring an electronic document displayed on an electronic display, the electronic document having content including document objects, the documents objects including at least text objects and graphical objects, the graphical objects including at least one of image objects, structured graphics, digital ink, and hyperlinks, the method comprising:

modifying the content of the electronic document;

applying an automatic hybrid reflow process; and

reflowing at least one of the text objects of the electronic document in accordance with the applied automatic hybrid reflow process, wherein the applied automatic hybrid reflow process acts to position the text objects and the graphical objects in the electronic document,

wherein the method is implemented using an electronic computing device.

2. The method according to claim 1 further comprising:

assigning a status of narrative text objects to at least one of the text objects;

assigning a status of annotative text objects to at least one of the text objects; and

performing a recalculate layout routine to recalculate a layout of the electronic document in consideration of the status assigned to the text objects.

3. The method according to claim 2 wherein the at least one text object that is reflowed is assigned the status of a narrative text object.

4. The method according to claim 2 further comprising:

providing distinct treatment between the narrative text objects and the annotative text objects.

5. The method according to claim 2 wherein the performing of the recalculate layout routine further comprises:

sorting the document objects according to positions that the document objects are located within the electronic document; and

creating a list of obstacle document objects, wherein the obstacle document objects include at least one of the image objects and the annotative text objects.

6. The method according to claim 2 wherein at least one of the narrative text object and the annotative text object is identified on an electronic display by at least one visual indicator.

7. The method according to claim 2 wherein classification of text objects as annotative text objects and narrative text objects is accomplished automatically.

8. The method according to claim 7, wherein the text objects are automatically classified as narrative text objects when a left edge of the text objects are placed within a predetermined distance from a left edge of a canvas of the electronic display.

9. The method according to claim 1 wherein the automatic hybrid reflow process further comprises:

performing a localized application of the text reflow.

10. The method according to claim 9 wherein the localized application of text reflow comprises:

assigning a reference vertical position to document objects; and

performing a recalculate layout routine, wherein placement of the document objects are recalculated in consideration of the reference vertical position.

11. The method according to claim 10 wherein the placement of the document objects includes translating the document objects in synchrony with surrounding narrative text objects.

12. The method according to claim 10 wherein the reference vertical position is established in reference to a narrative text object falling above the document object.

13. The method according to claim 10 wherein the reference vertical position is established in reference to a text line.

14. The method according to claim 13 wherein the reference text line is assigned to all document objects falling below the reference text line location.

15. The method according to claim 13 further including adjusting the document objects that fall below the reference text line of the reflowed narrative text objects, wherein the adjusting maintains a determined vertical distance of the document objects with respect to the reference text line.

16. The method according to claim 2 wherein the reflowing causes the at least one narrative text object to grow or shrink in height.

17. The method according to claim 1 wherein the applying of the automatic hybrid reflow process further includes:

performing automatic determination of vertical jumps.

18. The method according to claim 17 wherein the performing automatic determination of vertical jumps comprises:

applying a reflow narrative text object routine to the electronic document.

19. The method according to claim 18, wherein the applying of the reflow narrative object routine comprises:

finding a viable text line position to establish a location for a current text line; and

building textual content of the current text line.

20. The method according to claim 19 wherein the finding of the viable text line position comprises:

determining the limits of the viable text line position in the presence of obstacle document objects;

determining if, by adding at least one current character, a width of the current text line would fall within or outside limits of the viable text line position;

adding the at least one current character when it is determined the at least one current character does not extend outside the limits of the viable text line position; and

finding a next viable text line position for a next text line, when the at least one next character causes the current text line to extend outside the viable text line position.

21. The method according to claim 20 wherein the at least one current character is a group of characters that comprise a word.

22. The method according to claim 20 wherein the finding of the next viable text line, includes determining locations of at least one of the obstacle document objects.

23. The method according to claim 1 wherein the reflowed electronic document is at least part of an electronic message composed by:

selecting and transferring content from a referenced document external of a message composition region to the message composition region for use in composing the electronic message,

wherein the selecting and transferring are performed were a single view is presented to a user.

24. A system configured to author an electronic document displayed on an electronic display, the electronic document having content including document objects, the documents objects including at least text objects and graphical objects, the graphical objects including at least one of image objects, structured graphics, digital ink, and hyperlinks, the system comprising:

an electronic computing device, programmed to;

modify the content of the electronic document;

apply an automatic hybrid reflow process; and

reflow at least one of the text objects of the electronic document in accordance with the applied automatic hybrid reflow process, wherein the applied automatic hybrid reflow process acts to position the text objects and the graphical objects on the electronic document.

25. The system according to claim 24 wherein the electronic computing device, is further programmed to:

assign a status of narrative text objects to at least one of the text objects;

assign a status of annotative text objects to at least one of the text objects; and

perform a recalculate layout routine to recalculate a layout of the electronic document in consideration of the status assigned to the text objects.

26. The system according to claim 25 wherein the at least one text object that is reflowed is assigned the status of a narrative text object.

27. The system according to claim 25 wherein the electronic computing device, is further programmed to:

provide distinct treatment between the narrative text objects and the annotative text objects.

28. The system to claim 25 wherein the recalculate layout routine is further configured to:

sort the document objects according to positions that the document objects are located within the electronic document; and

create a list of obstacle document objects, wherein the obstacle document objects include at least one of the image objects and the annotative text objects.

29. The system according to claim 25 wherein at least one of the narrative text object and the annotative text object is identified on an electronic display by at least one visual indicator.

30. The system according to claim 25 wherein classification of text objects as annotative text objects and narrative text objects is accomplished automatically.

31. The system according to claim 30, wherein the text objects are automatically classified as narrative text objects when a left edge of the text objects are placed within a predetermined distance from a left edge of a canvas of the electronic display.

32. The system according to claim 25 wherein the automatic hybrid reflow process is further configured to:

perform a localized application of the text reflow.

33. The system according to claim 32 wherein the localized application of text reflow is configured to:

assign a reference vertical position to document objects; and

perform a recalculate layout routine, wherein placement of the document objects are recalculated in consideration of the reference vertical position.

34. The system according to claim 33 wherein the placement of the document objects includes translating the document objects in synchrony with surrounding narrative text objects.

35. The system according to claim 33 wherein the reference vertical position is established in reference to a narrative text object falling above the document object.

36. The system according to claim 33 wherein the reference vertical position is established in reference to a text line.

37. The method according to claim 36 wherein the reference text line is assigned to all document objects falling below the reference text line location.

38. The system according to claim 36 further including adjusting the document objects that fall below the reference text line of the reflowed narrative text objects, wherein the adjusting maintains a determined vertical distance of the document objects with respect to the reference text line.

39. The system according to claim 33 wherein the reflowing causes the at least one narrative text object to grow or shrink in height.

40. The system according to claim 25 wherein the automatic hybrid reflow process is further configured to:

perform automatic determination of vertical jumps.

41. The system according to claim 40 wherein the automatic determination of vertical jumps is further configured to:

apply a reflow narrative text object routine to the electronic document.

42. The system according to claim 41 wherein the reflow narrative object routine is further configured to:

find a viable text line position to establish a location for a current text line; and

build textual content of the current text line.

43. The system according to claim 42 wherein the finding of the viable text line position is further configured to:

determine the limits of the viable text line position in the presence of obstacle document objects;

determine if, by adding at least one current character, a width of the current text line would fall within or outside limits of the viable text line position;

add the at least one current character when it is determined the at least one current character does not extend outside the limits of the viable text line position;

an

find a next viable text line position for a next text line, when the at least one next character causes the current text line to extend outside the viable text line position.

44. The system according to claim 43 wherein the at least one current character is a group of characters that comprise a word.

45. The system according to claim 43 wherein the finding of the next viable text line, includes a determination of locations of at least one of the obstacle document objects.

46. The system according to claim 24 wherein the reflowed electronic document is at least part of an electronic message composed by the electronic computing device further configured to:

select and transfer content from a referenced document external of a message composition region to the message composition region for use in the composition of the electronic message,

wherein the select and transfer occur when a single view is presented to a user.

47. An article of manufacture comprising a computer usable medium having computer readable code embodied in said medium which, when said program code is executed by said computer causes said computer to perform a method of authoring an electronic document having content including document objects, the documents objects including at least text objects and graphical objects, the graphical objects including at least one of image objects, structured graphics, digital ink, and hyperlinks, the method comprising:

modifying the content of the electronic document;

applying an automatic hybrid reflow process; and

reflowing at least one of the text objects of the electronic document in accordance with the applied automatic hybrid reflow process, wherein the applied automatic hybrid reflow process acts to position the text objects and the graphical objects on the electronic document,

wherein the method is implemented using an electronic computing device.