Changing characters in an image

• US 5,167,016 A
• Filed: 12/29/1989
• Issued: 11/24/1992
• Est. Priority Date: 12/29/1989
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Hicks, Wayland R., Kaplan, Ronald M., Davies, Daniel, Bagley, Steven C.
• Primary Examiner(s): Herndon, Heather R.
• Application Number:
  US07/459,026
• Time in Patent Office: 1,061 Days
• Field of Search: 364/518, 364/521, 364/419, 382/37, 382/57, 395/144, 395/151, 395/150
• US Class Current: 715/210
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

An existing character, in a text defined in image form by data such as a two-dimensional array, is copied to add a new character to the text. The existing character is found by performing character recognition on a two-dimensional data array defining an image that includes part of the text, such as a page. The array can be obtained from a scanner. A word that is recognized as including characters of the type needed is tested to determine whether it can be divided into the correct number of characters. The word is divided by finding connected components in the part of the array in which the word was found during recognition. The connected components are grouped into sets, each set being likely to be a character. If the word can be correctly divided, character-size arrays for its characters are obtained and saved. One of the arrays for the character type of the new character is selected and used to produce an array for the word in which it is included. The new word'"'"'s array is then used to produce an array for a line in which the new word replaces an old word. The characters of the new word are spaced according to the spacing of the characters of the old word. The new character is positioned transverse to the line based on the transverse positioning of the existing character. The interword spaces of the line are adjusted. The line'"'"'s array is then used to produce data defining a modified version of the text in image form.

Claims

1. A method of operating a processor connected for accessing first text image data defining a first version of a text in image form, the first version of the text including a first character that is an instance of a first character type;

the method comprising the steps of;

operating on the first text image data to automatically obtain first character data defining the first character in substantially the same way as the first character is defined by the first text image data; and

using the first text image data and the first character data to produce second text image data, the second text image data defining a second version of the text in image form, the second version of the text including a second character that is an instance of the first character type, the second charcter not appearing in the first version of the text, the step of using the first text image data and the first character data comprising the substep of using the first character data to produce the second text image data so that the second character is defined by the second text image data in substantially the same way as the first character is defined by the first character data.

2. The method of claim 1 in which the first character data is data defining a two-dimensional array that defines the first character in substantially the same way as it is defined by the first text image data.

3. The method of claim 2 in which the first character data includes the two-dimensional array, the two-dimensional array being a character-size two-dimensional array.

4. The method of claim 1 in which the first text image data includes image data defining a first version of an image, the first version of the image including the first character, the second text image data including data defining a second version of the image, the second version of the image including the second character.

5. The method of claim 4 in which the image includes a page of the text.

6. The method of claim 4 in which the first text image data includes a first version two-dimensional array defining the first version of the image and the second text image data includes a second version two-dimensional array defining the second version of the image.

7. The method of claim 6 in which the step of using the first text image data and the first character data to produce second text image data comprises the substep of modifying the first version two-dimensional array to produce the second version two-dimensional array.

8. The method of claim 7 in which the first character data includes a first character two-dimensional array that defines the first character in substantially the same way as it is defined by the first text image data, the substep of modifying the first version two-dimensional array comprising using the first character two-dimensional array to modify the first version two-dimensional array.

9. The method of claim 2 in which the step of operating on the first text image data to automatically obtain the first character data comprises the substep of automatically obtaining a first character two-dimensional array that defines the first character in substantially the same way as it is defined by the first text image data from the first text image data.

10. The method of claim 9 in which the first version of the text includes a correctly spelled word, the correctly spelled word including the first character, the substep of automatically obtaining the first character two-dimensional array comprising the substeps of:

automatically obtaining an intermediate two-dimensional array of data defining the correctly spelled word in substantially the same way as it is defined by the first text image data; and

automatically obtaining the first character two-dimensional array from the intermediate two-dimensional array.

11. The method of claim 10 in which the substep of automatically obtaining the first character two-dimensional array from the intermediate two-dimensional array comprises the substeps of finding connected components in the intermediate two-dimensional array, grouping the connected components into a number of sets, and determining whether the number of sets is equal to a number of characters in the correctly spelled word.

12. The method of claim 10 in which the step of operating on the first text image data further comprises accessing the first text image data to obtain position data indicating a position of the correctly spelled word and character data indicating a character type of each character in the correctly spelled word;

the substep of automatically obtaining the intermediate two-dimensional array including using the position data;

the substep of automatically obtaining the first character two-dimensional array including using the character data.

13. The method of claim 1 in which the second version of the text includes a new word that includes the second character and that is not in the first version of the text, the step of using the first text image data and the first character data to produce second text image data further comprising the substeps of:

producing a new word two-dimensional array that defines the new word, the new word two-dimensional array defining the second character in substantially the same way as the first character is defined by the first character data; and

producing the second text image data so that it defines the new word in substantially the same way as the new word is defined by the new word two-dimensional array.

14. The method of claim 13 in which the first version of the text includes an old word, the substep of producing the second text image data further comprising the substep of omitting the old word so that the new word replaces the old word.

15. The method of claim 14, further comprising the step of determining that the old word is incorrect and that the new word should replace it.

16. The method of claim 15 in which the first text image data includes a first version two-dimensional array defining the first version of the text, the determining step comprising the substep of accessing the first text image data to obtain recognition result data from the first version two-dimensional array, the recognition result data including character data indicating character types of characters of the old word, the determining step further comprising the substep of performing spelling checking on the character data to determine that the old word is incorrect.

17. The method of claim 15 in which the processor is further connected for providing image output data to an image output device having a display, the image output device presenting views on the display based on the image output data, the processor further being connected for receiving user input data from a user input device, the determining step comprising the substeps of:

providing image output data to the image output device so that the image output device presents a view of the new word on the display; and

receiving user input data from the user input device indicating whether the new word should replace the old word.

18. The method of claim 13 in which the second version of the text includes a line that includes a plurality of words including the new word, the step of using the first text image data and the first character data to produce second text image data further comprising the substeps of:

obtaining a line two-dimensional array that defines the line, the line two-dimensional array defining the new word in substantially the same way as the new word is defined by the new word two-dimensional array, the line two-dimensional array defining the line with interword spaces separating the words in the line; and

producing the second text image data so that it defines the line in substantially the same way as the line is defined by the line two-dimensional array.

19. The method of claim 1 in which the first version of the text includes a third character that is an instance of a second character type, the second version of the text including a fourth character that is an instance of the second character type, the step of operating on the first text image data further comprising automatically obtaining third character data defining the third character in substantially the same way as it is defined by the first text image data, the step of using the first image data and the first character data to produce second text image data further comprising producing the second text image data so that it defines the fourth character in substantially the same way as the third character is defined by the third character data.

20. The method of claim 1 in which the first version of the text includes a plurality of characters that are instances of the first character type, the plurality of characters including the first character, the step of operating on the first text image data comprising the substeps of:

automatically obtaining respective character data defining each of the plurality of characters that are instances of the first character type; and

automatically selecting the first character data from the respective character data for the plurality of characters.

21. The method of claim 1 in which the step of operating on the first text image data comprises obtaining spatial data indicating spatial information about the first character, the substep of producing the second text image data comprising using the spatial data to position the second character within the second version of the text.

22. The method of claim 1 in which the processor is further connected for receiving image input data from an image input device, the method further comprising:

receiving the image input data from the image input device; and

obtaining the first text image data from the image input data.

23. A method of operating a processor connected for accessing first text image data defining a first version of a text in image form, the text including a first word;

the method comprising the steps of;

operating on the first text image data to produce second word array data defining a second word two-dimensional array that defines a second word; and

using the first text image data and the second word array data to produce second text image data defining a second version of the text in image form, the text being modified in the second version so that the second word replaces the first word, the second word being defined by the second text image data in substantially the same way as it is defined by the second word two-dimensional array.

24. The method of claim 23 in which the first text image data includes a first version two-dimensional array defining a first version of an image and the second text image data includes a second version two-dimensional array defining a second version of an image, the first version of the image including the first word, the second version of the image including the second word.

25. The method of claim 24 in which the text includes a plurality of pages, the image including one of the pages.

26. The method of claim 23 in which the first word includes a first plurality of characters and the second word includes a second plurality of characters, the method further comprising the step of obtaining spatial data indicating intercharacter spacing of the first plurality of characters;

the step of operating on the first text image data to produce the second word array data comprising producing the second word array data so that the second plurality of characters are defined by the second word two-dimensional array with the intercharacter spacing indicated by the spatial data.

27. The method of claim 23 in which the first version of the text includes a first character that is an instance of a first character type, the second word including a second character that is an instance of the first character type, the step of operating on the first text image data to produce the second word array data comprising the substeps of:

obtaining first character data defining the first character in substantially the same way as it is defined by the first text image data; and

producing the second word array data so that the second character is defined in substantially the same way as the first character is defined by the first character data.

28. The method of claim 27 in which the first character is in a first line of the first version of the text, the substep of obtaining the first character data comprising the substep of obtaining spatial data indicating a position of the first character in a direction transverse to the first line, the substep of producing the second word array data comprising the substep of using the spatial data to position the second character.

29. The method of claim 23 in which the second version of the text includes a second line that includes a plurality of words including the second word, the step of using the first text image data and the second word array data to produce second text image data comprising the substeps of:

producing second line array data defining a second line two-dimensional array that defines the second line, the second line two-dimensional array defining the second word in substantially the same way as the second word is defined by the second word two-dimensional array, the second line two-dimensional array defining the second line with interword spaces separating the words in the line; and

producing the second text image data so that the second text image data defines the second line in substantially the same way as the second line is defined by the second line two-dimensional array.

30. The method of claim 23, further comprising the step of determining that the first word is incorrect and that the second word should replace it.

31. The method of claim 30 in which the determining step comprises the substep of accessing the first text image data to obtain recognition result data from the first text image data, the recognition result data including character data indicating character types of characters of the first word, the determining step further comprising the substep of performing spelling checking on the character data to determine that the first word is incorrect.

32. The method of claim 30 in which the processor is further connected for providing image output data to an image output device having a display, the image output device presenting views on the display based on the image output data, the processor further being connected for receiving user input data from a user input device, the determining step comprising the substeps of:

providing image output data to the image output device so that the image output device presents a view of the second word on the display; and

receiving user input data from the user input device indicating whether the second word should replace the first word.

33. The method of claim 23 in which the second word array data includes the second word two-dimensional array.

34. A system comprising:

first text image data defining a first version of a text in image form, the text including a first character that is an instance of a first character type; and

a processor connected for accessing the first text image data, the processor operating to access the first text image data to obtain first character data that defines the first character in substantially the same way as it is defined by the first text image data, the processor obtaining the first character data automatically;

the processor further operating to produce second text image data, the second text image defining a second version of the text in image form the second version of the text including a second character that is an instance of the first character type, the second character not appearing in the first version of the text, the processor producing the second text image data so that the second character is defined by the second text image data in substantially the same way as the first character is defined by the first character data.

35. The system of claim 34, further comprising an image input device for providing image input data, the processor further being connected for receiving the image input data, the processor comprising a first subprocessor for obtaining the first text image data from the image input data and a second subprocessor for producing the second text image data from the first text image data.

36. The system of claim 35 in which the processor further comprises a third subprocessor for accessing the first text image data to obtain recognition result data, the recognition result data including character data indicating character types of characters in the text and position data indicating positions of characters in the text the second subprocessor accessing the recognition results data and using the character data and position data in obtaining the second text image data.

37. A method of operating a processor connected for accessing first text image data defining a first version of a text in image form, the first version of the text including a first character that is an instance of a first character type;

the method comprising of;

determining to modify the first version of the text by inserting an additional part that includes an instance of the first character type;

operating on the first text image data to automatically obtain first character data defining the first character in substantially the same way as the first character is defined by the first text image data;

using the first character data to produce a two-dimensional array that defines the additional part;

the two-dimensional array defining, within the additional part, a second character that is an instance of the first character type;

the two-dimensional array defining the second character in substantially the same way as the first character is defined by the first character data; and

using the first text image data and the two-dimensional array to produce second text image data, the second text data defining a second version of the text in image form;

the second version of the text including the additional part;

the second text image data defining the additional part in substantially the same way as the additional part is defined by the two-dimensional array.

38. The method of claim 37 in which the additional part is a word.

39. A method of operating a processor connected for accessing first text image data defining a first version of a text in image form, the first version of the text including a first character that is an instance of a first character type;

the first version of the text further including a first word;

the method comprising acts of;

determining that a second word that is not in the first version of the text should replace the first word;

the second word including an instance of the first character type;

operating on the first text image data to automatically obtain first character data defining the first character in substantially the same way as the first character is defined by the first text image data;

using the first character data to produce a second word two-dimensional array that defines the second word;

the second word two-dimensional array defining, within the second word, a second character that is an instance of the first character type;

the second word two-dimensional array defining the second character in substantially the same way as the first character is defined by the first character data; and

using the first text image data and the second word two-dimensional array to produce second text image data, the second text image data defining a second version of the text in image form;

the second version of the text further omitting the first word and instead including the second word so that the second word replaces the first word in the second version of the text;

the second text image data defining the second word in substantially the same way as the second word is defined by the second word two-dimensional array.

40. A method of operating a processor connected for accessing first text image data defining a first version of a text in image form, the first version of the text including a first character that is an instance of a first character type;

the first version of the text further including a first word;

the method comprising of;

operating on the first text image to determine that the first word is incorrect;

determining that a second word that is not in the first version of the text should replace the first word, the second word including an instance of the first character type;

operating on the first text image data to automatically obtain first character data defining the first character in substantially the same way as the first character is defined by the first text image data;

using the first character data to produce a second word two-dimensional array that defines the second word;

the second word two-dimensional array defining, within the second word, a second character that is an instance of the first character type;

the second word two-dimensional array defining the second character in substantially the same way as the first character is defined by the first character data; and

using the first text image data and the second word two-dimensional array to produce second text image data, the second text image data defining a second version of the text in image form;

the second version of the text further omitting the first word and instead including the second word so that the second word replaces the first word in the second version of the text;

the second text image data defining the second word in substantially the same way as the second word is defined by the second word two-dimensional array.