Portable terminal and character reading method using a portable terminal

• US 20060193517A1
• Filed: 01/30/2006
• Published: 08/31/2006
• Est. Priority Date: 01/31/2005
• Status: Active Grant

• Current Assignee: Lenovo Innovations Ltd Hong Kong (Lenovo Group Ltd.)
• Original Assignee: Casio Hitachi Mobile Communications Company Limited (NEC Corporation)
• Inventors: Itou, Toshihisa
• Granted Patent: US 7,697,722 B2
• Time in Patent Office: Days
• US Class Current: 382/182
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/287 of Kanji, Hiragana or Katakana characters

Abstract

In a portable terminal, a character string clipping section clips an image of a character string from image data photographed by a screen image pickup device. A character recognition section recognizes the clipped image of the character string and acquires a character code string corresponding to the clipped character string. A character string tracking section sets the acquired character code string as a tracking object character string when the tracking object character string extends beyond the photographable area as well as tracking the tracking object character string or a marker character string ultimately used as an input character string while repeatedly updating the marker character string. A display section highlights the tracking object character string when the tracking object character string extends beyond the photographable area of the image pickup device and displays an arrow showing the relative direction.

Claims

1. A portable terminal, comprising:

a screen image pickup means for photographing text;

a character clipping means for clipping an image containing at least one character string from an image of text photographed by the screen image pickup means;

a character recognition means for recognizing a character string contained in the image clipped by the character clipping means and acquiring a character code string of the clipped character string; and

a character string tracking means for comparing a current character code string acquired by the character recognition means and a previous character code string acquired from a character string contained in a clipped image of immediately preceding text captured by the screen image pickup means and for setting the current character code string as a tracking object character string when a character code line is at least partially the same.

2. The portable terminal according to claim 1, wherein the character code string set as the tracking object character string by the character string tracking means is ultimately used as an input character string.

3. The portable terminal according to claim 1, further comprising a display means for highlighting of the character string set as the tracking object character string by the character string tracking means upon image of the text when displaying the image of text photographed by the screen image pickup means.

4. The portable terminal according to claim 1, wherein the screen image pickup means repeatedly photographs the text at a predetermined time interval.

5. The portable terminal according to claim 1, wherein the character string clipping means acquires character string image position information of the image of the character string showing where the image photographed by the screen image pickup means is positioned when the screen image pickup means clips the image of a character string from the image photographed;

and

wherein the character string tracking means judges whether or not the tracking object character string extends beyond the photographable area of the screen image pickup means based on the character string position information and, when the tracking object character string extends beyond the photographable area of the screen image pickup means, the character string tracking means directs clipping of the character string adjacent to the position indicated by the character string image position information to the character string clipping means and so as to be within the photographable area of the screen image pickup means.

6. The portable terminal according to claim 1, wherein the character string clipping means further acquires image size information showing image size of the clipped character string upon clipping the image of a character string from the image photographed by the screen image pickup means;

and

wherein the character string tracking means judges whether or not character strings are the same position or the same image size based on the character string image position information and the image size information when judging if the same character string, wherein when the character strings to compare are in the same position or the same image size are judged as being the same character string.

7. The portable terminal according to claim 1, wherein the character string clipping means further acquires image size information showing the image size of the clipped character string upon clipping the image of a character string from the image photographed by the screen image pickup means;

and

the character string tracking means judges whether or not character strings are the same position and the same image size based on the character string image position information and the image size information when judging if the same character string, wherein when the character strings to compare are in the same position and the same image size are judged as being the same character string.

8. The portable terminal according to claim 5, wherein the character string tracking means directs clipping of the character string adjacent to the position indicated by the character string image position information to the character string clipping means so as to be within the photographable area of the screen image pickup means, which clips the character string existing adjacent to the tracking object character string by the character string clipping means and recognizes the character string existing adjacent to the tracking object character string as a marker character string for tracking of the tracking object character string.

9. The portable terminal according to claim 8, wherein the character string tracking means judges whether or not the marker character string extends beyond the photographable area of the screen image pickup means based on the character string position information of the recognized marker character string, wherein when the marker character string extends beyond the photographable area, the screen image pickup means directs clipping of the character string adjacent to the position indicated by the character string image position information to the character string clipping means so as to be within the photographable area of the screen image pickup means;

and

wherein as a result of clipping the character string adjacent to the tracking object character string by the character string clipping means, the character string adjacent to the marker character string will be recognized as the next marker character string.

10. The portable terminal according to claim 8, wherein the character string tracking means acquires direction information showing the current direction of the marker character string relative to the tracking object character string based on the character string position information of the marker character string and the character string position information of tracking object character string.

11. The portable terminal according to claim 10, wherein the display means display indicates recognized direction with the tracking object character string based on the direction information acquired by the character string tracking means.

12. The portable terminal according to claim 8, wherein the character string tracking means issues a command so that the adjacent character string is clipped in the direction containing the tracking object character string from the position containing the marker character string to the character string clipping means,

wherein the character string tracking means, upon clipping the marker character string by the character string clipping means, sets the most current marker character string and judges the direction containing the tracking object character string from the character string image position information of the most current marker string.

13. A character reading method for a portable terminal having an image pickup section, comprising the steps of:

photographing text repeatedly by the image pickup section at a predetermined time interval;

clipping an image containing at least one character string from an image of text photographed;

recognizing a character string contained in the clipped image and acquiring a character code string of the clipped character string;

comparing the acquired character code string from the character string clipped from the image of text photographed immediately preceding and setting the character string of the character code string as a tracking object character string when a character code line is at least partially the same; and

setting the character code string of a character string as the tracking object character string which is ultimately used as an input character string.

14. The character reading method according to claim 13, further comprising the step of:

highlighting of the character string set as the tracking object character string upon the image of text when displaying the image of text photographed.

15. The character reading method according to claim 13, further comprising the steps of:

acquiring character string image position information of the image of the character string showing where the image photographed is positioned when clipping the image of a character string from the image photographed by the image pickup section;

judging whether or not the tracking object character string extends beyond the photographable area of the image pickup section based on the character string position information and clipping the character string adjacent to the position indicated by the character string image position information so as to be within the photographable area when the tracking object character string extends beyond the photographable area;

recognizing the character string existing adjacent to the tracking object character string and within the photographable area as a marker character string for tracking of the tracking object character string;

acquiring direction information showing the current direction of the marker character string relative to the tracking object character string based on the character string position information of the marker character string and the character string position information of tracking object character string; and

indicating recognized direction with the tracking object character string based on the acquired direction information.

16. The character reading method according to claim 13, further comprising the steps of:

acquiring image size information showing image size of the clipped character string upon clipping the image of a character string from the image photographed by the image pickup section;

judging whether or not character strings are the same position or the same image size based on the character string image position information and the image size information when judging if the same character string; and

judging as being the same character string when the character strings to compare are in the same position or the same image size.

17. The character reading method according to claim 13, further comprising the steps of:

acquiring image size information showing image size of the clipped character string upon clipping the image of a character string from the image photographed by the image pickup section;

judging whether or not character strings are the same position and the same image size based on the character string image position information and the image size information when judging if the same character string; and

judging as being the same character string when the character strings to compare are in the same position and the same image size.

18. The character reading method according to claim 13, further comprising the steps of:

judging whether or not the marker character string extends beyond the photographable area of the image pickup section based on the character string position information of the recognized marker character string;

clipping the character string adjacent to the position indicated by the character string image position information so as to be within the photographable area when the marker character string extends beyond the photographable area; and

recognizing the character string adjacent to the marker character string as the next marker character string.

19. The character reading method according to claim 13, wherein upon clipping the character string adjacent to the direction containing the tracking object character string from the position containing the marker character string, the clipped character string will be set as the most current character string;

and judges the direction containing the tracking object character string from the character string image position information of the most current marker string.

20. A character reading program executed by a processor according to a portable terminal having an image pickup section, comprising the steps of:

photographing text by the image pickup section;

clipping an image containing at least one character string from an image of text photographed;

recognizing a character string contained in the clipped image and acquiring a character code string of the clipped character string; and

comparing the acquired character code string from the character string clipped from the image of text photographed immediately preceding and setting the character string of the character code string as a tracking object character string when a character code line is at least partially the same; and

setting the character code string of a character string as the tracking object character string which is ultimately used as an input character string.

21. The character reading program executed by a processor according to claim 20, further comprising the step of:

highlighting of the character string set as the tracking object character string upon the image of text when displaying the image of text photographed.

22. The character reading program executed by a processor according to claim 20, further comprising the steps of:

acquiring character string image position information of the image of the character string showing where the image photographed is positioned when clipping the image of a character string from the image photographed by the image pickup section;

judging whether or not the tracking object character string extends beyond the photographable area of the image pickup section based on the character string position information;

clipping the character string adjacent to the position indicated by the character string image position information so as to be within the photographable area when the tracking object character string extends beyond the photographable area;

recognizing the character string existing adjacent to the tracking object character string and within the photographable area as a marker character string for tracking of the tracking object character string;

acquiring direction information showing the current direction of the marker character string relative to the tracking object character string based on the character string position information of the marker character string and the character string position information of tracking object character string; and

indicating recognized direction with the tracking object character string based on the acquired direction information.