Entering Information Through an OCR-Enabled Viewfinder

• US 20140141836A1
• Filed: 11/07/2012
• Published: 05/22/2014
• Est. Priority Date: 07/18/2009
• Status: Active Grant

• Current Assignee: ABBYY Development LLC
• Original Assignee: ABBYY Software
• Inventors: Rozumyanskiy, Michael, Samoylov, Boris
• Granted Patent: US 9,251,428 B2
• Time in Patent Office: Days
• US Class Current: 455/556.1
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/1456 based on user interactions
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04M 2250/70 methods for entering alphabetical characters, e.g. multi-tap or dictionary disambiguation methods for entering alphabetical characters per se G06F3/0237

Abstract

An improved method for entering text or objects into fields is provided. Instead of a keyboard, a viewfinder provides text segmenting, text selecting and text recognizing (optical character recognition—OCR) functionalities. Text at a marker (e.g., a cursor or crosshairs) associated with the viewfinder is recognized and insertion of the recognized text is performed. The current frame is generally not captured by a user. As the user moves the camera to position a new word at the marker, the view finder is updated to provide results of recognition associated with the new word. A user is able to identify an area of interest, select text or other object of interest, and insert the same into one or more fields. The viewfinder may operate in conjunction with a camera of the electronic device on which the viewfinder is operating. Other mechanisms and variations are described.

Claims

1. A method for facilitating object/text entry for an electronic device, the method comprising:

activating a field for object/text entry on a display of the electronic device;

displaying a current frame on the display associated with a viewfinder of the electronic device;

determining an area of interest;

recognizing an object in the area of interest associated with the current frame; and

inserting a copy of the object in the activated field.

2. The method of claim 1, wherein recognizing an object in the area of interest is performed without capturing the current frame in the viewfinder and without persisting in storage the current frame.

3. The method of claim 1, wherein determining the area of interest comprises recognizing an object in the area of interest without interrupting displaying of the current frame in the viewfinder.

4. The method of claim 1, wherein determining the area of interest is based on a selection associated with the area of interest in the current frame in association with the viewfinder.

5. The method of claim 4, wherein the display of the electronic device is touch-sensitive, and wherein the selection associated with the area of interest includes an indication of a gesture detected along the touch-sensitive display.

6. The method of claim 1, wherein determining the area of interest is based on an analysis of an area of the current frame centered on a marker associated with the viewfinder detecting an area on a marker.

7. The method of claim 1, wherein the method further comprises:

displaying a new current frame based on a detected movement of the electronic device or a detected change of the new frame relative to the current frame.

8. The method of claim 7, wherein displaying the new current frame based on the detected change of the new frame relative to the current frame includes displaying the new frame when a marker is outside an area defined relative to the current frame.

9. The method of claim 1, wherein inserting a copy of the object in the displayed field is performed with respect to the viewfinder in proximity to the detected area of interest, wherein a copy of the object may be text, figures, an image, or characters.

10. The method of claim 1, wherein the object in the area of interest is one or more characters, wherein said recognizing the object is recognizing one or more characters, and wherein inserting the copy of the object is insertingthe one or more characters in the displayed field.

11. The method of claim 1, wherein displaying the current frame in the viewfinder includes displaying a representation of at least a portion of the current frame in the viewfinder of the electronic device.

12. The method of claim 1, wherein displaying the current frame in the viewfinder is facilitated by a camera that is part of the electronic device.

13. The method of claim 12, wherein said displaying the viewfinder on the display of the electronic device includes providing a control for the camera.

14. The method of claim 1, wherein a virtual keyboard is activated and displayed in response to activating the field for text entry, and wherein the viewfinder is displayed in response to detecting a selection to display the viewfinder.

15. The method of claim 14, wherein the viewfinder substantially replaces the virtual keyboard on the display of the electronic device.

16. The method of claim 14, wherein the viewfinder is displayed simultaneously with at least a portion of the virtual keyboard on the display of the electronic device.

17. The method of claim 1, wherein detecting a selection associated with an area of interest in the current frame in association with the viewfinder is made in an interactive regime of the viewfinder of a camera application.

18. The method of claim 1, wherein displaying the current frame includes accessing an image from a memory storage of the electronic device.

19. The method of claim 1, wherein recognizing the object in the area of interest associated with the current frame further comprises:

analyzing the recognized object in the area of interest;

initiating a call if the recognized object in the area of interest is a telephone number; and

opening an email client if the recognized object in the area of interest is an email address.

20. An electronic device for entering text into a text field, the electronic device comprising:

a processor;

a display in electronic communication with the processor;

a memory in electronic communication with the display and the processor, the memory configured with instructions to perform a method, the method including;

activating a field for object entry on the display of the electronic device;

displaying a current frame on the display, wherein the current frame is associated with a viewfinder;

determining an area of interest associated with the viewfinder; and

inserting information derived from the area of interest in the activated field.

21. The electronic device of claim 20, wherein said determining an area of interest from said detected selection includes performing recognition of text associated with said area of interest, and wherein said inserting information includes inserting text in the activated field.

22. The electronic device of claim 20, wherein said determining the area of interest from said detected selection includes segmenting characters associated with said area of interest, and wherein said inserting information includes recognizing characters and inserting said recognized characters in the activated field.

23. The electronic device of claim 20, wherein said determining the area of interest from said detected selection includes performing recognition of characters associated with said area of interest, and wherein said inserting information includes inserting characters in the activated field.

24. The electronic device of claim 20, wherein the electronic device further comprises a camera, and wherein displaying the current frame in the viewfinder includes displaying a representation of at least a portion of a frame of video dynamically captured by a camera application associated with the electronic device.

25. The electronic device of claim 22, wherein said displaying the viewfinder on the display of the electronic device includes providing a control for the camera.

26. The electronic device of claim 24, wherein the method further comprises capturing with the camera and storing the frame in a storage of the electronic device in addition to displaying the portion of the frame in the viewfinder.

27. The electronic device of claim 20, wherein a virtual keyboard is activated and displayed in response to activating the field for object/text entry, and wherein the viewfinder is displayed in response to detecting a selection to display the viewfinder.