Entering information through an OCR-enabled viewfinder

• US 9,251,428 B2
• Filed: 11/07/2012
• Issued: 02/02/2016
• Est. Priority Date: 07/18/2009
• Status: Active Grant

• Current Assignee: ABBYY Development LLC
• Original Assignee: ABBYY Development LLC
• Inventors: Rozumyanskiy, Michael, Samoylov, Boris
• Primary Examiner(s): Rao, Andy
• Assistant Examiner(s): WALKER, JARED T
• Application Number:
  US13/671,021
• Publication Number:
  US 20140141836A1
• Time in Patent Office: 1,182 Days
• Field of Search: 382/181, 382/182, 382/189, 382/321, 348/161
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/1456 based on user interactions
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04M 2250/70 methods for entering alphabetical characters, e.g. multi-tap or dictionary disambiguation methods for entering alphabetical characters per se G06F3/0237

Abstract

An improved method for entering text or objects into fields is provided. Instead of a keyboard, a viewfinder provides text segmenting, text selecting and text recognizing (optical character recognition—OCR) functionalities. Text at a marker (e.g., a cursor or crosshairs) associated with the viewfinder is recognized and insertion of the recognized text is performed. The current frame is generally not captured by a user. As the user moves the camera to position a new word at the marker, the view finder is updated to provide results of recognition associated with the new word. A user is able to identify an area of interest, select text or other object of interest, and insert the same into one or more fields. The viewfinder may operate in conjunction with a camera of the electronic device on which the viewfinder is operating. Other mechanisms and variations are described.

Claims

1. A method for facilitating text entry for an electronic device, the method comprising:

activating a field for text entry on a display of the electronic device;

displaying a current frame on the display associated with a viewfinder of the electronic device concurrently while also displaying the activated field for text entry;

determining an area of interest in the current frame;

recognizing text in the area of interest associated with the current frame, wherein recognizing text in the area of interest is performed without capturing the current frame in the viewfinder and without persisting in storage the current frame; and

displaying text corresponding to the recognized text in the activated field.

2. The method of claim 1, wherein determining the area of interest comprises recognizing an object in the area of interest without interrupting displaying of the current frame in the viewfinder.

3. The method of claim 1, wherein determining the area of interest is based on a selection associated with the area of interest in the current frame in association with the viewfinder.

4. The method of claim 3, wherein the display of the electronic device is touch-sensitive, and wherein the selection associated with the area of interest includes an indication of a gesture detected along the touch-sensitive display.

5. The method of claim 1, wherein determining the area of interest is based on an analysis of an area of the current frame centered on a marker associated with the viewfinder detecting an area on a marker.

6. The method of claim 1, wherein the method further comprises:

displaying a new current frame based on a detected movement of the electronic device or a detected change of the new frame relative to the current frame.

7. The method of claim 6, wherein displaying the new current frame based on the detected change of the new frame relative to the current frame includes displaying the new frame when a marker is outside an area defined relative to the current frame.

8. The method of claim 1, further comprising inserting a copy of the text in the display field, wherein inserting a copy of the text in the displayed field is performed with respect to the viewfinder in proximity to the detected area of interest.

9. The method of claim 8, wherein the text in the area of interest has one or more characters, wherein said recognizing the text is recognizing one or more characters, and wherein inserting the copy of the text is inserting the one or more characters in the displayed field.

10. The method of claim 1, wherein displaying the current frame in the viewfinder includes displaying a representation of at least a portion of the current frame in the viewfinder of the electronic device.

11. The method of claim 1, wherein displaying the current frame in the viewfinder is facilitated by a camera that is part of the electronic device.

12. The method of claim 11, wherein said displaying the viewfinder on the display of the electronic device includes providing a control for the camera.

13. The method of claim 1, wherein a virtual keyboard is activated and displayed in response to activating the field for text entry, and wherein the viewfinder is displayed in response to detecting a selection to display the viewfinder.

14. The method of claim 13, wherein the viewfinder substantially replaces the virtual keyboard on the display of the electronic device.

15. The method of claim 13, wherein the viewfinder is displayed simultaneously with at least a portion of the virtual keyboard on the display of the electronic device.

16. The method of claim 1, wherein detecting a selection associated with an area of interest in the current frame in association with the viewfinder is made in an interactive regime of the viewfinder of a camera application.

17. The method of claim 1, wherein displaying the current frame includes accessing an image from a memory storage of the electronic device.

18. The method of claim 1, wherein recognizing the text in the area of interest associated with the current frame further comprises:

analyzing the recognized text in the area of interest;

initiating a call if the recognized text in the area of interest is a telephone number; and

opening an email client if the recognized text in the area of interest is an email address.

19. An electronic device for entering text into a text field, the electronic device comprising:

a processor;

a display in electronic communication with the processor;

a memory in electronic communication with the display and the processor, the memory configured with instructions to perform a method, the method including;

activating a field for text entry on the display of the electronic device;

displaying a current frame on the display concurrently while also displaying the activated field for text entry, wherein the current frame is associated with a viewfinder;

determining an area of interest associated with the viewfinder;

recognizing text in the determined area of interest associated with the current frame, wherein recognizing text in the determined area of interest is performed without capturing the current frame in the viewfinder and without persisting in storage the current frame; and

displaying text corresponding to the recognized text in the activated field.

20. The electronic device of claim 19, wherein said determining the area of interest includes segmenting characters associated with said area of interest, and wherein said displaying text includes recognizing characters and inserting said recognized characters in the activated field.

21. The electronic device of claim 19, wherein said determining the area of interest includes performing recognition of characters associated with said area of interest, and wherein said displaying text includes inserting characters in the activated field.

22. The electronic device of claim 19, wherein the electronic device further comprises a camera, and wherein displaying the current frame in the viewfinder includes displaying a representation of at least a portion of a frame of video dynamically captured by a camera application associated with the electronic device.

23. The electronic device of claim 22, wherein said displaying the viewfinder on the display of the electronic device includes providing a control for the camera.

24. The electronic device of claim 22, wherein the method further comprises capturing with the camera and storing the frame in a storage of the electronic device in addition to displaying the portion of the frame in the viewfinder.

25. The electronic device of claim 19, wherein a virtual keyboard is activated and displayed in response to activating the field for text entry, and wherein the viewfinder is displayed in response to detecting a selection to display the viewfinder.