METHOD OF CONVERTING USER HANDWRITING INTO TEXT INFORMATION AND ELECTRONIC DEVICE FOR PERFORMING THE SAME

• US 20150073779A1
• Filed: 09/08/2014
• Published: 03/12/2015
• Est. Priority Date: 09/06/2013
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: AHN, Hee-bum, Kim, Do-hyeon, Jung, Ho-young, Hwang, Seong-taek
• Application Number:
  US14/479,902
• Publication Number:
  US 20150073779A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1456 based on user interactions
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

A method, computer-readable storage medium, and device for converting user handwriting into text information by reflecting a paragraph form of the user handwriting in an electronic device is provided. The method includes receiving a handwriting input from a user, recognizing the received handwriting input and converting the recognized handwriting input into text information, recognizing a paragraph form of the received handwriting input, and applying the recognized paragraph form to the converted text information.

Claims

1. A method of converting user handwriting into text information by reflecting a paragraph form of the user handwriting in an electronic device, the method comprising:

receiving a handwriting input from a user;

recognizing the received handwriting input and converting the recognized handwriting input into text information;

recognizing a paragraph form of the received handwriting input; and

applying the recognized paragraph form to the converted text information.

2. The method of claim 1, wherein,

the paragraph form comprises a paragraph shape, and

recognizing the paragraph form comprises recognizing, as the paragraph shape, at least one selected from indent, outdent, word spacing, alignment, line spacing, and an outline level.

3. The method of claim 1, wherein,

the paragraph form comprises a font of a letter included in a paragraph, and

recognizing the paragraph form comprises:

calculating an average size of letters included in the handwriting input;

recognizing letters, having a size within a predetermined range from the calculated average size, as having a size of a font corresponding to the average size; and

recognizing letters, having a size exceeding a range from the calculated average size, as having a larger font size than the average size.

4. The method of claim 1, wherein,

the paragraph form comprises a bullet, and

recognizing the paragraph form comprises recognizing a figure, which distinguishes a sentence or a paragraph, as a bullet.

5. The method of claim 1, further comprising:

recognizing an entity included in the received handwriting input; and

applying information, which is predetermined in correspondence with the recognized entity, to the converted text information.

6. The method of claim 1, further comprising displaying at least one selected from the received handwriting input and the converted text information.

7. The method of claim 6, wherein displaying at least one selected from the received handwriting input and the converted text information comprises storing the received handwriting input and the converted text information, and converting therebetween according to a request of a user.

8. The method of claim 1, wherein recognizing the paragraph form of the received handwriting input comprises:

determining a region, in which the handwriting input exists, as an entire region to recognize a paragraph form candidate group in the entire region; and

determining a region, in which a sentence included in the handwriting input exists, as a sentence region to recognize, as a paragraph form, at least one paragraph form of the paragraph form candidate group in the sentence region.

9. The method of claim 1, wherein recognizing the paragraph form of the received handwriting input comprises:

receiving an input, which selects a Region Of Interest (ROI) in the handwriting input, from the user to recognize a paragraph form candidate group in the ROI; and

determining a region, in which a sentence included in the ROI exists, as a sentence region to recognize, as a paragraph form, at least one paragraph form of the paragraph form candidate group in the sentence region.

10. A non-transitory computer-readable storage medium having recorded thereon a computer program for executing a method of converting user handwriting into text information by reflecting a paragraph form of the user handwriting in an electronic device, the method comprising:

receiving a handwriting input from a user;

recognizing the received handwriting input and converting the recognized handwriting input into text information;

recognizing a paragraph form of the received handwriting input; and

applying the recognized paragraph form to the converted text information.

11. An electronic device comprising:

a user handwriting input receiving unit configured to receive a handwriting input from a user;

a text information converting unit configured to recognize the received handwriting input and convert the recognized handwriting input into text information;

a paragraph form recognizing unit configured to recognize a paragraph form of the received handwriting input; and

a form applying unit configured to apply the recognized paragraph form to the converted text information.

12. The electronic device of claim 11, wherein,

the paragraph form comprises a paragraph shape, and

the paragraph form recognizing unit is configured to recognize, as the paragraph shape, at least one selected from indent, outdent, word spacing, alignment, line spacing, and an outline level.

13. The electronic device of claim 11, wherein,

the paragraph form comprises a font of a letter included in a paragraph, and

the paragraph form recognizing unit calculates an average of letters included in the handwriting input, recognizes letters, having a size within a predetermined range from the calculated average, as having a size of a font corresponding to the average, and recognizes letters, having a size exceeding a range from the calculated average, as having a larger font size than an average size.

14. The electronic device of claim 11, wherein,

the paragraph form comprises a bullet, and

the paragraph form recognizing unit is configured to recognize a figure, which distinguishes a sentence or a paragraph, as a bullet.

15. The electronic device of claim 11, further comprising an entity recognizing unit configured to recognize an entity included in the received handwriting input,

wherein the form applying unit is configured to apply information, which is predetermined in correspondence with the recognized entity, to the converted text information.

16. The electronic device of claim 11, further comprising a display unit configured to display at least one selected from the received handwriting input and the converted text information.

17. The electronic device of claim 16, wherein the display unit is configured to store the received handwriting input and the converted text information, and convert therebetween according to a request of a user.

18. The electronic device of claim 11, wherein the paragraph form recognizing unit is configured to determine a region, in which the handwriting input exists, as an entire region to recognize a paragraph form candidate group in the entire region, and determine a region, in which a sentence included in the handwriting input exists, as a sentence region to recognize, as a paragraph form, at least one paragraph form of the paragraph form candidate group in the sentence region.

19. The electronic device of claim 11, wherein the paragraph form recognizing unit is configured to receive an input, which selects a Region Of Interest (ROI) in the handwriting input, from the user to recognize a paragraph form candidate group in the ROI, and determine a region, in which a sentence included in the ROI exists, as a sentence region to recognize, as a paragraph form, at least one paragraph form of the paragraph form candidate group in the sentence region.