Method and device for reproducing partial handwritten content

• US 10,528,249 B2
• Filed: 09/26/2014
• Issued: 01/07/2020
• Est. Priority Date: 05/23/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yang, Pil-seung, Park, Da-hye, Won, Seol-hye, Yun, In-kuk, Park, Yong-gook
• Primary Examiner(s): Patel, Jayesh A
• Application Number:
  US14/497,451
• Publication Number:
  US 20150339524A1
• Time in Patent Office: 1,929 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method and apparatus for reproducing a portion of handwriting displayed on a screen in a same temporal manner in which the handwriting was handwritten.

Claims

1. A device comprising:

a display that displays handwritten content in response to a handwritten input of a user;

a memory configured to store data of the handwritten content, the data of the handwritten content comprising strokes of the handwritten content and time information, wherein the strokes comprise a first stroke and a second stroke, and wherein the time information indicates a first input time corresponding to the first stroke and a second input time corresponding to the second stroke;

a user interface configured to receive a first user input for selecting a portion of the handwritten content displayed on the display, wherein the selected portion of the handwritten content corresponds to the first stroke and the second stroke, and to receive a second user input for reproducing the selected portion of the handwritten content; and

a controller configured to, in response to receiving the second user input for reproducing the selected portion of the handwritten content, control the display to reproduce the selected portion of the handwritten content by sequentially reproducing the first stroke at a first output time corresponding to the first input time, and the second stroke at a second output time corresponding to the second input time,

wherein the first user input specifies a boundary of a region of interest which includes the selected portion of the handwritten content which can be reproduced based on the strokes and the time information, and

wherein in response to receiving the second user input, the controller is further configured to control the display to remove the handwritten content from the display before reproducing the selected portion of the handwritten content.

2. The device of claim 1, wherein the controller is further configured to control the display to reproduce the selected portion of the handwritten content according to position information of the selected portion and time information of the selected portion.

3. The device of claim 2, wherein the position information comprises time-sampled positions at which the handwritten content is handwritten, and

wherein the time information comprises sampling times of the time-sampled positions.

4. The device of claim 1, wherein the controller is further configured to obtain timestamp information of the handwritten content, and control the display to reproduce the selected portion of the handwritten content according to timestamp information of the selected portion of the handwritten content.

5. The device of claim 4, wherein the controller is further configured to reproduce the selected portion of the handwritten content while reproducing multimedia content synchronized with the portion of the handwritten content.

6. The device of claim 1, wherein the handwritten content is located at least one coordinate at which the handwritten input was performed, and

wherein the first user input for selecting the portion of the handwritten content displayed on the display comprises selects a portion including the at least one coordinate at which the handwritten input was performed.

7. The device of claim 1, wherein the controller is further configured to control the display to display a control panel comprising a reproduce function button within a predetermined distance from the portion of the handwritten content when the portion of the handwritten content is selected, and

the user interface receives an input for activating the reproduce function button via the control panel.

8. The device of claim 1, wherein the controller is configured to extract the strokes included in the portion of the handwritten content, and determine an order of the strokes of the portion of the handwritten content by using timestamp information corresponding to the strokes.

9. The device of claim 8, wherein the controller is configured to determine an initial stroke that is input first from among the strokes as a start position and a last stroke that is input last from among the strokes as an end position.

10. The device of claim 1, wherein the controller is configured to extract moving image content or audio content corresponding to the portion of the handwritten content, and provide the extracted moving image content or the extracted audio content.

11. The device of claim 10, wherein, when plural portions of the handwritten content are selected, the controller provides a list of a plurality of moving image contents corresponding to the plural portions of the handwritten content.

12. The device of claim 1, wherein the controller is configured to edit the handwritten content by using the time information.

19. The device of claim 1, wherein the controller is further configured to reproduce the first stroke and the second stroke by sequentially outputting lines connecting coordinate values associated with the first stroke and the second stroke.

13. A method of reproducing handwritten content the method comprising:

displaying handwritten content in response to a handwritten input of a user;

storing data of the handwritten content, the data of the handwritten content comprising strokes of the handwritten content and time information, wherein the strokes comprise a first stroke and a second stroke, and wherein the time information indicates a first input time corresponding to the first stroke and a second input time corresponding to the second stroke;

receiving a first user input for selecting a portion of the handwritten content displayed on a display, wherein the selected portion of the handwritten content corresponds to the first stroke and the second stroke;

receiving a second user input for reproducing the selected portion of the handwritten content;

in response to receiving the second user input for reproducing the selected portion of the handwritten content, reproducing the selected portion of the handwritten content by sequentially reproducing the first stroke at a first output time corresponding to the first input time, and the second stroke at a second output time corresponding to the second input time; and

in response to receiving the second user input, removing the handwritten content from the display before reproducing the selected portion of the handwritten content,

wherein the first user input specifies a boundary of a region of interest which includes the selected portion of the handwritten content which can be reproduced based on the strokes and the time information.

14. The method of claim 13, wherein the reproducing comprises reproducing the selected portion of the handwritten content according to position information of the selected portion and time information of the selected portion.

15. The method of claim 14, wherein the position information comprises time-sampled positions at which the handwritten content is handwritten, and

wherein the time information comprises sampling times of the time-sampled positions.

16. The method of claim 13, further comprising obtaining timestamp information of the handwritten content,

wherein the reproducing comprises reproducing the selected portion of the handwritten content according to timestamp information of the selected portion of the handwritten content.

17. The method of claim 13, wherein the first stroke and the second stroke are associated with at least one coordinate at which the first stroke and the second stroke were handwritten,

and wherein the reproducing comprises selecting the portion of the handwritten content based on a coordinate associated with the first stroke and the second stroke.

18. A non-transitory computer-readable recording medium having recorded thereon a program, which when executed by a device causes the device to execute a method of reproducing handwritten content, the method comprising:

displaying handwritten content in response to a handwritten input of a user;

storing data of the handwritten content, the data of the handwritten content comprising strokes of the handwritten content and time information, wherein the strokes comprise a first stroke and a second stroke, and wherein the time information indicates a first input time corresponding to the first stroke and a second input time corresponding to the second stroke;

receiving a first user input for selecting a portion of the handwritten content displayed on the display, wherein the selected portion of the handwritten content corresponds to the first stroke and the second stroke;

receiving a second user input for reproducing the selected portion of the handwritten content; and

in response to receiving the second user input for reproducing the selected portion of the handwritten content, reproducing the selected portion of the handwritten content by sequentially reproducing the first stroke at a first output time corresponding to the first input time, and the second stroke at a second output time corresponding to the second input time,

wherein the first user input specifies a boundary of a region of interest which includes the selected portion of the handwritten content which can be reproduced based on the strokes and the time information, and

wherein in response to receiving the second user input, the method further comprises removing the handwritten content from the display before reproducing the selected portion of the handwritten content.

20. A device comprising:

a display that displays handwritten content in response to a handwritten input of a user;

a memory configured to store data of the handwritten content, the data of the handwritten content comprising strokes of the handwritten content input according to a drawing process of the handwritten input;

a user interface configured to receive a user input for selecting a portion of the handwritten content displayed on the display, wherein the selected portion of the handwritten content corresponds to at least one stroke from among the strokes of the handwritten content, and to receive a user input for reproducing the selected portion of the handwritten content; and

a controller configured to, in response to receiving the user input for reproducing the selected portion of the handwritten content, control the display to reproduce the selected portion of the handwritten content by reproducing a portion of the drawing process corresponding to the at least one stroke,

wherein the display is configured to display the handwritten content, and

wherein the user interface is configured to receive the user input for reproducing the selected portion of the handwritten content by receiving a user input for selecting a reproduce function button;

wherein, in response to the selection of the reproduce function button, the controller is further configured to control the display to remove the handwritten content from the display before reproducing the selected portion of the handwritten content.