Method and device for reproducing content

• US 9,652,678 B2
• Filed: 05/22/2015
• Issued: 05/16/2017
• Est. Priority Date: 05/23/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yang, Pil-seung, Yun, In-kuk, Park, Da-hye, Won, Seol-hye, Park, Yong-gook
• Primary Examiner(s): Rahmjoo, Manuchehr
• Application Number:
  US14/720,111
• Publication Number:
  US 20150339051A1
• Time in Patent Office: 725 Days
• Field of Search: 382189
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 30/2272 with lexical matching

Abstract

Provided is a device including: a display unit configured to display handwritten content based on an analog handwritten input of a user; a user input unit that receives a user input of selecting a portion of the handwritten content displayed on the display unit; and a control unit reproduces a segment of multimedia content, which corresponds to the portion of the handwritten content, from the multimedia content synchronized with the handwritten content.

Claims

1. A device comprising:

a display configured to display handwritten content in response to an analog handwritten input of a user;

a memory configured to store data of the handwritten content, the data of the handwritten content comprising strokes in association with time stamp information indicating a time of input of the analog handwritten input corresponding to the strokes of the handwritten content; and

a processor configured to control the display to provide a user interface configured to receive a user input of selecting a portion of the handwritten content displayed on the display corresponding to at least one stroke of the handwritten content, receive a user input of editing first content corresponding to the portion of the handwritten content into second content, store strokes and time stamp information of the second content in the memory, and sequentially reproduce the handwritten content from the memory by reproducing the second content instead of the first content on the display when the portion of the handwritten content is reproduced.

2. The device of claim 1, wherein the processor is further configured to extract strokes from the handwritten content and determine an order of the strokes of the handwritten content by using the time stamp information of the handwritten content corresponding to the strokes of the handwritten content.

3. The device of claim 1, wherein the processor is further configured to reproduce the second content by determining a first stroke that is input first from among the strokes of the second content as a start position and a last stroke that is input last from among the strokes of the second content as an end position.

4. The device of claim 1, wherein, when the portion of the handwritten content is selected, the processor is further configured to control the display to display a control panel comprising an edit function button within a certain distance from the portion of the handwritten content.

5. The device of claim 1, wherein the user interface is further configured to receive a user input of deleting the first content and drawing the strokes of the second content in a region where the first content is deleted.

6. The device of claim 5, wherein the processor is further configured to add information about the strokes of the second content to a timeline corresponding to the deleted first content from a list of a plurality of strokes corresponding to the handwritten content.

7. The device of claim 5, wherein the processor is further configured to synchronize the second content and a segment of multimedia content corresponding to the first content.

8. The device of claim 1, wherein the processor is further configured to reproduce multimedia content synchronized with the handwritten content.

9. A method of reproducing content, the method being performed by a device and comprising:

displaying handwritten content in response to an analog handwritten input of a user on a display of the device;

storing data of the handwritten content in memory, the data of the handwritten content comprising strokes in association with time stamp information indicating a time of input of the analog handwritten input corresponding to the strokes of the handwritten content;

receiving a user input of selecting a portion of the handwritten content corresponding to at least one stroke of the handwritten content that is displayed on the display of the device;

receiving a user input of editing first content corresponding to the portion of the handwritten content into second content;

storing strokes and time stamp information of the second content in the memory; and

sequentially reproducing the handwritten content from the memory by reproducing the second content instead of the first content on the display when the portion of the handwritten content is reproduced.

10. The method of claim 9, wherein the reproducing comprises:

extracting strokes from the handwritten content; and

determining an order of the strokes of the handwritten content by using time stamp information of the handwritten content corresponding to the strokes of the handwritten content.

11. The method of claim 9, wherein the reproducing the second content comprises determining a first stroke that is input first from among the strokes of the second content as a start position and a last stroke that is input last from among the strokes of the second content as an end position.

12. The method of claim 9, further comprising:

displaying a control panel comprising an edit function button within a certain distance from the portion of the handwritten content.

13. The method of claim 9, wherein the receiving comprises receiving a user input of deleting the first content and drawing the strokes of the second content in a region where the first content is deleted.

14. The method of claim 13, further comprising:

adding information about the strokes of the second content to a timeline corresponding to the deleted first content from a list of a plurality of strokes corresponding to the handwritten content.

15. The method of claim 13, further comprising:

synchronizing the second content and a segment of multimedia content corresponding to the first content.

16. The method of claim 9, further comprising:

reproducing multimedia content synchronized with the handwritten content.

17. A non-transitory computer-readable recording medium having recorded thereon a program, which when executed by a device causes the device to execute a method of reproducing content, the method comprising:

displaying handwritten content in response to an analog handwritten input of a user on a display of the device;

storing data of the handwritten content in memory, the data of the handwritten content comprising strokes in association with time stamp information indicating a time of input of the analog handwritten input corresponding to the strokes of the handwritten content;

receiving a user input of selecting a portion of the handwritten content corresponding to at least one stroke of the handwritten content that is displayed on the display of the device;

receiving a user input of editing first content corresponding to the portion of the handwritten content into second content;

storing strokes and time stamp information of the second content in the memory; and

sequentially reproducing the handwritten content from the memory by reproducing the second content instead of the first content on the display when the portion of the handwritten content is reproduced.