Method for providing information based on contents and electronic device thereof

• US 10,095,380 B2
• Filed: 08/27/2014
• Issued: 10/09/2018
• Est. Priority Date: 08/27/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Moon, Byung-Hyuk, Kong, Kyu-Chul, Kwon, Hyun-Woong, Kim, Keun-Soo, Kim, Jeong-Hoon
• Primary Examiner(s): Song, Daeho D
• Application Number:
  US14/470,850
• Publication Number:
  US 20150067609A1
• Time in Patent Office: 1,504 Days
• Field of Search: 715835, 715769, 715770
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for obtaining information and an electronic device thereof. The method for obtaining the information in the electronic device includes: displaying one or more representing objects for representing contents on a display area; determining a selection area which is at least part of the display area based on a user input; detecting a representing object of the one or more representing objects as a clip object corresponding to the user input, wherein at least part of the representing object corresponds to the selection area; and recognizing a content corresponding to the clip object.

Claims

1. A method of an electronic device, the method comprising:

displaying, on a display area, a content comprising a plurality of images and a plurality of texts;

in response to detecting a first input for designating a selection area included in the display area, identifying an image located in the selection area among the plurality of images and a text located in the selection area among the plurality of texts;

storing, in a database, information regarding the image mapped to a first type and the text mapped to a second type;

detecting a second input on an icon indicating an application to insert at least one of the image or the text into the application;

identifying, in an entire area of a user interface (UI) of the application, a first area capable of receiving an object of the first type and a second area capable of receiving an object of the second type;

respectively obtaining, by retrieving from the database based on the first type and the second type, the image mapped to the first type and the text mapped to the second type; and

displaying, based on the obtaining from the database, the image in the first area which is associated with the first type, and the text in the second area which is associated with the second type, within the UI of the application.

2. The method of claim 1, further comprising:

displaying, in response to the detecting the first input, a first icon indicating the first type and a second icon indicating the second type,

wherein the first icon overlaps at least a part of the selection area or to be adjacent to the selection area, and

wherein the second icon overlaps at least a part of the selection area or to be adjacent to the selection area.

3. The method of claim 1, wherein the content further comprising at least one video, at least one audio, or at least one uniform resource identifier (URI), and

wherein the method further comprising:

if the selection area further includes one of video, audio, or URL, storing information regarding the one of video, audio, or URL mapped to a third type;

based on identifying a third area capable of receiving an object of the third type, obtaining the one of video, audio, or URL mapped to the third type; and

displaying, within the UI, the third area into which the one of video, audio, or URL is inserted.

4. The method of claim 1, further comprising:

displaying, within the UI, a bar comprising a first icon for inserting the image into the first area and a second icon for inserting the text into the second area.

5. The method of claim 4, further comprising:

in response to detecting a third input on the first icon displayed in the bar, inputting the image on the first area displayed within the UI, and

in response to detecting a fourth input on the second icon displayed in the bar, inputting the text on the second area displayed within the UI.

6. The method of claim 1, further comprising:

identifying, based on the detecting the second input, whether the UI includes the first area capable of receiving the image;

identifying, based on the identifying that the UI does not include a first area capable of receiving the image, a third area associated with a third type within the UI;

converting, based on the identifying the third type, image into an object mapped to the third type; and

inserting the converted object with the third type into the third area associated with the third type.

7. The method of claim 1, wherein location information of a plurality of objects included in the content and information on the plurality of objects included in the content are stored as data of nodes corresponding to the plurality of objects included in the content in a data structure in which one or more nodes are connected to one another.

8. The method of claim 7, further comprising:

detecting a node corresponding to the location information of the image and the text included in the selection area from the data structure; and

identifying, based on detecting the location information of the image and the text, the first type and the second type from the data structure.

9. The method of claim 7, further comprising detecting the image and the text corresponding to hierarchically connected nodes of nodes corresponding to objects at least part of which is comprised in the selection area in the data structure.

10. The method of claim 1, wherein the image and the text which are included in the selection area are highlighted relative to remaining objects among a plurality of objects.

11. The method of claim 1, wherein the identifying the image and the text comprises identifying the image and the text by parsing data associated with the content.

12. The method of claim 1, wherein the second input comprises a drag and drop input.

13. The method of claim 12, further comprising:

in response to the detecting a start point of the second input, highlighting one or more applications capable of inserting at least one of the image or the text.

14. The method of claim 1, wherein the selection area comprises a closed curve area or a rectangular area,

wherein the selection area is determined as the rectangular area by:

detecting an input for drawing a non-closed curve;

in response to the detecting the input for drawing the non-closed curve, detecting a start point of the non-closed curve and an end point of the non-closed curve; and

determining the rectangular are having a diagonal line, wherein a straight line connecting the start point and the end point is determined as the diagonal line.

15. The method of claim 1, further comprising,

based on detecting the first input for designating the selection area, displaying a preview window for indicating the image and the text which are included in the selection area.

16. An electronic device comprising:

a memory storing instructions;

a processor, coupled to the memory, configured to execute the stored instructions to;

display, on a display area, a content comprising a plurality of images and a plurality of texts;

in response to detecting a first input for designating a selection area included in the display area, identify an image located in the selection area among the plurality of images and a text located in the selection area among the plurality of texts;

store, in a database, information regarding the image mapped to a first type and the text mapped to a second type,

detect a second input on an icon indicating an application to insert at least one of the image or the text into the application;

identify, in an entire area of a user interface (UI) of the application a first area capable of receiving an object of the first type and a second area capable of receiving an object of the second type;

respectively obtaining, by retrieving from the database based on the first type and the second type, the image mapped to the first type and the text mapped to the second type; and

display, based on the obtaining from the database, the image in the first area which is associated with the first type, and the text in the second area which is associated with the second type, within the UI of the application.

17. The electronic device of claim 16, wherein the processor is further configured to execute the instructions to:

displaying, in response to the detecting the first input, a first icon indicating the first type and a second icon indicating the second type,

wherein the first icon overlaps at least a part of the selection area or to be adjacent to the selection area, and

wherein the second icon overlaps at least a part of the selection area or to be adjacent to the selection area.

18. The electronic device of claim 16, wherein the content further comprising at least one video, at least one audio, or at least one uniform resource identifier (URI) mapped to a third type, and

wherein the processor is further configured to execute the instructions to:

if the selection area further includes one of video, audio, or URL, store information regarding the one of video, audio, or URL mapped to a third type;

obtain, based on identifying a third area capable of receiving an object of the third type, the one of video, audio, or URL mapped to the third type; and

display, within the UI, the third area into which the one of video, audio, or URL is inserted.

19. The electronic device of claim 16, wherein the processor is further configured to execute the instructions to display, within the UI, a bar comprising a first icon for inserting the image into the first area and a second icon for inserting the text into the second area.

20. The electronic device of claim 19, wherein the processor is further configured to execute the instructions to input, in response to detecting a third input on the first icon displayed in the bar, the image on the first area displayed within the UI, and

in response to detecting a fourth input on the second icon displayed in the bar, inputting the text on the second area displayed within the UI.

21. The electronic device of claim 16, wherein the processor is further configured to execute the instructions to:

identify, based on the detecting the second input, whether the UI includes the first area capable of receiving the image;

identify, based on the identifying that the UI does not include the first area capable of receiving the image, a third area associated with a third type within the UI;

convert, based on the identifying the third type, the image into an object mapped to the third type; and

insert the converted object with the third type into the third area associated with the third type.

22. A non-transitory computer readable storing medium for storing instructions, the instructions being set to allow at least one processor to perform at least one operation when the instructions are executed by the at least one processor, the at least one operation comprising operations of:

displaying on a display area, a content comprising a plurality of images and a plurality of texts;

in response to detecting a first input for designating a selection area included in the display area, identifying an image located in the selection area among the plurality of images and a text located in the selection area among the plurality of texts;

storing, in a database, information regarding the image mapped to a first type and the text mapped to a second type,

detecting a second input on an icon indicating an application to insert at least one of the image or the text into the application; and

identifying, in an entire area of a user interface (UI) of the application, a first area capable of receiving an object of the first type and a second area capable of receiving an object of the second type;

respectively obtaining, by retrieving from the database based on the first type and the second type, the image mapped to the first type and the text mapped to the second type; and

displaying, based on the obtaining from the database, the image in the first area which is associated with the first type, and the text in the second area which is associated with the second type, within the UI of the application.