Data processing systems, devices, and methods for content analysis

• US 9,430,720 B1
• Filed: 04/20/2016
• Issued: 08/30/2016
• Est. Priority Date: 09/21/2011
• Status: Active Grant

• Current Assignee: Patnotate LLC
• Original Assignee: Barry Greenbaum, Roman Tsibulevskiy
• Inventors: Tsibulevskiy, Roman, Greenbaum, Barry
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US15/133,288
• Publication Number:
  US 20160232431A1
• Time in Patent Office: 132 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24553 of query operations
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/244 using graphical properties, e.g. alphabet type or font
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

Systems, devices and methods operative for identifying a reference within a figure and an identifier in a text associated with the figure, the reference referring to an element depicted in the figure, the reference corresponding to the identifier, the identifier identifying the element in the text, placing the identifier on the figure at a distance from the reference, the identifier visually associated with the reference upon the placing, the placing of the identifier on the figure is irrespective of the distance between the identifier and the reference.

Claims

1. A method comprising:

facilitating, via a processor, a capture of an image via a camera, wherein the image depicts an element, a line, a first alphanumeric string, and a second alphanumeric string, wherein the line extends between the element and the first alphanumeric string;

identifying, via the processor, the first alphanumeric string and the second alphanumeric string;

accessing, via the processor, a data structure based at least in part on the second alphanumeric string, wherein the data structure stores a text containing an alphabetic string and a third alphanumeric string, wherein the alphabetic string is in proximity of the third alphanumeric string;

performing, via the processor, a search for the third alphanumeric string based at least in part on the first alphanumeric string;

identifying, via the processor, the alphabetic string in proximity of the third alphanumeric string based at least in part on the search;

generating, via the processor, a copy of the alphabetic string;

modifying, via the processor, the image to depict the copy such that the copy is associated with at least one of the element, the line, or the first alphanumeric string when the image is at least one of displayed or printed.

2. The method of claim 1, wherein the processor and the camera are included in an eyewear device.

3. The method of claim 1, wherein the accessing is over a network.

4. The method of claim 1, further comprising:

storing, via the processor, the image in a memory which stores the data structure, wherein the processor is coupled to the memory.

5. The method of claim 1, wherein the data structure is a first data structure, wherein the alphabetic string is recited in a first language, and further comprising:

accessing, via the processor, a second data structure referencing between the first language and a second language;

translating, via the processor, the copy from the first language to the second language based at least in part on the second data structure.

6. The method of claim 5, wherein the second data structure is hosted on a data source remote from the processor.

7. The method of claim 5, wherein the second data structure is hosted on a data source local to the processor.

8. The method of claim 5, further comprising:

detecting, via the processor, a setting associated with the second language before the accessing the second data structure.

9. The method of claim 5, wherein the second language is selected from a menu provided to a user before the translating.

10. The method of claim 1, wherein the line is a first line, wherein the modifying comprises at least one of:

placing, via the processor, the copy into the image adjacent to the first alphanumeric string without overlying the first alphanumeric string;

placing, via the processor, a second line and the copy into the image such that the first alphanumeric string is positioned between the first line and the second line and such that the second line is positioned between the first alphanumeric string and the copy;

replacing, via the processor, the first alphanumeric string in the image with the copy;

placing, via the processor, the copy into the image such that the copy is positioned within the element;

or

placing, via the processor, a shape and the copy into the image such that the shape encloses the first alphanumeric string and the copy.

11. A method comprising:

facilitating, via a processor, a capture of an image via a camera, wherein the image depicts an element, a line, a first alphanumeric string, and a second alphanumeric string, wherein the line extends between the element and the first alphanumeric string;

identifying, via the processor, the first alphanumeric string and the second alphanumeric string;

accessing, via the processor, a data structure based at least in part on the second alphanumeric string, wherein the data structure stores a text containing an alphabetic string and a third alphanumeric string, wherein the alphabetic string is in proximity of the third alphanumeric string;

performing, via the processor, a search for the third alphanumeric string based at least in part on the first alphanumeric string;

identifying, via the processor, the alphabetic string in proximity of the third alphanumeric string based at least in part on the search;

generating, via the processor, a copy of the alphabetic string;

facilitating, via the processor, a presentation of the image and the copy on a display concurrently such that the copy is associated with at least one of the element, the line, or the first alphanumeric string.

12. The method of claim 11, wherein the processor and the camera are included in an eyewear device.

13. The method of claim 11, wherein the accessing is over a network.

14. The method of claim 11, further comprising:

storing, via the processor, the image in a memory which stores the data structure, wherein the processor is coupled to the memory.

15. The method of claim 11, wherein the data structure is a first data structure, wherein the alphabetic string is recited in a first language, and further comprising:

accessing, via the processor, a second data structure referencing between the first language and a second language;

translating, via the processor, the copy from the first language to the second language based at least in part on the second data structure.

16. The method of claim 15, wherein the second data structure is hosted on a data source remote from the processor.

17. The method of claim 15, wherein the second data structure is hosted on a data source local to the processor.

18. The method of claim 15, further comprising:

detecting, via the processor, a setting associated with the second language before the accessing the second data structure.

19. The method of claim 15, wherein the second language is selected from a menu provided to a user before the translating.

20. The method of claim 11, wherein the line is a first line, wherein the presentation is based at least in part on at least one of:

a processor-implemented positioning of the copy adjacent to the first alphanumeric string without overlying the first alphanumeric string;

a processor-implemented positioning of a second line and the copy such that the first alphanumeric string is positioned between the first line and the second line and such that the second line is positioned between the first alphanumeric string and the copy;

a processor-implemented replacement of the first alphanumeric string with the copy;

a processor-implemented positioning of the copy within the element;

or

a processor-implemented positioning of a shape and the copy such that the shape encloses the first alphanumeric string and the copy.