Data processing systems, devices, and methods for content analysis

• US 9,558,402 B2
• Filed: 06/19/2016
• Issued: 01/31/2017
• Est. Priority Date: 09/21/2011
• Status: Active Grant

• Current Assignee: Patnotate LLC
• Original Assignee: Barry Greenbaum, Roman Tsibulevskiy
• Inventors: Tsibulevskiy, Roman, Greenbaum, Barry
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US15/186,507
• Publication Number:
  US 20160292504A1
• Time in Patent Office: 226 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24553 of query operations
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/244 using graphical properties, e.g. alphabet type or font
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

Systems, devices and methods operative for identifying a reference within a figure and an identifier in a text associated with the figure, the reference referring to an element depicted in the figure, the reference corresponding to the identifier, the identifier identifying the element in the text, placing the identifier on the figure at a distance from the reference, the identifier visually associated with the reference upon the placing, the placing of the identifier on the figure is irrespective of the distance between the identifier and the reference.

Claims

1. A method comprising:

recognizing, via a processor, a pattern in an image;

accessing, via the processor, a data structure which stores an identifier associated with the pattern;

locating, via the processor, the identifier in the data structure;

generating, via the processor, a copy of the identifier;

resizing, via the processor, the pattern in the image such that the pattern is at least one of shrunk or compacted;

at least one of;

modifying, via the processor, the image to include the copy such that the copy is associated with the pattern as resized when the image is at least one of printed or displayed, or

facilitating, via the processor, a presentation of the image and the copy on a display concurrently such that the copy is associated with the pattern as resized.

2. The method of claim 1, wherein the recognizing is based at least in part on a location of the pattern in the image.

3. The method of claim 1, wherein the recognizing is based at least in part on a size of the pattern in the image.

4. The method of claim 1, wherein the recognizing is based at least in part on a shape of the pattern in the image.

5. The method of claim 1, wherein the data structure is a first data structure, wherein the recognizing is based at least in part on referencing, via the processor, a second data structure which stores a set of patterns containing the pattern.

6. The method of claim 5, wherein the second data structure is stored local to the processor.

7. The method of claim 5, wherein the second data structure is stored remote from the processor.

8. The method of claim 1, wherein the copy is highlighted during at least one of when the image is at least one of printed or displayed or the presentation.

9. The method of claim 1, wherein the copy is colored for visual distinction during at least one of when the image is at least one of printed or displayed or the presentation.

10. The method of claim 1, wherein the copy is positioned outside the pattern during at least one of when the image is at least one of printed or displayed or the presentation.

11. The method of claim 1, wherein the copy is positioned inside the pattern during at least one of when the image is at least one of printed or displayed or the presentation.

12. The method of claim 1, further comprising:

facilitating, via the processor, a capture of the image via a camera before the recognizing, wherein the camera is coupled to the processor, wherein the processor and the camera are included in an eyewear device.

13. The method of claim 1, wherein the accessing is over a network.

14. The method of claim 1, further comprising:

storing, via the processor, the image in a memory which stores the data structure.

15. The method of claim 1, wherein the data structure is a first data structure, wherein the identifier is recited in a first language, and further comprising:

accessing, via the processor, a second data structure referencing between the first language and a second language;

translating, via the processor, the identifier from the first language to the second language based at least in part on the accessing of the second data structure, wherein the generating is based at least in part on the translating.

16. The method of claim 15, wherein the second data structure is stored on a data source remote from the processor.

17. The method of claim 15, wherein the second data structure is stored on a data source local to the processor.

18. The method of claim 15, further comprising:

detecting, via the processor, a setting associated with the second language before the accessing the second data structure.

19. The method of claim 15, further comprising:

selecting, via the processor, the second language based at least in part on an input received from a user, wherein the input is based at least in part on a menu displayed to the user before the translating.

20. The method of claim 1, wherein at least one of the modifying or the facilitating comprises at least one of:

positioning the copy outside the pattern in proximity of the pattern;

positioning the copy inside the pattern;

positioning the copy and a line such that the line extends between the pattern and the copy;

or

positioning the copy and a shape such that the shape encloses the copy and such that the shape is associated with the pattern.