Organizing digital notes on a user interface

• US 10,698,560 B2
• Filed: 01/04/2018
• Issued: 06/30/2020
• Est. Priority Date: 10/16/2013
• Status: Active Grant

• Current Assignee: 3M Innovative Properties Company (3M Company)
• Original Assignee: 3M Innovative Properties Company (3M Company)
• Inventors: Axelsson, Pontus, English, Kyle W., Mahli, David M., Moore, Richard J., Moran, Cristin E., Persson, Roland, Rotstein, Michael, Somasundaram, Guruprasad, Wolk, Diane R., Akerlund, Linus
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US15/862,464
• Publication Number:
  US 20180129363A1
• Time in Patent Office: 908 Days
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/10 Multimedia information

Abstract

At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

Claims

1. A method comprising:

capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;

extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;

storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;

extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;

storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and

presenting a hint associated with a quality of the captured image of the plurality of physical notes,

wherein the presenting step comprises presenting as the hint a visual indication regarding a distance between the image capture device and the plurality of physical notes.

2. The method of claim 1, wherein extracting recognizable content from the first and/or second physical note is done by an image rendering module, implemented by a processor.

3. The method of claim 1, further comprising:

receiving, by a hardware user input device, a first user input indicating a first position within a first group image;

identifying, responsive to receiving the first user input, a digital note in the first group of digital notes based on the first position; and

modifying the first group image by removing the identified digital note from the first group.

4. The method of claim 3, wherein the hardware user input device includes a touch sensitive device.

5. The method of claim 1, wherein a size of the first digital note is reduced or enlarged relative to a size of the first physical note.

6. The method of claim 1, wherein the first and second digital notes are arranged in a grid format.

7. The method of claim 1, further comprising:

recognizing, by a note identification module implemented by the processor, one or more of the plurality of physical notes; and

generating a digital note corresponding to each of the recognized physical notes, wherein each of the generated digital notes includes a respective image of the corresponding recognized physical note.

8. The method of claim 1, wherein the overlapping portion of the first physical note and the overlapped portion of the second physical note are a same color.

9. The method of claim 1, wherein the presenting step further comprises presenting feedback regarding the quality of the captured image of the plurality of physical notes.

10. The method of claim 1, wherein the presenting step further comprises presenting feedback to move closer to the plurality of physical notes.

11. A method comprising:

capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;

extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;

storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;

extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;

storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and

presenting a hint associated with a quality of the captured image of the plurality of physical notes,

wherein the presenting step comprises presenting as the hint a desired size for display of the physical notes on a user interface.

12. A method comprising:

capturing, by an image capture device included within a computing system, an image of a scene having a plurality of physical notes, each of the plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, wherein the plurality of physical notes includes a first physical note and a second physical note, and wherein the first physical note includes an overlapping portion that overlaps an overlapped portion of the second physical note so as to occlude at least a portion of the recognizable content on the second physical note;

extracting, by the computing system, the recognizable content from the first physical note to create a first digital note corresponding to the first physical note;

storing, by the computing system, first note information associated with the first digital note and derived from the recognizable content from the first physical note;

extracting, by the computing system, the recognizable content from the second physical note to create a second digital note corresponding to the second physical note;

storing, by the computing system, second note information associated with the second digital note and derived from the recognizable content from the second physical note; and

presenting a hint associated with a quality of the captured image of the plurality of physical notes,

wherein the presenting step comprises presenting as the hint one or more of the following;

a visual indication regarding a lighting condition;

a visual indication regarding motion of the image capture device;

a grid overlaid with a visual representation of the physical notes; and

an animation.

13. The method of claim 12, wherein the presenting step further comprises presenting feedback to use a flash.

14. The method of claim 12, wherein the presenting step further comprises presenting feedback to hold still.