Organizing digital notes on a user interface

• US 10,175,845 B2
• Filed: 10/15/2014
• Issued: 01/08/2019
• Est. Priority Date: 10/16/2013
• Status: Active Grant

• Current Assignee: 3M Innovative Properties Company (3M Company)
• Original Assignee: 3M Innovative Properties Company (3M Company)
• Inventors: Axelsson, Pontus, English, Kyle W., Mahli, David M., Moore, Richard J., Moran, Cristin E., Persson, Roland, Rotstein, Michael, Somasundaram, Guruprasad, Wolk, Diane R., Akerlund, Linus
• Primary Examiner(s): Al Kawsar, Abdullah
• Assistant Examiner(s): Ramsey, Patrick
• Application Number:
  US14/514,669
• Publication Number:
  US 20150106760A1
• Time in Patent Office: 1,546 Days
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/10 Multimedia information

Abstract

At least some aspects of the present disclosure feature a computing device configured to display visual representations of digital notes and one or more group images representing one or more groups on a user interface, where each group may include one or more digital notes. The computing device is further configured to receive one or more user inputs via the user interface and change the compositions of the groups based on the received user inputs.

Claims

1. A method of managing digital notes with a hardware computing device comprising a processor, memory, an image capture device, a hardware display, and a hardware input device, the method comprising:

creating, by the computing device, a first group of digital notes and a second group of digital notes by;

capturing, by the image capture device, a single image of a first scene;

extracting, by the processor, at least a first digital note and a second digital note for the first group of digital notes from the single image of the first scene, where the first scene includes a first plurality of physical notes, each of the physical notes in the first plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, where the first digital note corresponds to a first physical note in the first plurality of physical notes, where the first physical note includes an overlapping portion that overlaps an overlapped portion of a second physical note in the first plurality of physical notes so as to occlude at least a portion of the recognizable content on the second physical note, wherein the overlapping portion of the first physical note and the overlapped portion of the second physical note are the same color, and where the second digital note corresponds to the second physical note;

storing, in the memory, a record for each digital note of the first group of digital notes, where each record includes metadata identifying the first group and recognized data for each physical note;

capturing, by the image capture device, a single image of a second scene different from the first scene;

extracting, by the processor, digital notes for the second group of digital notes from the single image of the second scene, and where the second scene includes a second plurality of physical notes, each of the physical notes in the second plurality of physical notes comprising a separately movable physical object and having recognizable content thereon; and

storing, in the memory, a record for each digital note of the second group of digital notes, where each record includes metadata identifying the second group and recognized data for each physical note;

rendering, by the processor, a first group image representing the first group of digital notes and a second group image representing the second group of digital notes;

displaying, by the hardware display, the first group image and the second group image;

receiving, by the hardware user input device, a first user input indicating a first position within the first group image and a second user input indicating a second position within the second group image;

identifying, by the processor and in response to the first user input and the second user input, a digital note in the first group of digital notes based on the first position;

modifying, by the processor, the first group by removing the identified digital note from the first group and modifying the second group by adding the identified digital note to the second group, the modifying comprising changing the metadata for the stored record for the identified digital note; and

updating, by the processor, the displayed first group image and the displayed second group image to reflect the modified metadata.

2. The method of claim 1, further comprising:

rendering a modified first group image representing the modified first group.

3. The method of claim 2, wherein a size of the modified first group image is reduced relative to a size of the first group image.

4. The method of claim 1, further comprising:

rendering a modified second group image representing the modified second group.

5. The method of claim 4, wherein the identified digital note is rendered within the modified second group image.

6. The method of claim 4, wherein a size of the modified second group image is enlarged relative to a size of the second group image.

7. The method of claim 1, wherein the digital notes represented in in at least one of the first and the second group images are arranged in a grid format.

8. The method of claim 1, wherein each of the first and second digital notes includes a respective image of the corresponding recognized physical note.

9. A computing device comprising:

a processor, memory, an image capture device, a hardware display, and a hardware input device, wherein the computing device is configured to create a first group of digital notes and a second group of digital notes by;

capturing, by the image capture device, a single image of a first scene;

extracting, by the processor, at least a first digital note and a second digital note for the first group of digital notes from the single image of the first scene, where the first scene includes a first plurality of physical notes, each of the physical notes in the first plurality of physical notes comprising a separately movable physical object and having recognizable content thereon, where the first digital note corresponds to a first physical note in the first plurality of physical notes, where the first physical note includes an overlapping portion that overlaps an overlapped portion of a second physical note in the first plurality of physical notes so as to occlude at least a portion of the recognizable content on the second physical note, wherein the overlapping portion of the first physical note and the overlapped portion of the second physical note are the same color, and where the second digital note corresponds to the second physical note;

storing, in the memory, a record for each digital note of the first group of digital notes, where each record includes metadata identifying the first group and recognized data for each physical note;

capturing, by the image capture device, a single image of a second scene different from the first scene;

extracting, by the processor, digital notes for the second group of digital notes from the single image of the second scene where the second scene includes a second plurality of physical notes, each of the physical notes in the second plurality of physical notes comprising a separately movable physical object and having recognizable content thereon; and

storing, in the memory, a record for each digital note of the second group of digital notes, where each record includes metadata identifying the second group and recognized data for each physical note;

rendering, by the processor, a first group image representing the first group of digital notes and a second group image representing the second group of digital notes;

displaying, by the hardware display, the first group image and the second group image;

receiving, by the hardware user input device, a first user input indicating a first position within the first group image and a second user input indicating a second position within the second group image;

identifying, by the processor in response to the first user input and the second user input, a digital note in the first group of digital notes based on the first position;

modifying, by the processor, the first group by removing the identified digital note from the first group and modifying the second group by adding the identified digital note to the second group, the modifying comprising changing the metadata for the stored record for the identified digital note; and

updating, by the processor, the displayed first group image and the displayed second group image to reflect the modified metadata.

10. The computing device of claim 9, wherein the computing device is further configured to:

render a modified first group image representing the modified first group.

11. The computing device of claim 10, wherein a size of the modified first group image is reduced relative to a size of the first group image.

12. The computing device of claim 9, wherein the computing device is further configured to:

render a modified second group image representing the modified second group.

13. The computing device of claim 12, wherein the identified digital note is rendered within the modified second group image.

14. The computing device of claim 12, wherein a size of the modified second group image is enlarged relative to a size of the second group image.

15. The computing device of claim 9, wherein the digital notes represented in in at least one of the first and the second group images are arranged in a grid format.

16. The computing device of claim 9, wherein each of the first and second digital notes includes a respective image of the corresponding recognized physical note.