Systems and methods for managing notes

• US 9,563,696 B2
• Filed: 03/31/2014
• Issued: 02/07/2017
• Est. Priority Date: 04/02/2013
• Status: Active Grant

• Current Assignee: 3M Innovative Properties Company (3M Company)
• Original Assignee: 3M Innovative Properties Company (3M Company)
• Inventors: Bastiaens, Willem V., Biller, Gabriel A., Clover, Kristopher W., Hackerson, Brian R., Henry, Masuma W., June, Stephen M., Linzie, Brian L., Lorentz, Robert D., Mahli, David M., Moore, Richard J., Moran, Cristin E., O'Brien, Michael E., Pearson, Scott D., Powell, Dennard J., Ronning, Olen, Somasundaram, Guruprasad, Stankiewicz, Brian J., Wolk, Diane R.
• Primary Examiner(s): Debrow, James J
• Application Number:
  US14/230,892
• Publication Number:
  US 20140297646A1
• Time in Patent Office: 1,044 Days
• Field of Search: 715/230
• US Class Current: 1/1
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments

Abstract

At least some aspects of the present disclosure feature systems and methods for managing notes. The note management system includes a note source, a note recognition module, a note extraction module, and a note labeling module. The note source is a visual representation of a scene having a note. The note recognition module is configured to receive the visual representation and determine a general boundary of the note from the visual representation. The note extraction module is configured to extract content of the note from the visual representation based on the determined general boundary. The note labeling module is configured to label the note with a category.

Claims

1. A note management system, the system comprising:

a device, comprising a sensor configured to generate a first image comprising a first visual representation of a scene having a plurality of physical notes, each of the physical notes comprising a separate physical object having a general boundary and recognizable content thereon; and

a processing unit comprising;

a note recognition module configured to receive, from the sensor, first image data associated with the first image and process the first image data, automatically identify one or more marks associated with one or more of the plurality of physical notes in the first image, determine a location associated with the one or more marks, and use the location to control the sensor to generate a second image comprising a second visual representation of the scene, wherein the second image comprises a zoomed-in image of one or more notes of the plurality of physical notes, the note recognition module further configured to determine the general boundary of one of the plurality of physical notes from the visual representation,

a note authentication module configured to authenticate the one of the plurality of physical notes,

a note extraction module configured to extract, in response to determining that the one of the plurality of physical notes is authenticated, the recognizable content of the one of the plurality of physical notes from the visual representation based on the determined general boundary of the one of the plurality of physical notes, and

a note labeling module configured to label a digital note representing the one of the plurality of physical notes with a category.

2. The note management system of claim 1, wherein the note labeling module is further configured to label the digital note based on the extracted recognizable content.

3. The note management system of claim 1, wherein the note recognition module is further configured to determine the general boundary of the one of the plurality of physical notes in the image data based upon the one or more marks.

4. The note management system of claim 1, further comprising:

a note presentation module configured to present the extracted recognizable content to a user.

5. The note management system of claim 1, wherein the note labeling module is further configured to label the one of the plurality of notes based on the extracted recognizable content and historical data.

6. The note management system of claim 1,

wherein the note extraction module is configured to extract the recognizable content of the one of the plurality of physical notes from the second image.

7. The note management system of claim 1, wherein the note labeling module is configured to automatically label the digital note based on the one or more marks.

8. The note management system of claim 1, wherein the note extraction module is further configured to associate the digital note with a unique identifier, and wherein the note labeling module is configured to automatically label the digital note based on the unique identifier.

9. The note management system of claim 1, wherein the note labeling module is configured to label the digital note based on extracted content and historical data.

10. The note management system of claim 1, wherein the note labeling module is configured to label the digital note based on the extracted recognizable content, historical data, and predictive modeling.

11. A method of managing notes, the method comprising:

receiving, by a processing unit from a sensor, a first image comprising a first visual representation of a scene having a plurality of physical notes, each of the physical notes comprising a separate physical object having a general boundary and recognizable content thereon;

identify, by the processing unit, one or more marks associated with the one or more of the plurality of physical notes in the first image;

determine, by the processing unit, a location associated with the one or more marks;

control, by the Processing unit, based on the location, the sensor to generate a second image comprising a second visual representation of the scene, wherein the second image comprises a zoomed-in image of one or more notes of the plurality of physical notes of the first visual representation of the scene;

processing, by the processing unit, image data associated with the image to identify the general boundary of at least one of the plurality of physical notes;

authenticating the one of the plurality of physical notes;

in response to determining that the one of the plurality of physical notes is authenticated, extracting, by the processing unit and based at least in part on identifying the general boundary, the recognizable content of the one of the plurality of physical notes; and

labeling, by the processor, respective digital notes representing each of the plurality of physical notes with a category.

12. The method of claim 11,

wherein extracting the recognizable content of the one of the plurality of physical notes comprises extracting the recognizable content from the second image.

13. The method of claim 12,

wherein one or more of the plurality of physical notes includes a mark, and

wherein controlling the sensor comprises controlling the sensor based on a location of the mark on the note.

14. The method of claim 11, wherein labeling comprises automatically labeling at least one of the digital notes based on the one or more marks.

15. The method of claim 11, further comprising associating at least one of the digital notes with a unique identifier, and wherein labeling comprises automatically labeling at least one of the digital notes based on the unique identifier.

16. The method of claim 11, wherein labeling comprises labeling at least one of the digital notes based on extracted content and historical data.

17. The method of claim 11, wherein labeling comprises labeling at least one of the digital notes based on the extracted recognizable content, historical data, and predictive modeling.

18. A note management system, the system comprising:

a sensor configured to generate a first image comprising a first visual representation of a scene having a plurality of physical notes, each of the physical notes comprising a separate physical object having a general boundary and recognizable content thereon; and

a processing unit comprising;

a note recognition module configured to receive, from the sensor, first image data associated with the first image and process the first image data, automatically identify one or more marks associated with one or more of the plurality of physical notes in the first image, determine a location associated with the one or more marks, and control the sensor, based on the location, to generate a second image comprising a second visual representation of the scene, wherein the second image comprises a zoomed-in image of one or more notes of the plurality of physical notes, the note recognition module further configured to determine the general boundary of one of the plurality of physical notes from the second image,

a note extraction module configured to extract the recognizable content of the one of the plurality of physical notes from the second image based on the determined general boundary of the one of the plurality of physical notes, and

a note labeling module configured to label a digital note representing the one of the plurality of physical notes with a category.

19. A method of managing notes, the method comprising:

receiving, by a processing unit and from a sensor, a first image comprising a first visual representation of a scene having a plurality of physical notes, each of the physical notes comprising a separate physical object having a general boundary and recognizable content thereon;

identifying, by the processing unit, one or more marks associated with the one or more of the plurality of physical notes in the first image;

determining, by the processing unit, a location associated with the one or more marks;

controlling, by the processing unit and based on the location, the sensor to generate a second image comprising a second visual representation of the scene, wherein the second image comprises a zoomed-in image of one or more notes of the plurality of physical notes of the first visual representation of the scene;

processing, by the processing unit, image data associated with the second image to identify the general boundary of at least one of the plurality of physical notes;

extracting, by the processing unit and based at least in part on identifying the general boundary, the recognizable content of the one of the plurality of physical notes from the second image; and

labeling, by the processor, respective digital notes representing each of the plurality of physical notes with a category.