Note recognition and association based on grouping indicators

• US 9,600,718 B2
• Filed: 04/13/2015
• Issued: 03/21/2017
• Est. Priority Date: 10/16/2013
• Status: Active Grant

• Current Assignee: 3M Innovative Properties Company (3M Company)
• Original Assignee: 3M Innovative Properties Company (3M Company)
• Inventors: Wolk, Diane R., Mahli, David M., Moran, Cristin E., Somasundaram, Guruprasad, Bastiaens, Willem V., Moore, Richard J., Axelsson, Pontus, Rotstein, Michael, Persson, Roland, kerlund, Linus, Nakayama, Tasuku
• Primary Examiner(s): Patel, Nirav G
• Application Number:
  US14/685,174
• Publication Number:
  US 20150213310A1
• Time in Patent Office: 708 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06T 11/20 Drawing from basic elements, e.g. lines or circles
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/36 Matching; Classification
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

Techniques are described for creating and manipulating software notes representative of physical notes. A computing device is described that includes a processor and an image collection module executable on the processor and configured to receive an input image of an environment having a plurality of physical notes. An image processing engine executable on the processor is configured to identify the plurality of physical notes in the input image and generate, for each of the physical notes, a corresponding digital note. The image processing engine is further configured to identify an indication of one or more groups of the plurality of identified notes in the input image and group the plurality of digital notes according to the indication.

Claims

1. A method comprising:

receiving, by a computing device, an input image of an environment having a plurality of physical notes;

processing the input image with the computing device to identify the plurality of physical notes in the input image;

generating, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;

identifying, by the computing device, an indication of one or more groups of the plurality of physical notes based on at least one line in the environment; and

grouping, by the computing device, the plurality of digital notes according to the indication of the one or more groups.

2. The method of claim 1, wherein the at least one line comprises a physically drawn line.

3. The method of claim 1, wherein the at least one line comprises a tape disposed in the environment.

4. The method of claim 1, further comprising:

displaying, by the computing device, the one or more groups of the plurality of digital notes.

5. A method, comprising:

receiving, by a computing device, an input image of an environment having a plurality of physical notes;

processing the input image with the computing device to identify the plurality of physical notes in the input image;

generating, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;

selecting, by the computing device, one or more of the plurality of digital notes based on at least one line in the environment; and

grouping, by the computing device, the one or more selected digital notes into a group.

6. The method of claim 5, further comprising:

displaying, by the computing device, the one or more groups of the plurality of digital notes.

7. The method of claim 5, wherein the at least one line comprises a physically drawn line.

8. The device method of claim 5, wherein the at least one line comprises a tape disposed in the environment.

9. A non-transitory computer-readable medium comprising instructions that cause a programmable processor to:

receive, by a computing device, an input image of an environment having a plurality of physical notes;

process the input image with the computing device to identify the plurality of physical notes in the input image;

generate, by the computing device, a plurality of digital notes corresponding to the plurality of physical notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of physical notes in the input image;

identify, by the computing device, an indication of one or more groups of the plurality of physical notes identified in the input image based on at least one line in the environment; and

group, by the computing device, the plurality of digital notes according to the indication of the one or more groups.

10. The non-transitory computer-readable medium of claim 9, wherein the at least one line comprises a physically drawn line.

11. The non-transitory computer-readable medium of claim 9, wherein the at least one line comprises a tape disposed in the environment.

12. A computing device comprising:

a processor;

an image collection module executable on the processor and configured to receive an input image of an environment having a plurality of physical notes; and

an image processing engine executable on the processor and configured to identify the plurality of physical notes in the input image and generate, for each of the physical notes, a corresponding digital note,

wherein the image processing engine is configured to identify an indication of one or more groups of the plurality of identified notes in the input image based on at least one line in the environment and group the plurality of digital notes according to the indication.

13. The device of claim 12, wherein the image processing engine is configured to display the input image including the plurality of grouped digital notes in place of the identified plurality of notes on a graphical user interface.

14. The device of claim 12, wherein the image collection module includes an image capture device configured to capture the input image.

15. The device of claim 12, wherein the image collection module includes a communication interface configured to receive the input image.

16. The device of claim 12, wherein the at least one line comprises a physically drawn line.

17. The device of claim 12, wherein the at least one line comprises a tape disposed in the environment.