Note recognition for overlapping physical notes
First Claim
1. A method comprising:
- receiving, by a computing device, an input image of an environment having a plurality of overlapping physical notes, each of the overlapping physical notes having a background color, adjacent ones of the plurality of physical notes having different background colors;
processing the input image with the computing device to identify each of the overlapping physical notes in the input image, wherein identifying the overlapping physical notes comprises;
classifying pixels of the input image into one of a plurality of color classes, wherein each of the different background colors corresponds to a respective color class of the plurality of color classes, wherein classifying the pixels comprises;
grouping adjacent pixels having the same color class into regions that each correspond to a note of the plurality of overlapping physical notes in the input image; and
determining, based on boundaries of the regions and according to a machine-learning pattern recognition algorithm, boundaries of each of the overlapping physical notes in the input image;
extracting, by the computing device, content for each of the respective overlapping physical notes based on the respective determined boundary;
creating, by the computing device, a plurality of digital notes, each of the digital notes representing a particular one of the identified overlapping physical notes; and
associating, by the computing device, the extracted content for each respective physical note of the identified overlapping physical notes with a corresponding digital note of the plurality of digital notes that represents the respective physical note.
0 Assignments
0 Petitions
Accused Products
Abstract
Techniques for creating and manipulating software notes representative of physical notes are described. A computing device includes a processor, an image collection module executable by the processor and configured to receive an input image of an environment having a plurality of overlapping physical notes, and an image processing engine executable by the processor and configured to process the input image with the computing device to identify the plurality of overlapping physical notes in the input image. The image processing engine determines a boundary of each note in the plurality of overlapping physical notes in the input image, and generates a plurality of digital notes corresponding to the determined boundary of each of the overlapping physical notes identified in the input image.
-
Citations
18 Claims
-
1. A method comprising:
-
receiving, by a computing device, an input image of an environment having a plurality of overlapping physical notes, each of the overlapping physical notes having a background color, adjacent ones of the plurality of physical notes having different background colors; processing the input image with the computing device to identify each of the overlapping physical notes in the input image, wherein identifying the overlapping physical notes comprises; classifying pixels of the input image into one of a plurality of color classes, wherein each of the different background colors corresponds to a respective color class of the plurality of color classes, wherein classifying the pixels comprises; grouping adjacent pixels having the same color class into regions that each correspond to a note of the plurality of overlapping physical notes in the input image; and determining, based on boundaries of the regions and according to a machine-learning pattern recognition algorithm, boundaries of each of the overlapping physical notes in the input image; extracting, by the computing device, content for each of the respective overlapping physical notes based on the respective determined boundary; creating, by the computing device, a plurality of digital notes, each of the digital notes representing a particular one of the identified overlapping physical notes; and associating, by the computing device, the extracted content for each respective physical note of the identified overlapping physical notes with a corresponding digital note of the plurality of digital notes that represents the respective physical note. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory computer-readable medium comprising instructions for causing a programmable processor to:
-
receive an input image of an environment having a plurality of overlapping physical notes, each of the overlapping physical notes having a background color, adjacent ones of the plurality of physical notes having different background colors; process the input image to identify each of the overlapping physical notes in the input image, wherein the instructions that cause the processor to identify the overlapping physical notes comprise instructions that cause the processor to; classify pixels of the input image into one of a plurality of color classes, wherein each of the different background colors corresponds to a respective color class of the plurality of color classes, wherein the instructions that cause the processor to classify the pixels comprise instructions that cause the processor to; group adjacent pixels having the same color class into regions that each correspond to a note of the plurality of overlapping physical notes in the input image; and determine, based on boundaries of the regions and according to a machine-learning pattern recognition algorithm, boundaries of each of the overlapping physical notes in the input image; extract content for each of the respective overlapping physical notes based on the respective determined boundary; generate a plurality of digital notes, each of the digital notes representing a particular one of the identified overlapping physical notes; and associate the extracted content for each respective physical note of the identified overlapping physical notes with a corresponding digital note of the plurality of digital notes that represents the respective physical note. - View Dependent Claims (9)
-
-
10. A computing device comprising:
-
a processor; and a memory storing instructions that, when executed, cause the processor to; receive an input image of an environment having a plurality of overlapping physical notes, each of the overlapping physical notes having a background color, adjacent ones of the plurality of physical notes having different background colors; process the input image with the computing device to identify the plurality of overlapping physical notes in the input image, wherein, to identify the plurality of overlapping physical notes, the processor is configured to; classify pixels of the input image into one of a plurality of color classes, wherein each of the different background colors corresponds to a respective color class of the plurality of color classes, wherein, to classify the pixels, the processor is configured to; group adjacent pixels having the same color class into regions that each correspond to a note of the plurality of overlapping physical notes in the input image; and determine, based on boundaries of the regions and according to a machine-learning pattern recognition algorithm, boundaries of each of the overlapping physical notes in the input image; extract content for each of the respective overlapping physical notes based on the respective determined boundary; generate a plurality of digital notes, each of the digital notes representing a particular one of the identified overlapping physical notes; and associate the extracted content for each respective physical note of the identified overlapping physical notes with a corresponding digital note of the plurality of digital notes that represents the respective physical note. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
Specification