Learning Pixel Visual Context from Object Characteristics to Generate Rich Semantic Images
1 Assignment
0 Petitions
Accused Products
Abstract
Both object-oriented analysis and the faster pixel-oriented analysis are used to recognize patterns in an image of stained tissue. Object-oriented image analysis is used to segment a small portion of the image into object classes. Then the object class to which each pixel in the remainder of the image most probably belongs is determined using decision trees with pixelwise descriptors. The pixels in the remaining image are assigned object classes without segmenting the remainder of the image into objects. After the small portion is segmented into object classes, characteristics of object classes are determined. The pixelwise descriptors describe which pixels are associated with particular object classes by matching the characteristics of object classes to the comparison between pixels at predetermined offsets. A pixel heat map is generated by giving each pixel the color assigned to the object class that the pixelwise descriptors indicate is most probably associated with that pixel.
-
Citations
31 Claims
-
1-7. -7. (canceled)
-
8. A method comprising:
-
segmenting a first portion of an image into objects of a data network that belong to classes, wherein the segmenting the first portion of the image into objects involves generating the data network in which the objects are linked to selected pixels of the first portion of the image, wherein at least one of the objects is linked to a plurality of subobjects, and wherein each of the subobjects is linked to other subobjects or to pixels of the image; determining class characteristics of each of the classes of objects; assigning a color to each of the classes of objects; generating pixelwise descriptors used to describe which pixels are associated with particular classes of objects; generating a pixel heat map by applying the pixelwise descriptors to each pixel in a second portion of the image without segmenting the second portion of the image into objects of any data network, wherein each pixel of the second portion of the image has the color assigned to the class of objects that the pixelwise descriptors indicate is most probably associated with that pixel; and displaying the pixel heat map on a graphical user interface. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17, 26)
-
-
18-21. -21. (canceled)
-
22. A method comprising:
-
segmenting a first portion of an image into network objects of a data network that belong to classes, wherein the image depicts a slice of tissue from a cancer patient that has been stained, wherein the segmenting involves generating the data network in which the network objects are linked to selected pixels of the image, wherein at least one of the network objects is linked to a plurality of network subobjects, and wherein each of the network subobjects is linked to other network subobjects or to pixels of the image; determining class characteristics of each of the classes of network objects; assigning a color to each of the classes of network objects; generating pixelwise descriptors used to describe which pixels are associated with particular classes of network objects; and generating a pixel heat map by applying the pixelwise descriptors to each pixel in a second portion of the image without segmenting the second portion of the image into network objects of any data network, wherein each pixel of the second portion of the image has the color assigned to the class of network objects that the pixelwise descriptors indicate is most probably associated with that pixel. - View Dependent Claims (23, 24, 25)
-
-
27. A method comprising:
-
segmenting a first portion of an image into objects of a data network using object-oriented image analysis, wherein a second portion of the image is not segmented into objects of the data network, wherein the objects of the data network are linked to subobjects of the data network and to selected pixels of the first portion of the image; defining classes of objects, wherein each of the objects belongs to one of the classes of objects; determining class characteristics of each of the classes of objects, wherein one of the class characteristics of a first class of objects defines a characteristic shape of the objects of the first class; assigning a color to each of the classes of objects; generating pixelwise descriptors used to describe which pixels are associated with particular class characteristics of classes of objects; performing pixel-oriented image analysis by applying the pixelwise descriptors individually to each pixel in the second portion of the image, wherein the pixelwise descriptors associate a first pixel in the second portion of the image with the characteristic shape of the objects of the first class; generating a pixel heat map in which each pixel of the second portion of the image has the color assigned to the class of objects that the pixelwise descriptors indicate is most probably associated with that pixel; and displaying the pixel heat map on a graphical user interface. - View Dependent Claims (28, 29, 30, 31)
-
Specification