Image-based circular plot recognition and interpretation

• US 10,460,446 B2
• Filed: 10/16/2017
• Issued: 10/29/2019
• Est. Priority Date: 10/16/2017
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Balch, Carla W., Witchey, Nicholas J.
• Primary Examiner(s): Bitar, Nancy
• Application Number:
  US15/785,008
• Publication Number:
  US 20190114776A1
• Time in Patent Office: 743 Days
• Field of Search: None
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/30072 Microarray; Biochip, DNA array; Well plate
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps
• CPC Class Codes: G16B 20/00 ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
• CPC Class Codes: G16B 30/00 ICT specially adapted for sequence analysis involving nucleotides or amino acids
• CPC Class Codes: G16B 45/00 ICT specially adapted for bioinformatics-related data visualisation, e.g. displaying of maps or networks
• CPC Class Codes: G16H 50/00 ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics

Abstract

A device includes software instructions for a circular plot analysis agent and at least one circular plot definition. The circular plot analysis agent obtains a digital image of a circular plot, detects a perimeter of the circular plot within the digital image, detects a plurality of edges within the perimeter, identifies a set of endpoints on the perimeter as a function of the plurality of edges, generates a plot descriptor from the set of endpoints, and initiates a transaction with a second device as a function of the plot descriptor.

Claims

1. A device comprising:

a non-transitory, computer readable memory storing software instructions that comprise an encoding of a machine executable circular plot analysis agent and at least one circular plot definition;

at least one processor coupled with the memory wherein the at least one processor is configurable, upon execution of the software instructions to operate as the circular plot analysis agent, to;

obtain a digital image of a circular plot;

detect a perimeter of the circular plot within the digital image;

detect a plurality of edges within the perimeter;

convert the plurality of edges into a set of chords within the perimeter as a function of the plurality of edges and according to the circular plot definition;

identify, from the set of chords, a set of endpoints on the perimeter as a function of the plurality of edges;

generate a plot descriptor from the set of endpoints wherein the descriptor represents sets of endpoints distributed around at least one perimeter track associated with the perimeter;

and

initiate a transaction with at least a second device as a function of the plot descriptor.

2. The device of claim 1 wherein the circular plot definition includes at least one of the following:

a preferred plot orientation;

plot metadata;

a number of perimeter tracks;

a perimeter track definition;

a number of track segments;

a track segment type definition;

a chord definition;

a chord endpoint definition; and

a descriptor definition.

3. The device of claim 1, wherein the circular plot comprises a genome sequence circular plot.

4. The device of claim 3, wherein the genome sequence circular plot comprises a whole genome sequence circular plot.

5. The device of claim 3, wherein the endpoints represent at least one of the following:

a base pair, a codon, an exon, an intron, a gene, a mutation, a single nucleotide polymorphism, a transcription, an insertion, and a deletion.

6. The device of claim 1, wherein the at least one processor is further configurable to convert the perimeter into a perimeter track as a function of the perimeter and according to the circular plot definition.

7. The device of claim 6, wherein the perimeter is adjusted according to an affine transformation.

8. The device of claim 6, wherein the set of endpoints are identified as a function of the perimeter track.

9. The device of claim 1, wherein the set of endpoints are identified as a function of the set of chords.

10. The device of claim 1, wherein the set of endpoints include at least one of the following types of endpoints:

a set of single values, a set of ranged values, source endpoints, and sink endpoints.

11. The device of claim 1, wherein the descriptor comprises a histogram compiled from the sets of endpoints.

12. The device of claim 1, wherein the descriptor is a plot-level invariant descriptor.

13. The device of claim 1, wherein the descriptor is a track-level invariant descriptor.

14. The device of claim 1, wherein the descriptor is a track segment-level invariant descriptor.

15. The device of claim 1, wherein the descriptors comprises a hue-based descriptor.

16. The device of claim 1, wherein the descriptor comprises an endpoint relationship descriptor.

17. The device of claim 1, wherein the descriptors comprises a time-varying descriptor.

18. The device of claim 1, wherein the device further comprises an optical sensor.

19. The device of claim 18, wherein the optical sensor comprises a digital camera capable of capturing the digital image of the circular plot.

20. The device of claim 18, wherein the at least one processor is further configurable to provide instructions to a user to capture additional digital images of the circular plot.

21. The device of claim 1, wherein the transaction comprises a digital transaction.

22. The device of claim 21, wherein the second device comprises a networked database server.

23. The device of claim 22, where the networked database server is configured to store and retrieve at least one of the following types of data as a function of the descriptor:

a medical record, a diagnosis, a prognosis, an insurance record, a transaction key, a resistance factor, and a prescription.

24. The device of claim 21, wherein the second device comprises a mobile device.

25. The device of claim 24, wherein the mobile device includes at least one of the following:

a cell phone, an electronic healthcare card, a smart watch, a fitness band, and a vehicle.

26. The device of claim 21, wherein the digital transaction comprises at least one of the following:

a financial transaction, a database query, a prescription, a purchase, an event logging, a diagnosis transaction, a prognosis, an insurance transaction, a healthcare transaction, a notification, an alert, a cryptographic transaction, a block chain transaction, and a security transaction.

27. The device of claim 1, wherein the device comprises at least one of the following:

a cell phone, a smart phone, a person data assistant, a tablet, a phablet, a computer, a medical device, a robot, and a vehicle.

28. The device of claim 1, wherein the at least one processor is configurable, upon execution of the software instructions to operate as the circular plot analysis agent, to generate the plot descriptor from the set of endpoints and the plurality of edges.

29. A non-transitory, computer readable medium storing at least one circular plot definition and software instructions that cause a processor to perform operations comprising:

obtaining a digital image of a circular plot;

detecting a pen meter of the circular plot within the digital image;

detecting a plurality of edges within the perimeter;

converting the plurality of edges into a set of chords within the perimeter as a function of the plurality of edges and according to the circular plot definition;

identifying, from the set of chords, a set of endpoints on the perimeter as a function of the plurality of edges;

generating a plot descriptor from the set of endpoints wherein the descriptor represents sets of endpoints distributed around at least one perimeter track associated with the perimeter; and

initiating a transaction with at least one device as a function of the plot descriptor.

30. A method comprising:

obtaining a digital image of a circular plot;

detecting a perimeter of the circular plot within the digital image;

detecting a plurality of edges within the perimeter;

converting the plurality of edges into a set of chords within the perimeter as a function of the plurality of edges and according to a circular plot definition;

identifying, from the set of chords, a set of endpoints on the perimeter as a function of the plurality of edges;

generating a plot descriptor from the set of endpoints wherein the descriptor represents sets of endpoints distributed around at least one perimeter track associated with the perimeter; and

initiating a transaction with at least one device as a function of the plot descriptor.