Method for searching and constructing 3D image database

• US 8,520,933 B2
• Filed: 01/20/2010
• Issued: 08/27/2013
• Est. Priority Date: 05/11/2009
• Status: Active Grant

• Current Assignee: National Applied Research Laboratories (Government of The Republic of China), National Tsing Hua University
• Original Assignee: National Applied Research Laboratories (Government of The Republic of China), National Tsing Hua University
• Inventors: Wang, Sheng-Chuan, Chiang, Ann-Shyn, Lee, Ping-Chang, Lin, Ching-Yao, Ching, Yu-Tai, Zhuang, Chao-Jun, Chang, Hsiu-Ming, Chen, Yung-Chang, Tsai, Kuen-Long, Hsieh, Chang-Huain
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): WOLDEMARIAM, AKLILU K
• Application Number:
  US12/690,424
• Publication Number:
  US 20100284585A1
• Time in Patent Office: 1,315 Days
• Field of Search: 382/128, 382/129, 382/224, 382/104
• US Class Current: 382/154
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

The present invention relates to methods for searching and constructing a 3D motif image database, wherein said 3D motif image database can be used to understand the connection relationship of a 3D network, e.g. a neural network comprising biological neural networks or artificial neural networks. The searching and constructing methods are applied on the 3D motif image database, a proper computer-aided graphic platform. The database not only facilitates the management of the huge amount of categorized data but also rationally excavates the hidden information cloaked within.

Claims

1. A method for database construction comprising the following steps:

(a) providing more than one three-dimensional (3D) network motif images;

(b) aligning and correcting 3D images generated in (a) according to a 3D standardized coordinate, wherein each point registered to the 3D images is assigned a coordinate location (x, y, z) to indicate its position in the standardized space area;

(c) dividing 3D images in (b) with individual voxel or a self-defined brick consisting various voxels, wherein voxel is a volume element, representing 1×

1×

1 unit on a regular grid in the standardized space area;

(d) categorizing space information of each coordinate point registered to the 3D images within voxels;

(e) storing processed 3D network motif images in (c) and space information in (d) into a computer-readable recording medium; and

(f) providing skeletal forms of said 3D network motif images processed with path tracing algorithm.

2. The method of claim 1, wherein said 3D network motif images comprises neuronal images include at least one complete neuron.

3. The method of claim 2, wherein said complete neuron further comprises a soma, an axon or dendrites.

4. The method of claim 1, wherein said path tracing algorithm comprises the following steps:

selecting any given two points from the 3D network motif images and using the 3D network motif image outline between these points to calculate the curve length s with the following formula;

5. The method of claim 4, wherein said best energy equation refers to a minimum energy action map which is built using the following function:

6. The method of claim 2, wherein said neuronal images are generated from micro-imaging devices comprising a charged particle scanning microscope, electron scanning microscope, laser scanning microscope, confocal microscope and fluorescent microscope.

7. The method of claim 1, wherein space information within voxels in (d) comprises the location of said voxel and the ID number of images passing through that particular voxel unit.

8. The method of claim 1, wherein steps (e) further comprised storing the information of processed images consisting the types of said images, starting and ending point locations of said images and designate filenames of said images.

9. The method of claim 8, wherein the type of said images consist the gender of the original organism that donated said images, the function of said images or any biological characters that distinguish said images from one another.

10. The method of claim 1, wherein said computer-readable recording medium comprises a magnetic storage device, an optical storage device or an electronic storage device, where said recording medium are situated on a PC and a remote device connected through a transmission system.

11. A method for interactive query of a 3D network database comprising the following steps:

(a) providing a 3D network motif image database, wherein the 3D network motif image database is used to understand the connection relationship of the 3D network, and constructing an interactive query interface for users;

(b) selecting at least one spatial region, wherein said spatial region comprises at least one 3D rectangular space, at least one branch path or a Boolean combination of the aforementioned objects, or entering at least one search string in query interface in (a) to search for corresponding images information meeting the query criteria, wherein said corresponding images information meeting the query criteria in database refers to a name of neuron, the characteristics of the neuronal image, and the 3D neuronal image in database as described in (a);

(c) presenting said resulting images meeting the query criteria in (b) with dot-matrix or image forms with texts on the query interface, wherein a search string comprises the texts of at least one name of the motif image or at least one source of the network motif image or the Boolean operation of above; and

(d) providing the dot-matrix represents the number of terminals of the neuron path tracing graph in each unit space.

12. The method of claim 11, wherein said network motif image database comprises neuronal image data and spatial information of said neuronal images.

13. The method of claim 11, wherein said query interface provides users with at least one visualization interface and at least one search field.

14. The method of claim 13, wherein said visualization interface further comprises a computer screen, a 3D or non-3D multi-media display and an exhibition space or flat surface for 3D or non-3D projection.

15. The method of claim 13, wherein said visualization interface presents motif images in three-dimension form, while further provides users to rotate and zoom said images at all angles for panoramic view.

16. The method of claim 15, wherein said visualization interface displays motif images in semi-transparent form to illustrate multiple network motif images.

17. The method of claim 11, wherein said query interface automatically identifies the designated criteria by users for data search when the users input a search command.

18. The method of claim 11, wherein said path is consisted of the extension of a first network motif image to at least two other network motif images, where the first network motif image is selected by users.

19. The method of claim 11, wherein said characteristics of the neuronal image comprises the sources of the neuronal image, spatial distribution of the image and the unit space density of the nerve terminals.

20. The method of claim 11, wherein said unit space density of the nerve terminals refers to the representation of the level of density of synapse in a unit space in gray-scale for the prediction of network hubs.

21. The method of claim 11, wherein said corresponding image information meeting the query criteria is further used for searching similar image information in the database and the results are displayed on the query interface.

22. The method of claim 21, wherein the similar image information comprises the information of network images from the same origin organism or from proximate space point locations of the original image in the corresponding search criteria.