OBJECT-TRACKING SYSTEMS AND METHODS

• US 20100080415A1
• Filed: 09/29/2008
• Published: 04/01/2010
• Est. Priority Date: 09/29/2008
• Status: Active Grant

• Current Assignee: Venus Concept, Inc.
• Original Assignee: Restoration Robotics, Inc. (Venus Concept, Inc.)
• Inventors: Qureshi, Shehrzad A., Breton, Kyle R., Tenney, John A.
• Granted Patent: US 8,848,974 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: A61B 2017/00752 Hair removal or transplantation
• CPC Class Codes: A61B 2017/00969 used for transplantation
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/2057 Details of tracking cameras
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/363 Use of fiducial points
• CPC Class Codes: A61B 2090/3937 Visible markers
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/32 operating autonomously
• CPC Class Codes: A61B 90/17 for soft tissue, e.g. breast-holding devices
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30088 Skin; Dermal
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/246 : using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/248 : involving reference images or patches
• CPC Class Codes: G06T 7/40 : Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G06T 7/74 : involving reference images or patches
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: Y10S 901/47 : Optical

Abstract

A system and method for tracking, identifying, and labeling objects or features of interest is provided. In some embodiments, tracking is accomplished using unique signature of the feature of interest and image stabilization techniques. According to some aspects a frame of reference using predetermined markers is defined and updated based on a change in location of the markers and/or specific signature information. Individual objects or features within the frame may also be tracked and identified. Objects may be tracked by comparing two still images, determining a change in position of an object between the still images, calculating a movement vector of the object, and using the movement vector to update the location of an image device.

Claims

1. A method for tracking a follicular unit, the method comprising:

identifying at least one marker in a first image, the first image including a follicular unit;

computing a signature of the follicular unit in the first image;

identifying the at least one marker in a second image;

computing a motion vector corresponding to a change in position of the at least one marker from the first image to the second image; and

using the motion vector and the signature of the follicular unit in the first image to label the follicular unit in the second image.

2. The method of claim 1, wherein there are at least three markers in the first image.

3. The method of claim 1, wherein the at least one marker comprises one or more of another follicular unit, a mole, a scar, a freckle, a wrinkle, a bump, or a depression of the body surface.

4. The method of claim 1, comprising a plurality of markers in the first image and wherein identifying the at least one marker in a first image comprises identifying a point cloud.

5. The method of claim 4, further comprising calculating a centroid of the point cloud.

6. The method of claim 1, wherein computing a signature of the follicular unit in a first image comprises identifying one or more of a length, type, caliber, emergence angle, area, shape, and color of the follicular unit.

7. The method of claim 1, further comprising labeling the at least one marker in the first image, and labeling the at least one marker in the second image with the same label as in the first image by searching for the at least one marker in the second image in the direction pointed to by the motion vector.

8. The method of claim 1, further comprising computing a second motion vector from the first image and the second image, and using the second motion vector to label the follicular unit in the second image.

9. The method of claim 8, wherein the second vector is computed using one or more of the Gray-Coded Bit-Plane, optical flow, and block search image stabilization techniques.

10. The method of claim 1, further comprising moving an image-capture device according to the motion vector to keep the follicular unit in a field of view of the image-capture device.

11. The method of claim 1, wherein identifying the at least one marker comprises associating electronic identifiers with the at least one marker.

12. The method of claim 1, further comprising discarding from consideration any marker in the second image inconsistent with its location in the first image according to the motion vector.

13. The method of claim 1, wherein the motion vector defines a search region for locating the follicular unit and wherein defining the search region comprises analyzing a region along the motion vector and within a predetermined distance from the motion vector.

14. The method of claim 13, wherein the predetermined distance from the motion vector comprises a cone having a tip at a location of the marker in the first image, the tip having a predetermined tip angle, the cone extending in a direction of the motion vector and including an area within the predetermined tip angle.

15. The method of claim 1, further comprising dividing the first and second images into a plurality of first and second sub-images, and computing a plurality of motion vectors from the first and second sub-images.

16. The method of claim 1, wherein the method further comprises harvesting the follicular unit that has been tracked, and further implanting the harvested follicular unit in a recipient area.

17. A method for tracking a follicular unit, the method comprising:

receiving a first image of a body surface containing follicular units and a second image of the same body surface;

identifying a follicular unit in the first image;

computing a signature of the follicular unit in the first image;

computing a motion vector from the first image and the second image; and

using the motion vector and the signature of the follicular unit in the first image to label the follicular unit in the second image.

18. The method of claim 17, wherein the motion vector is computed using one or more of the Gray-Coded Bit-Plane, optical flow, and block search image stabilization techniques.

19. The method of claim 17, wherein computing the signature of the follicular unit in the first image comprises identifying one or more of a length, type, caliber, emergence angle, area, shape, and color of the follicular unit.

20. A system for tracking a follicular unit on a body surface, the system comprising:

an imaging device for capturing at least two images, a first image including a first marker and a follicular unit;

a signature identification component, wherein the signature identification component identifies signature information about the follicular unit;

a vectoring component, wherein the vectoring component calculates a motion vector between a first image of the two images and a second image of the two images; and

a tracking system for receiving data corresponding to the motion vector, and labeling the follicular unit based on the motion vector and the follicular unit signature information.

21. The system of claim 20, wherein the tracking system is further programed to move the imaging device based on the motion vector.

22. The system of claim 20, wherein the signature identification component, vectoring component, and tracking system are part of a single software or hardware product.

23. The system of claim 20, farther comprising a marker identification component, and wherein the marker identification component is a part of the signature identification component.

24. The system of claim 20, wherein one or more of the signature identification component, the vectoring component, and the tracking component comprises a processor connected to at least one of memory and the imaging device.

25. The system of claim 20, wherein the system is a robotic system further comprising a robotic arm.

26. A system for labeling follicular units, comprising:

an interface adapted to receive an image data containing follicular units; and

an image processor comprising one or more modules for executing operations on the image data, the one or more modules including instructions for;

receiving a first image of a body surface containing follicular units and a second image of the same body surface;

identifying a follicular unit in the first image;

computing a signature of the follicular unit in the first image;

computing a motion vector from the first image and the second image; and

using the motion vector and the signature of the follicular unit in the first image to label the follicular unit in the second image.