METHOD AND SYSTEM FOR CROPPING A 3-DIMENSIONAL MEDICAL DATASET

• US 20130033571A1
• Filed: 08/03/2011
• Published: 02/07/2013
• Est. Priority Date: 08/03/2011
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Steen, Erik N.
• Granted Patent: US 8,817,076 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

A method and gesture-based control system for manipulating a 3-dimensional medical dataset include translating a body part, detecting the translation of the body part with a camera system. The method and system include translating a crop plane in the 3-dimensional medical dataset based on the translating the body part. The method and system include cropping the 3-dimensional medical dataset at the location of the crop plane after translating the crop plane and displaying the cropped 3-dimensional medical dataset using volume rendering.

Claims

1. A method of manipulating a 3-dimensional medical dataset comprising:

translating a body part;

detecting said translating the body part with a camera system;

translating a crop plane in the 3-dimensional medical dataset based on said translating the body part;

cropping the 3-dimensional medical dataset at the location of the crop plane after said translating the crop plane; and

displaying the cropped 3-dimensional medical dataset using volume rendering.

2. The method of claim 1, wherein said translating the body part comprises translating a hand.

3. The method of claim 1, wherein said cropping the 3-dimensional medical dataset comprises removing a portion of the image to one side of the crop plane.

4. The method of claim 3, wherein the cropped 3-dimensional medical dataset comprises a live ultrasound image.

5. The method of claim 1, wherein said translating the crop plane occurs in real-time while said translating the body part.

6. The method of claim 1, wherein said detecting said translating the body part comprises implementing a segmentation algorithm to identify the body part.

7. A method of manipulating a 3-dimensional medical dataset comprising:

performing an initialization gesture within a predetermined volume;

detecting the initialization gesture with a camera system;

determining with a processor the location of the initialization gesture within the predetermined volume;

selecting with the processor one of a plurality of crop planes based on the location of the initialization gesture within the predetermined volume;

performing a translation gesture within the predetermined volume;

detecting the translation gesture with the camera system;

determining with the processor a translation direction and a translation distance based on the translation gesture;

moving the selected crop plane the translation distance in the translation direction;

cropping a 3-dimensional medical dataset at the location of the crop plane after said moving the crop plane; and

displaying the cropped 3-dimensional medical dataset using volume rendering.

8. The method of claim 7, wherein the initialization gesture comprises opening a hand.

9. The method of claim 8, wherein the translation gesture comprises translating the hand.

10. The method of claim 7, wherein the initialization gesture comprises closing a hand.

11. The method of claim 10, wherein the translation gesture comprises translating the hand.

12. The method of claim 9, wherein the crop plane comprises one of six planes oriented in a box.

13. The method of claim 7, further comprising performing a stop gesture after said performing the translation gesture.

14. The method of claim 13, further comprising detecting the stop gesture and deselecting the crop plane.

15. The method of claim 7, wherein said moving the selected crop plane the translation distance in the translation direction occurs in real-time while said performing the translation gesture.

16. A gesture-based control system comprising:

a camera system;

a display device connected to the camera system; and

a processor connected to the camera system and the display device, wherein the processor is configured to;

display a volume rendering of a 3-dimensional medical dataset on the display device;

receive camera data of a translation gesture from the camera system;

segment a body part from the camera data;

determine a translation distance and a translation direction of the translation gesture from the camera data;

move the crop plane the translation distance in the translation direction;

crop the 3-dimensional medical dataset at the location of the crop plane; and

display the cropped 3-dimensional medical dataset on the display device using volume rendering.

17. The gesture-based control system of claim 16, wherein the camera system comprises a single camera.

18. The gesture-based control system of claim 16, wherein the camera system comprises multiple cameras.

19. The gesture-based control system of claim 16, wherein the processor is configured to determine the translation distance and the translation direction by feature tracking.

20. The gesture-based control system of claim 16, wherein the processor is configured to determine the translation distance and the translation direction based on a focus depth of the camera system.