Method and system for cropping a 3-dimensional medical dataset

• US 8,817,076 B2
• Filed: 08/03/2011
• Issued: 08/26/2014
• Est. Priority Date: 08/03/2011
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Steen, Erik N.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Brown, Jr., Howard D
• Application Number:
  US13/197,223
• Publication Number:
  US 20130033571A1
• Time in Patent Office: 1,119 Days
• Field of Search: 348/46, 382/154
• US Class Current: 348/46
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

A method and gesture-based control system for manipulating a 3-dimensional medical dataset include translating a body part, detecting the translation of the body part with a camera system. The method and system include translating a crop plane in the 3-dimensional medical dataset based on the translating the body part. The method and system include cropping the 3-dimensional medical dataset at the location of the crop plane after translating the crop plane and displaying the cropped 3-dimensional medical dataset using volume rendering.

Claims

1. A method of manipulating a 3-dimensional medical dataset comprising:

translating a body part;

receiving camera data of said translating the body part from a camera system;

determining with a processor a translation distance and a translation direction from the camera data based on at least one of feature tracking and a focus depth of the camera system;

translating a crop plane in the 3-dimensional medical dataset based on the translation distance and the translation direction;

cropping the 3-dimensional medical dataset at the location of the crop plane after said translating the crop plane; and

displaying the cropped 3-dimensional medical dataset using volume rendering.

2. The method of claim 1, wherein said translating the body part comprises translating a hand.

3. The method of claim 1, wherein said cropping the 3-dimensional medical dataset comprises removing a portion of the image to one side of the crop plane.

4. The method of claim 3, wherein the cropped 3-dimensional medical dataset comprises a live ultrasound image.

5. The method of claim 1, wherein said translating the crop plane occurs in real-time while said translating the body part.

6. The method of claim 1, further comprising implementing a segmentation algorithm to identify the body part.

7. A method of manipulating a 3-dimensional medical dataset comprising:

performing an initialization gesture within a predetermined volume;

detecting the initialization gesture with a camera system;

determining with a processor the location of the initialization gesture within the predetermined volume;

selecting with the processor one of a plurality of crop planes based on the location of the initialization gesture within the predetermined volume, wherein the crop plane comprises one of six planes oriented in a box;

performing a translation gesture within the predetermined volume;

detecting the translation gesture with the camera system;

determining with the processor a translation direction and a translation distance based on the translation gesture;

moving the selected crop plane the translation distance in the translation direction;

cropping a 3-dimensional medical dataset at the location of the crop plane after said moving the crop plane; and

displaying the cropped 3-dimensional medical dataset using volume rendering.

8. The method of claim 7, wherein the initialization gesture comprises opening a hand.

9. The method of claim 8, wherein the translation gesture comprises translating the hand.

10. The method of claim 7, wherein the initialization gesture comprises closing a hand.

11. The method of claim 10, wherein the translation gesture comprises translating the hand.

12. The method of claim 7, further comprising performing a stop gesture after said performing the translation gesture.

13. The method of claim 12, further comprising detecting the stop gesture and deselecting the crop plane.

14. The method of claim 7, wherein said moving the selected crop plane the translation distance in the translation direction occurs in real-time while said performing the translation gesture.

15. A gesture-based control system comprising:

a camera system;

a display device connected to the camera system; and

a processor connected to the camera system and the display device, wherein the processor is configured to;

display a volume rendering of a 3-dimensional medical dataset on the display device;

receive camera data of a translation gesture from the camera system;

segment a body part from the camera data;

determine a translation distance and a translation direction of the translation gesture from the camera data based on feature tracking;

move the crop plane the translation distance in the translation direction;

crop the 3-dimensional medical dataset at the location of the crop plane; and

display the cropped 3-dimensional medical dataset on the display device using volume rendering.

16. The gesture-based control system of claim 15, wherein the camera system comprises a single camera.

17. The gesture-based control system of claim 15, wherein the camera system comprises multiple cameras.

18. A gesture-based control system comprising:

a camera system;

a display device connected to the camera system; and

a processor connected to the camera system and the display device, wherein the processor is configured to;

display a volume rendering of a 3-dimensional medical dataset on the display device;

receive camera data of a translation gesture from the camera system;

segment a body part from the camera data;

determine a translation distance and a translation direction of the translation gesture from the camera data based on a focus depth of the camera system;

move the crop plane the translation distance in the translation direction;

crop the 3-dimensional medical dataset at the location of the crop plane; and

display the cropped 3-dimensional medical dataset on the display device using volume rendering.

19. The gesture-based control system of claim 18, wherein the camera system comprises of a single camera.

20. The gesture-based control system of claim 18, wherein the camera system comprises multiple camera.