Method and apparatus for providing user interface for medical diagnostic apparatus

• US 9,582,091 B2
• Filed: 08/01/2014
• Issued: 02/28/2017
• Est. Priority Date: 08/23/2013
• Status: Active Grant

• Current Assignee: Samsung Medison Company Limited (Samsung Electronics Co. Ltd.)
• Original Assignee: Samsung Medison Company Limited (Samsung Electronics Co. Ltd.)
• Inventors: Ahn, Mi-Jeoung, Jo, Jae-Moon, Kim, Hyoung-Jin, Hyun, Dong-Gyu
• Primary Examiner(s): ROSARIO, NELSON M
• Application Number:
  US14/449,602
• Publication Number:
  US 20150054761A1
• Time in Patent Office: 942 Days
• Field of Search: 345156-178, 345/592, 345/676, 345/684
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation

Abstract

A user interface (UI) providing method and apparatus that increase the usability of a control panel and quickly and conveniently provide a desired UI to a user. The UI providing method includes detecting a gesture of a hand of a user, determining a touch input UI that corresponds to the detected gesture and is displayed on a screen, and adjusting and displaying the touch input UI on a basis of a distance from the screen to the hand.

Claims

1. A user interface (UI) providing method for use in a medical diagnostic apparatus, the UI providing method comprising:

detecting a number of hands and a number of fingers of a user;

determining a touch input UI, from among a plurality of touch input UIs, that corresponds to the detected number of hands and number of fingers and is to be displayed on a screen; and

adjusting and displaying the touch input UI on a basis of a distance from the screen to the hand,

wherein the determining of the touch input UI comprises;

when the number of the detected hands is two and the number of the detected fingers is eight or more, determining a virtual keyboard as the touch input UI;

when the number of the detected hands is one and the number of the detected fingers is two, determining a time gain compensation (TGC) adjustment UI as the touch input UI;

when the number of the detected hands is one and the number of the detected fingers is one, determining a menu selection UI as the touch input UI; and

when the number of the detected hands is one and no finger is detected, determining an image control UI as the touch input UI.

2. The UI providing method of claim 1, wherein the adjusting and displaying of the touch input UI comprises changing at least one of transparency, size, and position of the touch input UI on a basis of the distance from the screen to the hand.

3. The UI providing method of claim 1, wherein the adjusting and displaying of the touch input UI comprises, as the distance from the screen to the hand becomes shorter, decreasing the transparency of the touch input UI.

4. The UI providing method of claim 1, wherein the adjusting and displaying of the touch input UI comprises:

when the distance from the screen to the hand is equal to a first distance, displaying a portion of the touch input UI on the screen; and

when the distance from the screen to the hand is equal to a second distance, displaying an entirety of the touch input UI on the screen, the second distance being shorter than the first distance.

5. The UI providing method of claim 1, wherein the adjusting and displaying of the touch input UI comprises changing at least one of a shape, color, brightness, and flickering period of the touch input UI on a basis of the distance from the screen to the hand.

6. The UI providing method of claim 1, further comprising:

acquiring an image of the hand;

detecting a change in at least one of a palm, knuckle, and fingertip of the hand from the acquired image; and

searching for a gesture, corresponding to the detected change in the at least one of the palm, knuckle, and fingertip of the hand, from stored information about at least one gesture.

7. The UI providing method of claim 1, wherein the adjusting and displaying of the touch input UI comprises:

detecting a position of the hand; and

displaying the touch input UI on a region of the screen corresponding to the detected position.

8. The UI providing method of claim 1, wherein the touch input UI comprises at least one of a virtual keyboard, a time gain compensation (TGC) adjustment UI, a menu selection UI, and an image control UI that controls a rotation of a 3D medical image.

9. The UI providing method of claim 1, wherein when the touch input UI is a virtual keyboard, the adjusting and displaying of the touch input UI comprises:

detecting an interval between fingertips of the hand; and

displaying the virtual keyboard having a key interval corresponding to the detected interval.

10. A user interface (UI) providing apparatus for use in a medical diagnostic apparatus, the UI providing apparatus comprising:

a detector configured to detect a number of hands and a number of fingers of a user;

a controller configured to determine a touch input UI, from among a plurality of touch input UIs, which corresponds to the detected number of hands and number of fingers and is to be displayed on a screen, and adjusts the touch input UI on a basis of a distance from the screen to the hand; and

a display configured to display the adjusted touch input UI,

wherein,

when the number of the detected hands is two and the number of the detected fingers is eight or more, the controller determines a virtual keyboard as the touch input UI,

when the number of the detected hands is one and the number of the detected fingers is two, the controller determines a time gain compensation (TGC) adjustment UI as the touch input UI,

when the number of detected hands is one and the number of the detected fingers is one, the controller determines a menu selection UI as the touch input UI, and

when the number of the detected hands is one and no finger is detected, the controller determines an image control UI as the touch input UI.

11. The UI providing apparatus of claim 10, wherein the controller changes at least one of transparency, size, and position of the touch input UI on a basis of the distance from the screen to the hand.

12. The UI providing apparatus of claim 10, wherein as the distance from the screen to the hand becomes shorter, the controller decreases the transparency of the touch input UI.

13. The UI providing apparatus of claim 10, wherein,

when the distance from the screen to the hand is equal to a first distance, the controller displays a portion of the touch input UI on the screen,

when the distance from the screen to the hand is equal to a second distance, the controller displays an entirety of the touch input UI on the screen, and

the second distance is shorter than the first distance.

14. The UI providing apparatus of claim 10, wherein the controller changes at least one of a shape, color, brightness, and flickering period of the touch input UI on a basis of the distance from the screen to the hand.

15. The UI providing apparatus of claim 10, wherein the detector comprises:

an image acquirer configured to acquire an image of the hand;

an image analyzer configured to detect a change in at least one of a palm, knuckle, and fingertip of the hand from the acquired image; and

a searcher configured to search for a gesture, corresponding to the detected change in the at least one of the palm, knuckle, and fingertip of the hand, from stored information about at least one gesture.

16. The UI providing apparatus of claim 10, wherein,

the detector detects a position of the hand, and

the controller controls the UI display to display the touch input UI on a region of the screen corresponding to the detected position.

17. The UI providing apparatus of claim 10, wherein the touch input UI comprises at least one of a virtual keyboard, a time gain compensation (TGC) adjustment UI, a menu selection UI, and an image control UI that controls a rotation of a 3D medical image.

18. The UI providing apparatus of claim 10, wherein when the touch input UI is a virtual keyboard,

the detector detects an interval between fingertips of the hand, and

the controller controls the UI display to display the virtual keyboard having a key interval corresponding to the detected interval.

19. A non-transitory computer-readable storage medium storing a program for executing a user interface (UI) providing method for use in a medical diagnostic apparatus, the UI providing method comprising:

detecting a number of hands and a number of fingers of a user;

determining a touch input UI, from among a plurality of touch input UIs, that corresponds to the detected number of hands and number of fingers and is to be displayed on a screen; and

adjusting and displaying the touch input UI on a basis of a distance from the screen to the hand,

wherein the determining of the touch input UI comprises;

when the number of the detected hands is two and the number of the detected fingers is eight or more, determining a virtual keyboard as the touch input UI;

when the number of the detected hands is one and the number of the detected fingers is two, determining a time gain compensation (TGC) adjustment UI as the touch input UI;

when the number of the detected hands is one and the number of the detected fingers is one, determining a menu selection UI as the touch input UI; and

when the number of the detected hands is one and no finger is detected, determining an image control UI as the touch input UI.