User interface for handheld imaging devices

• US 7,022,075 B2
• Filed: 10/29/2003
• Issued: 04/04/2006
• Est. Priority Date: 08/20/1999
• Status: Expired due to Term

• Current Assignee: Shenzhen Mindray Bio-Medical Electronics Co., Ltd. (Excelsior Union Ltd.)
• Original Assignee: Zonare Medical Systems Incorporated (Excelsior Union Ltd.)
• Inventors: Grunwald, Sorin, McLaughlin, Glen W., Stanson, Robert, Batool, Ailya, Hom, Soo
• Primary Examiner(s): IMAM, ALI M
• Application Number:
  US10/697,148
• Publication Number:
  US 20040138569A1
• Time in Patent Office: 888 Days
• Field of Search: 600437-472, 128/916, 367/7, 367/11, 367/130, 367/138, 382/128, 705/3
• US Class Current: 600/446
• CPC Class Codes: A61B 8/00 Diagnosis using ultrasonic, sonic or infrasonic waves imaging of objects using sonar G01S15/00
• CPC Class Codes: A61B 8/06 Measuring blood flow measuring volume flow in general G01F, e.g. G01F1/66, G01F1/72; measuring speed of fluids in general G01P5/00
• CPC Class Codes: A61B 8/08 Detecting organic movements or changes, e.g. tumours, cysts, swellings A61B8/02 - A61B8/06 take precedence
• CPC Class Codes: A61B 8/0833 involving detecting or locating foreign bodies or organic structures
• CPC Class Codes: A61B 8/0866 involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby
• CPC Class Codes: A61B 8/13 Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 8/4427 Device being portable or laptop-like
• CPC Class Codes: A61B 8/4438 Means for identifying the diagnostic device, e.g. barcodes
• CPC Class Codes: A61B 8/4455 Features of the external shape of the probe, e.g. ergonomic aspects
• CPC Class Codes: A61B 8/4472 Wireless probes
• CPC Class Codes: A61B 8/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/465 adapted to display user selection data, e.g. icons or menus
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/468 allowing annotation or message recording
• CPC Class Codes: A61B 8/469 for selection of a region of interest
• CPC Class Codes: A61B 8/488 involving Doppler signals
• CPC Class Codes: G01S 15/8981 Discriminating between fixed and moving objects or between objects moving at different speeds, e.g. wall clutter filter
• CPC Class Codes: G01S 7/52084 related to particular user interfaces special user input means for ultrasonic medical diagnostic devices A61B8/467
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

A Graphical User Interface (GUI) for an ultrasound system. The ultrasound system has operational modes and the GUI has corresponding icons, tabs, and menu items image and information fields. The User Interface (UI) provides several types of graphical elements with intelligent behavior, such as being context sensitive and adaptive, called active objects, for example, tabs, menus, icons, windows of user interaction and data display and an alphanumeric keyboard. In addition the UI may also be voice activated. The UI further provides for a touchscreen for direct selection of displayed active objects. In an embodiment, the UI is for a medical ultrasound handheld imaging instrument. The UI provides a limited set of hard and soft keys with adaptive functionality that can be used with only one hand and potentially with only one thumb.

Claims

1. A handheld user interface for an ultrasonic imaging system, the user interface comprising:

a set of display and user interaction areas comprising;

an image area configured to display ultrasonic images;

a control area comprising elements configured to enable a user to access a plurality of operation modes single-handedly, the elements having active behavior that provides timely user control of the ultrasonic imaging system whereby each of the display areas can interact with the user independently in order to provide timely response to specific user requests; and

means for causing the user interface to automatically optimize display settings in accordance with a plurality of parameters.

2. The user interface of claim 1, wherein the image area is further configured to display patient information fields.

3. The user interface of claim 1, wherein the image area is further configured to display patient information retrieved from a patient information database using active database components.

4. The user interface of claim 1, wherein the image area is further configured to display system configuration information using active display elements.

5. The user interface of claim 1, wherein the active behavior of the elements comprises behavior based on context.

6. The user interface of claim 1, wherein the active behavior of the elements comprises behavior based on a history of user interactions with the ultrasonic imaging system.

7. The user interface of claim 1, wherein the active behavior of the elements comprises behavior based on a state of the ultrasonic imaging system.

8. The user interface of claim 1, wherein the elements are configured to accept input comprising voice commands.

9. The user interface of claim 1, further comprising a virtual keyboard configured to allow the user to interact with the elements.

10. The user interface of claim 9, wherein the virtual keyboard comprises user programmable function keys.

11. The user interface of claim 9, wherein the virtual keyboard is configured to accept input comprising voice commands.

12. The user interface of claim 9, wherein the virtual keyboard is configured to accept input via a touchscreen.

13. The user interface of claim 1, wherein the plurality of operation modes comprises a patient information mode, an image mode selection mode, an image acquisition mode, and a system configuration mode.

14. The user interface of claim 1, wherein the plurality of operation modes comprises an archive mode configured to enable patient information to be saved to a patient information database.

15. The user interface of claim 1, wherein the plurality of operation modes comprises an annotation mode configured to enable the user to attach annotations to a stored ultrasonic image.

16. The user interface of claim 15, wherein the annotation mode enables the user to attach a text annotation to the stored ultrasonic image.

17. The user interface of claim 15, wherein the annotation mode enables the user to attach a voice annotation to the stored ultrasonic image.

18. The user interface of claim 1, wherein the ultrasonic imaging system is portable.

19. The user interface of claim 1, wherein the control area comprises at least one tab selectable by the user to select one of the plurality of operation modes.

20. The user interface of claim 1, wherein the control area comprises a tab selectable by the user to expand the image area to a full screen view.

21. A handheld user interface for an ultrasonic imaging system, the user interface comprising:

a set of display and user interaction areas comprising;

an image area configured to display ultrasonic images;

a control area comprising elements configured to enable a user to access a plurality of operation modes single-handedly, the elements having intelligent behavior that provides optimized user control of the ultrasonic imaging system whereby each of the display areas can interact with the user independently in order to provide timely response to specific user requests; and

means for causing the user interface to automatically optimize display settings in accordance with a plurality of parameters.

22. The user interface of claim 21, wherein the image area is further configured to display patient information fields.

23. The user interface of claim 21, wherein the image area is further configured to display patient information retrieved from a patient information database.

24. The user interface of claim 21, wherein the image area is further configured to display system configuration information.

25. The user interface of claim 21, wherein the intelligent behavior of the elements comprises auto-adaptive behavior.

26. The user interface of claim 21, wherein the intelligent behavior of the elements comprise behavior based on context.

27. The user interface of claim 21, wherein the intelligent behavior of the elements comprises behavior based on a history of user interactions with the ultrasonic imaging system.

28. The user interface of claim 21, wherein the intelligent behavior of the elements comprises behavior based on a state of the ultrasonic imaging system.

29. The user interface of claim 21, wherein the elements are configured to accept input comprising voice commands.

30. The user interface of claim 21, further comprising a virtual keyboard configured to allow the user to interact with the elements.

31. The user interface of claim 30, wherein the virtual keyboard comprises user programmable function keys.

32. The user interface of claim 30, wherein the virtual keyboard is configured to accept input comprising voice commands.

33. The user interface of claim 30, wherein the virtual keyboard is configured to accept input via a touchscreen.

34. The user interface of claim 21, wherein the plurality of operation modes comprises a patient information mode, an image mode selection mode, an image acquisition mode, and a system configuration mode.

35. The user interface of claim 21, wherein the plurality of operation modes comprises an archive mode configured to enable patient information to be saved to a patient information database.

36. The user interface of claim 21, wherein the plurality of operation modes comprises an annotation mode configured to enable the user to attach annotations to a stored ultrasonic image.

37. The user interface of claim 36, wherein the annotation mode enables the user to attach a text annotation to the stored ultrasonic image.

38. The user interface of claim 36, wherein the annotation mode enables the user to attach a voice annotation to the stored ultrasonic image.

39. The user interface of claim 21, wherein the ultrasonic imaging system is portable.

40. The user interface of claim 21, wherein the control area comprises at least one tab selectable by the user to select one of the plurality of operation modes.

41. The user interface of claim 21, wherein the control area comprises a tab selectable by the user to expand the image area to a full screen view.

42. A handheld user interface for an ultrasonic imaging system, the user interface comprising:

a plurality of display areas, at least one of the plurality of display areas comprising at least one independent element configured to be operated single-handedly, the at least one independent element operable to receive user input and maintain a history of user interaction, and the at least one independent element having behavior that depends upon input and the history of user interaction; and

means for causing the user interface to automatically optimize display settings in accordance with a plurality of parameters.

43. The user interface of claim 42, wherein each of the plurality of display areas is resizable by a user.

44. The user interface of claim 42, wherein each of the plurality of display areas is repositionable by a user.

45. The user interface of claim 42, wherein at least one of the plurality of display areas is configured to display ultrasonic image data.

46. The user interface of claim 42, wherein at least one of the plurality of display areas is configured to display system information.

47. A handheld user interface comprising:

a plurality of operation modes comprising an image acquisition mode, a system configuration mode, a measure and annotate mode, an archiving mode, and a system services mode;

a display view shown on a display device, the display view comprising an image area and a control area, the image area configured to display an image generated in accordance with the image acquisition mode, and the control area configured to enable selection of one of the plurality of operation modes single-handedly; and

means for causing the user interface to automatically optimize display settings in accordance with a plurality of parameters.

48. The user interface of claim 47, wherein the display view comprises a plurality of windows, each of the windows being resizable and repositionable within the display view.

49. The user interface of claim 48, wherein the control area is configured to enable a user to hide all windows in the display view except for the image area, which then automatically expands to occupy the entire display view.

50. The user interface of claim 47, wherein the control area comprises at least one tab selectable by a user to select one of the plurality of operation modes.

51. The user interface of claim 50, wherein the control area comprises at least one tab selectable by the user to select at least one mode within a selected operation mode.

52. The user interface of claim 47, wherein the control area comprises a virtual keyboard.

53. A handheld user interface comprising:

an image view configured to display an ultrasound image;

a control view configured to present controls to a user, the controls configured to be operated single-handedly, the control view comprising active elements, each active element having context-dependent behavior, and each active element configured to maintain a history of user interactions with that active element;

the control view further comprising intelligent elements, each intelligent element configured to provide auto-adaptive interactions between the user and the user interface; and

means for causing the user interface to automatically optimize display settings in accordance with a plurality of parameters.