Intelligent user interface using on-screen force feedback and method of use

• US 8,151,188 B2
• Filed: 07/23/2008
• Issued: 04/03/2012
• Est. Priority Date: 07/23/2008
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Mahesh, Prakash, Kenney, Timothy, Whitfill, James
• Primary Examiner(s): Tran, Tuyetlien
• Assistant Examiner(s): CHUONG, TRUC T
• Application Number:
  US12/178,258
• Publication Number:
  US 20100023857A1
• Time in Patent Office: 1,350 Days
• Field of Search: 715/834, 715701-702, 715/856, 600/437
• US Class Current: 715/701
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

Certain embodiments of the present invention provide methods and systems combining user interface features with force feedback techniques in clinical applications. Certain embodiments provide a user interface providing clinical software tools and information access for a picture archiving and communication system. The user interface includes a plurality of regions displayed to represent selectable functionality for an associated plurality of clinical software tools and information. The user interface also includes a cursor movable by a user to select one of the plurality of regions. The user interface further includes a processor configured to determine a location and pattern of movement of the cursor and provide force feedback to the user based on the location and pattern of movement of the cursor to provide a non-visual indication to the user of the location and pattern of movement of the cursor.

Claims

1. A user interface system providing clinical software tools and information access for a picture archiving and communication system, said user interface system comprising:

a plurality of regions displayed to represent selectable functionality for an associated plurality of clinical software tools and information, each of said plurality of regions selectable to access functionality including a clinical software tool and information associated with said region;

a cursor movable by a user to select one of said plurality of regions; and

a processor configured to determine a location and pattern of movement of said cursor and provide force feedback to said user based on said location and pattern of movement of said cursor to provide a non-visual indication to said user of said location and pattern of movement of said cursor,

wherein said cursor is movable by a mousing device and wherein said processor provides said force feedback via said mousing device, and wherein a first click of said mousing device activates a force feedback feature to provide force feedback based on said location and pattern of movement of said cursor by the user after activation of the force feedback feature, and wherein a second click of said mousing device executes functionality corresponding to said region associated with said location of said cursor.

2. The user interface of claim 1, wherein said cursor is movable by a touchscreen and wherein said processor provides said force feedback via said touchscreen.

3. The user interface of claim 1, wherein said plurality of regions includes a pie-shaped menu including a plurality of wedge segments each representing a corresponding clinical software tool or information.

4. The user interface of claim 1, wherein an amount of force feedback varies based on said location of said cursor to distinguish between each of said plurality of regions.

5. The user interface of claim 1, wherein said force feedback allows said user to feel boundaries between said plurality of regions.

6. The user interface of claim 5, wherein user selection after moving said cursor across a boundary into a region expands that region.

7. The user interface of claim 1, wherein a degree of force applied by said user determines functionality activated in a region.

8. A method for providing force feedback to a user in conjunction with a user interface or application display in a clinical system, said method comprising:

associating a degree of force feedback with a region of a display and a boundary of the region, the display providing a plurality of regions displayed to represent selectable functionality for an associated plurality of clinical software tools and information, each of said plurality of regions selectable to access functionality including a clinical software tool and information associated with said region;

tracking manipulation of a cursor with respect to the region on the display to determine a location and pattern of movement of said cursor, said cursor movable by a user via a mousing device to select one of said plurality of regions;

providing said force feedback to a user via said mousing device when said cursor enters and leaves said region based on a first click of said mousing device to provide a non-visual indication to said user of said location and pattern of movement of said cursor, said first click to activate a force feedback feature to provide said force feedback after activation of the force feedback feature; and

executing functionality corresponding to said region based on a second click of said mousing device.

9. The method of claim 8, wherein an amount of force feedback varies based on said location of said cursor to distinguish between each of a plurality of regions.

10. The method of claim 8, wherein said force feedback allows said user to feel a boundaries surrounding said region.

11. The method of claim 8, wherein user selection after moving said cursor across said boundary into said region expands said region.

12. A computer-readable storage medium including a set of instructions for execution on a processing device and associated processing logic, the set of instructions comprising:

a user interface routine displaying a plurality of regions representing selectable functionality for an associated plurality of clinical software tools and information, each of said plurality of regions selectable to access functionality including a clinical software tool and information associated with said region; and

a processing routine configured to determine a location and pattern of movement of a cursor movable by a user to select one of said plurality of regions and to provide force feedback to said user based on said location and pattern of movement of said cursor to provide a non-visual indication to said user of said location and pattern of movement of said cursor,

wherein said cursor is movable by a mousing device and wherein said processing routine is configured to provide force feedback to said user via said mousing device based on said location and pattern of movement of said cursor based on a first click of said mousing device, said first click to activate a force feedback feature to provide said force feedback after activation of the force feedback feature, and to execute functionality corresponding to said region associated with said cursor based on a second click of said mousing device.

13. The computer-readable storage medium of claim 12, wherein said cursor is movable by a touchscreen and wherein said processing routine provides said force feedback via said touchscreen.

14. The computer-readable storage medium of claim 12, wherein an amount of force feedback varies based on said location of said cursor to distinguish between each of said plurality of regions.

15. The computer-readable storage medium of claim 12, wherein said force feedback allows said user to feel boundaries between said plurality of regions.