Method and apparatus for changing user interface based on user motion information

• US 9,904,455 B2
• Filed: 07/01/2014
• Issued: 02/27/2018
• Est. Priority Date: 07/01/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ban, Dae-hyun, Kim, Su-jin, Han, Jeong-ho
• Primary Examiner(s): Phantana-angkool, David
• Application Number:
  US14/320,924
• Publication Number:
  US 20150089411A1
• Time in Patent Office: 1,337 Days
• Field of Search: 715765
• CPC Class Codes: A61B 8/44 Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
• CPC Class Codes: A61B 8/4405 Device being mounted on a trolley
• CPC Class Codes: A61B 8/4427 Device being portable or laptop-like
• CPC Class Codes: A61B 8/4477 using several separate ultrasound transducers or probes
• CPC Class Codes: A61B 8/465 adapted to display user selection data, e.g. icons or menus
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: G01S 7/52084 related to particular user interfaces special user input means for ultrasonic medical diagnostic devices A61B8/467
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03549 Trackballs G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A method of changing a user interface (UI), which is used for diagnosis of a target object via a medical device, based on user motion information. The method including obtaining motion information regarding a user; changing the UI based on the obtained motion information regarding the user; and displaying the changed UI.

Claims

1. A method comprising:

displaying a graphical user interface (GUI) on a screen, the displayed GUI including a plurality of user interfaces to control a medical device used for diagnosis of a target object, each user interface of the plurality of user interfaces having a shape, size and location displayed on the screen;

obtaining user motion information regarding a user of the medical device; and

for at least one user interface of the plurality of user interfaces, changing at least one of the shape, the size and the location of the at least one user interface displayed on the screen to a different shape, size and location, respectively, displayed on the screen, based on the obtained user motion information regarding the user, to thereby display a changed GUI having an improved ease of access to the at least one user interface, as compared to the GUI before being changed, by the user for a current position of the user at which the user uses the medical device.

2. The method of claim 1, wherein the user motion information regarding the user is obtained based on position information regarding a current position of a probe of the medical device.

3. The method of claim 2, wherein the position information regarding the current position of the probe comprises at least one from among a current pointing direction of the probe and an angle of inclination and a height of the probe with respect to a predetermined reference point.

4. The method of claim 1, wherein the user motion information regarding the user is obtained based on biometric information regarding the user including at least one from among information regarding a fingerprint of the user, information regarding an iris of the user, and information regarding a face of the user.

5. The method of claim 1, wherein the at least one user interface comprises at least one from among a shortkey, a switch, a keyboard, and a trackball that indicate functions to be used for diagnosis of the target object.

6. The method of claim 1, wherein, the at least one of the shape, the size and the location is the location.

7. The method of claim 5, wherein the changing changes the at least one of the shape, the size, and the location based on frequency of accessing functions that are used during a diagnosis of the target object.

8. The method of claim 5, further comprising:

editing the GUI based on externally input signals.

9. The method of claim 1, wherein the screen is a screen of a control panel of the medical device on which a captured image is displayed.

10. The method of claim 9, further comprising:

adjusting at least one of a height and an angle of the control panel based on the user motion information regarding the user.

11. The method of claim 1, further comprising:

obtaining user identification information regarding the user; and

storing the changed GUI based on obtained user identification information.

12. A non-transitory computer readable recording medium having recorded thereon a computer program for implementing the method of claim 1.

13. An apparatus comprising:

at least one memory storing instructions; and

at least one processor that executes the instructions to cause the following to be performed;

displaying a graphical user interface (GUI) on a screen, the displayed GUI including a plurality of user interfaces to control a medical device used for diagnosis of a target object, each user interface of the plurality of user interfaces having a shape, size and location displayed on the screen,

obtaining user motion information regarding a user of the medical device, and

for at least one user interface of the plurality of user interfaces, changing at least one of the shape, the size and the location of the at least one user interface displayed on the screen to a different shape, size and location, respectively, displayed on the screen, based on the obtained user motion information regarding the user, to thereby display a changed GUI having an improved ease of access to the at least one user interlace, as compared to the GUI before being changed, by the user for a current position of the user at which the user uses the medical device.

14. The apparatus of claim 13, further comprising:

a sensor to sense a current position of a probe of the medical device,

wherein the obtaining obtains the user motion information regarding the user based on information regarding the current position of the probe sensed by the sensor.

15. The apparatus of claim 14, wherein the information regarding the current position of the probe comprises at least one from among a current pointing direction of the probe and an angle of inclination and a height of the probe with respect to a predetermined reference point.

16. The apparatus of claim 13, wherein the obtaining obtains the user motion information regarding the user based on biometric information regarding the user including at least one from among information regarding a fingerprint of the user, information regarding an iris of the user, and information regarding a face of the user.

17. The apparatus of claim 13, wherein the at least one user interlace comprises at least one from among a shortkey, a switch, a keyboard, and a trackball that indicate functions to be used for diagnosis of the target object.

18. The apparatus of claim 13, wherein, the at least one of the shape, the size and the location is the location.

19. The apparatus of claim 17, wherein the changing changes the at least one of the shape, the size, and the location based on frequency of accessing functions used during a diagnosis of the target object.

20. The apparatus of claim 17, wherein the at least one processor executes the instructions to further cause the following to be performed:

receiving an external input signal, and

editing the GUI based on the received externally input signal.

21. The apparatus of claim 13, wherein the changed GUI is displayed on a control panel of the medical device and on which a captured image is displayed.

22. The apparatus of claim 13, wherein the at least one processor executes the instructions to further cause the following to be performed:

adjusting at least one of a height and an angle of a control panel of the medical device based on the user motion information regarding the user.

23. The apparatus of claim 13, wherein the at least one processor executes the instructions to further cause the following to be performed:

obtaining user identification information regarding the user, and

storing the changed GUI based on the user identification information.

24. A method, comprising:

determining, based on detected motion of a user of a medical device when the user is using the medical device, a use pattern of the user; and

changing, based on the determined use pattern, displayed locations of user interfaces for controlling the medical device and included in a graphical user interface (GUI) displayed on a screen, to thereby optimize a layout of the user interfaces in the GUI,

to thereby display a changed GUI having an improved ease of access to the user interfaces, as compared to the GUI before being changed, by the user based on the determined use pattern.

25. The method of claim 24, wherein the layout is stored responsive to an identity of the user.

26. The method of claim 24, wherein determining the use pattern determines the use pattern based on at least one of detected handedness of the user, detected finger position of the user, detected iris position of the user, detected face position of the user, detected probe motion of a probe of the medical device, and detected frequency of function access of the user.