METHOD OF MOVING THE DISPLAYS OF AN ULTRASOUND DIAGNOSTIC DEVICE AND ULTRASOUND DIAGNOSTIC DEVICE

• US 20150002490A1
• Filed: 06/25/2014
• Published: 01/01/2015
• Est. Priority Date: 06/28/2013
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: HAN, Jeong-ho, YANG, Eun-ho
• Application Number:
  US14/314,313
• Publication Number:
  US 20150002490A1
• Time in Patent Office: Days
• US Class Current: 345/204
• CPC Class Codes: A61B 8/4405 Device being mounted on a trolley
• CPC Class Codes: A61B 8/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/464 involving a plurality of displays
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/469 for selection of a region of interest
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A method of moving a display of an ultrasound diagnostic device includes obtaining an image of an operator capturing an ultrasound image of an object by using the ultrasound diagnostic device, determining a position and a viewing direction of the operator based on the image of the operator, and changing a position of the display connected to the ultrasound diagnostic device from a first position to a second position according to the position and the viewing direction of the operator.

Claims

1. A method of moving a display of an ultrasound diagnostic device, the method comprising:

obtaining an image comprising an operator of the ultrasound diagnostic device, the operator performing a capturing of an ultrasound image of an object by using the ultrasound diagnostic device;

determining a position and a viewing direction of the operator based on the image comprising the operator; and

changing a position of the display connected to the ultrasound diagnostic device from a first position to a second position according to the position and the viewing direction of the operator.

2. The method of claim 1, wherein the changing of the position of the display comprises:

determining a viewing range of the operator based on the position and the viewing direction of the operator; and

changing the position of the display from the first position to the second position such that a screen of the display is located in the determined viewing range of the operator.

3. The method of claim 1, wherein the determining of the viewing direction of the operator comprises:

determining a posture of the operator based on the image of the operator; and

determining the viewing direction of the operator by using the determined posture of the operator.

4. The method of claim 3, wherein the determining of the posture of the operator comprises determining the posture of the operator based on at least one of a shape and a positional relationship of a head part and a body part of the operator included in the image of the operator.

5. The method of claim 1, wherein the image comprising the operator further comprises a support table supporting the object, and

the determining of the viewing direction of the operator comprises determining a positional relationship between the operator and the support table comprised in the image of the operator.

6. The method of claim 1, wherein the changing of the position of the display comprises determining the second position, and the determining of the second position comprises determining a positional relationship between the ultrasound diagnostic device and the operator.

7. The method of claim 2, wherein the changing of the position of the display comprises determining a position located in the viewing range of the operator and in a space within which the display is movable as the second position.

8. The method of claim 1, wherein:

the obtaining of the image of the operator comprises obtaining a depth image of the operator, and

the determining of the position and the viewing direction of the operator comprises determining the position and the viewing direction of the operator based on the depth image of the operator.

9. The method of claim 8, wherein the obtaining of the depth image comprises obtaining a depth image of the operator by using a depth camera.

10. The method of claim 8, wherein the obtaining of the depth image comprises:

obtaining images of the operator by using at least two color cameras; and

obtaining a depth image of the operator by applying stereo matching to the images of the operator obtained by using the at least two color cameras.

11. The method of claim 1, wherein the changing of the position of the display comprises determining a movement path from the first position to the second position based on information about a position of at least one of a person and an object comprised in the image comprising the operator.

12. The method of claim 11, wherein the determining of the movement path comprises determining the movement path from the first position to the second position such that the display does not collide with at least one of the person and the object included in the image comprising the operator.

13. The method of claim 1, wherein the changing of the position of the display comprises changing from a first movement path to a second movement path of the display upon determining that an obstacle exists on the first movement path of the display;

wherein no obstacle exists on the second movement path; and

wherein the first and second movement paths are moving paths between the first position of the display and the second position of the display.

14. The method of claim 1, further comprising:

obtaining information about a portion of the object, the portion being a portion to which ultrasound is applied;

obtaining an image of the object;

determining a position of a portion corresponding to the portion in the image of the object; and

changing a position of the display from a third position to the first position according to the determined position of the portion.

15. The method of claim 14, wherein the obtaining of the image of the object comprises obtaining a depth image of the object.

16. The method of claim 1, wherein the determining of the position and the viewing direction of the operator comprises determining a person who is the closest to a position of a probe of the ultrasound diagnostic device when a plurality of persons are comprised in the image comprising the operator.

17. The method of claim 16, wherein the determining of the person who is the closest to the position of the probe of the ultrasound diagnostic device as the operator comprises:

determining the position of the probe by using infrared or short-range communication; and

determining a person who is the closest to the position of the probe, based on the position of the probe and the image of the operator, as the operator.

18. The method of claim 1, wherein the display comprises a first display and a second display, and

the method further comprising adjusting an angle between the first display and the second display.

19. The method of claim 18, wherein the adjusting of the angle between the first display and the second display comprises adjusting the angle between the first display and the second display such that a screen of the first display and a screen of the second display are located at the viewing direction of the operator.

20. The method of claim 18, wherein the adjusting of the angle between the first display and the second display comprises adjusting the angle between the first display and the second display so that a screen of the first display is located at the viewing direction of the operator and the screen of the second display is located at a viewing direction of the object.

21. The method of claim 1, further comprising adjusting at least one of a brightness value, a contrast value, and a tilting angle of the display located at the second position according to a preset value.

22. The method of claim 1, further comprising:

detecting a gesture of the operator with respect to the display located at the second position; and

performing a function of the ultrasound diagnostic device corresponding to the gesture of the operator.

23. The method of claim 22, wherein the detecting of the gesture of the operator comprises detecting a gesture of the operator by using the image of the operator.

24. The method of claim 23, wherein the detecting of the gesture of the operator comprises performing a function corresponding to a position indicated by a hand of the operator among functions displayed on the display when it is determined, based on the image of the operator, that the hand of the operator and the display are located within a preset distance for a preset time.

25. The method of claim 22, wherein the detecting of the gesture of the operator comprises detecting a gesture of the operator by using a gesture detection camera attached to the display.

26. The method of claim 22, wherein the detecting of the gesture of the operator comprises:

detecting a gesture or movement of an eye of the operator by using an eye tracking sensor attached to the display or attached to a headset of the operator; and

performing a function of the ultrasound diagnostic device corresponding to the detected gesture or movement of the eye of the operator.

27. The method of claim 1, further comprising receiving a display position change input from the operator.

28. The method of claim 27, wherein the display position change input comprises at least one of an input through a foot switch connected to the ultrasound diagnostic device, an input through operator'"'"'s voice, and an input through operator'"'"'s gesture.

29. The method of claim 1, further comprising:

receiving a capturing end input by the operator or receiving input from the operator to end image capturing; and

changing the position of the display from the second position to the first position according to the capturing end input.

30. A method of moving a display of an ultrasound diagnostic device, the method comprising:

obtaining an image of an object whose ultrasound image is to be captured by using the ultrasound diagnostic device;

obtaining information about a portion of the object;

determining a position of a first portion corresponding to the portion based on the image of the object; and

changing a position of the display connected to the ultrasound diagnostic device from a first position to a second position according to the determined position of the first portion.

31. A method of moving a display of an ultrasound diagnostic device, the method comprising:

obtaining an image of an operator performing ultrasound imaging of an object by using the ultrasound diagnostic device;

determining a viewing direction of the operator from the obtained image of the operator; and

adjusting an angle between a first display and a second display that are connected to the ultrasound diagnostic device, according to the viewing direction of the operator.

32. The method of claim 31, wherein the adjusting of the angle between the first display and the second display comprises adjusting the angle between the first display and the second display such that a screen of the first display and a screen of the second display are located at the viewing direction of the operator.

33. The method of claim 31, further comprising:

obtaining an image of the object; and

determining a viewing direction of the object based on the image of the object,

wherein the adjusting of the angle between the first display and the second display comprises adjusting the angle between the first display and the second display such that a screen of the first display is located at the viewing direction of the operator and the screen of the second display is located at a viewing direction of the object.

34. A non-transitory computer readable storage medium having recorded thereon a program for executing a method comprising:

obtaining an image comprising an operator of an ultrasound diagnostic device, the operator performing the capturing of an ultrasound image of an object by using the ultrasound diagnostic device;

determining a position and a viewing direction of the operator based on the image comprising the operator; and

changing a position of a display connected to the ultrasound diagnostic device from a first position to a second position according to the position and the viewing direction of the operator.

35. An ultrasound diagnostic device comprising:

an image obtaining unit for obtaining an image comprising an operator of the ultrasound diagnostic device, the operator performing the capturing of an ultrasound image of an object;

a determination unit for determining a position and a viewing direction of the operator based on the image comprising the operator;

a display for displaying at least one of an information of the object and an ultrasound image of the object; and

a control unit for changing a position of the display from a first position to a second position according to the position and the viewing direction of the operator.

36. The ultrasound diagnostic device of claim 35, wherein the determination unit determines a viewing range of the operator based on the position and the viewing direction of the operator, and

the control unit changes the position of the display from the first position to the second position so that a screen of the display is located within the viewing range of the operator.

37. The ultrasound diagnostic device of claim 35, wherein the determination unit determines a posture of the operator based on the image comprising the operator and determines the viewing direction of the operator by using the determined posture of the operator.

38. The ultrasound diagnostic device of claim 37, wherein the determination unit determines the posture of the operator based on at least one of a shape and a positional relationship of a head part and a body part of the operator comprised in the image of the operator.

39. The ultrasound diagnostic device of claim 35, wherein the image of the operator comprises a support table supporting the object, and

the determination unit determines the viewing direction of the operator based on a positional relationship between the operator and the support table comprised in the image comprising the operator.

40. The ultrasound diagnostic device of claim 35, wherein the control unit determines the second position based on a positional relationship between the ultrasound diagnostic device and the operator.

41. The ultrasound diagnostic device of claim 36, wherein the control unit determines a position located in the viewing range of the operator and in a space within which the display is movable as the second position.

42. The ultrasound diagnostic device of claim 35, wherein the image obtaining unit obtains a depth image of the operator, and

the determination unit determines the position and the viewing direction of the operator based on the depth image of the operator.

43. The ultrasound diagnostic device of claim 42, wherein the image obtaining unit comprises a depth camera for obtaining a depth image of the operator.

44. The ultrasound diagnostic device of claim 42, wherein the image obtaining unit comprises at least two color cameras for obtaining images of the operator and obtains a depth image of the operator by applying stereo matching to the images of the operator obtained by using the at least two color cameras.

45. The ultrasound diagnostic device of claim 35, wherein the control unit determines a movement path from the first position to the second position based on information about a position of at least one of a person and an object comprised in the image comprising the operator.

46. The ultrasound diagnostic device of claim 45, wherein the control unit determines the movement path from the first position to the second position such that the display does not collide against at least one of the person and the object included in the image of the operator.

47. The ultrasound diagnostic device of claim 35, wherein the display comprises a distance detection sensor that detects an obstacle located within a predetermined distance.

48. The ultrasound diagnostic device of claim 47, wherein the control unit changes the movement path of the display from a first movement path to a second movement path when an obstacle detected by the distance detection sensor exists on the first movement path of the display when the position of the display is changed from the first position to the second position along the first path;

and

wherein no obstacle exists on the second movement path; and

wherein the first and second movement paths are moving paths between the first position of the display and the second position of the display.

49. The ultrasound diagnostic device of claim 35, further comprising a communication unit obtaining information about a portion of the object, the portion being a portion to which ultrasound is applied;

wherein the image obtaining unit obtains an image of the object, the determination unit determines a position of a portion corresponding to the portion in the image of the object, and the control unit changes a position of the display from a third position to the first position according to a determined position of the portion.

50. The ultrasound diagnostic device of claim 35, wherein the determination unit determines a person who is the closest to a position of a probe of the ultrasound diagnostic device when a plurality of persons are comprised in the image comprising the operator.

51. The ultrasound diagnostic device of claim 50, further comprising an infrared emitting unit that emits an infrared ray,

wherein the determination unit determines a position of an object that reflects or absorbs the infrared ray emitted by the infrared emitting unit, as a position of the probe.

52. The ultrasound diagnostic device of claim 35, wherein the display comprises a first display and a second display, and the control unit adjusts an angle between the first display and the second display.

53. The ultrasound diagnostic device of claim 52, wherein the control unit adjusts the angle between the first display and the second display such that a screen of the first display and a screen of the second display are located at the viewing direction of the operator.

54. The ultrasound diagnostic device of claim 52, wherein the control unit adjusts the angle between the first display and the second display such that a screen of the first display is located at the viewing direction of the operator and the screen of the second display is located at a viewing direction of the object.

55. The ultrasound diagnostic device of claim 35, wherein the control unit adjusts at least one of a brightness value, a contrast value, and a tilting angle of the display located at the second position according to a preset value.

56. The ultrasound diagnostic device of claim 35, further comprising a gesture detection unit that detects a gesture of the operator with respect to the display located at the second position,

wherein the control unit performs a function of the ultrasound diagnostic device corresponding to the gesture of the operator.

57. The ultrasound diagnostic device of claim 56, wherein the gesture detection unit detects a gesture of the operator by using the image comprising the operator.

58. The ultrasound diagnostic device of claim 57, wherein the gesture detection unit determines, based on the image of the operator, whether a hand of the operator and the display are located within a preset distance for a preset time and

the control unit performs a function corresponding to a position indicated by the hand of the operator among functions displayed on the display.

59. The ultrasound diagnostic device of claim 56, wherein the gesture detection unit comprises a gesture detection camera that is attached on the display and detects a gesture of the operator.

60. The ultrasound diagnostic device of claim 56, wherein the gesture detection unit comprises an eye tracking sensor that is attached to the display and detects a gesture or a movement of an eye of the operator;

and

the control unit performs a function of the ultrasound diagnostic device corresponding to the detected gesture or movement of the eye of the operator.

61. The ultrasound diagnostic device of claim 35, further comprising a communication unit that receives a display position change input from the operator.

62. The ultrasound diagnostic device of claim 61, wherein the display position change input comprises at least one of an input through a foot switch connected to the ultrasound diagnostic device, an input through operator'"'"'s voice, and an input through operator'"'"'s gesture.

63. The ultrasound diagnostic device of claim 35, further comprising a communication unit that receives a capturing end input by the operator or an input from the operator to end image capturing,

wherein the control unit changes the position of the display from the second position to the first position according to the capturing end input.

64. An ultrasound diagnostic device comprising:

an image obtaining unit for obtaining an image of an object whose ultrasound image is to be captured;

a communication unit for obtaining information about a portion of the object, the portion being a portion to which ultrasound is applied;

a determination unit for determining a position of a portion corresponding to the portion based on the image of the object;

a display for displaying at least one of an information of the object and an ultrasound image of the object; and

a control unit for changing a position of the display from a first position to a second position according to the determined position of the portion.

65. An ultrasound diagnostic device comprising:

an image obtaining unit for obtaining an image of an operator who captures an ultrasound image of an object;

a determination unit for determining a viewing direction of the operator from the image of the operator;

a first display and a second display for displaying at least one of an information of the object and the ultrasound image of the object; and

a control unit for adjusting an angle between the first display and the second display that are connected to the ultrasound diagnostic device, according to the viewing direction of the operator.

66. The ultrasound diagnostic device of claim 65, wherein the control unit adjusts the angle between the first display and the second display such that a screen of the first display and a screen of the second display are located at the viewing direction of the operator.

67. The ultrasound diagnostic device of claim 65, wherein the image obtaining unit obtains an image of the object,

the determination unit determines a viewing direction of the object based on the image of the object, and

the control unit adjusts the angle between the first display and the second display such that a screen of the first display is located at the viewing direction of the operator and the screen of the second display is located at a viewing direction of the object.

68. The ultrasound diagnostic device of claim 65, wherein the image obtaining unit obtains a depth image of the operator, and the determination unit determines the viewing direction of the operator from the depth image of the operator.