DISPLAY CONTROL DEVICE, DISPLAY DEVICE, SURGICAL ENDOSCOPIC SYSTEM AND DISPLAY CONTROL SYSTEM

• US 20170172381A1
• Filed: 02/13/2015
• Published: 06/22/2017
• Est. Priority Date: 02/21/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: MORIMOTO, Toshiyasu
• Granted Patent: US 10,874,284 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00055 for alerting the user
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/368 changing the image on a display according to the operator's position
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/50 Supports for surgical instruments, e.g. articulated arms
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/63 for local operation

Abstract

There is provided a device (200) that generates display data to be displayed by each of a plurality of head mounted displays (100A, 100B) configured to be worn by each of a plurality of users involved in a surgery based on information that the each of a plurality of users in the surgery visually recognizes.

Claims

1. A system comprising:

circuitry configured to generate display data to be displayed by each of a plurality of head mounted displays configured to be worn by each of a plurality of users involved in a surgery based on information that the each of a plurality of users in the surgery visually recognizes.

2. The system of claim 1, wherein

the circuitry is configured to generate, as at least a part of the display data, main information selected by a received user input for display by a first of the plurality of head mounted displays.

3. The system of claim 1, wherein

the circuitry is configured to generate, as at least a part of the display data to be displayed by a first of the head mounted displays configured to be worn by one of the users involved in the surgery, an object corresponding to information that another of the users in the surgery visually recognize.

4. The system of claim 3, wherein

the object is a thumbnail image corresponding to a piece of information displayed by the another of the head mounted displays.

5. The system of claim 3, wherein

the object is a piece of text information corresponding to a piece of information that the another of the users in the surgery visually recognizes.

6. The system of claim 3, wherein

the objects is a chart corresponding to a piece of information that the another of the users in the surgery visually recognizes.

7. The system of claim 3, wherein

the display data includes identification information identifying the another of the users.

8. The system of claim 2, wherein

the circuitry is configured to generate, as at least a part of the display data to be displayed by a first of the head mounted displays configured to be worn by one of the users involved in the surgery, a notification indicating that a piece of information that another of the users in the surgery visually recognizes has changed.

9. The system of claim 1, wherein

the circuitry is configured to generate second display data to be displayed by a display device that a user not wearing the head mounted display is able to visually recognize.

10. The system of claim 1, wherein

the information includes a viewpoint in which a user wearing the at least one of the plurality of head mounted displays views at least one of the user'"'"'s hands at a surgical site.

11. The system of claim 1, wherein

the circuitry is configured to determine information that a user wearing at least one of the head mounted displays visually recognizes by detecting a sight line of the user.

12. The system of claim 1, wherein

the information includes an image captured by an endoscope device.

13. A surgical endoscopic system comprising:

a plurality of head mounted displays;

circuitry communicatively connected to each of the head mounted displays and configured to control information displayed on each of the head mounted displays; and

an endoscope device communicatively connected to the circuitry, wherein

the circuitry is configured to output information selected by a user involved in a surgery wearing one of the head mounted displays to the one of the head mounted displays and a piece of information that another user involved in the surgery wearing another of the head mounted displays visually recognizes to the one of the head mounted displays.

14. A display control device comprising:

circuitry configured to generate display data corresponding to a viewpoint of each of a plurality of users wearing a respective one of a plurality of head mounted displays to each of the plurality of head mounted displays.

15. A display device comprising:

a display; and

circuitry configured to control the display based on display data corresponding to a viewpoint of each of a plurality of users wearing a respective one of a plurality of head mounted displays.

16. The display device according to claim 15,

wherein the display device is a head mounted display.

17. A system comprising:

a plurality of head mounted displays; and

circuitry communicatively connected to the plurality of head mounted displays and configured to control pieces of information displayed on the head mounted displays, wherein

the circuitry is configured output information selected by a user wearing one of the head mounted displays to the one of the head mounted displays and a piece of information that another user wearing another of the head mounted displays visually recognizes to the one of the head mounted displays.