Information processing apparatus, information processing method, and information processing system

• US 10,664,216 B2
• Filed: 07/03/2018
• Issued: 05/26/2020
• Est. Priority Date: 07/16/2013
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Tsuda, Atsunari, Uchiyama, Toshikazu, Wakamiya, Hitomi, Takano, Masahide
• Primary Examiner(s): Sams, Michelle L
• Application Number:
  US16/026,214
• Publication Number:
  US 20180364965A1
• Time in Patent Office: 693 Days
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

An information processing apparatus includes an acquisition unit that acquires plural pieces of medical apparatus information which are plural pieces of information acquired from a plurality of medical apparatuses; a generation unit that generates presentation information which contains at least a part of the plural pieces of medical apparatus information acquired by the acquisition unit; and a presentation unit that outputs the generated presentation information to a plurality of image display apparatuses.

Claims

1. An information processing apparatus comprising a processor configured to:

acquire plural pieces of medical apparatus information that are plural pieces of information acquired from a medical apparatus;

generate plural pieces of presentation information that respectively contain at least a part of the medical apparatus information;

acquire a distance measurement between an object viewed by a user through a personal image display apparatus and the personal image display apparatus;

determine an enlargement ratio or a reduction ratio based on the distance measurement; and

output the generated presentation information to the personal image display apparatus,

wherein the presentation information includes the medical apparatus information that has been manipulated by being enlarged or reduced in size based on the enlargement ratio or the reduction ratio.

2. The information processing apparatus according to claim 1, wherein the processor is further configured to manipulate the medical apparatus information in order to determine an edge of the object in the presentation information.

3. The information processing apparatus according to claim 2, wherein the processor is further configured to rotate, distort, or reduce noise in the presentation information.

4. The information processing apparatus according to claim 1, wherein the processor is further configured to manipulate the medical apparatus information in order to determine one or more markers of the object in the presentation information.

5. The information processing apparatus according to claim 4, wherein the processor is further configured to rotate, distort, or reduce noise in the presentation information.

6. The information processing apparatus according to claim 1, wherein an aspect ratio of the medical apparatus information is maintained when the medical apparatus information is manipulated.

7. The information processing apparatus according to claim 1, wherein the personal image display apparatus is a head mounted display apparatus on which the user can see a virtual image and an outside scene.

8. The information processing apparatus according to claim 7, wherein the processor is further configured to:

acquire from the head mounted display apparatus an image in a direction of a visual field of the user that wears the head mounted display apparatus,

extract characteristics of the object contained in the outside scene by recognizing the image acquired in the direction of the visual field, and

compensate the presentation information based on the extracted characteristics, and output the compensated presentation information.

9. The information processing apparatus according to claim 1, wherein the processor is further configured to:

transmit information on a predetermined step and change the step to be transmitted based on the acquired plural pieces of medical apparatus information, and

generate the presentation information that contains the received step.

10. The information processing apparatus according to claim 1, wherein:

the medical apparatus includes a plurality of medical apparatuses,

in a first mode, the presentation information corresponds to the medical apparatus information acquired from only a specific medical apparatus of the plurality of medical apparatus, and

in a second mode, the presentation information corresponds to the medical apparatus information acquired from each medical apparatus of the plurality of medical apparatus.

11. The information processing apparatus according to claim 1, wherein the processor is further configured to perform a color conversion process on the presentation information by manipulating brightness, contrast, chroma, and/or color of the presentation information.

12. The information processing apparatus according to claim 1, wherein the processor is further configured to:

calculate an amount of change in the presentation information during a predetermined time interval,

compare the amount of change with a predetermined threshold value, and

update the generated presentation information that is outputted to the personal image display apparatus if the amount of change is greater than the predetermined threshold value.

13. The information processing apparatus according to claim 1, the generated presentation information that is outputted to the personal image display apparatus is a three-dimensional image.

14. The information processing apparatus according to claim 1, wherein the user can see the generated presentation information and an outside scene on the personal image display apparatus.

15. The information processing apparatus according to claim 1, wherein the user can see the generated presentation information but not an outside scene on the personal image display apparatus.

16. The information processing apparatus according to claim 1, wherein the generated presentation information is output to the personal image display apparatus only after the medical apparatus information has been manipulated by being enlarged or reduced in size.

17. An information processing method comprising:

acquiring plural pieces of medical apparatus information that are plural pieces of information acquired from a medical apparatus;

generating plural pieces of presentation information that respectively contain at least a part of the medical apparatus information;

acquiring a distance measurement between an object viewed by a user through a personal image display apparatus and the personal image display apparatus;

determining an enlargement ratio or a reduction ratio based on the distance measurement;

manipulating the medical apparatus information in order to enlarge or reduce in size the presentation information based on the enlargement ratio or the reduction ratio; and

outputting the generated presentation information to the personal image display apparatus.

18. The method according to claim 17, wherein the medical apparatus information is manipulated in order to determine an edge of the object in the presentation information.

19. The method according to claim 17, wherein the medical apparatus information is manipulated in order to determine one or more markers of the object in the presentation information.

20. The information processing apparatus according to claim 17, wherein the generated presentation information is output to the personal image display apparatus only after the medical apparatus information has been manipulated by being enlarged or reduced in size.