Augmented reality patient interface device fitting apparatus

• US 10,459,232 B2
• Filed: 10/10/2015
• Issued: 10/29/2019
• Est. Priority Date: 10/21/2014
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Grashow, Jonathan Sayer
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US15/520,425
• Publication Number:
  US 20170315359A1
• Time in Patent Office: 1,480 Days
• CPC Class Codes: A61M 16/06 Respiratory or anaesthetic masks
• CPC Class Codes: A61M 16/0605 Means for improving the adaptation of the mask to the patient
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/60 for the operation of medical equipment or devices
• CPC Class Codes: G16H 40/63 for local operation

Abstract

An augmented reality apparatus for facilitating a patient interface device fitting process includes a device or system for providing a real-time image of the patient, and a processor apparatus structured to: (i) store a plurality of augmented reality component data files, each of the augmented reality component data files relating to either a structure or an aspect of one or more particular patient interface devices or a problem that may be encountered in the fitting process, and (ii) cause an augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files.

Claims

1. An augmented reality apparatus for facilitating a patient interface device fitting process, comprising:

means for providing a real-time image of the patient; and

a processor apparatus storing a plurality of augmented reality component data files, the plurality of augmented reality component data files including, for each of a plurality of patient interface devices comprising a plurality of different sizes of a particular patient interface device type, contact region image data representing an image of a contact region showing only where the patient interface device would actually contact a wearer'"'"'s face and not representing an image of the patient interface device itself, the processor apparatus being configured to cause an augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using the contact region image data of at least one of the augmented reality component data files, wherein the augmented real-time image comprises one or more of the contact regions rendered on the real-time image, and wherein the processor apparatus is configured to cause the augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using the contact region image data of each of the plurality of different sizes of the particular patient interface device type simultaneously.

2. An augmented reality apparatus according to claim 1, wherein the means for providing a real-time image comprises a combiner, wherein the augmented reality apparatus includes a projector, and wherein the processor apparatus is structured and configured to cause the augmented real-time image to be created by causing the projector to create and transmit to the combiner a supplemental image which is combined with the real-time image.

3. An augmented reality apparatus according to claim 2, wherein the augmented reality apparatus is a head mounted display apparatus, wherein the combiner is a partially transmissive and partially reflective lens, and wherein the projector is mounted on a frame member of the head mounted display apparatus in a manner where in the supplemental image is transmitted to a reflective surface of the lens.

4. An augmented reality apparatus according to claim 3, wherein the head mounted display apparatus is a pair of eyeglasses.

5. An augmented reality apparatus according to claim 1, wherein the means for providing a real-time image comprises an image capture device, wherein the augmented reality apparatus includes a display device, and wherein the processor apparatus is structured and configured to cause the augmented real-time image to be created by creating a supplemental image using the least one of the augmented reality component data files, supplementing the real-time image using the supplemental image to create the augmented real-time image, and causing the augmented real-time image to be transmitted by the display device.

6. An augmented reality apparatus according to claim 1, wherein the augmented reality component data files further include data that represents a 2D or 3D patient interface device image, wherein the processor apparatus is configured to cause a second augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files, and wherein the second augmented real-time image comprises the 2D or 3D patient interface device image rendered on the real-time image.

7. An augmented reality apparatus according to claim 1, wherein the augmented reality component data files further include data that represents an instructional tag image including text indicating a potential problem area, wherein the processor apparatus is configured to cause a second augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files, and wherein the second augmented real-time image comprises the instructional tag image rendered on the real-time image.

8. An augmented reality apparatus according to claim 1, wherein the augmented reality component data files further include data that represents an instructional tag image including text indicating instructions for using a particular one of the patient interface devices, and wherein the second augmented real-time image comprises the instructional tag image rendered on the real-time image.

9. An augmented reality patient interface device fitting method, comprising:

storing in a processor apparatus of an augmented reality apparatus a plurality of augmented reality component data files, the plurality of augmented reality component data files including, for each of a plurality of patient interface devices comprising a plurality of different sizes of a particular patient interface device type, contact region image data representing an image of a contact region showing only where the patient interface device would actually contact a wearer'"'"'s face and not representing an image of the patient interface device itself;

providing in the augmented reality apparatus a real-time image of a patient; and

creating and transmitting by the augmented reality apparatus an augmented real-time image by augmenting the real-time image using the contact region image data of at least one of the augmented reality component data files, wherein the augmented real-time image comprises one or more of the contact regions rendered on the real-time image, wherein the creating and transmitting comprises augmenting the real-time image using the contact region image data of each of the plurality of different sizes of the particular patient interface device type simultaneously.

10. An augmented reality patient interface device fitting method according to claim 9, wherein the providing the real-time image employs a combiner, and wherein the creating and transmitting the augmented real-time image comprises causing a projector to create and transmit to the combiner a supplemental image which is combined with the real-time image.

11. An augmented reality patient interface device fitting method according to claim 9, wherein the providing the real-time image employs an image capture device, and wherein the creating and transmitting the augmented real-time image comprises creating a supplemental image using the least one of the augmented reality component data files, supplementing the real-time image using the supplemental image to create the augmented real-time image, and causing the augmented real-time image to be transmitted by a display device.

12. An augmented reality patient interface device fitting method according to claim 9, wherein the augmented reality component data files further include data that represents a 2D or 3D patient interface device image, wherein the method includes causing a second augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files, and wherein the second augmented real-time image comprises the 2D or 3D patient interface device image rendered on the real-time image.

13. An augmented reality patient interface device fitting method according to claim 9, wherein the augmented reality component data files further include data that represents an instructional tag image including text indicating a potential problem area, wherein the method includes causing a second augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files, and wherein the second augmented real-time image comprises the instructional tag image rendered on the real-time image.

14. An augmented reality patient interface device fitting method according to claim 9, wherein the augmented reality component data files further include data that represents an instructional tag image including text indicating instructions for using a particular one of the patient interface devices, wherein the method includes causing a second augmented real-time image to be created and transmitted by the augmented reality apparatus by augmenting the real-time image using at least one of the augmented reality component data files, and wherein the second augmented real-time image comprises the instructional tag image rendered on the real-time image.