Methods And Systems For Augmented Reality

• US 20160216515A1
• Filed: 09/03/2014
• Published: 07/28/2016
• Est. Priority Date: 09/04/2013
• Status: Active Grant

• Current Assignee: Essilor International SA
• Original Assignee: Essilor International SA
• Inventors: BOUCHIER, Aude, CANO, Jean-Paul, LE SAUX, Gilles
• Granted Patent: US 10,520,730 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 2202/20 Diffractive and Fresnel lenses or lens portions
• CPC Class Codes: G02C 7/027 considering wearer's parameters
• CPC Class Codes: G02C 7/086 Auxiliary lenses located directly on a main spectacle lens or in the immediate vicinity of main spectacles
• CPC Class Codes: G02C 7/14 Mirrors; Prisms
• CPC Class Codes: G03H 1/0808 Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
• CPC Class Codes: G03H 1/2286 Particular reconstruction light G03H1/24 takes precedence; Beam properties
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0825 Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
• CPC Class Codes: G03H 2001/2284 Superimposing the holobject with other visual information
• CPC Class Codes: G03H 2225/60 Multiple SLMs
• CPC Class Codes: G03H 2226/04 Transmission or communication means, e.g. internet protocol
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Methods and systems for image display with a head-mounted device, wherein customization of the display is achieved by taking into account wearer-specific visualization parameters. Such visualization parameters include parameters pertaining to the design of the device and/or wearer ophthalmic data such as wearer prescription data. Preferred images are computer-generated holographic images.

Claims

1. A computer-implemented method for the processing of computer-generated image data for display with a head-mounted computer-generated image displaying device worn by a wearer, comprising:

(i) a step of providing visualization parameter data selected from wearer ophthalmic data including wearer prescription data, wearer eye sensitivity data (SD) and wearer ophthalmic biometry data, and

head-mounted device data including frame data and lens data,

(ii) a step of providing computer-generated image data,

(iii) a step of calculating modified computer-generated image data from the computer-generated image data of step (ii) by taking into account the visualization parameter data of step (i), and

(iv) a step of providing the modified computer-generated image data of step (iii) to said device for display.

2. The computer-implemented method of claim 1, wherein

said image is a holographic image, and/or

said visualization parameter data are wearer prescription data selected from astigmatism module, astigmatism axis, power, prism and addition.

3. The computer-implemented method of claim 1, wherein said image is a holographic image, said computer-generated image data are computer-generated holographic image data, said modified computer-generated image data are modified computer-generated holographic image data;

and wherein said method further comprises;

(v) a step of emitting, by at least one light source, a light beam arranged for displaying the holographic image from the modified computer-generated holographic image data of step (iii) by illumination of said device,

wherein said light source is provided on a remote lighting terminal and/or is built-in on said device.

4. The computer-implemented method of claim 3, wherein said light source is provided on a remote lighting terminal and said light source is further arranged to transmit data, and wherein:

step (ii) comprises a step of transmitting said computer-generated holographic image data from said light source to said device, or

step (iv) comprises a step of transmitting said modified computer-generated holographic image data from said light source to said device.

5. The computer-implemented method of claim 1, wherein at least one of said visualization parameter data of step (i) are stored in a memory on said device.

6. The computer-implemented method of claim 5, wherein step (i) comprises:

(i-a) a step of detecting, by at least one communication terminal, the presence of said wearer,

(i-b) responsive to the detected presence at step (i-a), a step of transmitting said visualization parameter data from said device to said communication terminal,

and wherein step (iii) comprises a step of transmitting modified computer-generated image data from said communication terminal to said device.

7. The computer-implemented method of claim 1, wherein at least one of said visualization parameter data of step (i) are stored in a wearer database on a communication server connected to at least one communication terminal via a communication network, in association with a visualization parameter identifier which is an identifier that allows the retrieval of said visualization parameter data.

8. The computer-implemented method of claim 7, wherein step (i) comprises:

(i-a) a step of detecting, by said at least one communication terminal, the presence of said wearer,

(i-b) responsive to the detected presence at step (i-a), a step of transmitting said visualization parameter data from said communication server to said communication terminal.

9. The computer-implemented method of claim 8, wherein step (i) comprises:

(i-c) a further step of transmitting visualization parameter data from said communication terminal to said device.

10. The computer-implemented method of claim 7, wherein step (iii) comprises:

a step of transmitting modified computer-generated image data from said communication terminal to said device.

11. The computer-implemented method of claim 10, wherein step (iii) comprises:

a prior step of transmitting modified computer-generated image data from said communication server to said communication terminal.

12. The computer-implemented method of claim 1, wherein said computer-generated image data or said modified computer-generated image data are stored in an image database,

wherein said method comprises a preliminary step of pre-registering, in said database, an association between a wearer identifier and said wearer, and

wherein said computer-generated image data of step (ii) and/or said modified computer-generated image data of step (iii) are determined according to said wearer identifier.

13. The computer-implemented method of claim 12,

wherein said computer-generated image data of step (ii) and/or said modified computer-generated image data of step (iii) are determined according to said wearer identifier in accordance with access rights.

14. A lighting terminal arranged for the implementation of the method of claim 3, comprising:

a light source arranged for displaying a holographic image by illumination.

15. The lighting terminal according to claim 14, further comprising:

a sensor arranged for detecting the presence of a wearer provided with a head-mounted computer-generated holographic image displaying device, and/or

a communication interface arranged for transmitting, from and/or to said terminal, data selected from visualization parameter data, computer-generated holographic image data and modified computer-generated holographic image data.

16. The lighting terminal according to claim 14, wherein said light source is further arranged for transmitting computer-generated holographic image data and/or modified computer-generated holographic image data from said lighting terminal.

18. A head-mounted computer-generated image displaying device arranged for the implementation of the method of claim 1, comprising:

a phase and/or amplitude spatial light modulator.

19. The head-mounted computer-generated image displaying device according to claim 18, further comprising:

a light source arranged for displaying an image illumination, and/or

a communication interface arranged for transmitting, from and/or to said device, data selected from visualization parameter data, computer-generated image data and modified computer-generated image data.

17. (canceled)

20. A phase and/or amplitude spatial light modulator, for use in correcting ametropia in a wearer-prescription-compliant head-mounted display device.

21. A spatial Light Modulator for use according to claim 20, wherein the Spatial Light Modulator is an LCoS Spatial Light Modulator or Glass transmissive Active Matrix Liquid Crystal Spatial Light Modulator.