Methods and systems for augmented reality

• US 10,520,730 B2
• Filed: 09/03/2014
• Issued: 12/31/2019
• Est. Priority Date: 09/04/2013
• Status: Active Grant

• Current Assignee: Essilor International SA
• Original Assignee: Essilor International SA
• Inventors: Bouchier, Aude, Cano, Jean-Paul, Le Saux, Gilles
• Primary Examiner(s): Chatly, Amit
• Application Number:
  US14/916,905
• Publication Number:
  US 20160216515A1
• Time in Patent Office: 1,945 Days
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 2202/20 Diffractive and Fresnel lenses or lens portions
• CPC Class Codes: G02C 7/027 considering wearer's parameters
• CPC Class Codes: G02C 7/086 Auxiliary lenses located directly on a main spectacle lens or in the immediate vicinity of main spectacles
• CPC Class Codes: G02C 7/14 Mirrors; Prisms
• CPC Class Codes: G03H 1/0808 Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
• CPC Class Codes: G03H 1/2286 Particular reconstruction light G03H1/24 takes precedence; Beam properties
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0825 Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
• CPC Class Codes: G03H 2001/2284 Superimposing the holobject with other visual information
• CPC Class Codes: G03H 2225/60 Multiple SLMs
• CPC Class Codes: G03H 2226/04 Transmission or communication means, e.g. internet protocol
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Methods and systems for image display with a head-mounted device, wherein customization of the display is achieved by taking into account wearer-specific visualization parameters. Such visualization parameters include parameters pertaining to the design of the device and/or wearer ophthalmic data such as wearer prescription data. Preferred images are computer-generated holographic images.

Claims

1. A computer-implemented method for the processing of computer-generated holographic phase-coded image data for display with a head-mounted computer-generated holographic image displaying device worn by a wearer, the computer-implemented method comprising:

(i) a step of obtaining visualization parameter data comprising;

wearer ophthalmic data including wearer prescription data and at least one of wearer eye sensitivity data and wearer ophthalmic biometry data;

(ii) a step of obtaining the computer-generated holographic phase-coded image data which are coded by phase modulation;

(iii) a step of calculating modified computer-generated holographic phase-coded image data from the computer-generated holographic phase-coded image data of step (ii) by taking into account the visualization parameter data of step (i);

(iv) a step of providing the modified computer-generated holographic phase-coded image data of step (iii) to said device for display; and

(v) a step of emitting, by at least one light source provided on a remote lighting terminal to which are transmitted said visualization parameter data, a light beam arranged for displaying the holographic image from the modified computer-generated holographic phase-coded image data of step (iii) by illumination of said device,

wherein said at least one light source is further arranged to transmit data,

wherein;

step (ii) comprises a step of transmitting said computer-generated holographic image data from said at least one light source to said device, the illumination of said device being carried out after transmitting the computer-generated holographic image data from said light source to said device, or

step (iv) comprises a step of transmitting said modified computer-generated holographic image data from said at least one light source to said device, the illumination of said device being carried out after transmitting the modified computer-generated holographic image data from said light source to said device, and

wherein step (i) comprises;

(i-a) a step of detecting, by said remote lighting terminal, the presence of said wearer provided with said device by a sensor which is a haptic command, and

(i-b) responsive to the detected presence at step (i-a), a step of transmitting said visualization parameter data to said remote lighting terminal.

2. The computer-implemented method of claim 1, wherein

said visualization parameter data are wearer prescription data selected from at least one of astigmatism module, astigmatism axis, power, prism and addition.

3. The computer-implemented method of claim 1, wherein at least one of said visualization parameter data of step (i) are stored in a memory on said device.

4. The computer-implemented method of claim 1, wherein at least one of said visualization parameter data of step (i) are stored in a wearer database on a communication server connected to said remote lighting terminal via a communication network, in association with a visualization parameter identifier which is an identifier that allows the retrieval of said visualization parameter data.

5. The computer-implemented method of claim 4, wherein step

(i-b) comprises, responsive to the detected presence at step (i-a), the step of transmitting said visualization parameter data from said communication server to said remote lighting terminal.

6. The computer-implemented method of claim 5, wherein step (i) comprises:

(i-c) a further step of transmitting visualization parameter data from said remote lighting terminal to said device.

7. The computer-implemented method of claim 4, wherein step (iv) comprises:

a step of transmitting modified computer-generated holographic image data from said remote lighting terminal to said device.

8. The computer-implemented method of claim 7, wherein step (iv) comprises:

a prior step of transmitting modified computer-generated holographic image data from said communication server to said remote lighting terminal.

9. The computer-implemented method of claim 1, wherein said computer-generated holographic phase-coded image data or said modified computer-generated holographic phase-coded image data are stored in an image database,

wherein said method comprises a preliminary step of pre-registering, in said database, an association between a wearer identifier and said wearer, and

wherein said computer-generated holographic phase-coded image data of step (ii) and/or said modified computer-generated holographic phase-coded image data of step (iii) are determined according to said wearer identifier.

10. The computer-implemented method of claim 9,

wherein said computer-generated holographic phase-coded image data of step (ii) and/or said modified computer-generated holographic phase-coded image data of step (iii) are determined according to said wearer identifier in accordance with access rights.

11. A system for displaying a computer-generated holographic image for a wearer of a head-mounted computer-generated holographic image displaying device, the system comprising:

said head-mounted computer-generated holographic image displaying device; and

at least one remote lighting terminal communicating with said head-mounted computer-generated holographic image displaying device and comprising;

a light source,

a sensor which is arranged to detect presence of a wearer provided with said head-mounted computer-generated holographic image displaying device, and which is a haptic command, and

a communication interface arranged to transmit, to said at least one remote lighting terminal, responsive to the detected presence of the wearer, visualization parameter data comprising wearer ophthalmic data including wearer prescription data and at least one of wearer eye sensitivity data and wearer ophthalmic biometry data,

wherein said light source is arranged to transmit computer-generated holographic image data and modified computer-generated holographic image data from said remote lighting terminal, and afterwards to emit a light beam to illuminate said head-mounted computer-generated holographic image displaying device so as to display the holographic image.

12. The system according to claim 11, further comprising a plurality of said remote lighting terminals, each of which is connected to a lighting server via a lighting network.

13. The system according to claim 11, wherein said head-mounted computer-generated holographic image displaying device comprises a phase or phase and amplitude spatial light modulator made of LCoS (liquid crystal on silicon) or Glass transmissive Active Matrix Liquid Crystal.

14. The system according to claim 12, wherein said head-mounted computer-generated holographic image displaying device comprises a phase or phase and amplitude spatial light modulator made of LCoS (liquid crystal on silicon) or Glass transmissive Active Matrix Liquid Crystal.

15. The system according to claim 13, wherein said head-mounted computer-generated holographic image displaying device is wearer-prescription-compliant, being arranged to correct ametropia via said phase or phase and amplitude spatial light modulator.