System and method of obtaining fit and fabrication measurements for eyeglasses using simultaneous localization and mapping of camera images

• US 10,620,454 B2
• Filed: 12/22/2017
• Issued: 04/14/2020
• Est. Priority Date: 12/22/2017
• Status: Active Grant

• Current Assignee: Optikam Tech Inc.
• Original Assignee: Optikam Tech Inc.
• Inventors: El-Hajal, Bassem, Lancione, Marco, Szymborski, Piotr
• Primary Examiner(s): Greece, James R
• Application Number:
  US15/853,703
• Publication Number:
  US 20190196221A1
• Time in Patent Office: 844 Days
• Field of Search: 35115975
• CPC Class Codes: A61B 3/00 Apparatus for testing the eyes; Instruments for examining the eyes eye inspection using ultrasonic, sonic or infrasonic waves A61B8/10; devices for treatment of the eyes A61F9/00; exercisers for the eyes A61H5/00; optical systems in general G02B
• CPC Class Codes: A61B 3/04 Trial frames; Sets of lenses for use therewith lenses per se G02C7/02
• CPC Class Codes: G02C 13/003 Measuring during assembly or fitting of spectacles
• CPC Class Codes: G02C 13/005 Measuring geometric parameters required to locate ophtalmic lenses in spectacles frames apparatus for testing or instruments for examining the eyes per se A61B3/00; machines or devices and accessories for grinding the edges of lenses using spectacles as a template B24B9/144
• CPC Class Codes: G02C 7/027 considering wearer's parameters
• CPC Class Codes: G02C 7/028 Special mathematical design techniques
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

A system and method for determining the measurements needed to fabricate prescription eyeglasses. A person is imaged wearing the eyeglass frames, from a first camera position and a subsequent camera position. This produces images having differing perspectives from known distances. Common measurement points are identified within at least some of the images. The common measurement points undergo positional changes between the images having said differing perspectives. The positional changes of the common measurement points and the known distance to the imaging camera are utilized to map three dimensional coordinates for the measurement points using an actual measurement scale. Fabrication measurements are calculated between the various three-dimensional coordinates in the same scale.

Claims

1. A method of obtaining at least some measurements needed to correctly fabricate prescription lenses for a person without the use of imaging scales, said method comprising the steps of:

providing eyeglass frames into which said prescription lenses are to be set;

having the person wear said eyeglass frames without any auxiliary attachments;

imaging the person wearing said eyeglass frames using a camera that has an autofocus function that is utilized to calculate image distances between the person wearing said eyeglass frames and said camera, wherein said camera is used from a first camera position and from at least one subsequent camera position, therein producing images having differing perspectives, wherein said image distances for said first camera position and said at least one subsequent camera position are measured in a first measurement scale;

identifying common measurement points within at least some of said images, wherein at least some of said common measurement points undergo positional changes between said images having said differing perspectives;

utilizing said positional changes in said common measurement points between at least some of said images and said image distances of first camera position and said at least one subsequent camera position to map three dimensional coordinates for said measurement points in said first measurement scale; and

calculating fabrication measurements between said three dimensional coordinates in said first measurement scale; and

fabricating said prescription lenses using said fabrication measurements.

2. The method according to claim 1, wherein said camera is a handheld electronic device that contains a processor and runs application software.

3. The method according to claim 1, wherein said common measurement points includes points on said eyeglass frames from which a lens length, a lens width, and a frame length can be directly measured.

4. The method according to claim 1, wherein said common measurement points include points on the person from which a pupil height and a pupil distance can be directly measured.

5. The method according to claim 1, wherein said common measurement points includes points on both said eyeglass frames and the person from which a pantoscopic tilt angle and rear vertex distance can be directly measured.

6. The method according to claim 2, wherein said application software running on said processor maps said three dimensional coordinates for said measurement points utilizing said positional changes in said common measurement points between at least some of said images and said image distances of said first camera position and said at least one subsequent camera position.

7. The method according to claim 2, wherein said application software running in said processor calculates fabrication measurements between said three dimensional coordinates in said first measurement scale.

8. A method of obtaining at least some measurements needed to correctly fabricate lenses for a person, said method comprising the steps of:

providing eyeglass frames into which said lenses are to be set;

providing a smartphone having a camera, an autofocus system, and a processor, wherein said processor runs application software that uses said autofocus system to measure camera distances between said camera and an object being imaged;

imaging the person wearing said eyeglass frames from a first camera position and from at least one subsequent camera position, therein producing images having differing perspectives, wherein said first camera position and said at least one subsequent camera position are at said camera distances measured by said autofocus system, and wherein said camera distances are in a first measurement scale;

utilizing said application software to identify common measurement points within at least some of said images, wherein at least some of said common measurement points undergo positional changes between said images having said differing perspectives;

utilizing said application software to identify said positional changes in said common measurement points between at least some of said images and said camera distances of first camera position and said at least one subsequent camera position and to map three dimensional coordinates for said measurement points in said first measurement scale; and

utilizing said application software to calculate fabrication measurements between said three dimensional coordinates in said first measurement scale.

9. The method according to claim 8, further including the step of fabricating said lenses using said fabrication measurements.

10. The method according to claim 8, wherein said fabrication measurements include measurements for pupil height, pantoscopic tilt angle, and rear vertex distance.

11. The method according to claim 8, wherein said common measurement points include points on said eyeglass frames from which a lens length, a lens width, and a frame length can be directly measured.

12. The method according to claim 11, wherein said common measurement points include points on the person from which a pupil height and a pupil distance can be directly measured.

13. The method according to claim 12, wherein said common measurement points include points on both said eyeglass frames and the person from which a pantoscopic tilt angle and rear vertex distance can be directly measured.

14. The method according to claim 8, wherein said application software running on said processor maps said three dimensional coordinates for said measurement points utilizing said positional changes in said common measurement points between at least some of said images and said camera distances of said first camera position and said at least one subsequent camera position.

15. The method according to claim 8, wherein said application software running on said processor calculates said fabrication measurements between said three dimensional coordinates in said first measurement scale.

16. A method of obtaining measurements needed to correctly fabricate prescription lenses, said method comprising the steps of:

providing eyeglass frames into which said lenses are to be set;

providing an electronic device having a camera, an autofocus system, and a processor, wherein said processor runs application software that uses said autofocus system to measure camera distances between said camera and an object being imaged;

imaging said eyeglass frames while being worn from a first camera position and from at least one subsequent camera position, therein producing images having differing perspectives, wherein said first camera position and said at least one subsequent camera position are at said camera distances measured by said autofocus system, and wherein said camera distances are in a first measurement scale;

identifying said common measurement points within at least some of said images utilizing said application software, wherein at least some of said common measurement points undergo positional changes between said images having said differing perspectives;

identifying said positional changes in said common measurement points between at least some of said images and said camera distances of said first camera position and said at least one subsequent camera position to map three dimensional coordinates for said measurement points in said first measurement scale; and

calculating fabrication measurements between said three dimensional coordinates in said first measurement scale utilizing said application software.

17. The method according to claim 16, further including the step of fabricating said lenses using said fabrication measurements.

18. The method according to claim 16, wherein said fabrication measurements include measurements for pupil height, pantoscopic tilt angle, and rear vertex distance.

19. The method according to claim 16, wherein said common measurement points include points on said eyeglass frames from which a lens length, a lens width, and a frame length can be directly measured.