Method and system for selecting and designing eyeglass frames

• US 6,944,327 B1
• Filed: 11/03/2000
• Issued: 09/13/2005
• Est. Priority Date: 11/04/1999
• Status: Active Grant

• Current Assignee: Stefano Soatto
• Original Assignee: Stefano Soatto
• Inventors: Soatto, Stefano
• Primary Examiner(s): AHMED, SAMIR ANWAR
• Application Number:
  US09/706,217
• Time in Patent Office: 1,775 Days
• Field of Search: 382/154, 382/155, 345/419, 345/427, 356/12, 705/27, 705/26, 351/204, 351/205, 351/178, 351/227, 351/246, 332/00, 335/07
• US Class Current: 382/154
• CPC Class Codes: G02C 13/003 Measuring during assembly or fitting of spectacles
• CPC Class Codes: G02C 13/005 Measuring geometric parameters required to locate ophtalmic lenses in spectacles frames apparatus for testing or instruments for examining the eyes per se A61B3/00; machines or devices and accessories for grinding the edges of lenses using spectacles as a template B24B9/144

Abstract

The present invention provides a method and apparatus for designing and visualizing the shape of eyeglass lenses and of the front rims of eyeglass frames, and for allowing the customer to modify the design by changing the shape and style interactively to suit his/her preference and perceived character. The present invention comprises an interface for a lens grinding machine that allows the retailer to manufacture the selected frame at the store for certain specified styles, or allows the retailer to transmit the shape and style data to a manufacturer that can implement the selected design and deliver it directly to the customer. Another embodiment of the present invention is to provide a method for designing, visualizing, modifying the shape and style of eyeglass lenses and frames remotely through the Internet or other communication channel, and to transmit the design to a manufacturer, which enables the customer to select and purchase eyeglasses directly from manufacturers.

Claims

1. A method for selecting and modifying the shape of eyeglasses utilizing a system, said method comprising the steps of:

receiving at least one image of a person'"'"'s face, and storing the received image in an image database;

displaying the stored image to a user;

generating a model of the person'"'"'s face with the received image;

displaying to the user a plurality of styles of eyeglass frames available through the system;

receiving a style selection by the user;

receiving the position of the center of the pupils in the image;

determining the axis of symmetry of the person'"'"'s face and an approximate contour of the face as an elliptical two-dimensional template;

automatically determining an appropriate size for a selected eyeglass frame by combining the user style selection and the model of the person'"'"'s face;

generating a virtual image of the person wearing the selected eyeglass frame by superimposing the image of the selected eyeglass frame to the image of the face and;

permitting the user to interactively modify the selected eyeglass frame.

2. A method in accordance with claim 1 wherein said step of determining a proper size of the selected eyeglass frame comprises the step of utilizing a two-dimensional template to determine a position of eyes on the displayed image.

3. A method in accordance with claim 1 further comprising the step of refining the position of the center of the pupils to subpixel precision utilizing template matching.

4. A method in accordance with claim 1 further comprising the step of determining the position of features on the person'"'"'s face.

5. A method in accordance with claim 1 further comprising the step of receiving a frontal image of the person'"'"'s face and storing the front image in a database.

6. A method in accordance with claim 1 wherein the system includes a server connected to at least one user device, said method further comprising the step of accessing the server via the user device.

7. A method in accordance with claim 6 wherein the server is connected to the user device via a network.

8. A method in accordance with claim 7 wherein the network is one of the Internet, an intranet, and a wide area network.

9. A method in accordance with claim 1 wherein said step of receiving at least one image comprises the step of receiving two or more images of the person'"'"'s face simultaneously obtained from two or more cameras oriented in a particular configuration.

10. A method in accordance with claim 9 further comprising the steps of estimating the epipolar geometry of the configuration of the cameras;

and generating a three-dimensional model of the person'"'"'s face.

11. A method in accordance with claim 10 further comprising the steps of:

determining pixel correspondence along scan-lines using normalized correlation with sub-pixel interpolation;

determining the depth corresponding to each pixel utilizing triangulation; and

generating a three-dimensional mesh of the position of the pixels.

12. A method in accordance with claim 11 further comprising the steps of:

fitting a three-dimensional template of a face to the generated three-dimensional mesh;

generating an image of the three-dimensional model of the face; and

superimposing the eyeglass frame model to the person'"'"'s face model to generate a virtual image of the person'"'"'s face wearing the eyeglass frame.

13. A method in accordance with claim 1 further comprising:

representing the shape of the lens using a parameterized curve or a piecewise linear curve where the shape depends upon the position of a number of control points;

representing the shape of the lens and the front rim using a constrained parameterized curve, where in the lens shape depends upon the position of the control points; and

constraining the position of the control points to maintain the perimeter of the rim approximately constant and to maintain the tangent at the hinge and bridge, and the maximum curvature below a prescribed bound determined by the properties of the eyeglass frame.

14. A method in accordance with claim 13 further comprising the step of modifying the selected eyeglass frame style by changing the position of the control points while maintaining the perimeter approximately constant.

15. A method in accordance with claim 13 further comprising the steps of:

maintaining the tangents of the selected eyeglass frame at the hinges and bridge constant; and

modifying the selected style to have a prescribed perimeter, while minimizing the distortion from the style selected by the user.

16. A method in accordance with claim 1 further comprising the steps of:

associating a position of a set of control points to a set of perceptual qualities stored in a database; and

modifying a shape of the lens based upon perceptual qualities.

17. A method in accordance with claim 16 wherein said step of modifying the shape of the lens comprises the step of modifying the shape of the lens based upon perceptual qualities chosen by the user.

18. A method in accordance with claim 17 further comprising the steps of:

storing selected designs;

comparing the stored designs;

performing collaborative filtering; and

recommending to the user shapes and styles according to selections of other customers that best match the choices of the current customer.

19. A method in accordance with claim 1 further comprising the step of controlling a lens grinding machine in accordance with data received by the system.

20. A method in accordance with claim 1 wherein the system includes a database of maps between the geometry of the eyeglass frame, represented by the position of a number of control points, and the perceptual quality of the shape of eyeglasses, said method further comprising the steps of:

modifying the selected shape by specifying the amount of each descriptive quality;

adapting the database to particular clientele; and

performing collaborative filtering to suggest shapes and a style that matches the choices of other customers with potentially similar preferences.

21. A method in accordance with claim 20 wherein the database is one of a learning database utilizing psychophysical experiments and empirically established database.

22. A method in accordance with claim 1 further comprising the step of modifying the selected style and shape of the eyeglass frame with satisfying constraints due to manufacturing process and inventory.

23. A method in accordance with claim 22 further comprising the steps of:

evaluating the constraints within which any given eyeglass frame can be modified; and

enforcing the constraints during eyeglass frame modification.

24. A method in accordance with claim 1 further comprising the step of receiving prescription data for the lenses.

25. A method in accordance with claim 1 further comprising the step of transmitting the shape and style data to a manufacturer who ships the selected eyeglasses directly to the customer.

26. A method in accordance with claim 1 further comprising the steps of:

selecting landmark points of the person'"'"'s face;

tracking the selected points through time as the person moves their head; and

estimating the three-dimensional motion of the landmark points on-line.

27. A method in accordance with claim 1 further comprising the step of generating a two and a half dimensional model.

28. A method in accordance with claim 27 further comprising the step of selecting a feature template for relevant facial features.

29. A method in accordance with claim 28 further comprising the steps of:

tracking the position of the feature templates from image frame to image frame; and

selecting a reference frame.

30. A method in accordance with claim 29 wherein said step of selecting a reference frame comprises the steps of:

selecting a reference frame from one of a 2-D Euclidean, 2-D Affine, 2-D Projective, and 3-D Euclidean; and

estimating a transformation.

31. A method in accordance with claim 30 further comprising the step of using the estimate transformation to modify the appearance of an eyeglass frame template.

32. A method in accordance with claim 1 further comprising the step of creating a virtual image of the person'"'"'s face moving and wearing the eyeglass frame.