DEVICES, SYSTEMS AND METHODS OF CAPTURING AND DISPLAYING APPEARANCES

• US 20130229482A1
• Filed: 03/15/2013
• Published: 09/05/2013
• Est. Priority Date: 03/01/2005
• Status: Active Grant

• Current Assignee: Eyesmatch, Ltd.
• Original Assignee: Eyesmatch, Ltd.
• Inventors: Vilcovsky, Nissi, Saban, Ofer
• Granted Patent: US 8,982,109 B2
• Time in Patent Office: Days
• US Class Current: 348/14.07
• CPC Class Codes: A47F 2007/195 Virtual display of clothes on the wearer by means of a mirror, screen or the like
• CPC Class Codes: G02B 5/08 Mirrors vehicle mirrors involving special optical features B60R1/08
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G09F 19/16 involving the use of mirrors
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 2005/2726 for simulating a person's appearance, e.g. hair style, glasses, clothes
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems, devices and methods enabling appearance comparison. The system includes at least one interactive imaging and display station. The station includes a mirror-display device capable of selectably operating in either or both a mirror mode or a display mode; an imaging device to capture one or more appearances appearing in a field of view in front of the mirror-display device; and/or an image control unit to select the mode of operation of the mirror-display device according to a user command.

Claims

1. A method for operating a system having a monitor, a camera, and a processor, so as to display a mirror-mimicking image on the monitor, by performing the non-ordered steps comprising:

obtaining a digital image from a camera;

flipping the image about a vertical axis so as to reverse right and left sides of the image;

applying a transformation mapping to the image to modify the image such that it appears to mimic a reflection of a mirror;

resizing the image to reduce variations caused by changes in object'"'"'s distance to the camera;

displaying the image on the monitor after performing the flipping, transformation mapping, and resizing.

2. The method of claim 1, wherein the transformation mapping renders an image appearing to have been taken from a camera positioned at eye-level height and pointing horizontally.

3. The method of claim 1, wherein the transformation mapping comprises at least a tilt transformation and an elevation transformation.

4. The method of claim 3, wherein the tilt transformation modifies an input image taken with a non-horizontally pointing camera and transforming the image to appear as if the camera was pointed straight horizontally.

5. The method of claim 3, wherein the elevation transformation modifies an input image taken with a camera positioned at arbitrary height and transforming the image to appear as if the camera was positioned at a user'"'"'s eye level.

6. The method of claim 1, wherein the step of resizing the image is performed integral to the step of applying the transformation mapping.

7. The method of claim 1, further comprising the steps:

obtaining a reference image;

performing registration of the digital image with the reference image;

using data obtained from the registration to generate the transformation mapping.

8. The method of claim 1, further comprising applying a translation transformation to move the image within display area of the monitor.

9. The method of claim 1, further comprising changing illumination intensity of individual or groups of pixels of the monitor, so as to enhance shading or illumination in the image.

10. The method of claim 1, further comprising applying at least one of a barrel-effect transformation and a fish-eye transformation.

11. The method of claim 1, further comprising:

determining distance to a user appearing in the image; and

,

varying resolution of the image according to the distance.

12. The method of claim 1, further comprising a step of pixel filling, wherein pixel image is extrapolated into empty pixels left after applying the transformation mapping.

13. The method of claim 1, further comprising the steps:

obtaining a second digital image from a second camera;

flipping the second image about a vertical axis so as to reverse right and left sides of the second image;

applying a transformation mapping to the second image to modify the second image such that it appears to mimic a reflection of a mirror;

resizing the second image to reduce variations caused by changes in object'"'"'s distance to the second camera;

stitching the image and the second image after performing the flipping, transformation mapping, and resizing, to thereby obtain a stitched image;

displaying the stitched image on the monitor.

14. The method of claim 13, wherein field of views of the camera and of the second camera overlap, and further comprising the step of overlay decision to determine best location in overlapping parts of the field of views to perform the stitching.

15. The method of claim 14, further comprising a smoothing operation to correct artifacts caused by the step of stitching.

16. The method of claim 1, further comprising the steps:

obtaining a second digital image from a second camera;

flipping the second image about a vertical axis so as to reverse right and left sides of the second image;

applying a transformation mapping to the second image to modify the second image such that it appears to mimic a reflection of a mirror;

resizing the second image to reduce variations caused by changes in object'"'"'s distance to the second camera;

displaying the image and the second image after performing the flipping, transformation mapping, and resizing, to thereby obtain a three-dimensional image on the monitor.

17. The method of claim 1, wherein the non-ordered steps are performed on a series of images of a live video feed from the camera.

18. The method of claim 17, further comprising:

determining distance to a user appearing in the live video feed; and

,

varying rate at which the non-ordered steps are performed on the series of images according to the distance.

19. The method of claim 17, storing the live video feed in a digital storage device and selectively operating the system in one of a mirror mode or display mode, wherein during mirror mode displaying on the monitor transformed images of what the camera sees at that particular moment while during display mode displaying on the monitor a transformed images of what the camera saw in the past and obtained from the digital storage device.

20. The method of claim 1, further comprising calculating distance to a user appearing in the image by identifying user'"'"'s shoes and triangulating to the shoes.