SYSTEMS AND METHODS FOR SIMULATING ACCESSORY DISPLAY ON A SUBJECT

• US 20130278626A1
• Filed: 04/20/2012
• Published: 10/24/2013
• Est. Priority Date: 04/20/2012
• Status: Abandoned Application

• Current Assignee: TAAZ Incorporated
• Original Assignee: Photometria, Inc.
• Inventors: Mallick, Satya, Kriegman, David, Flagg, Matthew
• Application Number:
  US13/451,949
• Publication Number:
  US 20130278626A1
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

Systems and methods for simulating accessory display on a subject are described herein. At least one digital image of a subject is obtained. At least one target contour in an accessory target zone is identified. An accessory image and an accessory foreground matte, and a plurality of accessory control points associated with at least one contour contact zone are obtained. At least one accessory scaling factor is determined. At least one accessory registration angle is determined based on the at least one digital image. At least one simulated image is generated by registering a foreground portion of the accessory image with the at least one digital image based on the at least one accessory scaling factor, the at least one accessory registration angle, the accessory foreground matte, the at least one target contour, and the plurality of accessory control points, where registering includes applying a transformation.

Claims

1. A computer-readable medium comprising computer-readable instructions for simulating accessory display on a subject, wherein execution of said computer-readable instructions by one or more processors causes said one or more processors to carry out steps comprising:

obtaining at least one digital image of a subject comprising an accessory target zone;

identifying at least one target contour in said accessory target zone of said at least one digital image;

obtaining an accessory image comprising an accessory;

obtaining an accessory foreground matte;

obtaining a plurality of accessory control points associated with at least one contour contact zone;

determining at least one accessory scaling factor;

determining at least one accessory registration angle based on said at least one digital image of said subject; and

generating at least one simulated image by registering a foreground portion of said accessory image with said at least one digital image based on said at least one accessory scaling factor, said at least one accessory registration angle, said accessory foreground matte, said at least one target contour, and said plurality of accessory control points, wherein registering comprises applying a transformation.

2. The computer-readable medium of claim 1, wherein said transformation comprises a moving least squares morphing image deformation.

3. The computer-readable medium of claim 1, wherein said accessory target zone comprises a neck region.

4. The computer-readable medium of claim 1, wherein said accessory comprises an accessory selected from the group consisting of hats, bracelets, necklaces, scarves, purses, handbags, backpacks, watches, jewelry, form-fitting accessories, form-fitting clothing and undergarments.

5. The computer-readable medium of claim 4, wherein said at least one target contour comprises a left shoulder contour and a right shoulder contour.

6. The computer-readable medium of claim 1, wherein said accessory image comprises at least one reference marker.

7. The computer-readable medium of claim 6, wherein said at least one accessory scaling factor is determined based on said at least one reference marker and at least one inter-pupillary distance in said at least one digital image.

8. The computer-readable medium of claim 6, wherein said at least one reference marker comprises at least one reference color.

9. The computer-readable medium of claim 1, wherein said steps further comprise determining an image color distribution of said digital image, wherein said registering is further based on said image color distribution.

10. The computer-readable medium of claim 1, wherein said steps further comprise obtaining at least one material movement attribute associated with at least one portion of said accessory foreground matte, wherein said transformation is further based on said at least one material movement attribute.

11. The computer-readable medium of claim 1, wherein said steps further comprise obtaining at least one material appearance attribute corresponding to at least one portion of said accessory foreground matte, wherein said generation is further based on said at least one material appearance attribute.

12. The computer-readable medium of claim 11, wherein said at least one material appearance attribute comprises at least one attribute selected from the set consisting of transparency, surface angle and surface reflectivity.

13. The computer-readable medium of claim 1, wherein said at least one digital image comprises a plurality of video frames.

14. The computer-readable medium of claim 13, wherein said steps further comprise obtaining at least one sway point associated with said accessory foreground matte, wherein said transformation is further based on said at least one sway point and at least one estimated sway position of said accessory in said plurality of video frames.

15. The computer-readable medium of claim 1, wherein said accessory image and said accessory foreground matte are prepared by:

placing said accessory on a mannequin comprising a transparent surface;

providing backlighting with respect to an imaging device positioned to face said front chest area of said mannequin, wherein said backlighting is detectable through said transparent surface by said imaging device;

using said imaging device to capture a full accessory image; and

generating an initial accessory matte based on image intensity in said accessory image,

wherein said accessory image comprises at least a portion of said full accessory image and wherein said accessory foreground matte is based on said initial accessory matte.

16. The computer-readable medium of claim 15, wherein said mannequin further comprises a dampening portion configured to reduce movement of said accessory.

17. The computer-readable medium of claim 15, wherein said backlighting is configured to illuminate an area corresponding to a maximum accessory target zone.

18. The computer-readable medium of claim 15, further comprising the steps of

obtaining a manual mask prepared by a user based on said full accessory image, wherein said manual mask overlaps with said accessory in said full accessory image;

determining a manual mask edge based on said manual mask; and

determining an intersection between said manual mask edge and said initial accessory matte,

wherein one or more of said plurality of accessory control points is based on said intersection.

19. The computer-readable medium of claim 15, further comprising the step of iteratively refining said accessory image matte by:

modifying said backlighting based on a current accessory matte;

obtaining at least one additional matte image of said accessory; and

generating at least one additional accessory matte based on said at least one additional matte image.

20. The computer-readable medium of claim 19, further comprising the step of obtaining at least one updated full accessory image using said modified backlighting.

21. The computer-readable medium of claim 15, wherein at least one reference marker is placed in a known position with respect to said mannequin.

22. The computer-readable medium of claim 15, wherein said steps further comprise manually modifying said accessory foreground matte.

23. The computer-readable medium of claim 15, wherein said steps further comprise:

displaying said at least one simulated image in a user interface;

accepting at least one modification to at least one of said accessory scaling factor, said accessory registration angle, said inter-pupillary distance, and said at least one target contour; and

generating at least one modified simulated image based on said at least one modification.

24. The computer-readable medium of claim 1, wherein said steps further comprise displaying said at least one simulated image in association with marketing material for said accessory.

25. The computer-readable medium of claim 1, wherein said steps further comprise:

obtaining at least one additional accessory image comprising at least one additional accessory;

obtaining at least one additional accessory foreground matte;

obtaining a plurality of additional accessory control points associated with said at least one additional accessory foreground matte;

determining at least one additional accessory scaling factor; and

determining at least one additional accessory registration angle based on said at least one digital image of said subject,

registering at least one foreground portion of said at least one additional accessory image with said at least one digital image and said foreground portion of said accessory image.

26. A computer-readable medium comprising computer-readable instructions for generating and displaying model accessory images, wherein execution of said computer-readable instructions by one or more processors causes said one or more processors to carry out steps comprising:

obtaining a model image comprising a neck and upper chest region of a subject;

obtaining a left shoulder contour and a right shoulder contour of said subject in said model image;

obtaining an accessory image of an accessory for a neck area;

obtaining an accessory foreground matte defining a foreground region of said accessory in said accessory image;

obtaining a plurality of accessory control points associated with at least one contour contact zone;

generating a simulated image by registering a foreground portion of said accessory image with said model image based on said accessory foreground matte, said at least one target contour, and said plurality of accessory control points, wherein registering comprises applying a transformation based on said plurality of accessory control points and said at least one target contour; and

displaying said simulated image in association with marketing material for said accessory.