Textile matching using color and pattern recognition and methods of use

• US 10,460,199 B2
• Filed: 11/03/2014
• Issued: 10/29/2019
• Est. Priority Date: 11/03/2014
• Status: Active Grant

• Current Assignee: myDiModa, Inc.
• Original Assignee: Terrence A. Carroll
• Inventors: Carroll, Terrence A., Hussami, Peter, Kalecz-Simon, Andras, Jin, Bin
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US15/523,935
• Publication Number:
  US 20180046882A1
• Time in Patent Office: 1,821 Days
• Field of Search: None
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/60 of audio data
• CPC Class Codes: G06F 16/63 Querying
• CPC Class Codes: G06F 18/24155 Bayesian classification
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

Textile matching using color and pattern recognition and methods of use are provided herein. An example method includes analyzing an image (305) of a first article of clothing to obtain color information and pattern information (205-230), comparing the color information and pattern information of the first article of clothing to color information and pattern information for a plurality of other articles of clothing (using Bayesian probability analysis to determine matched pairs, and providing a user with wardrobe suggestions using the matched pairs (705-740).

Claims

1. A non-transitory, computer-readable medium comprising program code that, when executed by one or more processors of a computer system, causes the one or more processors to:

analyze a first image of a first article of clothing to obtain color and pattern information corresponding to the first article of clothing;

locate a second article of clothing for pairing with the first article of clothing to create a matched pair of articles of clothing, wherein the second article of clothing is located by;

obtaining a plurality of possible matching articles of clothing from one or more databases,

identifying, for each of the plurality of possible matching articles of clothing, color and pattern information; and

selecting one of the plurality of possible matching articles of clothing based on the color and pattern information corresponding to the first article of clothing and the color and pattern information corresponding to one or more the possible matching articles of clothing;

initiate display of images of the matched pair of articles of clothing, the images of the matched pair of articles of clothing comprising the first image of the first article of clothing and a second image of the second article of clothing, the second image displayed in association with a selectable feedback object that allows for input of feedback regarding the selection of the second article of clothing;

receive the feedback regarding the selection of the second article of clothing; and

based on the feedback being positive, calculate an updated probability value, wherein the updated probability value indicates that some of the plurality of possible matching articles with similar probability values to a probability value of the second article of clothing are more likely to be selected in a future pairing that others of the plurality of possible matching articles.

2. The non-transitory, computer-readable medium according to claim 1, wherein the plurality of possible matching articles of clothing are selected based on an initial rule based analysis between the color and pattern information of the first article of clothing and the color and pattern information for the plurality of possible matching articles of clothing.

3. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to initiate display of a first graphical user interface that allows for input of an even category for the first article of clothing,

wherein the event category includes at least one of formal clothing or business casual.

4. The non-transitory, computer-readable medium according to claim 1, wherein the first article of clothing and the second article of clothing are of a different type so as to comprise an outfit.

5. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to repeat the analyzing and the locating to identify a plurality of articles of clothing for a user that are matched to the first article of clothing to create a virtual wardrobe.

6. The non-transitory, computer-readable medium according to claim 1, wherein the second article of clothing is for sale, and selectable for purchase when matched to the first article of clothing.

7. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to receive an event category for the first article of clothing, the event category defining an initial set of rules used in obtaining a plurality of possible matching articles of clothing from the one or more databases.

8. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to obtain skin color information for a user who will wear the first article of clothing from the first image.

9. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to:

obtain color information by;

performing a color space conversion of the image of the first article of clothing;

performing color recognition of the color space converted image to obtain color information;

extracting image segmentation information for the image that identifies image segments;

for each identified image segment, obtaining dominant color information by performing a focusing region selection of the color information of an image segment; and

calculating an average of the dominant color information for the identified image segments.

10. The non-transitory, computer-readable medium according to claim 9, further comprising program code that, when executed, causes the one or more processors to:

obtain pattern information by;

calculating an edge orientation field using a Sobel operator in a dominant color region of the image;

calculating a split of an edge orientation of the image;

calculating a mean orientation in each sub-region of the dominant color region;

obtaining an output of a strip and square image using the mean orientation; and

obtaining an output of a dot image and empty image using the dominant color information and the split of the edge orientation of the image.

11. The non-transitory, computer-readable medium according to claim 9, further comprising program code that, when executed, causes the one or more processors to:

detect skin color information for a wearer of the first article of clothing, wherein the skin color information is used in the calculation of the dominant color information.

12. The non-transitory, computer-readable medium according to claim 9, wherein the color recognition uses any of:

(1) k-nearest neighbors analysis, a red, green, blue analysis, a hue, saturation, and value analysis, and a cyan, magenta, yellow, key analysis.

13. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to:

receive clothing type criteria corresponding to the first article of clothing, the clothing type criteria defining a kind of the first article of clothing, and

initiate display of a third article of clothing, wherein the first article of clothing and the third and the third article of clothing are of a different clothing type of complete an outfit.

14. The non-transitory, computer-readable medium according to claim 1, further comprising program code that, when executed, causes the one or more processors to:

select for purchase, the second article of clothing, when a positive input for feedback is received.

15. A non-transitory, computer-readable medium comprising program code that, when executed by one or more processors of a computer system, causes the one or more processors to:

provide a virtual wardrobe comprising images of articles of clothing, wherein each of the images is associated with color and pattern information corresponding to the articles of clothing, respectively;

identify, for an article of clothing for purchase, color and pattern information for the article of clothing for purchase;

identify at least one of a color or a pattern match between the color and pattern information for the article of clothing for purchase and the color and pattern information for one the articles of clothing to create a matched pair of articles of clothing;

display images of the matched pair of articles of clothing, the images of the matched pair of articles of clothing comprising a first image of the one article of clothing in the matched pair of articles of clothing and a second image of the article of clothing for purchase in the matched pair of articles of clothing, the second image displayed in association with a selectable feedback object that allow for input of feedback regarding the selection the article of clothing for purchase;

receive the feedback regarding the selection of the article of clothing for purchase;

based on the feedback being positive, calculate an updated probability value, wherein the updated probability value indicates that some of a plurality of articles of clothing for possible purchase with similar probability values to a probability value of the article of clothing for purchase are more likely to be selected in a future pairing than others of the plurality of articles of clothing for possible purchase;

receive an indication that the article of clothing for purchase has been purchased; and

add the purchased article of clothing to the virtual wardrobe.

16. The non-transitory, computer-readable medium according to claim 15, further comprising program code that, when executed, causes the one or more processors to:

analyze a representation of a first article of clothing to obtain color information, the color information comprising a dominant color region in the image, and pattern information, the pattern information comprising artwork or aesthetic pattern of the first article of clothing; and

compare the color and pattern information of the first article of clothing to color and pattern information for the article of clothing for purchase using the updated probability value to determine matched pairs.

17. The non-transitory, computer-readable medium according to claim 15, further comprising program code that, when executed, causes the one or more processors to:

determine a second article of clothing for purchase using the updated probability value.

18. The non-transitory, computer-readable medium according to claim 15, wherein the computer-readable medium embodying the computer system further comprises program code to:

identify an event category, the event category corresponding to clothing appropriate for an event in the event category; and

identify at least a portion of a plurality of particles of clothing in the virtual wardrobe that are appropriate for the event based on the event category,

wherein the event category includes at least one of formal or business casual.

19. A non-transitory, computer-readable medium comprising program code that, when executed by one or more processors of a computer system, causes the one or more processors to:

analyze a first image of a first article of clothing to obtain color and pattern information corresponding to the first article of clothing;

locate a second article of clothing for pairing with the first article of clothing to create a matched pair of articles of clothing, wherein the second article of clothing is located by;

obtaining a plurality of possible matching articles of clothing from one or more databases,

identifying, for each of the plurality of possible matching articles of clothing, color and pattern information, and

selecting one of the plurality of possible matching articles of clothing based on the color and pattern information corresponding to the first article of clothing and the color and pattern information corresponding to one or more of the possible matching articles of clothing; and

initiate display of images of the matched pair of articles of clothing, the images of the matched pair of articles of clothing comprising the first image of the first article of clothing and a second image of the second article of clothing, the second image displayed in association with a selectable feedback object that allows for input of feedback regarding the selection of the second article of clothing;

initiate display of a first graphical user interface that allows for input of an event category for the first article of clothing, wherein the event category includes at least one of formal clothing or business casual;

receive the feedback regarding the selection of the second article of clothing; and

based on the feedback being positive, calculate an updated probability value, wherein the updated probability value indicates that some of the plurality of possible matching articles with similar probability values to a probability value of the second article of clothing are more likely to be selected in a future pairing than others of the plurality of possible matching articles,

wherein the first article of clothing and the second article of clothing are of a different type so as to complete an outfit, and

wherein the second article of clothing is for sale, and selectable for purchase when matched to the first article of clothing.