Virtual try-on apparatus, virtual try-on method, and computer program product

• US 9,984,485 B2
• Filed: 03/26/2015
• Issued: 05/29/2018
• Est. Priority Date: 08/08/2014
• Status: Active Grant

• Current Assignee: Toshiba Digital Solutions Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation), Toshiba Solutions Corporation (Toshiba Corporation)
• Inventors: Osada, Kunio, Dobashi, Toshimasa, Yoshioka, Hisao, Mikami, Shigeru, Inomata, Yumi, Ueda, Hiroki
• Primary Examiner(s): Chen, Yu
• Application Number:
  US14/669,110
• Publication Number:
  US 20160042542A1
• Time in Patent Office: 1,160 Days
• Field of Search: None
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2210/16 Cloth

Abstract

According to an embodiment, an apparatus includes an acquisition unit, a first controller, an acceptor, a generator, and a second controller. The acquisition unit is configured to acquire characteristic information on a subject. The first controller is configured to generate a screen according to the acquired characteristic information and display the display screen on a first display. The screen contains clothing images corresponding to the acquired characteristic information in first information in which the characteristic information and the clothing images are associated with each other. The acceptor is configured to accept from the subject a selection of an image of clothing to be tried on from among the clothing images displayed on the first display. The generator is configured to generate a composite image of a subject image of the subject and the selected clothing image. The second controller is configured to display the composite image on a second display.

Claims

1. A virtual try-on apparatus comprising:

a processor; and

a memory that stores instructions that, when executed by the processor, facilitate performance of operations, comprising;

acquiring characteristic information on a try-on subject;

generating a display screen according to the acquired characteristic information and displaying the display screen on a first display, the display screen containing clothing images corresponding to the acquired characteristic information in first information in which the characteristic information and the clothing images are associated with each other, wherein the generating further comprises generating the display screen of a screen design according to the characteristic information and displaying the display screen on the first display;

accepting from the try-on subject a selection of an image of clothing to be tried on from among the clothing images displayed on the first display;

generating a composite image of a try-on subject image of the try-on subject and the selected clothing image, and displaying the composite image on a second display, and

transmitting try-on information to a first server device, wherein

the characteristic information includes at least an inner characteristic of the try-on subject, and

the operations further comprise;

in generating of the display screen, generating, based on the characteristic information, at least one of;

a background color of the display screen, a display size of at least either of data items or the clothing images to be displayed on the display screen, colors of the data items, and a display position on the display screen of the at least either of the data items or the clothing images, and displaying the generated one on the first display,

in generating of the composite image, generating the composite image in which the try-on subject image and the selected clothing image are superimposed on a background image of a color or a scene based on the characteristic information, and displaying the composite image

in the accepting, accepting a pre-decided motion of the try-on subject as pre-decided instruction information corresponding to the motion, the instruction information being an instruction for capturing the composite image displayed on the second display,

in displaying of the composite image, displaying on the second display, the composite image including at least one of the instruction image and second time information indicative of a remaining time before confirmation of the instruction for capturing; and

displaying, after a lapse of the remaining time indicated by the second time information, on the second display, the composite image including at least one of the instruction image and third time information indicative of a remaining time before execution of a process according to the instruction for capturing, and

in the transmitting, transmitting, after a lapse of the remaining time indicated by the third time information, to the first server device the try-on information included in the composite image displayed on the second display, the try-on information including first identification information of one or more of the clothing images, second identification information of the try-on subject image included in the composite image, and a clothing image of clothing identified by the first identification information.

2. The apparatus according to claim 1, wherein the characteristic information includes at least either of outer characteristics or try-on subject'"'"'s preferences of the try-on subject.

3. The apparatus according to claim 1, wherein the characteristic information represents at least one of:

body shape parameters indicative of the body shape of the try-on subject, characteristic color of the try-on subject, age bracket in which the try-on subject resides, try-on subject'"'"'s personality, and try-on subject'"'"'s preferences.

4. The apparatus according to claim 1, wherein the operations further comprise:

accepting a pre-decided motion of the try-on subject as pre-decided instruction information corresponding to the motion, and

displaying on the second display, the composite image including at least one of an instruction image indicative of the accepted instruction information and first time information indicative of a remaining time required before completion of a process corresponding to the instruction information.

5. The apparatus according to claim 4, wherein

the instruction information is an instruction for changing the composite image, and wherein the operations further comprise

displaying on the second display, the composite image including at least one of the instruction image and the first time information indicative of the remaining time required before display of the changed composite image, and

displaying the changed composite image on the second display after a lapse of the remaining time indicated by the first time information.

6. The apparatus according to claim 1, wherein

generating of the display screen generates the display screen having a screen design such that, as an age bracket in the characteristic information represents an older age, a display size of at least one of data items and the clothing images to be displayed on the display screen becomes larger.

7. The apparatus according to claim 1, wherein

generating of the display screen generates the display screen having a screen design including a data item color and a background color similar to a characteristic color in the characteristic information.

8. A virtual try-on method comprising:

acquiring characteristic information on a try-on subject;

generating a display screen according to the acquired characteristic information and displaying the display screen on a first display, the display screen containing clothing images corresponding to the acquired characteristic information in first information in which the characteristic information and the clothing images are associated with each other, wherein the generating further comprises generating the display screen of a screen design according to the characteristic information and displaying the display screen on the first display;

accepting from the try-on subject a selection of an image of clothing to be tried on from among the clothing images displayed on the first display;

generating a composite image of a try-on subject image of the try-on subject and the selected clothing image, and displaying the composite image on a second display, and

transmitting try-on information to a first server device, wherein

the characteristic information includes at least an inner characteristic of the try-on subject, and

the method further comprises;

in generating of the display screen, generating, based on the characteristic information, at least one of;

a background color of the display screen, a display size of at least either of data items or the clothing images to be displayed on the display screen, colors of the data items, and a display position on the display screen of the at least either of the data items or the clothing images, and displaying the generated one on the first display,

in generating of the composite image, generating the composite image in which the try-on subject image and the selected clothing image are superimposed on a background image of a color or a scene based on the characteristic information, and displaying the composite image,

in the accepting, accepting a pre-decided motion of the try-on subject as pre-decided instruction information corresponding to the motion, the instruction information being an instruction for capturing the composite image displayed on the second display,

in displaying of the composite image, displaying on the second display, the composite image including at least one of the instruction image and second time information indicative of a remaining time before confirmation of the instruction for capturing; and

displaying, after a lapse of the remaining time indicated by the second time information, on the second display, the composite image including at least one of the instruction image and third time information indicative of a remaining time before execution of a process according to the instruction for capturing, and

in the transmitting, transmitting, after a lapse of the remaining time indicated by the third time information, to the first server device the try-on information included in the composite image displayed on the second display, the try-on information including first identification information of one or more of the clothing images, second identification information of the try-on subject image included in the composite image, and a clothing image of clothing identified by the first identification information.

9. A computer program product comprising a non-transitory computer-readable medium containing a program executed by a computer, the program causing the computer to execute:

acquiring characteristic information on a try-on subject;

generating a display screen according to the acquired characteristic information and displaying the display screen on a first display, the display screen containing clothing images corresponding to the acquired characteristic information in first information in which the characteristic information and the clothing images are associated with each other, wherein the generating further comprises generating the display screen of a screen design according to the characteristic information and displaying the display screen on the first display;

accepting from the try-on subject a selection of an image of clothing to be tried on from among the clothing images displayed on the first display;

generating a composite image of a try-on subject image of the try-on subject and the selected clothing image, and displaying the composite image on a second display, and

transmitting try-on information to a first server device, wherein

the characteristic information includes at least an inner characteristic of the try-on subject, and

the program further causes the computer to execute;

in generating of the display screen, generating, based on the characteristic information, at least one of;

a background color of the display screen, a display size of at least either of data items or the clothing images to be displayed on the display screen, colors of the data items, and a display position on the display screen of the at least either of the data items or the clothing images, and displaying the generated one on the first display,

in generating of the composite image, generating the composite image in which the try-on subject image and the selected clothing image are superimposed on a background image of a color or a scene based on the characteristic information, and displaying the composite image,

in the accepting, accepting a pre-decided motion of the try-on subject as pre-decided instruction information corresponding to the motion, the instruction information being an instruction for capturing the composite image displayed on the second display,

in displaying of the composite image, displaying on the second display, the composite image including at least one of the instruction image and second time information indicative of a remaining time before confirmation of the instruction for capturing; and

displaying, after a lapse of the remaining time indicated by the second time information, on the second display, the composite image including at least one of the instruction image and third time information indicative of a remaining time before execution of a process according to the instruction for capturing, and

in the transmitting, transmitting, after a lapse of the remaining time indicated by the third time information, to the first server device the try-on information included in the composite image displayed on the second display, the try-on information including first identification information of one or more of the clothing images, second identification information of the try-on subject image included in the composite image, and a clothing image of clothing identified by the first identification information.