Augmented reality design system

• US 9,858,724 B2
• Filed: 03/18/2016
• Issued: 01/02/2018
• Est. Priority Date: 02/22/2010
• Status: Active Grant

• Current Assignee: Nike, Inc.
• Original Assignee: Nike, Inc.
• Inventors: Friesen, David Y.
• Primary Examiner(s): NGUYEN, ANH TUAN V
• Application Number:
  US15/074,154
• Publication Number:
  US 20160203647A1
• Time in Patent Office: 655 Days
• Field of Search: None
• CPC Class Codes: A43B 3/0078 provided with logos, letters, signatures or the like decoration A43B23/24 takes precedence
• CPC Class Codes: G06F 2111/02 CAD in a network environment, e.g. collaborative CAD or distributed simulation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/16 Cloth

Abstract

An augmented reality design system is disclosed. The augmented reality design system allows a user to create a design for an article in real time using a proxy. The system can be configured using a head mounted display for displaying at least one virtual design element over a proxy located in a real-world environment. The system can also be configured using a projector that projects at least one virtual design element onto a proxy located in the real world.

Claims

1. A method of designing an article of apparel, the method comprising the steps of:

viewing a proxy on a display device, the proxy existing in a real-world environment, the proxy including a detecting device that is configured to detect interactions between portions of the proxy with an interacting device, and the proxy having a shape of a mannequin;

contacting the proxy in the real-world environment with the interacting device along a surface on the proxy to create a mark associated with a virtual design for the article of apparel, wherein the contacting has been detected by the detecting device;

physically rotating, during the step of contacting, the proxy in the real-world environment while maintaining contact between the interacting device and the proxy during the rotation of the proxy;

viewing, on the display device and during the step of physically rotating, a virtual line in the virtual design corresponding to the contacting of the proxy with the interacting device along the surface on the proxy during the step of physically rotating the proxy;

wherein the virtual design is displayed on the display device so as to appear to be a part of the proxy; and

wherein orientation and position of the virtual design is displayed on the display device so as to appear to be a part of the proxy as the proxy is rotated in the real-world environment.

2. The method according to claim 1, wherein the mannequin includes an upper portion that corresponds to a torso and arms, and wherein the step of viewing a virtual line includes viewing the virtual line on the upper portion.

3. The method according to claim 2 further comprising the step of placing a shirt onto the upper portion prior to the step of viewing a virtual line.

4. The method according to claim 2, wherein the article of apparel is a shirt.

5. The method according to claim 1, wherein the mannequin includes a lower portion that corresponds to a waist and legs, and wherein the step of viewing a virtual line includes viewing the virtual line on the lower portion.

6. The method according to claim 5, wherein the article of apparel is a pair of pants.

7. The method according to claim 5 further comprising the step of placing a pair of pants onto the lower portion prior to the step of viewing a virtual line.

8. The method according to claim 1, wherein the mannequin includes an upper portion that corresponds to a torso and arms and a lower portion that corresponds to a waist and legs, and wherein the step of viewing a virtual line includes viewing the virtual line on both the upper portion and the lower portion.

9. The method according to claim 8, wherein the article of apparel is an article that extends over both the upper portion and the lower portion.

10. A method of designing an article of apparel, the method comprising the steps of:

viewing a proxy on a display device, the proxy existing in a real-world environment, the proxy including sensors that are configured to detect interactions between portions of the proxy and an interacting device, and the proxy having a shape of a full length mannequin having an upper portion and a lower portion;

contacting the proxy in the real-world environment with the interacting device along a surface on the proxy to create a virtual design element for the article of apparel, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy;

physically rotating, during the step of contacting, the proxy in the real-world environment while maintaining contact between the interacting device and the proxy during the rotation of the proxy;

viewing, on the display device and during the step of physically rotating, a virtual image of the virtual design element corresponding to the contacting of the proxy with the interacting device along the surface on the proxy during the step of physically rotating the proxy;

wherein the virtual design is displayed on the display device so as to appear to be a part of the proxy, wherein the virtual design extends over both the upper portion and the lower portion of the proxy; and

wherein orientation and position of the virtual design is displayed on the display device so as to appear to be a part of the proxy as the proxy is rotated in the real-world environment.

11. The method according to claim 10 further comprising the step of adapting the virtual design element to a boundary marking disposed on the proxy.

12. The method according to claim 11 further comprising the step of virtually applying the boundary marking to the proxy.

13. The method according to claim 11 further comprising the step of placing an article of clothing directly onto the proxy, wherein the article of clothing establishes the boundary marking.

14. The method according to claim 11, wherein the proxy includes the boundary marking.

15. An augmented reality design system for designing an article of apparel, the system comprising:

an imaging device for receiving images from a real-world environment;

a proxy existing in the real world environment, the proxy being a mannequin, and the proxy including a detecting device, wherein the detecting device includes a plurality of sensors in the proxy, wherein the sensors substantially cover a surface of the proxy;

an interacting device for interacting with the proxy in the real world environment, wherein the detecting device of the proxy is capable of detecting interactions between portions of the proxy with the interacting device;

a computing device capable of generating virtual images, at least one of the virtual images being based on at least one detection of a contact point by the detecting device of the proxy;

a display device, wherein the at least one virtual image is superimposed onto an image of the proxy received by the imaging device;

a virtual menu that may be displayed on the display device, wherein the virtual menu is associated with a location in the real world environment and wherein a user can interact with the virtual menu by placing the interacting device in the location;

wherein the virtual menu can be used to apply a virtual design element to the proxy at a location on the proxy corresponding with a contact point of the interacting device with the proxy in the real world environment; and

wherein the detecting device detects the location on the proxy corresponding with the contact point of the interacting device with a surface of the proxy in the real-world environment.

16. The augmented reality design system according to claim 15, wherein the mannequin includes an upper portion in the shape of a torso and arms and a lower portion in the shape of a waist and legs.

17. The augmented reality design system according to claim 16, wherein the virtual design element extends from the upper portion to the lower portion.

18. The augmented reality design system according to claim 15, wherein the proxy includes boundary markings.