Augmented reality design system
First Claim
Patent Images
1. A method of designing an article, comprising the steps of:
- viewing a proxy for the article on a display device, the proxy existing in a real-world environment, the proxy having a three-dimensional irregular shape, the proxy including sensors disposed in the proxy that are configured to detect interactions between portions of the proxy with an interacting device, and wherein a portion of the proxy, as viewed on the display device, has a first color;
wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device;
viewing, on the display device, a virtual menu in a location in the real-world environment;
physically placing the interacting device in the location to select a color from a color palette, wherein the placing the interacting device in the location has been detected by an imaging device;
contacting the portion of the proxy in the real-world environment with the interacting device at a contact point, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy; and
viewing, during the step of contacting, the proxy on the display device, wherein the portion of the proxy, as viewed on the display device, has a second color that is different from the first color, and wherein the portion has been displayed, by the display device, as the second color based on the contacting being detected by the sensor of the sensors disposed in the proxy and based on the physically placing the interacting device in the location being detected by the imaging device.
0 Assignments
0 Petitions
Accused Products
Abstract
An augmented reality design system is disclosed. The augmented reality design system allows a user to create a design for an article in real time using a proxy. The system can be configured using a head mounted display for displaying at least one virtual design element over a proxy located in a real-world environment. The system can also be configured using a projector that projects at least one virtual design element onto a proxy located in the real world.
-
Citations
23 Claims
-
1. A method of designing an article, comprising the steps of:
-
viewing a proxy for the article on a display device, the proxy existing in a real-world environment, the proxy having a three-dimensional irregular shape, the proxy including sensors disposed in the proxy that are configured to detect interactions between portions of the proxy with an interacting device, and wherein a portion of the proxy, as viewed on the display device, has a first color; wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device; viewing, on the display device, a virtual menu in a location in the real-world environment; physically placing the interacting device in the location to select a color from a color palette, wherein the placing the interacting device in the location has been detected by an imaging device; contacting the portion of the proxy in the real-world environment with the interacting device at a contact point, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy; and viewing, during the step of contacting, the proxy on the display device, wherein the portion of the proxy, as viewed on the display device, has a second color that is different from the first color, and wherein the portion has been displayed, by the display device, as the second color based on the contacting being detected by the sensor of the sensors disposed in the proxy and based on the physically placing the interacting device in the location being detected by the imaging device. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method of designing an article, comprising the steps of:
-
selecting a color from a virtual color palette associated with a proxy for the article, the selecting the color from the virtual color palette having been detected by an imaging device, the proxy existing in a real-world environment and having a first color, the proxy having a three-dimensional irregular shape, and the proxy including sensors disposed in the proxy that are configured to detect interactions between portions of the proxy with an interacting device, wherein a portion of the proxy has a first color; wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device; contacting the portion of a proxy in the real-world environment with the interacting device at a contact point, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy; and viewing a projection of a second color on the portion of the proxy including the contact point substantially immediately after the interacting device has contacted the portion of the proxy in the real-world environment, wherein the second color is different from the first color, and wherein the projection of the second color has been based on the contacting being detected by the sensor of the sensors disposed in the proxy and based on the selected color from the virtual color palette being detected by the imaging device. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. An augmented reality design system for designing an article, comprising:
-
an imaging device for receiving images from a real-world environment; a proxy for the article existing in the real world environment, the proxy having a three dimensional irregular shape; an interacting device for interacting with the proxy in the real world environment, wherein sensors disposed in the proxy are configured to detect interactions between portions of the proxy with the interacting device; wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device; a computing device capable of generating virtual images, at least one of the virtual images being based on at least one detection of a contact point by a sensor of the sensors disposed in the proxy; a display device, wherein the at least one virtual image is superimposed onto an image, received by the imaging device, of the proxy; a virtual menu that may be displayed on the display device, wherein the virtual menu is associated with a location in the real world environment and wherein a user can interact with the virtual menu by placing the interacting device in the location and wherein the interaction with the virtual menu is detected by the imaging device; wherein the virtual menu can be used to apply a virtual design element to the proxy at a location on the proxy corresponding with a contact point of the interacting device with the proxy in the real world environment; and wherein the sensors disposed in the proxy detect the location on the proxy corresponding with the contact point of the interacting device with a surface of the proxy in the real-world environment. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. An augmented reality design system for designing an article, comprising:
-
an imaging device for receiving images from a real-world environment; a proxy for the article existing in a real world environment, the proxy having a three dimensional irregular shape; an interacting device for interacting with the proxy in the real world environment, wherein sensors disposed in the proxy are configured to detect interactions between portions of the proxy with the interacting device; wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device; a computing device capable of generating virtual images, at least one of the virtual images being based on at least one detection of a contact point by a sensor of the sensors disposed in the proxy; a projecting device, wherein the at least one virtual image is projected onto the proxy; a virtual menu that may be projected onto a location in the real-world environment, wherein a user can interact with the virtual menu by placing the interacting device in the location and wherein the interaction with the virtual menu is detected by the imaging device; wherein the virtual menu can be used to apply a virtual design element to the proxy at a location on the proxy corresponding with a contact point of the interacting device with the proxy in the real world environment; and wherein the sensors disposed in the proxy detect the location on the proxy corresponding with the contact point of the interacting device with a surface of the proxy in the real world environment. - View Dependent Claims (21, 22, 23)
-
Specification