SYSTEM AND METHOD FOR TEXTURING IN VIRTUAL REALITY AND MIXED REALITY ENVIRONMENTS

• US 20170357407A1
• Filed: 06/14/2017
• Published: 12/14/2017
• Est. Priority Date: 06/14/2016
• Status: Active Grant

• Current Assignee: Unity IPR ApS (Unity Software, Inc.)
• Original Assignee: Unity IPR ApS (Unity Software, Inc.)
• Inventors: Palmaro, Gregory Lionel Xavier Jean
• Granted Patent: US 10,001,901 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes

Abstract

A system includes hardware processors and a texturing module configured to display a texturing tray within a virtual reality environment or a mixed reality environment, the texturing tray including a first plurality of texturing mode objects, detect that a user has grabbed a first texturing mode object of the first plurality of texturing mode objects from the texturing tray with a virtual hand of the user, based on motion of the virtual hand after the grabbing, moving the first texturing mode object into a position adjacent to a surface of a target object, detect that the user has applied a texturing agent toward the first texturing mode object, and apply a texture effect to the surface of the target object based on a virtual interaction between the texturing agent and the first texturing mode object, the texture effect altering the appearance of the surface of the target object.

Claims

1. A system comprising:

one or more hardware processors; and

a texturing module, executable by the one or more hardware processors, configured to perform operations comprising;

displaying a texturing tray within an environment, the environment being one of a virtual reality environment and a mixed reality environment, the texturing tray being a virtual object within the environment, the texturing tray including a first plurality of texturing mode objects, each texturing mode object of the first plurality of texturing mode objects being a virtual object within the environment;

detecting that a user has grabbed a first texturing mode object of the first plurality of texturing mode objects from the texturing tray with a virtual hand of the user;

based on motion of the virtual hand after the grabbing, moving the first texturing mode object into a position adjacent to a surface of a target object;

detecting that the user has applied a texturing agent in relation to the first texturing mode object; and

applying a texture effect to the surface of the target object based on a virtual interaction between the texturing agent and the first texturing mode object, the texture effect altering the appearance of the surface of the target object.

2. The system of claim 1, wherein the first texturing mode object includes a stencil shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object through the stencil shape.

3. The system of claim 1, wherein the first texturing mode object includes a mask shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object around the mask shape.

4. The system of claim 1, wherein the texturing tray includes a display wall, wherein the first plurality of texturing mode objects are attached to the display wall.

5. The system of claim 1, moving the first texturing mode object into a position adjacent to a surface of a target object further includes:

detecting that the first texturing mode object is within a predetermined distance of the surface of the target object; and

removably attaching the first texturing mode object to the surface of the target object.

6. The system of claim 1, wherein the texturing tray includes a plurality of texture mode selectors, wherein each mode selector is associated with one of a plurality of sets of texture mode objects, wherein the first plurality of texturing mode objects is one set of texture mode objects of the plurality of sets of texture mode objects.

7. The system of claim 6, the operations further comprising:

detecting selection of a first texture mode selector of the plurality of texture mode selectors;

presenting the first plurality of texturing mode objects on the texturing tray;

detecting selection of a second texture mode selector of the plurality of texture mode selectors;

removing the first plurality of texturing mode objects from the texturing tray in response to said detecting selection of the second texture mode selector; and

presenting a second plurality of texturing mode objects on the texturing tray.

8. A computer-implemented method comprising:

displaying a texturing tray within an environment, the environment being one of a virtual reality environment and a mixed reality environment, the texturing tray being a virtual object within the environment, the texturing tray including a first plurality of texturing mode objects, each texturing mode object of the first plurality of texturing mode objects being a virtual object within the environment;

detecting that a user has grabbed a first texturing mode object of the first plurality of texturing mode objects from the texturing tray with a virtual hand of the user;

based on motion of the virtual hand after the grabbing, moving the first texturing mode object into a position adjacent to a surface of a target object;

detecting that the user has applied a texturing agent in relation to the first texturing mode object; and

applying a texture effect to the surface of the target object based on a virtual interaction between the texturing agent and the first texturing mode object, the texture effect altering the appearance of the surface of the target object.

9. The method of claim 8, wherein the first texturing mode object includes a stencil shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object through the stencil shape.

10. The method of claim 8, wherein the first texturing mode object includes a mask shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object around the mask shape.

11. The method of claim 8, wherein the texturing tray includes a display wall, wherein the first plurality of texturing mode objects are attached to the display wall.

12. The method of claim 8, moving the first texturing mode object into a position adjacent to a surface of a target object further includes:

detecting that the first texturing mode object is within a predetermined distance of the surface of the target object; and

removably attaching the first texturing mode object to the surface of the target object.

13. The method of claim 8, wherein the texturing tray includes a plurality of texture mode selectors, wherein each mode selector is associated with one of a plurality of sets of texture mode objects, wherein the first plurality of texturing mode objects is one set of texture mode objects of the plurality of sets of texture mode objects.

14. The method of claim 13, the operations further comprising:

detecting selection of a first texture mode selector of the plurality of texture mode selectors;

presenting the first plurality of texturing mode objects on the texturing tray;

detecting selection of a second texture mode selector of the plurality of texture mode selectors;

removing the first plurality of texturing mode objects from the texturing tray in response to said detecting selection of the second texture mode selector; and

presenting a second plurality of texturing mode objects on the texturing tray.

15. A non-transitory machine-readable medium storing processor-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:

displaying a texturing tray within an environment, the environment being one of a virtual reality environment and a mixed reality environment, the texturing tray being a virtual object within the environment, the texturing tray including a first plurality of texturing mode objects, each texturing mode object of the first plurality of texturing mode objects being a virtual object within the environment;

detecting that a user has grabbed a first texturing mode object of the first plurality of texturing mode objects from the texturing tray with a virtual hand of the user;

based on motion of the virtual hand after the grabbing, moving the first texturing mode object into a position adjacent to a surface of a target object;

detecting that the user has applied a texturing agent in relation to the first texturing mode object; and

applying a texture effect to the surface of the target object based on a virtual interaction between the texturing agent and the first texturing mode object, the texture effect altering the appearance of the surface of the target object.

16. The machine-readable medium of claim 15, wherein the first texturing mode object includes a stencil shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object through the stencil shape.

17. The machine-readable medium of claim 15, wherein the first texturing mode object includes a mask shape, wherein the texturing agent is a color spray, wherein applying the texture effect includes applying color to the surface of the target object around the mask shape.

18. The machine-readable medium of claim 15, wherein the texturing tray includes a display wall, wherein the first plurality of texturing mode objects are attached to the display wall.

19. The machine-readable medium of claim 15, wherein moving the first texturing mode object into a position adjacent to a surface of a target object further includes:

detecting that the first texturing mode object is within a predetermined distance of the surface of the target object; and

removably attaching the first texturing mode object to the surface of the target object.

20. The machine-readable medium of claim 15, wherein the texturing tray includes a plurality of texture mode selectors, wherein each mode selector is associated with one of a plurality of sets of texture mode objects, wherein the first plurality of texturing mode objects is one set of texture mode objects of the plurality of sets of texture mode objects, the operations further comprising:

detecting selection of a first texture mode selector of the plurality of texture mode selectors;

presenting the first plurality of texturing mode objects on the texturing tray;

detecting selection of a second texture mode selector of the plurality of texture mode selectors;

removing the first plurality of texturing mode objects from the texturing tray in response to said detecting selection of the second texture mode selector; and

presenting a second plurality of texturing mode objects on the texturing tray.