3D DIGITAL PAINTING

• US 20110292042A1
• Filed: 05/26/2011
• Published: 12/01/2011
• Est. Priority Date: 06/01/2010
• Status: Active Grant

• Current Assignee: Vladimir Vaganov
• Original Assignee: Vladimir Vaganov
• Inventors: Vaganov, Vladimir
• Granted Patent: US 8,817,017 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: B44D 2/002 Kits for drawing or painting
• CPC Class Codes: B44F 7/00 Designs imitating three-dimensional effects
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing

Abstract

The present invention provides method and system for 3D hand-painting and 3D hand-drawing. The system corresponding to the invented method comprises: an electronic monitor and computer, means for 3D digital vision, multi-axis input control device allowing digital painting or drawing on the canvas, additional input control device for virtual changing the position of the canvas between the painter and the monitor, means for 3D image presentation. The system and method provide painting or drawing on the electronic canvas for each of the virtual positions of the canvas by changing this position with the input control device and verifying it with the means for 3D digital vision. The system provides complete digital 2D images of the painting for the right and the left eyes, which are used for presentation of 3D painting by available means for 3D vision.

Claims

1. A method of digital 3D hand-painting and 3D hand-drawing, said method comprising:

providing a digital electronic canvas capable to presenting two pictures for the right and left eye;

providing means for changing the virtual distance between the canvas and the painter by digital changing the horizontal shifting between the images for the right and left eye on the canvas corresponding to each virtual canvas position;

painting on the electronic canvas for each virtual positions of the canvas providing simultaneous appearance of a similar stroke on the right and left image due to a high spatial and/or time resolution between right and left image on the canvas.

2. A method of digital recording of 3D hand-painted and 3D hand-drawn images, said method comprising:

providing an electronic canvas (computer monitor, TV screen, projection screen, display of the mobile device, etc.);

providing means for 3D digital vision (shutter glasses, splitting canvas on two canvases and switching these canvases between left and right eye, etc.);

providing at least one at least two-axis input control device allowing digital painting or drawing on the canvas;

providing additional at least one at least one-axis input control device for virtual changing the position of the canvas along the axis between the painter and the canvas;

painting or drawing on the electronic canvas for each of the virtual positions of the canvas in the third dimension by changing this position with the at least one at least one-axis input control device and verifying this position with the means for 3D digital vision;

providing a description in digital format of images for right and left eyes on each virtual position of the canvas and of corresponding positions of the canvas;

providing complete 2D images of the painting for the right and the left eyes;

using left and right images of the painting for presentation of 3D painting by available means for 3D vision.

3. A method according to claim 2, further providing a description in digital format of images on each virtual position of the canvas and of corresponding positions of the canvas and providing complete 3D digital image of the painting for different applications associated with 3D image processing (like rotation, animation, etc.).

4. A method according to claim 2, wherein painting or drawing on the electronic canvas for each of the virtual positions of the canvas in the third dimension will result in simultaneous painting on two canvases switching between right and left eye with frequency high enough that hand-painted images would appear on both canvases with certain horizontal offsets with respect to a central vertical line for each canvas on a distance corresponding to chosen virtual position of the canvas.

5. A method according to claim 2, wherein complete 2D images of the painting for the right and the left eyes are provided by superposition of layers corresponding to different virtual positions of the canvas for the right and the left eye separately.

6. A method according to claim 2, wherein the additional two or more at least one-axis input control devices are used for controlling functions of the digital painting process chosen from a group of:

action, turning on and off, navigation of a cursor on the display of the electronic device, scrolling, zooming, shadowing, screening, selecting, deleting, restoring, saving, opening, closing, searching, setting up, previewing, undoing, clearing, repeating, pasting, finding, replacing, inserting, formatting, color selection, color mixing, line or stroke width, brush size, swatch size, sponge size, eraser size, the depth of the focal plane around the canvas virtual position, special effects . . . or combination.

7. A method according to claim 2, wherein painting or drawing on the electronic canvas is happening simultaneously with changing the virtual positions of the canvas in the third dimension by changing this position with the at least one at least one-axis input control device and verifying this position with the means for 3D digital vision.

8. A method according to claim 2, wherein the virtual position of the canvas is presented by at least one virtual Z-axis having an origin located in the plane parallel to the canvas and having a scale describing a relative distance between the painter and the virtual position of the canvas and each current virtual position of the canvas is indicated on the scale of this at least one virtual Z-axis.

9. A method according to claim 8, wherein the virtual position of the canvas is presented by more than one virtual Z-axis, which have different scale on different virtual Z-axes reflecting the different angular position of the virtual canvas with respect to different virtual Z-axes.

10. A method according to claim 9, wherein the virtual position of the canvas is presented as a temporary plane within a 3D grid created by a system of lines including lines connecting points on different virtual Z-axes corresponding to the same position of the virtual canvas.

11. A system for digital recording of 3D hand-painted and 3D hand-drawn images, said system comprising:

an electronic canvas (computer monitor, TV screen, projection screen, display of the mobile device, etc.);

means for 3D digital vision (shutter glasses, splitting canvas on two canvases and switching these canvases between left and right eye, etc.);

at least one at least two-axis input control device allowing digital painting or drawing on the canvas;

at least one at least one-axis input control device for virtual changing the position of the canvas along the axis between the painter and the canvas;

means for 3D image presentation;

wherein the system provides painting or drawing on the electronic canvas for each of the virtual positions of the canvas in the third dimension by changing this position with the at least one-axis input control device and verifying this position with the means for 3D digital vision;

the system also provides a description in digital format of images for right and left eyes on each virtual position of the canvas and of corresponding positions of the canvas;

the system also provides complete 2D images of the painting for the right and the left eyes by superposition of all layers corresponding to virtual positions of the canvas for the right and the left eye separately;

the system also provides complete 3D images of the painting by superposition of all layers corresponding to all virtual positions of the canvas;

the system provides using left and right images for presentation of 3D painting by available means for 3D vision.

12. A system according to claim 11, wherein at least two-axis input control device allowing digital painting or drawing on the canvas is chosen from the group:

sensitive pad, mouse, track ball, joystick, finger joystick, thimble, key-button, touch pad, touch screen, 6D motion sensor, electronic pen, smart pen, Vpaint.

13. A system according to claim 11, wherein the additional at least one at least one-axis input control device for virtual changing the position of the canvas along the axis between the painter and the canvas is chosen from a group of:

scroll wheel, sensitive pad, mouse, track ball, joystick, finger joystick, thimble, key-button, touch pad, touch screen, 6D motion sensor, smart pen, Vpaint and alike.

14. A system according to claim 11, wherein means for presentation of 3D images are chosen from a group of:

optical projection of two images with polarized light onto one screen and using polarized glasses, optical projection of two images with colored light onto one screen and using corresponding colored glasses, stereoscopic glasses and two photographs or slides, 3D digital personal viewer, shutter glasses and synchronous switching display between left and right eye, 3D monitor with the system of vertical cylindrical lenses and corresponding striped overlapping images for the right and left eyes, direct projection of left and right images onto retina of the eyes.

15. A system according to claim 14, wherein 3D digital personal viewer comprises:

two micro-displays for left and right eye;

two lenses of the glasses for projecting the images from the displays into eyes;

processor;

memory;

power supply;

transceiver;

body of the viewer integrating all the elements of the device.

16. A system according to claim 11, wherein the at least one at least two-axis input control device allowing digital painting or drawing on the canvas comprises:

an end-point coupled to an integrated at least one at least two-axis force sensor within the device;

IC circuit for digitizing the information from at least one at least two-axis force sensor and processing the data related to the change of the force vector components;

hardware and software for providing a description in digital format of how the device has been pressed to the surface based at least in part on the force applied by the end-point to the writing surface;

and hardware and software for providing a description in digital format of how the device has been moved over the surface based at least in part on the correlation between the force vector components and corresponding movement vector components,

wherein the device is moving with a hand and/or fingers such that the end-point is contacting a surface suitable for such movement across the surface in a process of painting, drawing, writing or cursor navigating while recording with the integrated at least one at least two-axis force sensor the change of the vector force representing the motion of the device and force applied to the sensor by the end-point.

17. A device according to claim 16, further providing at least one sensor chosen from the group of sensors consisting of:

one-axis linear accelerometer, two-axis linear accelerometer, three-axis linear accelerometer, one-axis gyro, two-axis gyro, three-axis gyro, one-axis angular accelerometer, two-axis angular accelerometer, three-axis angular accelerometer, one-axis compass, two-axis compass, three-axis compass for determining the motion parameters, at which the device has been moved between recording of two positions on the working surface.

18. A system according to claim 11, wherein the at least one at least two-axis input control device allowing digital painting or drawing on the canvas comprises:

a device having an end-point coupled to an integrated at least one at least two-axis force sensor within the device;

at least one at least two-axis motion sensor within the device;

any working surface suitable for moving the device having an end-point across the working surface in the process of painting or drawing;

IC circuit for digitizing the information from at least one at least one-axis force sensor and from at least one at least two-axis motion sensor and processing the data related to the change of the force vector components and motion sensor components;

hardware and software for providing a description in digital format of how the device has been pressed to the surface based at least in part on the force applied by the end-point to the writing surface;

and hardware and software for providing a description in digital format of how the device has been moved over the surface based at least in part on the correlation between the motion sensor vector components and corresponding movement vector components,

wherein the device is moving with a hand and/or fingers such that the end-point is contacting a surface suitable for such movement across the surface in a process of painting, drawing, writing or cursor navigating while recording with the integrated at least one at least two-axis force sensor the change of the vector of force applied to the force sensor by the end-point and recording with the at least one at least two-axis motion sensor the change of the vector of motion representing the motion of the device.

19. A device according to claim 18, wherein the at least one at least two-axis force sensor comprises of:

a semiconductor substrate sensor chip, said semiconductor sensor chip comprising a frame element, a rigid island element and an elastic element mechanically coupling said frame and said rigid island elements;

a set of two or more stress-sensitive IC components integrated into the elastic element;

at least one force-transferring element coupling the end-point to a rigid island element of a sensor die for transferring the applied external vector force from the end-point through at least one force-transferring element to the rigid island element of the sensor die, and thereby generating electrical outputs from application the external force vector via stress-sensitive IC components positioned in the elastic element each carrying the unique orthogonal system component of signal from the force vector, where the IC component outputs are functions of input component stresses developed from the orthogonal system force components.

20. A device according to claim 18, wherein the at least one at least two-axis sensor is chosen from a group:

mechanical force sensor, linear acceleration force sensor, angular acceleration force sensor, Coriolis force or angular rate force sensor and combination.