High resolution and high sensitivity three-dimensional (3D) cursor maneuvering device

• US 10,254,855 B2
• Filed: 06/03/2014
• Issued: 04/09/2019
• Est. Priority Date: 06/04/2013
• Status: Active Grant

• Current Assignee: Wen-Chieh Geoffrey Lee
• Original Assignee: Wen-Chieh Geoffrey Lee
• Inventors: Lee, Wen-Chieh Geoffrey
• Primary Examiner(s): Edwards, Mark
• Application Number:
  US14/294,369
• Publication Number:
  US 20140354548A1
• Time in Patent Office: 1,771 Days
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A three dimensional (3D) maneuvering device generates 3D data by irradiating a variably tinted two dimensional (2D) reference surface. The tri-stimuli color index data (e.g. CIE 1931 RGB) is a reliable and high definition source of such tinting. By mathematical conversion, the color index data on the 2D surface is mapped into 3D positional data, i.e. (x, y, z) to be used by a computer, a 3D rendering device or an electronic or electromechanical device such as a 3D printer. The 3D maneuvering device has high sensitivity, high resolution, and immunity from the noise caused by human vibrations. A rotational motion vector is derived by comparing the relative motion vectors derived from a pattern recognition process of surface features on the same reference plane with the positional data derived using the color index data. Thus, a single gestural movement of the operator'"'"'s hand provides both the translational and rotational motion data simultaneously.

Claims

1. A maneuvering system comprising:

a two dimensional (2D) planar continuously tinted reference surface, configured to emit electromagnetic radiation when illuminated externally, wherein said electromagnetic radiation is characterized by multiple wavelengths and varying intensities;

wherein said planar continuously tinted reference surface produces a tri-stimuli or tri-color gamut comprising a multiplicity of hues deposited on said tinted reference surface with a pre-determined intensity gradient;

wherein said planar continuously tinted reference surface may also include targetable features thereon; and

a navigational device including a source of illumination and an optoelectronic sensor sensitive to said emitted radiation and configured to move on said continuously tinted planar reference surface and further configured to cause said emission of said multiple wavelengths of radiation at varying intensities by using said source of illumination to illuminate said surface and to create and identify images of said targetable features when said targetable features are present;

wherein said navigational device is configured to receive and process said multiple wavelengths of radiation at varying intensities emitted by said continuously tinted planar reference surface and wherein said navigational device is also configured to simultaneously capture images of said targetable features located thereon when said targetable features are present;

wherein, by sensing and analyzing independent wavelength components or other independent electromagnetic properties of said radiation as a function of their various intensities emitted by said tinted planar reference surface, said navigational device is configured to determine its absolute position on said planar reference surface;

whereby said navigational device determines a continuous mapping from said absolute position on said 2D tinted planar reference surface to a 3D space characterized by a higher dimensional, 3D set of independent position and motion variables;

wherein said navigational device may also be configured to simultaneously determine its motion relative to said surface by an evaluation of relative positional changes of said identifiable features that may be thereon;

whereby, using said absolute position determination and said relative motion determination, said navigational device communicates its motion in a form configured for;

     1) generating linear and non-linear portions of the 3D motion of a cursor or of a graphically rendered object,

     2) providing corresponding 3D control of an electronic or electromechanical device,

     3) activating certain display or control functions.

2. The maneuvering system of claim 1 wherein variable intensities of independent, reflected wavelengths caused by illumination of said tinted planar reference surface by said source of illumination within said navigational device provide an absolute position on said tinted reference surface and whereby said absolute position further provides a continuous mapping from a 2D surface to a 3D space of a three dimensional graphical rendering device or provides 3D control of an electronic or electromechanical device.

3. The maneuvering system of claim 1 wherein said electronic or electromechanical device is a 3D printer.

4. The maneuvering system of claim 1 wherein said electronic or electromechanical device is a device for maneuvering a real physical object.

5. The maneuvering system of claim 1 wherein said emission from said tinted reference surface is caused by reflection or by fluorescence or by other forms of photo-emission or by interference or refraction of incident electromagnetic radiation from said source of illumination, or includes the effects of polarization change or phase change whereby a phase or a polarization of said incident radiation is changed and wherein intensities of said independent emitted radiation having said changed phase or polarization are detected and are converted to a three-dimensional mapping of a two-dimensional absolute position on said tinted reference surface.

6. The maneuvering system of claim 2 wherein said absolute two dimensional location determination provided by said electromagnetic radiation intensity data on said planar reference surface produces three-dimensional x, y and z data for positioning and moving a cursor or other graphically rendered object on a graphic rendering device in a manner that includes effects of non-linear components of said motion of and positioning said cursor or said graphically rendered object on a graphic rendering device and moving said cursor or said graphically rendered object in a three-dimensional manner and with subtlety and nuance provided by said non-linear components.

7. The maneuvering system of claim 1 wherein said reference surface has targetable features thereon and wherein absolute location determination by analysis of color intensities combined with relative motional data obtained by evaluation of said targetable features enables a graphically rendered object to be accurately positioned on a graphic rendering device and rotated through an angle about an axis or graphically rendered with perspective or zoomed in or out.

8. The maneuvering system of claim 1 comprising at least one light source configured to produce light reflection or emission of said multiple wavelengths of light from said tinted planar reference surface.

9. The maneuvering system of claim 8 wherein said at least one light source is a source of light of as many wavelengths as will produce a range of independent wavelengths within the range between IR and UV and including optical radiation to comprise a tri-stimuli gamut.

10. The maneuvering system of claim 1 wherein said tri-color gamut or said tri-stimuli gamut is produced by a distribution of spots of three independently colored dyes or pigments corresponding to said tri-coloration, where said dyes or pigments are blended in such a manner on said surface as to produce a variation of intensities of independent colors along three directions of motion.

11. The maneuvering system of claim 8 wherein said at least one light source is a variable intensity light source configured to illuminate said tinted planar reference surface with variations of said intensity and thereby producing a variation in intensity of any of said multiplicity of wavelengths of said emitted light.

12. The maneuvering system of claim 1 wherein said tinted planar reference surface enables at least one vanishing point to be defined whereby a graphic designer is enabled to produce perspective drawings to be rendered on a computer, a graphical rendering device or to implement an operation of an electronic or electromechanical device to facilitate 3D motions.

13. The maneuvering system of claim 12 wherein changing the intensity of illumination of said tinted planar reference surface enables the motion of a cursor in 3D space to proceed along any of a multiplicity of planes in said space selected by an operator and wherein said any of a multiplicity of planes may be tilted at an angle selected by an operator of said navigational device.

14. The maneuvering system of claim 1 wherein a combination of location determination on said tinted planar reference surface using multiple wavelength intensities from said tinted planar reference surface together with relative motion detection using the relative motion of identifiable targeted topological features on said planar reference surface permits the generation of fully three-dimensional motion including linear and non-linear portions, or of translational motion plus a separate rotational degree of freedom about an axis for use by a three-dimensional graphical rendering system or by an electronic or electromechanical system for facilitating 3D motions of real or virtual objects, using only linear motion of said navigational device along said planar reference surface.

15. The maneuvering system of claim 1 wherein said planar reference surface is reflectively tinted so that each individual position on said surface reflects radiation in a multiplicity of wavelengths, wherein said wavelengths do not interfere with each other and wherein each wavelength is reflected with a different intensity whereby a three-dimensional mapping of said two-dimensional planar reference surface is made onto a three-dimensional graphical rendering system.

16. The maneuvering system of claim 15 wherein said reflected radiation is the reflection of radiation emitted by at least one source of electromagnetic radiation within said navigational device.

17. The maneuvering system of claim 16 wherein said reflected radiation is captured by said navigational device and determines an absolute position of said device on said reference surface.

18. The maneuvering system of claim 1 wherein said planar reference surface is coated with a radiatively emissive coating so that each individual position on said surface emits radiation in a multiplicity of wavelengths and intensities that may be different from radiation emitted by sources within said navigational device, wherein said wavelengths are independent of each other and wherein each wavelength is emitted with a different intensity to produce a profile of wavelengths and their respective intensities to produce a three-dimensional mapping of said planar reference surface onto a three-dimensional graphical imaging system.

19. The maneuvering system of claim 1 wherein said navigational device comprises a body having a cavity opening onto said planar reference surface wherein said cavity further includes a source of illumination by electromagnetic radiation of multiple wavelengths and intensities configured to irradiate said planar reference surface and wherein said navigational device further includes a sensor of such radiation configured to capture independent wavelengths of reflections or other radiative emissions from said planar reference surface caused by said radiation impinging on said planar reference surface.

20. The maneuvering system of claim 19 wherein said planar reference surface is coated with color reflective material to reflect a continuous range of wavelengths and intensities characterized by a tri-color gamut corresponding to any of the appropriate sets of three independent colors.

21. The maneuvering system of claim 20 wherein changing the intensity of one or more of said multiple wavelengths of light of said navigational device while maintaining the intensity of remaining wavelengths causes a cursor or other object to zoom in or out or controls the position of a vanishing point.

22. The maneuvering system of claim 19 wherein said sensor creates a pixillated image frame capable of retaining a succession of images of the illuminated planar reference surface, wherein said images may be constructed of non-interfering reflected or emitted wavelengths of varying intensities from said planar reference surface or, independently, of identifiable topological features on said surface.

23. The maneuvering system of claim 19 wherein said sensor creates a sequence of pixillated image frames retaining a succession of images of the illuminated planar reference surface containing identifiable topological features on said surface and wherein a comparison of said images are used to extract translations and rotations of said navigational device whereby higher order terms (H.O.T) are identified and used to communicate subtle operator movements to said graphical rendering device.

24. The maneuvering system of claim 1 wherein a variation of the intensities of multiple wavelengths of light emitted by said navigational device allows a corresponding variation in a depth value and/or vanishing point of graphical images being rendered on said graphical rendering device.

25. The maneuvering system of claim 1 wherein a resolution and sensitivity are controlled by variations of the hue value of said planar reference surface.

26. The maneuvering system of claim 1 wherein a motional path of said navigational device along said planar reference surface is retraceable as a result of said tinted planar reference surface providing absolute positions of said navigational device.

27. The maneuvering system of claim 1 wherein wavelengths and other optical features of said radiation and their intensities are analyzed by said navigational device using analog circuitry clock-synchronized to optoelectronic image capturing circuitry.

28. The maneuvering system of claim 1 wherein said navigational device uses digital/analog hybrid circuitry to simultaneously capture relative motion of topological features and absolute positions resulting from hue evaluations.

29. The maneuvering system of claim 1 wherein said navigational device is a touch-screen device that comprises a body having an enclosed cavity having bottom and top surfaces, wherein said bottom surface of said cavity includes a plurality of widely separated light sources emitting different wavelengths of light at different intensities towards a top surface of said cavity and wherein a photo-sensor device is disposed between said light sources;

wherein said top surface of said cavity is covered by a Lambertian plate having an upper surface and a lower surface;

whereby light emitted by said light sources strike said lower surface of said Lambertian plate and are reflected downward in a diffuse manner whereby they impinge on said photo-sensor;

wherein finger pressure exerted on said upper surface of said Lambertian plate modifies said downward reflection in a manner that is sensed by said photo-sensor and is transmitted to a graphical rendering device.

30. The maneuvering system of claim 29 wherein a cursor or graphical object displayed on a graphical display device is oriented three-dimensionally by a movement of an operator'"'"'s finger.

31. The maneuvering system of claim 29 where said operator'"'"'s finger motion provides an innate relationship between said operator'"'"'s nuanced gestures and the responses of said cursor.

32. The maneuvering system of claim 1 wherein said tinted planar reference surface is tinted in a manner that provides independent variations of radiation wavelength and intensity along three directions of motion, whereby a mapping of said two-dimensional tinted planar reference surface and a three-dimensional graphical rendering space is obtained.

33. The maneuvering system of claim 28 wherein analog circuitry is used for analysis of electromagnetic radiation from said planar reference surface and wherein digital circuitry is used for analysis of the relative motion of targeted objects on said planar reference surface.

34. The maneuvering system of claim 33 wherein said analog circuitry compares multiple sets of hue intensity data and wherein said analog comparison provides a direction of motion or a displacement value for a cursor or graphically rendered object represented in a three dimensional coordinate system.

35. The maneuvering system of claim 24 wherein said depth values may be varied in such a way as to create a vanishing point at infinity and thereby to permit an operator to make full use of perspective in creating realistic three dimensional renderings.

36. The maneuvering system of claim 1 wherein, using only said absolute two dimensional motion and location determination provided by said electromagnetic wave intensity data on said planar reference surface and not using the relative motion of targetable features, three-dimensional x, y and z data is produced for positioning and moving a cursor or other graphically rendered object on a graphic rendering device in a manner that includes rotational and translational components of said motion of and positioning said cursor or said graphically rendered object on a graphic rendering device and moving said cursor or said graphically rendered object in a three-dimensional manner.

37. A three dimensional (3D) maneuvering device configured to generate a three dimensional mapping of a two dimensional surface, comprising an optoelectronic sensor configured for capturing images produced by electromagnetic radiation reflected or re-emitted from said two dimensional surface and a source for illuminating said two dimensional surface with said electromagnetic radiation at a multiplicity of wavelengths and with a variable intensity for each of said multiplicity of wavelengths and wherein said electromagnetic radiation is further characterized by variable polarization and phase;

wherein, by simultaneously capturing two images, said device acquires both a first set of data which is configured for measuring a displacement and a second set of data which is configured for the detection of motion having a linear and a non-linear part and wherein, by maintaining a sensitivity and resolution of said optoelectronic sensor for said displacement measurement while said source of electromagnetic radiation varies said intensity, polarization and phase of said electromagnetic radiation, said non-linear part of said motion is determined.

38. A three-dimensional (3D) maneuvering device comprising:

a device configured for moving on a planar reference surface and for mapping its two-dimensional motion into a three-dimensional display space, said device including a source of electromagnetic radiation for illuminating said planar reference surface while said device moves thereon and an optoelectronic sensor for capturing, images or other analog motional or positional data from said planar reference surface while said device moves thereon;

wherein

while said images or other data are being captured, as a result of said illumination said planar reference surface emits a plurality of electromagnetic waves caused by reflection, refraction, interference, photo-emission, fluorescence, and characterized by different intensities, wavelengths, polarizations, phases, wherein;

said emissions vary along a trajectory on said planar reference surface having a predetermined profile thereon characterized by a fixed or changeable mathematical function or a set of parameters, wherein said emissions are captured by said optoelectronic sensor and said function or parameters characterizing said emissions are recognizable by said device or by electronic links to said device;

whereby

when said mathematical function is fixed, said motional or positional data along said trajectory is associated by said device with a specific geometrical pattern in three-dimensional space; and

when said mathematical function is changed, said trajectory produces a different set of data and a different geometrical pattern in three-dimensional space will then be associated with said data.