Method and device for capturing and processing graphical information

• US 5,717,168 A
• Filed: 06/22/1995
• Issued: 02/10/1998
• Est. Priority Date: 11/17/1992
• Status: Expired due to Fees

• Current Assignee: Lectra SA
• Original Assignee: Lectra Systemes
• Inventors: Gilliard, Laurent, DeBuisser, Thomas, Lerisson, Jean-Pierre
• Primary Examiner(s): Kuntz, Curtis
• Assistant Examiner(s): Shankar, Vijay
• Application Number:
  US08/436,307
• Time in Patent Office: 964 Days
• Field of Search: 178/18, 178/19, 345/158, 345/173, 345/176, 345/177, 345/179, 382/119, 382/120, 382/121, 382/122, 382/187
• US Class Current: 178/18.04
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

Ultrasound pulses are emitted by two emitters (12, 14) carried by an instrument (10) and substantially aligned with the tip of the instrument. Several receivers (62a, . . . , 62e) occupy determined positions with respect to the support (50) on which a trace is made with the tip of the instrument so that ultrasound pulses emitted from any point on the surface of the support are received by more than two receivers. The times of propagation of the ultrasound pulses between each of the emitters and receivers are measured in order to evaluate the coordinates of the vector defined by the positions of the two emitters and to deduce therefrom the position of the tip of the instrument on the support, and at least one of the two instrument orientation cues consisting of the inclination of the longitudinal direction of the instrument with respect to the support and the angular position of the instrument about an axis making a predetermined angle with respect to the support. The pressure exerted on the support by the tip of the instrument is moreover detected in such a way as to determine a stroke width cue dependent on at least one of the orientation and pressure cues, on a stroke width cue, and to associate with a cue representing the position of the tip of the instrument, a cue representing the stroke width for this position.

Claims

1. A method of capturing and processing graphical data representative of a trace made on a surface of a neutral support by means of a tip of an instrument, comprising the steps of:

emitting a plurality of ultrasound pulses by means of at least two ultrasound wave emitters carried by the instrument and spaced apart in a longitudinal direction of the instrument, and substantially aligned with the tip of the instrument,

receiving the ultrasound pulses by several ultrasound wave receivers occupying positions determined with respect to the support, such that ultrasound pulses emitted from any point on the surface are received by more than two receivers,

measuring a plurality of propagation times of the ultrasound pulses between each of the emitters and receivers,

evaluating, from the measured propagation times, a plurality of coordinates of at least one vector defined by the positions of the two emitters carried by the instrument,

determining, from the evaluation of the coordinates of the vector, a position of the tip of the instrument on the support, and at least one of two instrument orientation cues consisting of an inclination of the longitudinal direction of the instrument with respect to the support and an angular position of the instrument about an axis making a predetermined angle with respect to the support,

detecting a pressure exerted on the support by the tip of the instrument,

transmitting a cue representative of the detected pressure and

determining, as a function of at least one of the orientation and pressure cues, a stroke width cue, so as to associate a cue representing the position of the tip of the instrument with a cue representing the stroke width for the position of the tip of the instrument.

2. The method recited in claim 1, wherein, for evaluating the coordinates of the vector defined by the positions of the two emitters, an erroneous or anomalous measurement can be detected and discarded by using a redundant number of propagation time measurements.

3. The method recited in claim 1, wherein the orientation cues of the instrument are determined from the measurement of an amplitude and a direction of the projection onto the support of the vector defined by the positions of the two emitters.

4. The method recited in claim 1, wherein the emission of the ultrasound pulses and the commencement of the measurement of the propagation time of the ultrasound pulses up to the receivers are synchronized by transmitting infrared pulses from the instrument, and the cue representative of the pressure exerted on the tip of the instrument is transmitted by modulation of the infrared pulses.

5. The method recited in claim 1 further comprising the step of selecting a type of writing implement simulated by the instrument and determining a stroke width on the basis of a plurality of prerecorded cues giving, for various writing implements, a relation between the width of stroke traced with a tip of the writing implement on a surface and at least one cue from among an inclination of a longitudinal direction of the writing implement with respect to the surface, an angular position of the writing implement about an axis making a predetermined angle with respect to the surface, and a pressure exerted on the tip of the writing implement.

6. The method recited in claim 1, wherein the ultrasound pulses are emitted at a frequency at least equal to 50 Hz allowing acquisition of the coordinates of at least 50 vectors per second.

7. The method recited in claim 1, further comprising the steps of periodically emitting and receiving an ultrasound pulse by means of an emitter and a receiver, each occupying a predetermined fixed relative position so as to provide a reference value of a speed of propagation of the ultrasound waves in an ambient environment.

8. The method recited in claim 1, further comprising the step of selecting a stroke color and determining a colour density cue on the basis of the cue representing the pressure exerted on the tip of the instrument, so as additionally to associate the cue representing the position of tip of the instrument with a cue representing the color of the trace for the position of the tip of the instrument.

9. The method recited in claim 1, further comprising the step of selecting a stroke color, different colours being selectable for a plurality of portions of the trace, and associating the cue representing the position of the tip of the instrument with a cue representing the color of the trace for the position of the tip of the instrument, the trace color cue being

either the stroke color selected for a portion of the trace on which the position of the tip of the instrument lies,

a color saturation selected when the position of the tip of the instrument is at an intersection of a plurality of trace portions for which the same color has been selected,

or a mixture of colors selected when the position of the tip of the instrument is at an intersection of a plurality of trace portions for which different colors have been selected.

10. The method recited in claim 1, wherein the position and stroke width cues are used to control a displaying of the trace made with the tip of the instrument and a back-projection onto the support of the displayed trace, so that the back-projection appears in real time under the tip of the instrument.

11. The method recited in claim 1, further comprising the step of displaying at least one menu in a zone of the surface of the support and selecting an option from the displayed menu, in response to a detection of the position of the tip of the instrument at a location corresponding to the selected option.

12. The method recited in claim 11, wherein a plurality of menus are displayed in a viewing zone of the surface of the support and wherein a desired menu is selected in response to a detecting of the tip of the instrument in a predetermined region of a working area of the support, outside and adjacent to the viewing zone.

13. The method recited in claim 11, wherein the displayed menu makes it possible to select a particular type of writing implement whose use is simulated, the gauge of this implement, and a stroke color for this implement.

14. The method recited in claim 11, wherein the displayed menu makes it possible to select a drawing management function chosen in particular from a group of functions, the group including an erase function, a modify function, a save function, a copy function, and a paste function.

15. A device for capturing and processing graphical data representative of a trace made on a surface of a support by means of a tip of an instrument, comprising:

at least two ultrasound wave emitters carried by the instrument and spaced apart in a longitudinal direction of the instrument,

a voltage pulse generating circuit connected to the emitters in order to effect the emission of ultrasound pulse trains,

a plurality of ultrasound wave receivers occupying positions determined with respect to the support in such a way that ultrasound pulses emitted from any point on the surface are received by more than two receivers,

means for detecting a pressure exerted on the tip of the instrument,

means for transmitting a pressure cue representative of the detected pressure, and

a processing circuit connected to the ultrasound wave receivers and receiving the pressure cue, the processing circuit comprising;

means for measuring a plurality of propagation timers of the ultrasound pulses between each of the emitters and receivers,

means for evaluating, from the measured propagation times, a plurality of coordinates of at least one vector defined by the positions of the two emitters carried by the instrument

means for determining, from the evaluation of the coordinates of the vector, a position of the tip of the instrument on the support, and at least one of two instrument orientation cues consisting of an inclination of the longitudinal direction of the instrument with respect to the support and an angular position of the instrument about an axis making a predetermined angle with respect to the support, and

means for determining, as a function of at least one of the orientation and pressure cues, a stroke width cue, so as to associate a cue representing the position of the tip of the instrument with a cue representing the stroke width for the position of the tip of the instrument.

16. The device recited in claim 15, wherein the voltage pulse generating circuit has a frequency which varies as a function of the detected pressure.

17. The device recited in claim 15, further comprising means for storing cues representing, for various types of writing implements, a predetermined relation between the stroke width and at least one of the said orientation and pressure cues.

18. The device recited in claim 15, further comprising means for selecting a stroke color and wherein the processing circuit further comprises means for associating the cue representing the position of the tip of the instrument with a trace color cue for the position of the tip of the instrument.

19. The device recited in claim 18, wherein the processing circuit further comprises means for associating the position cue for the tip of the instrument with a trace color cue, the trace color cue being:

either the stroke color selected for a portion of the trace on which the position of the tip of the instrument lies,

a color saturation selected when the position of the tip of the instrument is at an intersection of a plurality of trace portions for which the same color has been selected,

or a mixture of colors selected when the position of the tip of the instrument is at an intersection of a plurality of trace portions for which different colors have been selected.

20. The device recited in claim 18, further comprising means for storing, for at least certain types of simulated writing implements, a relation between the selected color of stroke, the trace color corresponding to the selected color of stroke, and a color density, the colour density depending on the pressure exerted on the tip of the implement.

21. The device recited in claim 18, further comprising means for displaying in real time an image of the trace reproducing the position, stroke width and trace color cues.

22. The device recited in claim 21, wherein the display means include a device for back-projecting onto the support made from a translucent material so that an image of the trace appears in real time under the tip of the instrument.

23. The device recited in claim 15, wherein the receivers are arranged on a same line along one side of a working area.

24. The device recited in claim 15, wherein the ultrasound wave emitters and receivers are comprised of a plurality of directional transducers.

25. The device recited in claim 15, further comprising:

at least one infrared wave emitter carried by the instrument,

means for applying pulses to the infrared wave emitter in synchronism with the application of pulses to the ultrasound wave emitters, and

at least one infrared wave receiver carried by the support.

26. The device recited in claim 25, further comprising two infrared wave emitters linked in parallel and fixed at two opposite locations of the instrument.

27. The device recited in claim 15, further comprising at least one additional ultrasound wave emitter and receiver, each occupying a predetermined fixed relative position, and wherein the processing circuit further comprises means for measuring a time of propagation of ultrasound waves between the additional emitter and receiver so as to compile a cue representative of a speed of propagation of the ultrasound waves.