Auto-correction for mobile receiver with pointing technology

• US 10,133,411 B2
• Filed: 06/11/2010
• Issued: 11/20/2018
• Est. Priority Date: 06/11/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Eruchimovitch, Baruch, Sheynblat, Leonid
• Primary Examiner(s): Haley, Joseph
• Assistant Examiner(s): Frank, Emily
• Application Number:
  US12/814,340
• Publication Number:
  US 20110304537A1
• Time in Patent Office: 3,084 Days
• Field of Search: 345156, 345179, 178 1901- 1907
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

A mobile station and unattached work area is used with an electronic pen, which includes a transmitter, such as an acoustic transmitter. The mobile station includes a receiver that receives signals from the transmitter and orientation sensors that detect movement of the mobile station. The position of the receiver is calibrated with respect to the unattached work area. Data from the orientation sensors is received when the mobile station, and thus, the receiver is moved with respect to the work area. A transformation matrix is generated based on the data from the orientation sensors, which can be used to correct for the movement of the receiver. The position of the transmitter in the electronic pen is calculated and mapped based on received signals and the transformation matrix and the mapped position is then displayed.

Claims

1. A method comprising:

receiving acoustic signals, emitted by a transducer, with a receiver, the transducer being included in a transmitter unit of an electronic pen, the electronic pen being configured to engage a work area of a writing surface that is unattached to the receiver, one or both of the work area and the receiver being subject to extraneous sources causing a relative movement of the receiver with respect to the work area;

after defining an initial position of the receiver relative to the work area, receiving data from orientation sensors coupled to the receiver, the orientation sensors being configured to detect a movement of the receiver;

detecting a change in the position of the receiver relative to the work area using the data from the orientation sensors;

calculating and mapping a position of the transmitter with respect to the work area using the received acoustic signals and a transformation matrix, the transformation matrix being generated according to the change in the position of the receiver relative to the work area and being configured to correct for the relative movement of the receiver with respect to the work area; and

displaying the mapped position of the transmitter with respect to the work area.

2. The method of claim 1, wherein the receiver and the orientation sensors are in a mobile station.

3. The method of claim 1, wherein the electronic pen is a writing instrument.

4. The method of claim 3, further comprising receiving orientation signals for an orientation of the writing instrument and using the orientation signals to determine that the writing instrument is in use.

5. The method of claim 1, further comprising receiving orientation signals for an orientation of the transmitter and using the orientation signals to determine the orientation of the transmitter with respect to the receiver.

6. The method of claim 5, further comprising determining the position of the receiver in an external reference frame and determining the position of the transmitter in the external reference frame using the orientation of the transmitter with respect to the receiver and the position of the receiver in the external reference frame.

7. The method of claim 1, wherein the orientation sensors are accelerometers.

8. The method of claim 1, wherein the receiver is an acoustic receiver and the transmitter is an acoustic transmitter.

9. The method of claim 8, wherein the acoustic receiver receives ultrasonic signals.

10. The method of claim 1, further comprising:

generating a second transformation matrix using the received data from the orientation sensors to correct for additional movement of the receiver with respect to the work area;

calculating and mapping the position of the transmitter with respect to the work area using received signals from the transmitter on the transmitter and the second transformation matrix; and

displaying the mapped position of the transmitter.

11. The method of claim 1, further comprising:

defining the initial position of the receiver by performing a calibration procedure in which an initial receiver coordinate system is established relative to the work area; and

establishing a new receiver coordinate system in response to the detecting of the change in the position of the receiver relative to the work area, wherein the transformation matrix is used to transform a calculated position of the transmitter in the new receiver coordinate system into the position of the transmitter in the initial receiver coordinate system.

12. The method of claim 1, further comprising:

defining the initial position of the receiver by performing a calibration procedure in which an initial receiver coordinate system is established relative to the work area; and

establishing a new receiver coordinate system in response to the detecting of the change in the position of the receiver relative to the work area, wherein the transformation matrix is used to transform previously calculated positions of the transmitter in the initial receiver coordinate system into positions in the new receiver coordinate system.

13. An apparatus comprising:

a receiver for receiving acoustic signals, emitted by a transducer, with a receiver, the transducer being included in a transmitter unit of an electronic pen, the electronic pen being configured to engage a work area of a writing surface that is unattached to the receiver;

orientation sensors, coupled with the receiver, for detecting a movement of the receiver with respect to the work area;

a display;

a processor connected to the receiver, the orientation sensors and the display;

memory connected to the processor; and

software held in the memory and run in the processor to cause the processor to;

define an initial position of the receiver relative to the work area;

detect a change in the position of the receiver relative to the work area using the data from the orientation sensors;

calculate and map a position of the transmitter with respect to the work area using the received acoustic signals and a transformation matrix, the transformation matrix being generated according to the change in the position of the receiver relative to the work area and being configured to correct for the movement of the receiver with respect to the work area; and

display the mapped position of the transmitter with respect to the work area, in the display.

14. The mobile station of claim 13, wherein the electronic pen is a writing instrument.

15. The mobile station of claim 14, wherein signals from the transmitter comprises orientation signals for the orientation of the writing instrument, wherein the software causes the processor to use the received orientation signals to determine that the writing instrument is in use.

16. The mobile station of claim 13, wherein signals from the transmitter comprises orientation signals for the orientation of the transmitter, wherein the software causes the processor to use the received orientation signals to determine the orientation of the transmitter with respect to the receiver.

17. The mobile station of claim 16, further comprising a satellite positioning system receiver coupled to provide received satellite positioning system signals to the processor, wherein the software causes the processor to use the received satellite positioning system signals to determine the position of the receiver in an external reference frame, the software further causes the processor to determine the position of the transmitter in the external reference frame using the orientation of the transmitter with respect to the receiver and the position of the receiver in the external reference frame.

18. The mobile station of claim 13, wherein the orientation sensors are accelerometers.

19. The mobile station of claim 13, wherein the receiver is an acoustic receiver and the transmitter is an acoustic transmitter.

20. The mobile station of claim 19, wherein the acoustic receiver receives ultrasonic signals.

21. The mobile station of claim 13, wherein the software held in the memory and run in the processor causes the processor to discontinue calculating and mapping the position of the transmitter while the receiver is moving with respect to the work area.

22. The mobile station of claim 13, wherein the software held in the memory and run in the processor causes the processor to generate a second transformation matrix using the data from the orientation sensors to correct for additional movement of the receiver with respect to the work area;

calculate and map the position of the transmitter with respect to the work area using received signals from the transmitter and the second transformation matrix; and

display the mapped position of the transmitter in the display.

23. The mobile station of claim 13, wherein the software held in the memory and run in the processor causes the processor to:

define the initial position of the receiver by performing a calibration procedure in which an initial receiver coordinate system is established relative to the work area;

establish a new receiver coordinate system in response to the detecting of the change in the position of the receiver relative to the work area; and

use the transformation matrix to transform a calculated position of the transmitter in the new receiver coordinate system into the position of the transmitter in the initial receiver coordinate system.

24. The mobile station of claim 13, wherein the software held in the memory and run in the processor causes the processor to:

define the initial position of the receiver by performing a calibration procedure in which an initial receiver coordinate system is established relative to the work area;

establish a new receiver coordinate system in response to the detecting of the change in the position of the receiver relative to the work area; and

use the transformation matrix to transform previously calculated positions of the transmitter in the initial receiver coordinate system into positions in the new receiver coordinate system.

25. A system comprising:

a receiver for receiving acoustic signals, emitted by a transducer, with a receiver, the transducer being included in a transmitter unit of an electronic pen, the electronic pen being configured to engage a work area of a writing surface that is unattached to the receiver one or both of the work area and the receiver being subject to extraneous sources causing a relative movement of the receiver with respect to the work area;

a processor connected to the receiver and receiving data from orientation sensors coupled to the receiver, the orientation sensors being configured to detect movement of the receiver with respect to the work area of the writing surface;

memory connected to the processor; and

software held in the memory and run in the processor to cause the processor to;

define an initial position of the receiver relative to the work area;

detect a change in the position of the receiver relative to the work area using the data from the orientation sensors; and

calculate and map a position of the transmitter with respect to the work area using the received acoustic signals and a transformation matrix, the transformation matrix being generated according to the change in the position of the receiver relative to the work area and being configured to correct for the relative movement of the receiver with respect to the work area; and

means for displaying the mapped position of the transmitter with respect to the work area.

26. The system of claim 25, wherein:

the sensors are configured to detect movement of the receiver.

27. The system of claim 25, wherein the electronic pen is a writing instrument.

28. The system of claim 25, wherein the receiver is an acoustic receiver and the transmitter is an acoustic transmitter.

29. The system of claim 28, wherein the acoustic receiver receives ultrasonic signals.

30. A non-transitory computer-readable medium including program code stored thereon, comprising:

program code to calculate and map a position of a receiver with respect to a work area of a writing surface that is unattached to the receiver, one or both of the work area and the receiver being subject to extraneous sources causing a relative movement of the receiver with respect to the work area of the writing surface, the receiver being configured to receive acoustic signals, emitted by a transducer, the transducer being included in a transmitter of an electronic pen, the electronic pen being configured to engage the work area of the writing surface;

program code to define an initial position of the receiver relative to the work area;

program code to detect a change in the position of the receiver relative to the work area using data received from orientation sensors coupled to the receiver, the orientation sensors being configured to detect the relative movement of the receiver with respect to the work area of the writing surface;

program code to generate a transformation matrix according to the change in the position of the receiver relative to the work area, the transformation matrix being configured to correct for the relative movement of the receiver with respect to the work area;

program code to calculate and map the position of a transmitter with respect to the work area using the received acoustic signals and the transhformation matrix; and

program code to display the mapped position of the transmitter.