UTILIZING A MOBILE DEVICE AS A MOTION-BASED CONTROLLER

• US 20160321917A1
• Filed: 04/22/2016
• Published: 11/03/2016
• Est. Priority Date: 04/30/2015
• Status: Abandoned Application

• Current Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Original Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Inventors: Yun, Sangki, Chen, Yi-Chao, Qiu, Lili
• Application Number:
  US15/135,877
• Publication Number:
  US 20160321917A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 5/0264 at least one of the systems being a non-radio wave positioning system
• CPC Class Codes: G01S 5/0278 involving statistical or probabilistic considerations G01S5/0252, G01S5/0294 take precedence
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G01S 5/30 Determining absolute distances from a plurality of spaced points of known location
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G08C 23/02 using infrasonic, sonic or ultrasonic waves
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

A method, system and computer program product for accurately tracking the position of a mobile device. The microphone on a mobile device receives acoustic signals at a few selected frequencies from a device to be controlled by the mobile device. The frequency shifts are used to estimate the speed and distance traveled. The distance between the speakers of the device to be controlled is calibrated and the mobile device'"'"'s initial position is narrowed down using its movement trajectory. Based on the information, the mobile device'"'"'s new position is continuously tracked in real time. Hence, movement of the mobile device can be accurately tracked, thereby allowing the mobile device to be realized as a motion-based controller (e.g., mouse, game controller, controller for Internet of Things).

Claims

1. A method for utilizing a mobile device as a motion-based controller, the method comprising:

determining a distance between two or more speakers of a device to be controlled by said mobile device;

receiving inaudible acoustic signals by said mobile device with a microphone from said device;

recording said inaudible acoustic signals;

estimating a frequency shift using said recorded inaudible acoustic signals;

estimating a velocity of said mobile device using said estimated frequency shift;

estimating distances said mobile device is located from each of said two or more speakers using said estimated velocity and a previous position of said mobile device; and

determining, by a processor, a current location of said mobile device using said estimated distances said mobile device is located from said two or more speakers, said distance between said two or more speakers of said device and said previous position of said mobile device.

2. The method as recited in claim 1, wherein said two or more speakers generate said inaudible acoustic signals at different frequencies.

3. The method as recited in claim 2 further comprising:

applying a maximal ratio combining technique to said inaudible acoustic signals at said different frequencies to remove outliers.

4. The method as recited in claim 1 further comprising:

calibrating said distance between said two or more speakers of said device.

5. The method as recited in claim 4, wherein said calibration comprises movement of said mobile device back and forth across said device.

6. The method as recited in claim 1 further comprising:

generating particles corresponding to possible initial locations of said mobile device; and

filtering said particles whose locations are inconsistent with said estimated velocity.

7. The method as recited in claim 6 further comprising:

estimating a current position of said mobile device using a centroid of remaining particles not filtered.

8. A method for utilizing a mobile device as a motion-based controller, the method comprising:

determining a distance between a speaker and a wireless transmitter of a wireless device;

receiving an inaudible acoustic signal by said mobile device with a microphone from a device with said speaker to be controlled by said mobile device;

receiving a radio frequency signal from said wireless device;

recording said inaudible acoustic signal and said radio frequency signal;

estimating a phase of said radio frequency signal;

estimating a distance said mobile device is located from said wireless transmitter using said estimated phase of said radio frequency signal and a previous position of said mobile device;

estimating a frequency shift using said recorded inaudible acoustic signal;

estimating a velocity of said mobile device from said speaker using said estimated frequency shift;

estimating a distance said mobile device is located from said speaker using said estimated velocity and said previous position of said mobile device; and

determining, by a processor, a current location of said mobile device using said estimated distance said mobile device is located from said speaker, said estimated distance said mobile device is located from said wireless transmitter, said distance between said speaker and said wireless transmitter of said wireless device and said previous position of said mobile device.

9. The method as recited in claim 8, wherein said radio frequency signal is a Wi-Fi signal, a Bluetooth signal or a wireless signal.

10. A method for utilizing a mobile device as a motion-based controller, the method comprising:

determining a distance between two or more speakers of a device to be controlled by said mobile device;

determining a distance between each of said two or more speakers of said device and a wireless transmitter of a wireless device;

receiving inaudible acoustic signals by said mobile device with a microphone from said device;

receiving a radio frequency signal from said wireless device;

recording said inaudible acoustic signals and said radio frequency signal;

estimating a phase of said radio frequency signal;

estimating a distance said mobile device is located from said wireless transmitter of said wireless device using said estimated phase of said radio frequency signal and a previous position of said mobile device;

estimating a frequency shift using said recorded inaudible acoustic signals;

estimating a velocity of said mobile device towards each of said two or more speakers using said estimated frequency shift;

estimating distances said mobile device is located from each of said two or more speakers using said estimated velocity and said previous position of said mobile device; and

determining, by a processor, a current location of said mobile device using said estimated distances said mobile device is located from each of said two or more speakers, said estimated distance said mobile device is located from said wireless transmitter of said wireless device, said distance between said two or more speakers of said device, said distance between each of said two or more speakers of said device and said wireless transmitter of said wireless device and said previous position of said mobile device.

11. The method as recited in claim 10, wherein said radio frequency signal is a Wi-Fi signal, a Bluetooth signal or a wireless signal.

12. A computer program product for utilizing a mobile device as a motion-based controller, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code comprising the programming instructions for:

determining a distance between two or more speakers of a device to be controlled by said mobile device;

receiving inaudible acoustic signals by said mobile device with a microphone from said device;

recording said inaudible acoustic signals;

estimating a frequency shift using said recorded inaudible acoustic signals;

estimating a velocity of said mobile device using said estimated frequency shift;

estimating distances said mobile device is located from each of said two or more speakers using said estimated velocity and a previous position of said mobile device; and

determining a current location of said mobile device using said estimated distances said mobile device is located from said two or more speakers, said distance between said two or more speakers of said device and said previous position of said mobile device.

13. The computer program product as recited in claim 12, wherein said two or more speakers generate said inaudible acoustic signals at different frequencies.

14. The computer program product as recited in claim 13, wherein the program code further comprises the programming instructions for:

applying a maximal ratio combining technique to said inaudible acoustic signals at said different frequencies to remove outliers.

15. The computer program product as recited in claim 12, wherein the program code further comprises the programming instructions for:

calibrating said distance between said two or more speakers of said device.

16. The computer program product as recited in claim 15, wherein said calibration comprises movement of said mobile device back and forth across said device.

17. The computer program product as recited in claim 12, wherein the program code further comprises the programming instructions for:

generating particles corresponding to possible initial locations of said mobile device; and

filtering said particles whose locations are inconsistent with said estimated velocity.

18. The computer program product as recited in claim 17, wherein the program code further comprises the programming instructions for:

estimating a current position of said mobile device using a centroid of remaining particles not filtered.

19. A computer program product for utilizing a mobile device as a motion-based controller, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code comprising the programming instructions for:

determining a distance between a speaker and a wireless transmitter of a wireless device;

receiving an inaudible acoustic signal by said mobile device with a microphone from a device with said speaker to be controlled by said mobile device;

receiving a radio frequency signal from said wireless device;

recording said inaudible acoustic signal and said radio frequency signal;

estimating a phase of said radio frequency signal;

estimating a distance said mobile device is located from said wireless transmitter using said estimated phase of said radio frequency signal and a previous position of said mobile device;

estimating a frequency shift using said recorded inaudible acoustic signal;

estimating a velocity of said mobile device from said speaker using said estimated frequency shift;

estimating a distance said mobile device is located from said speaker using said estimated velocity and said previous position of said mobile device; and

determining a current location of said mobile device using said estimated distance said mobile device is located from said speaker, said estimated distance said mobile device is located from said wireless transmitter, said distance between said speaker and said wireless transmitter of said wireless device and said previous position of said mobile device.

20. The computer program product as recited in claim 19, wherein said radio frequency signal is a Wi-Fi signal, a Bluetooth signal or a wireless signal.

21. A mobile device, comprising:

a memory unit for storing a computer program for utilizing said mobile device as a motion-based controller; and

a processor coupled to the memory unit, wherein the processor is configured to execute the program instructions of the computer program comprising;

determining a distance between two or more speakers of a device to be controlled by said mobile device;

receiving inaudible acoustic signals by said mobile device with a microphone from said device;

recording said inaudible acoustic signals;

estimating a frequency shift using said recorded inaudible acoustic signals;

estimating a velocity of said mobile device using said estimated frequency shift;

estimating distances said mobile device is located from each of said two or more speakers using said estimated velocity and a previous position of said mobile device; and

determining a current location of said mobile device using said estimated distances said mobile device is located from said two or more speakers, said distance between said two or more speakers of said device and said previous position of said mobile device.

22. The mobile device as recited in claim 21, wherein said two or more speakers generate said inaudible acoustic signals at different frequencies.

23. The mobile device as recited in claim 22, wherein the program instructions of the computer program further comprise:

applying a maximal ratio combining technique to said inaudible acoustic signals at said different frequencies to remove outliers.

24. The mobile device as recited in claim 21, wherein the program instructions of the computer program further comprise:

calibrating said distance between said two or more speakers of said device.

25. The mobile device as recited in claim 24, wherein said calibration comprises movement of said mobile device back and forth across said device.

26. The mobile device as recited in claim 21, wherein the program instructions of the computer program further comprise:

generating particles corresponding to possible initial locations of said mobile device; and

filtering said particles whose locations are inconsistent with said estimated velocity.

27. The mobile device as recited in claim 26, wherein the program instructions of the computer program further comprise:

estimating a current position of said mobile device using a centroid of remaining particles not filtered.

28. A mobile device, comprising:

a memory unit for storing a computer program for utilizing said mobile device as a motion-based controller; and

a processor coupled to the memory unit, wherein the processor is configured to execute the program instructions of the computer program comprising;

determining a distance between a speaker and a wireless transmitter of a wireless device;

receiving an inaudible acoustic signal by said mobile device with a microphone from a device with said speaker to be controlled by said mobile device;

receiving a radio frequency signal from said wireless device;

recording said inaudible acoustic signal and said radio frequency signal;

estimating a phase of said radio frequency signal;

estimating a distance said mobile device is located from said wireless transmitter using said estimated phase of said radio frequency signal and a previous position of said mobile device;

estimating a frequency shift using said recorded inaudible acoustic signal;

estimating a velocity of said mobile device from said speaker using said estimated frequency shift;

estimating a distance said mobile device is located from said speaker using said estimated velocity and said previous position of said mobile device; and

determining a current location of said mobile device using said estimated distance said mobile device is located from said speaker, said estimated distance said mobile device is located from said wireless transmitter, said distance between said speaker and said wireless transmitter of said wireless device and said previous position of said mobile device.

29. The mobile device as recited in claim 28, wherein said radio frequency signal is a Wi-Fi signal, a Bluetooth signal or a wireless signal.