User interfaces

• US 9,329,728 B2
• Filed: 10/07/2010
• Issued: 05/03/2016
• Est. Priority Date: 10/07/2009
• Status: Active Grant

• Current Assignee: Elliptic Laboratories AS
• Original Assignee: Elliptic Laboratories AS
• Inventors: Dahl, Tobias
• Primary Examiner(s): Johnson, Gerald
• Assistant Examiner(s): JAVED, MAHEEN I
• Application Number:
  US13/500,898
• Publication Number:
  US 20120313900A1
• Time in Patent Office: 2,035 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01S 2013/466 by Trilateration, i.e. two antennas or two sensors determine separately the distance to a target, whereby with the knowledge of the baseline length, i.e. the distance between the antennas or sensors, the position data of the target is determined
• CPC Class Codes: G01S 2013/468 by Triangulation, i.e. two antennas or two sensors determine separately the bearing, direction or angle to a target, whereby with the knowledge of the baseline length, the position data of the target is determined
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

A first electronic device is operated in the presence of a second electronic device. Both are configured to transmit acoustic signals, the first being configured to transmit signals with a first characteristic. The first device determines the presence of the second device and thereafter transmits acoustic signals having a second, signal characteristic, different from the first characteristic, and giving a reduced interference between signals transmitted from the first and second devices respectively than the first signal characteristic. Acoustic signals comprising reflections of the transmitted signals from an object are received at the first device, and are used to characterise the motion of the object and thereby control a function of the first device.

Claims

1. A method of operating a first handheld electronic device in the presence of a second handheld electronic device wherein the first and second devices are configured to transmit acoustic signals the for user input detection, the first device being configured to transmit first acoustic signals with a first signal characteristic, the method comprising:

the first device determining the presence of the second device;

when the second device is determined to be present, thereafter altering a transmission of the first device so as to transmit second acoustic signals from the first device, the second acoustic signals having a second signal characteristic, different from the first signal characteristic;

receiving said second acoustic signals at the first device, the second acoustic signals comprising reflections of the transmitted second acoustic signals from an object; and

using the received second signals to characterize the motion of the object and thereby to control a function of the first device,

wherein the second signal characteristic gives a reduced interference between acoustic signals transmitted from the first and second devices respectively than the first signal characteristic.

2. The method as claimed in claim 1 wherein the transmit signals are periodic or quasi-periodic so as to define a frame rate, and the first and second signal characteristics comprise different respective frame rates.

3. The method as claimed in claim 2 wherein the second signal characteristic comprises a frame rate more than 10percent different from a frame rate of signals transmitted by the second device.

4. The method as claimed in claim 1 wherein the difference between the first and second signal characteristics is a fixed time offset between the transmission of the signals having the first characteristic and the signals having the second characteristic.

5. The method as claimed in claim 4 wherein the transmit signals are periodic or quasi-periodic so as to define a frame rate, and wherein the fixed time offset is caused by altering the length of one or more frames.

6. The method as claimed in claim 5 where the length of the frame(s) is lengthened by introducing a period in which the first device does not transmit.

7. The method as claimed in claim 1 comprising detecting the signals of the second device indirectly as an interference effect on the signals received by the first device arising from transmissions by the first device itself.

8. The method as claimed in claim 1 wherein the first device and the second device transmit acoustic signals having the same encoding.

9. The method as claimed in claim 1 comprising the first device starting to use an increased portion of a time-frequency resource in response to detecting the presence of a noise or interfering source.

10. The method as claimed in claim 9 comprising the first device detecting when the noise or interfering source has gone, and reducing its time-frequency resource consumption.

11. The method as claimed in claim 1 comprising the first device, in response to detecting the presence of a noise or interfering source, starting to transmit signals of greater duration or bandwidth or intensity than the signals it transmitted immediately preceding the detection.

12. The method as claimed in claim 1 wherein the first device determines the presence of the second device by the acoustic signals the second device transmits.

13. The method as claimed in claim 12 comprising the first device recognizing one or more of a frequency, pattern of frequencies, spread of frequencies, change of frequencies, timing, or repetition rate of a signal to determine the presence of the second device.

14. The method as claimed in claim 1 comprising the first device transmitting signals at a frame rate, and changing the frame rate at intervals or continuously.

15. The method as claimed in claim 14 comprising the first device changing the frame rate and comparing signals received before the change with signals received after the change.

16. The method as claimed in claim 1 comprising the first device determining the presence of a second device using a separate communication channel from that used by the transmitted signals.

17. The method as claimed in claim 1 wherein the first device receives information over the communication channel from the second device and adjusts its transmissions on the basis of the information.

18. The method as claimed in claim 17 wherein the communication channel is two-way.

19. The method as claimed in claim 17 wherein the first device and the second device communicate to coordinate adjustments to their transmissions so as to reduce or minimize or substantially eradicate interference in motion characterization operations of both devices.

20. The method as claimed in claim 1 comprising one of a plurality of communicating devices directing adjustments in transmissions by the other device or devices.

21. The method as claimed in claim 1 comprising the first device ceasing transmitting signals while it receives signals from another device, and processing the received signals to determine information from or about the second device.

22. The method as claimed in claim 1 comprising iteratively adjusting the transmissions of the first and/or a second device, and attempting to characterize the motion of an object, over a number of iterations, in order to determine an adjustment that improves the accuracy of the motion characterization.

23. The method as claimed in claim 1 comprising tracking the motion of a human hand or part thereof.

24. The method as claimed in claim 1 comprising identifying a hand gesture.

25. The method as claimed in claim 1 wherein the first and/or second device is a portable device.

26. The method as claimed in claim 1 comprising the first device calculating successive impulse responses from received signals corresponding to successive time frames of a transmit signal.

27. The method as claimed in claim 1 wherein the transmitted signals are ultrasonic.

28. The method of claim 1, wherein the difference between the first and second signal characteristics is selected from the group consisting of:

a difference between respective frame rates of the acoustic signals;

a difference between respective repetition rates of the acoustic signals;

a fixed time offset between the transmission of the acoustic signals having the first characteristic and the acoustic signals having the second characteristic;

a difference between respective timing patterns of the acoustic signals;

a duration of the second acoustic signals being greater than a duration of the first acoustic signals;

a bandwidth of the second acoustic signals being greater than a bandwidth of the first acoustic signals;

an intensity of the second acoustic signals being greater than an intensity of the first acoustic signals;

a difference between respective directions of propagation of the acoustic signals;

a difference due to the addition of a time-shift function to the second acoustic signals; and

a difference due to the addition of dithering to an underlying, stable frame rate of the second acoustic signals.

29. The method of claim 1, further comprising applying an inverse time-shift function to the received signals.

30. The method of claim 1, wherein the first device is configured to use a first processing algorithm to process received signals comprising reflections of the first acoustic signals, the method further comprising using a second processing algorithm to process the received signals comprising reflections of the second acoustic signals.

31. A first handheld electronic device comprising:

a transmitter adapted to transmit first acoustic signals for user input detection with a first signal characteristic;

a receiver adapted to receive acoustic signals comprising reflections of the transmitted first acoustic signals of the first device from an object,

wherein the electronic device is adapted;

to determine the presence of a second handheld electronic device, the second device being configured to transmit acoustic signals;

after determining the presence of the second device, to alter a transmission of the first device so as to transmit second acoustic signals with a second signal characteristic, different from the first signal characteristic, the receiver thereafter being adapted to receive said second acoustic signals comprising reflections of the transmitted second acoustic signals of the first device from the object; and

to use the received second signals to characterize the motion of the object and thereby control a function of the first device,

wherein the second signal characteristic gives a reduced interference between acoustic signals transmitted from the first and second devices respectively than the first signal characteristic.

32. The device as claimed in claim 31 wherein the transmit signals are periodic or quasi-periodic so as to define a frame rate, and the first and second signal characteristics comprise different respective frame rates.

33. The device as claimed in claim 32 wherein the second signal characteristic comprises a frame rate more than 10 percent different from a frame rate of signals transmitted by the second device.

34. The device as claimed in claim 31 wherein the difference between the first and second signal characteristics is a fixed time offset between the transmission of the signals having the first characteristic and the signals having the second characteristic.

35. The device as claimed in claim 34 wherein the transmit signals are periodic or quasi-periodic so as to define a frame rate, and wherein the fixed time offset is caused by altering the length of one or more frames.

36. The device as claimed in claim 35 configured to increase the length of the frame(s) by introducing a period in which the first device does not transmit.

37. The device as claimed in claims 31 configured to detect the signals of the second device indirectly as an interference effect on the signals received by the first device arising from transmissions by the first device itself.

38. The device as claimed in claim 31 configured to transmit acoustic signals having the same encoding as those transmitted by the second device.

39. The device as claimed in claim 31 configured, in response to detecting the presence of a noise or interfering source, to start to transmit signals of greater duration or bandwidth or intensity than the signals the device transmitted immediately preceding the detection.

40. The device as claimed in claim 31 configured to determine the presence of a second device by the acoustic signals the second device transmits.

41. The device as claimed in claim 40 configured to recognize one or more of a frequency, pattern of frequencies, spread of frequencies, change of frequencies, timing, or repetition rate of a signal to determine the presence of the second device.

42. The device as claimed in claim 31 configured to transmit signals at a frame rate, and to change the frame rate at intervals or continuously.

43. The device as claimed in claim 42 configured to change the frame rate and compare signals received before the change with signals received after the change.

44. The device as claimed in claims 31 configured to determine the presence of a second device using a separate communication channel from that used by the transmitted signals.

45. The device as claimed in claim 31 configured to receive information over the communication channel from the second device and to adjust its transmissions on the basis of the information.

46. The device as claimed in claim 45 wherein the communication channel is two-way.

47. The device as claimed in claim 45 configured to communicate with the second device to coordinate adjustments to their transmissions so as to reduce or minimize or substantially eradicate interference in motion characterization operations of both devices.

49. The device of claim 31, wherein the difference between the first and second signal characteristics is selected from the group consisting of:

a difference between respective frame rates of the acoustic signals;

a difference between respective repetition rates of the acoustic signals;

a fixed time offset between the transmission of the acoustic signals having the first characteristic and the acoustic signals having the second characteristic;

a difference between respective timing patterns of the acoustic signals;

a duration of the second acoustic signals being greater than a duration of the first acoustic signals;

a bandwidth of the second acoustic signals being greater than a bandwidth of the first acoustic signals;

an intensity of the second acoustic signals being greater than an intensity of the first acoustic signals;

a difference between respective directions of propagation of the acoustic signals;

a difference due to the addition of a time-shift function to the second acoustic signals; and

a difference due to the addition of dithering to an underlying, stable frame rate of the second acoustic signals.

50. The device of claim 31, further arranged to apply an inverse time-shift function to the received signals.

51. The device of claim 31, wherein the first device is configured to use a first processing algorithm to process received signals comprising reflections of the first acoustic signals, the device further being arranged to use second processing algorithm to process the received signals comprising reflections of the second acoustic signals.

48. A first portable handheld electronic device comprising:

an ultrasonic transmitter and an ultrasonic receiver and adapted to detect the presence of a second handheld device transmitting ultrasonic signals,

the first portable handheld device being adapted to transmit ultrasonic signals for user input detection at a power level dependent on whether the second handheld device is detected,

the first portable handheld device is adapted to receive ultrasonic reflections to characterize the motion of an object and thereby control a function of the first portable handheld device,

wherein the power level reduces interference between transmissions of the first portable handheld device and the second handheld device.

52. A non-transitory computer readable medium product configured, when run on a first handheld electronic device, to operate the device in the presence of a second handheld electronic device, wherein the first and second devices are configured to transmit acoustic signals for user input detection, comprising:

instructions for transmitting first acoustic signals with a first signal characteristic;

logic for determining the presence of the second device;

instructions for altering a transmission of the first device after the presence of the second device is determined, so as to transmit second acoustic signals with a second signal characteristic, different from the first signal characteristic;

logic for processing said second acoustic signals received at the first device comprising reflections of the transmitted second acoustic signals from an object; and

logic adapted to use the received second signals to characterize the motion of the object and thereby control a function of the first device,

wherein the second signal characteristic gives a reduced interference between acoustic signals transmitted from the first and second devices respectively than the first signal characteristic.

53. The non-transitory computer readable medium of claim 52, wherein the difference between the first and second signal characteristics is selected from the group consisting of:

a difference between respective frame rates of the acoustic signals;

a difference between respective repetition rates of the acoustic signals;

a fixed time offset between the transmission of the acoustic signals having the first characteristic and the acoustic signals having the second characteristic;

a difference between respective timing patterns of the acoustic signals;

a duration of the second acoustic signals being greater than a duration of the first acoustic signals;

a bandwidth of the second acoustic signals being greater than a bandwidth of the first acoustic signals;

an intensity of the second acoustic signals being greater than an intensity of the first acoustic signals;

a difference between respective directions of propagation of the acoustic signals;

a difference due to the addition of a time-shift function to the second acoustic signals; and

a difference due to the addition of dithering to an underlying, stable frame rate of the second acoustic signals.

54. The non-transitory computer readable medium of claim 52, further comprising logic for applying an inverse time-shift function to the received signals.

55. The non-transitory computer readable medium of claim 52, wherein the instructions comprise a first processing algorithm to process received signals comprising reflections of the first acoustic signals, the instructions further comprising a second processing algorithm to process the received signals comprising reflections of the second acoustic signals.