Computer Interface Method

• US 20120242589A1
• Filed: 06/02/2011
• Published: 09/27/2012
• Est. Priority Date: 03/24/2011
• Status: Abandoned Application

• Current Assignee: Lancaster University
• Original Assignee: Lancaster University
• Inventors: Gellersen, Hans-Werner, Schmidt, Dominik, Chehimi, Fadi, Rukzio, Enrico
• Application Number:
  US13/151,554
• Publication Number:
  US 20120242589A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04W 4/21 for social networking applications
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A method of interacting with a first electronic device having a touch-sensitive display. The method comprises establishing a connection between the first electronic device and a second electronic device, the connection allowing data communication between the first electronic device and the second electronic device. A first event involving the first electronic device is detected and a second event involving the second electronic device is detected. It is determined if the first event and the second event relate to an interaction between the second electronic device and an element displayed on the touch-sensitive display. If the first and second events relate to an interaction between the second electronic device and an element displayed on the touch-sensitive display, operation of the first electronic device is controlled based upon one or more characteristics of the interaction.

Claims

1. A method of interacting with a first electronic device having a touch-sensitive display, the method comprising:

establishing a connection between said first electronic device and a second electronic device, said connection allowing data communication between the first electronic device and the second electronic device;

detecting a first event involving said first electronic device;

detecting a second event involving said second electronic device;

determining if said first event and said second event relate to an interaction between said second electronic device and an element displayed on said touch-sensitive display;

if said first and second events relate to an interaction between said first and second electronic devices, controlling operation of said first electronic device based upon one or more characteristics of said interaction.

2. A method according to claim 1, wherein establishing a connection between said first electronic device and said second electronic device comprises synchronising respective system clocks of said first and second electronic devices.

3. A method according to claim 2, further comprising associating said first event with a first time indicated by the system clock of said first electronic device when the first event was detected;

and

associating said second event with a second time indicated by the system clock of said second device.

4. A method according to claim 3, wherein determining if said first event and said second event relate to an interaction between said second electronic device and an element displayed on said touch-sensitive display comprises:

determining if said first time and said second time meet a predetermined criterion.

5. A method according to claim 4, wherein said predetermined criterion is that said first time and said second time are equal to within a predetermined tolerance.

6. A method according to claim 1, wherein said first event is a touch event between said first electronic device and said second electronic device.

7. A method according to claim 1, wherein said element is associated with a data item stored at said first electronic device;

and

wherein controlling operation of said first electronic device comprises transmitting said data item to said second electronic device.

8. A method according to claim 1, further comprising:

if said first and second events relate to an interaction between said second electronic device and an element displayed on said touch-sensitive display, controlling operation of said second electronic device based upon one or more characteristics of said interaction.

9. A method according to claim 8, wherein controlling operation of said second electronic device comprises transmitting a data item from said second electronic device to said first electronic device.

10. A method according to claim 8, wherein said element is associated with a first data entry field displayed on said touch-sensitive display and wherein controlling operation of said second electronic device comprises providing a second data entry field on said second electronic device corresponding to said first data entry field;

and

transmitting from said second electronic device data entered at said second data entry field to said first electronic device for inputting into said first data entry field.

11. A method according to claim 8, wherein controlling operation of said second electronic device comprises controlling operation of the second electronic device to provide feedback based upon one or more characteristics of said interaction, said feedback comprising at least one of audio visual or haptic feedback.

12. A method according to claim 1, wherein said characteristic of said interaction is dependent upon whether a button of said second electronic device was activated during said interaction.

13. A method according to claim 12, wherein said button is a virtual button displayed on a touch-sensitive display of said second electronic device.

14. A method according to claim 1, wherein said characteristic of said interaction is dependent upon a spatial orientation of said second electronic device during said interaction.

15. A method according to claim 1, wherein said characteristic of said interaction is dependent upon data stored at the second electronic device.

16. A method according to claim 1, wherein controlling operation of said first electronic device comprises initiating a payment based upon payment data stored at or input via said second electronic device.

17. A method according to claim 1, wherein said element is a plurality of elements.

18. A method according to claim 1, wherein said second electronic device is a mobile device.

52. A computer readable media carrying computer readable instructions configured to cause two computers to carry out a method according to claim 1.

55. A computer apparatus for interacting with a first electronic device having a touch sensitive display, comprising:

a first electronic device including;

a touch sensitive display;

a memory storing processor readable instructions; and

a processor arranged to read and execute instructions stored in said memory; and

a second electronic device including;

a memory storing processor readable instructions; and

a processor arranged to read and execute instructions stored in said memory;

wherein said processor readable instructions comprise instructions arranged to control the computer apparatus to carry out a method according to claim 1.

19. A method of interacting with a first electronic device having a touch-sensitive display, the method comprising:

at said first electronic device;

establishing a connection with a second electronic device, said connection allowing data communication between said first electronic device and said second electronic device;

detecting a first event;

determining if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device; and

if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device, controlling operation of said first electronic device based upon one or more characteristics of said interaction.

20. A method according to claim 19, wherein establishing a connection with said second electronic device comprises synchronising the system clock of said first electronic device to the system clock of second electronic devices.

21. A method according to claim 20, further comprising receiving an indication of a second event detected by said second electronic device.

22. A method according to claim 21, further comprising associating said first event with a first time indicated by the system clock of said first electronic device when the first event was detected;

and

associating said second event with a second time indicated by the system clock of said second device.

23. A method according to claim 22, wherein determining if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device comprises determining if said first time and said second time meet a predetermined criterion.

24. A method according to claim 23, wherein said predetermined criterion is that said first time and said second time are equal to within a predetermined tolerance.

25. A method according to claim 19, wherein said first event is a touch event between an element displayed on said touch-sensitive screen and said second electronic device.

26. A method according to claim 19, wherein said element is associated with a data item stored at said first electronic device;

and

wherein controlling operation of said first electronic device comprises transmitting said data item to said second electronic device.

27. A method according to claim 19, further comprising:

if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device, controlling operation of said second electronic device based upon one or more characteristics of said interaction.

28. A method according to claim 27, wherein controlling operation of said second electronic device comprises causing a data item to be transmitted from said second electronic device to said first electronic device.

29. A method according to claim 27, wherein said element is associated with a first data entry field displayed on said touch-sensitive display and wherein controlling operation of said second electronic device comprises causing a second data entry field to be provided on said second electronic device corresponding to said first data entry field;

and

receiving at said first electronic device from said second electronic device data entered at said second data entry field for inputting into said first data entry field.

30. A method according to claim 19, wherein said characteristic of said interaction is dependent upon whether a button of said second electronic device was activated during said interaction.

31. A method according to claim 30, wherein said button is a virtual button displayed on a touch-sensitive display of said second electronic device.

32. A method according to claim 19, wherein said characteristic of said interaction is dependent upon an indication of a spatial orientation of said second electronic device during said interaction, received from said second electronic device.

33. A method according to claim 19, wherein controlling operation of said first electronic device comprises initiating a payment based upon payment data stored at or input via said second electronic device.

34. A method according to claim 19, wherein said element is a plurality of elements.

35. A method according to claim 19, wherein said second electronic device is a mobile device.

53. A computer readable medium carrying computer readable instructions configured to cause a computer to carry out a method according to claim 19.

56. A computer apparatus for interacting with a first electronic device having a touch sensitive display, comprising:

a memory storing processor readable instructions; and

a processor arranged to read and execute instructions stored in said memory;

wherein said processor readable instructions comprise instructions arranged to control the computer to carry out a method according to claim 19.

36. A method of interacting with a first electronic device having a touch sensitive display, comprising:

at a second electronic device;

establishing a connection with said first electronic device, said connection allowing data communication between said first electronic device and said second electronic device;

detecting a first event;

determining if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device; and

if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device, executing computer program code, said execution being based upon one or more characteristics of said interaction.

37. A method according to claim 36, wherein establishing a connection with said first electronic device comprises synchronising the system clock of said second electronic device with the system clock of said first electronic device.

38. A method according to claim 37, further comprising receiving an indication of a second event detected by said first electronic device.

39. A method according to claim 36, further comprising associating said first event with a first time indicated by the system clock of said second electronic device when the first event was detected.

40. A method according to claim 39, wherein determining if said first event relates to an interaction between an element displayed on said touch-sensitive screen and said second electronic device comprises:

transmitting an indication of said first event and said first time to said first electronic device.

41. A method according to claim 36, wherein said first event is a touch event between an element displayed on said touch-sensitive screen and said second electronic device.

42. A method according to claim 36, wherein said element is associated with a data item stored at said first electronic device;

and

wherein executing computer program code comprises executing computer program code to receive said data item from said first electronic device.

43. A method according to claim 36, wherein executing computer program code on said second electronic device comprises transmitting a data item from said second electronic device to said first electronic device.

44. A method according to claim 36, wherein said element is associated with a first data entry field displayed on said touch-sensitive display and wherein executing computer program code on said second electronic device comprises causing a second data entry field to be provided on said second electronic device corresponding to said first data entry field;

and

transmitting to said first electronic device data entered at said second data entry field for inputting into said first data entry field.

45. A method according to claim 36, wherein said characteristic of said interaction is dependent upon whether a button of said second electronic device was activated during said interaction.

46. A method according to claim 45, wherein said button is a virtual button displayed on a touch-sensitive display of said second electronic device.

47. A method according to claim 36, wherein said characteristic of said interaction is dependent upon an indication of a spatial orientation of said second electronic device.

48. A method according to claim 47, further comprising transmitting said indication of a spatial orientation of said second electronic device to the first electronic device.

49. A method according to claim 36, wherein executing computer program code comprises initiating a payment based upon payment data stored at or input via said second electronic device.

50. A method according to claim 36, wherein said element is a plurality of elements.

51. A method according to claim 36, wherein said second electronic device is a mobile device.

54. A computer readable medium carrying computer readable instructions configured to cause a computer to carry out a method according to claim 36.

57. A computer apparatus for interacting with a first electronic device having a touch sensitive display, comprising:

a memory storing processor readable instructions; and

a processor arranged to read and execute instructions stored in said memory;

wherein said processor readable instructions comprise instructions arranged to control the computer to carry out a method according to claim 36.