PROGRAMMABLE TACTILE TOUCH SCREEN DISPLAYS AND MAN-MACHINE INTERFACES FOR IMPROVED VEHICLE INSTRUMENTATION AND TELEMATICS

• US 20090273574A1
• Filed: 07/10/2009
• Published: 11/05/2009
• Est. Priority Date: 06/29/1995
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pryor, Timothy R.
• Application Number:
  US12/500,951
• Publication Number:
  US 20090273574A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM'"'"'s “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Claims

1. A computer implemented method for controlling a variable in response to input received from a user, the method comprising:

providing a display screen responsive to a touch input on a surface of the display screen facing a user;

identifying a first location and a second location on the display screen, wherein the first location indicates a first touch input and the second location indicates a second touch input, the first location being separated from the second location by a first distance;

detecting a change in the location of at least one of the first touch input and the second touch input causing the first touch input and the second touch input to be separated by a second distance different from the first distance; and

determining a value desired of the variable dependent on the difference between the first distance and the second distance.

2. The method according to claim 1 wherein the difference between the first distance and the second distance is proportional to the value desired of the variable.

3. The method according to claim 1 wherein the difference between the first distance and the second distance indicates at least one of an increment and a decrement desired of the variable.

4. The method according to claim 3 wherein the at least one of the increment and the decrement desired of the variable is proportional to the difference between the first distance and the second distance.

5. The method according to claim 1 further comprising designating a first region of the display adapted to receive a touch input from the user to control the variable, wherein the first location is within the first region.

6. The method according to claim 1 wherein the first touch input and the second touch input each include one of a finger and a thumb in contact with the touch screen.

7. The method according to claim 1 further including:

calculating a first centroid corresponding to the first touch input;

calculating a second centroid corresponding to the second touch input; and

determining the location of the first touch input and the location of the second touch input based on the first and second centroids, respectively.

8. A computer implemented method for performing an operation on a computer system in response to input received from a user, the method comprising:

providing a touch screen capable of displaying visually observable data;

receiving a first touch input on the touch screen;

receiving a second touch input on the touch screen a distance from the first touch input;

detecting a change in the distance between the first touch input and the second touch input, the change indicating movement of at least one of the first touch input and the second touch input along the touch screen; and

performing an operation on the computer system in response to said detecting step.

9. The method according to claim 8 wherein the first touch input and the second touch input each include one of a finger and a thumb in contact with the touch screen.

10. The method according to claim 8 further comprising designating a first region of the touch screen adapted to a receive touch input from the user to control a first variable, wherein the first touch input is within the first region.

11. The method according to claim 10 further comprising designating a second region of the touch screen adapted to receive touch input from the user to control a second variable.

12. The method according to claim 10 wherein the change in the distance separating the first touch input from the second touch input indicates a desired value of the first variable.

13. The method according to claim 12 wherein the value is proportional to the change in the distance separating the second distance and the first distance.

14. The method according to claim 10 wherein the change in the distance separating the first touch input from the second touch input indicates at least one of an increment and a decrement desired of the first variable.

15. The method according to claim 14 wherein the change in the distance separating the first touch input from the second touch input is proportional to the one of an increment and a decrement desired of the first variable.

16. The method according to claim 8 further comprising:

calculating a first centroid corresponding to the first touch input;

calculating a second centroid corresponding to the second touch input; and

determining the location of the first touch input and the location of the second touch input based on the first and second centroids, respectively.

17. A computer implemented method for controlling a variable in response to input received from a user, the method comprising:

providing a display screen responsive to a touch input on a surface of the display screen facing a user;

providing a base point fixed in relation to the display screen;

identifying a first location on the surface of the display screen a first distance from the base point, the first location indicating a first position of one of a finger and a thumb in contact with the display screen at the first location;

identifying a second location on the surface of the display screen separated from the base point by a second distance, the second location indicating a second position of the one of a finger and a thumb resulting from movement along the display screen of the at least one of a finger and a thumb from the first location to the second location; and

determining a value desired of the variable based on the difference between the first distance and the second distance.

18. The method according to claim 17 wherein the base point includes a lateral edge of the display screen.

19. The method according to claim 17 wherein the base point includes a tactile reference.

20. The method according to claim 19 wherein the tactile reference includes at least one of a protrusion and an indentation.

21. The method according to claim 17 wherein the difference between the first distance and the second distance is proportional to the desired value of the variable.

22. The method according to claim 17 wherein the difference between the first distance and the second distance indicates at least one of an increment and a decrement desired of the variable.

23. The method according to claim 22 wherein the at least one of the increment and the decrement desired of the variable is proportional to the difference between the first distance and the second distance.

24. A computer implemented method for controlling a variable in response to input received from a user, the method comprising:

providing a touch screen capable of displaying visually observable data;

identifying a first location on the touch screen corresponding to a first stationary touch input from one of a finger and a thumb;

determining the direction of the force applied by the stationary touch input; and

controlling the variable in response to said determining step.

25. The method according to claim 24 wherein:

the touch screen includes a display surface; and

the determining step further includes detecting a distortion manifested on a rear portion of the display surface by the first stationary touch input.

26. The method according to claim 25 wherein:

the distortion is elongated in a first direction corresponding to the tangential component of the force applied by the first stationary touch input; and

the determining step further includes detecting the first direction.

27. The method according to claim 25 further comprising actuating the display surface with a force feedback signal in response to the determining step.

28. The method according to claim 24 further comprising determining the magnitude of the force applied by the stationary touch input.

29. The method according to claim 24 further including identifying a second location on the touch screen corresponding to a second touch input from one of a finger and a thumb, the first and second touch inputs being simultaneous.

30. The method according to claim 24 wherein the controlling step is responsive to one of the normal component and the tangential component of the force applied by the stationary touch input.

31. The method according to claim 24 wherein the variable controls a function of a vehicle control panel.

32. A computer implemented method for controlling a variable in response to input received from a user, the method comprising:

providing a touch screen capable of displaying visually observable data;

identifying a first location on the touch screen indicating a touch input from one of a finger and a thumb;

determining a force vector corresponding to the touch input; and

controlling the variable in response to said determining step.

33. The method according to claim 32 wherein:

the determining step includes determining a normal and a tangential component of the force vector; and

the controlling step is responsive to at least one of the normal component and the tangential component of the force vector.

34. The method according to claim 33 wherein the tangential component indicates at least one of an increment and a decrement desired of the variable.

35. The method according to claim 33 wherein:

the touch input generates a local surface distortion on the touch screen; and

said determining step further includes determining the tangential component of the force vector in response to the local surface distortion.

36. The method according to claim 33 further comprising displaying a virtual controller in response to said identifying step.

37. The method according to claim 36 wherein the virtual controller includes:

a first portion displayed at the first location; and

a second portion displayed at a first orientation with respect to the first portion and moveable with respect to the first portion.

38. The method according to claim 37 further comprising the step of displaying the second portion of the virtual controller in a second orientation in response to said determining step.

39. The method according to claim 38 wherein the first orientation indicates a first value of the variable and the second orientation indicates a second value of the variable.

40. The method according to claim 39 wherein the second value of the variable is selected by the user based on the tangential component of the force vector.

41. The method according to claim 40 wherein the virtual controller is a slider.

42. A computer implemented method for performing an operation on a computer system in response to input received from a user, the method comprising:

providing a touch screen capable of displaying visually observable data;

receiving a touch input at a first location on the touch screen;

determining a force vector corresponding to the touch input, the force vector including a normal component and a tangential component; and

performing an operation on the computer system in response to said determining step.

43. The method according to claim 42 wherein said performing step includes determining a desired value of a variable as a function of the tangential component of the force vector.

44. The method according to claim 42 wherein said performing step includes determining a desired value of a variable as a function of the duration of the touch input.

45. The method according to claim 42 further including the step of displaying a virtual slider in response to said receiving step.

46. The method according to claim 45 herein the virtual slider includes a first portion and a second portion, the first portion being stationary with respect to the first location.

47. The method according to claim 46 further comprising animating the second portion of the slider in response to said determining step, so that a second portion of the slider moves relative to the first portion.

48. The method according to claim 47 wherein the slider indicates a plurality of values selectable by the user.

49. The method according to claim 48 wherein the touch input includes at least one of a finger and a thumb in contact with the touch screen.

50. A computer implemented method for simulating rotation of a virtual object on a touch screen display, the method comprising:

identifying a first location on the touch screen display corresponding to a first touch input on a first portion of the virtual object,

identifying a second location on the touch screen display corresponding to a second touch input on a second portion of the virtual object;

detecting a time-based change in the location of the first touch input and the second touch input corresponding to a rotation of the first touch input and second touch input about the virtual object;

displaying a rotation of the virtual object in response to said detecting step; and

determining a desired value, wherein the value is selected as a function of the rotation of the virtual object.

51. The method according to claim 50 wherein:

the virtual object includes a periphery; and

the first touch input and the second touch input each include one of a finger and a thumb in contact with the virtual object periphery.

52. The method according to claim 50 wherein said displaying step includes displaying rotation of the virtual object through a first angle.

53. The method according to claim 52 wherein the desired value is selected as a function of the first angle.

54. The method according to claim 52 wherein the desired value is proportional to the first angle.

55. The method according to claim 50 wherein the virtual object is a knob.

56. The method according to claim 50 wherein the virtual object controls a function on a vehicle simulator.

57. The method according to claim 50 wherein the virtual object controls a function on a vehicle control panel.

58. The method according to claim 57 wherein the vehicle control panel includes a car dashboard.

59. The method according to claim 57 wherein the vehicle control panel includes an aircraft cockpit display.

60. The method according to claim 50 wherein identifying a first location on the touch screen includes:

calculating a first centroid corresponding to the first touch input; and

determining the location of the first touch input based on the first centroid.

61. The method according to claim 60 wherein identifying a second location on the touch screen includes:

calculating a second centroid corresponding to the second touch input; and

determining the location of the second touch input based on the second centroid.

62. A computer implemented method for determining a value in response to input received from a user, the method comprising:

providing a touch screen capable of displaying visually observable data and capable of detecting a plurality of simultaneous touch inputs;

detecting the location of a first touch input and a second touch input on the touch screen;

in response to said detecting step, displaying a virtual object on the touch screen, the virtual object including a periphery including a first portion and a second portion underlying the first touch input and the second touch input respectively;

detecting a time-based change in the location of the first touch input and the location of the second touch input corresponding to rotation of the first touch input and the second touch input about the center of the virtual object;

displaying rotation of the virtual object from a first orientation to a second orientation; and

determining the value as a function of the rotation of the virtual object.

63. The method according to claim 62 wherein:

said displaying step includes displaying rotation of the virtual object through a first angle; and

the value is selected as a function of the first angle.

64. The method according to claim 62 wherein the virtual object is a knob.

65. The method according to claim 62 wherein the virtual object controls a function of a vehicle simulator.

66. The method according to claim 62 wherein the virtual object controls a function of a vehicle control panel.

67. The method according to claim 66 wherein the vehicle control panel includes a car dashboard.

68. The method according to claim 66 wherein the vehicle control panel includes an aircraft cockpit display.

69. The method according to claim 62 wherein detecting the location of the first touch input and the second touch input includes:

calculating a first centroid corresponding to the first touch input;

calculating a second centroid corresponding to the second touch input; and

determining the location of the first touch input and the location of the second touch input based on the first and second centroids, respectively.