PROGRAMMABLE TACTILE TOUCH SCREEN DISPLAYS AND MAN-MACHINE INTERFACES FOR IMPROVED VEHICLE INSTRUMENTATION AND TELEMATICS

• US 20090273563A1
• Filed: 07/10/2009
• Published: 11/05/2009
• Est. Priority Date: 11/08/1999
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pryor, Timothy R.
• Granted Patent: US 8,482,535 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/145 Instrument input by combination of touch screen and hardware input devices
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM'"'"'s “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Claims

1. A computer implemented method for designating information displayed on a touch screen, the method comprising:

identifying a first location on the touch screen corresponding to a first touch input;

displaying a controller on the touch screen at the first location in response to said identifying step;

displaying a cursor in response to said identifying step, the cursor being responsive to actuation of the controller;

detecting a change in the location of the first touch input along the touch screen corresponding to actuation of the controller; and

displaying movement of the cursor in response to said detecting step.

2. The method according to claim 1 wherein the first touch input includes at least one of a finger and a thumb in contact with the touch screen.

3. The method according to claim 1 further comprising displaying a plurality of textual characters on the touch screen, the first location being on the side of the plurality of textual characters, the cursor being within the plurality of textual characters.

4. The method according to claim 1 wherein the controller is a slider bar.

5. The method according to claim 1 wherein:

the change in the location of the first touch input includes a linear movement of the touch input in a first direction along the touch screen; and

the corresponding movement of the cursor includes a linear movement in the first direction.

6. The method according to claim 1 wherein movement of the touch input a first distance corresponds to movement of the cursor a second distance different from the first distance.

7. The method according to claim 6 wherein the first distance is greater than the second distance.

8. A computer implemented method of designating information in response to input received from a user using a touch screen, the method comprising:

displaying a first line of writing on the touch screen;

receiving a touch input on the side of the first line of writing;

displaying a slider bar and a cursor on the touch screen in response to said receiving step, the slider bar being at the side of the line of writing, the cursor being within the line of text and being responsive to the slider bar;

detecting a change in the location of the touch input corresponding to actuation of the slider bar by the user; and

displaying a change in the location of the cursor in response to said detecting step.

9. The method according to claim 8 wherein the touch input corresponds to one of a finger and a thumb in contact with the touch screen

10. The method according to claim 8 wherein

the change in location of the touch input includes a linear movement of the touch input in a first direction along the touch screen;

and

the corresponding movement of the cursor includes a linear movement in the first direction.

11. The method according to claim 8 wherein movement of the touch input a first distance corresponds to movement of the cursor a second distance different from the first distance.

12. The method according to claim 11 wherein the first distance is greater than the second distance.

13. A touch interface for a computer comprising:

a display screen adapted to display a line of data; and

a control circuit adapted to identify a time-based change in the location of a touch input along the display screen adjacent the line of data, the control circuit being further adapted to actuate a virtual controller including a slider bar and a cursor responsively coupled to the slider bar in response to the time-based change in the location of the touch input, the slider bar being adjacent the line of data and the cursor designating a portion of the line of data.

14. The touch interface of claim 13 wherein the touch input corresponds to one of a finger and a thumb in contact with the display screen.

15. The touch interface of claim 13 wherein the actuation of the virtual controller includes movement of the touch input in first direction to command movement of the cursor in the first direction within the line of data.

16. The touch interface of claim 15 wherein the movement of the touch input is scaled with respect to movement of the cursor.

17. A computer implemented method of designating a data object on a touch screen in response to input received from a user, the method comprising:

identifying a first location on the touch screen corresponding a first touch input and a second location on the touch screen corresponding to a second touch input, the first touch input and the second touch input being simultaneously in contact with the touch screen;

displaying a cursor at a third location on the touch screen in response to said identifying step;

detecting a change in the location of the second touch input along the touch screen relative to the location of the first touch input, and

displaying a change in the location of the cursor in response to said detecting step.

18. The method according to claim 17 wherein the third location is between the first location and the second location.

19. The method according to claim 17 wherein the change in the location of the second touch input relative to the location of first touch input includes a change in the distance between the second touch input and the first touch input.

20. The method according to claim 19 wherein the change in the location of the cursor includes a change in the distance between the cursor and the first location.

21. The method according to claim 17 wherein the change in the location of the second touch input relative to the first touch inputs includes at least a partial rotation of the second touch input about the first touch input.

22. The method according to claim 20 wherein the change in the location of the cursor includes at least a partial rotation of the cursor about the first location.

23. The method according to claim 17 further comprising registering the designation of the data object by detecting a change in the force of at least one of the first touch input and the second touch input when the cursor is proximate the data object.

24. The method according to claim 23 wherein the change in the force of at least one of the first touch input and the second touch input includes an increase in the normal component of the force of at least one of the first touch input and the second touch input.

25. The method according to claim 17 further comprising registering the designation of the data object by detecting a voice command.

26. The method according to claim 17 wherein the data object is between the first location and the second location.

27. The method according to claim 17 wherein:

the first touch input corresponds to one of a finger and a thumb in contact with the touch screen; and

the second touch input corresponds to another one of a finger and a thumb in contact with the touch screen.

28. The method according to claim 17 wherein the data object includes an alphanumeric.

29. A computer implemented method of designating a data object displayed on a touch screen, the method comprising:

receiving a first touch input on the touch screen;

receiving a second touch input on the touch screen, wherein the first touch input and the second touch input are simultaneous;

displaying a cursor between with the first touch input and the second touch input;

detecting a change in the location of the second touch input relative to the first touch input; and

displaying movement of the cursor in response to said detecting step wherein the cursor remains between the first touch input and the second touch input throughout its range of movement.

30. The method according to claim 29 wherein the change in the location of the second touch input relative to the first touch input includes a change in the distance between the second touch input and the first touch input.

31. The method according to claim 29 wherein the change in the location of the second touch input relative to the first touch input includes at least a partial rotation of the second touch input about the first touch input.

32. The method according to claim 29 further comprising registering the designation of the data object by detecting a change in the force of at least one of the first touch input and the second touch input when the cursor is proximate the data object.

33. The method according to claim 32 wherein the change in the force includes an increase in the normal component of the force of the at least one of the first touch input and the second touch input.

34. The method according to claim 29 further comprising registering the designation of the data object by detecting a voice command.

35. The method according to claim 29 wherein:

the first touch input corresponds to one of a finger and a thumb in contact with the touch screen; and

the second touch input corresponds to one of a finger and a thumb in contact with the touch screen.

36. The method according to claim 29 wherein the data object includes an alphanumeric.

37. A touch interface for a computer comprising:

a display screen adapted to display a data object; and

a control circuit adapted to identify a time-based change in the location of a first touch input relative to the location of a simultaneous second touch input, the control circuit being further adapted to move a cursor displayed on the touch screen in response to the identified change, the cursor being between the first touch input and the second touch input throughout its range of movement.

38. The touch interface of claim 37 wherein the change in the location of the first touch input relative to the location of a second touch input includes a change in the distance between the first touch input and the second touch input.

39. The touch interface according to claim 37 wherein the change in the location of the first touch input relative to the second touch input includes at least a partial rotation of the first touch input about the second touch input.

40. The touch interface according to claim 37 wherein the control circuit is further adapted to detect a change in the force of at least one of the first touch input and the second touch input.

41. The touch interface according to claim 37 wherein the change in the force includes an increase in the normal component of the force.

42. The touch interface according to claim 37 wherein:

the first touch input corresponds to one of a finger and a thumb in contact with the touch screen; and

the second touch input corresponds to one of a finger and a thumb in contact with the touch screen.

43. A computer implemented method of designating a data object on a touch screen in response to input received from a user, the method comprising:

identifying a first location on the touch screen corresponding a first touch input;

displaying a cursor at a second location different from the first location on the touch screen in response to said identifying step;

detecting movement of the first touch input along the touch screen relative to the first location, and

displaying movement of the cursor in response to said detecting step.

44. The method according to claim 43 wherein:

the movement of the first touch input along the touch screen includes a linear component in a first direction; and

the movement of the cursor includes a linear component in the first direction.

45. The method according to claim 43 further comprising registering the designation of the data object by detecting a change in the force of the first touch input when the cursor is proximate the data object.

46. The method according to claim 45 wherein the change in the force of the first touch input includes an increase in the normal component of the force.

47. The method according to claim 43 further comprising registering the designation of the data object by detecting a voice command.

48. The method according to claim 43 wherein movement of the cursor is scaled with respect to movement of the touch input.

49. A computer implemented method of controlling a cursor on a touch screen in response to input received from a user, the method comprising:

receiving a first touch input on the touch screen;

receiving a second touch input on the touch screen, wherein the first touch input and the second touch input are simultaneously in contact with the touch screen;

displaying a cursor on the touch screen between the first touch input and the second touch input;

detecting a change in the location of the first touch input along the touch screen; and

displaying movement of the cursor on the touch screen in response to said detecting step wherein the cursor remains between the first touch input and the second touch input.

50. The method according to claim 49 wherein:

the second touch input remains stationary during the change in location of the first touch input; and

the change in the location of the first touch input includes a change in the distance between the second touch input and the first touch input.

51. The method according to claim 49 wherein:

the second touch input remains stationary during the change in the location of the first touch input; and

the change in the location of the first touch input includes rotation of the first touch input about the second touch input.

52. A computer implemented method for performing an operation in response to input received from a user, the method comprising:

identifying a location on a touch screen corresponding to a first touch input, wherein the first touch input indicates one of a finger and a thumb in contact with the touch screen;

detecting movement of the first touch input along the touch screen defining a first trace pattern having a first characteristic; and

performing an operation in response to said detecting step, the operation being a function of the first characteristic of the first trace pattern.

53. The method according to claim 52 wherein the performing step includes controlling a value of a first variable as a function at least one of the shape and the orientation of the first trace pattern.

54. The method according to claim 53 wherein the value of the first variable is a function of the rate of the movement of the first touch input.

55. The method according to claim 53 wherein the value of the first variable is a function of the amount of the movement of the first touch input.

56. The method according to claim 53 wherein:

movement of the first touch input in a first direction corresponds to an increase in the first variable value; and

movement of the first touch input in a second direction different from the first direction corresponds to a decrease in the first variable value.

57. The method according to claim 52 wherein the first trace pattern is one of a horizontal line and an arc.

58. The method according to claim 53 further including:

identifying a location on a touch screen corresponding to a second touch input, wherein the second touch input indicates one of a finger and a thumb in contact with the touch screen;

detecting movement of the second touch input along the touch screen defining a second trace pattern having a second characteristic; and

performing an operation in response to said detecting step, the operation being a function of the second characteristic of the second trace pattern.

59. The method according to claim 58 wherein the value of the second variable is a function of the rate of the movement of the second touch input.

60. The method according to claim 58 wherein the value of the second variable is a function of the amount of the movement of the second touch input.

61. The method according to claim 58 wherein the second trace pattern includes one of a horizontal line and an arc.

62. The method according to claim 58 wherein:

movement of the second touch input in a first direction corresponds to an increase in the second variable value; and

movement of the second touch input in a second direction different from the first direction corresponds to a decrease in the second variable value.

63. The method according to claim 58 wherein the first touch input and the second touch input are simultaneously in contact with the touch screen.

64. The method according to claim 58 wherein:

the location of first touch input is selectable by the user from among a plurality of locations on the touch screen; and

the location of the second touch input is selectable by the user from among a plurality of locations on the touch screen.

65. The method according to claim 58 wherein:

the first variable controls a first function of a vehicle control panel; and

the second variable controls a second function of a vehicle control panel.

66. The method according to claim 65 wherein:

the first function of the vehicle control panel includes setting blower speed for an automobile; and

the second function of the vehicle control panel includes setting wiper speed for an automobile.

67. A computer implemented method for controlling a variable in response to input received from a user, the method comprising:

identifying a location on a touch screen corresponding to a first touch input, wherein the first touch input indicates one of a finger and a thumb in contact with the touch screen;

detecting a movement of the first touch input along the touch screen, the movement having first and second characteristics; and

controlling a value of a first variable in response to the detection of the first and second characteristics.

68. The method according to claim 67 wherein the first characteristic includes at least one of the shape and the orientation of the first movement.

69. The method according to claim 67 wherein the second characteristic includes the rate of the first movement.

70. The method according to claim 67 wherein the second characteristic includes the amount of movement of the first touch input.

71. The method according to claim 67 wherein the second characteristic includes the direction of the movement of the first touch input.

72. The method according to claim 71 wherein:

movement of the first touch input in a first direction corresponds to an increase in the value of the first variable; and

movement of the first touch input in a second direction corresponds to a decrease in the value of the first variable.

73. The method according to claim 68 wherein the first shape is one of a horizontal line and an arc.

74. The method according to claim 67 wherein the location of the first touch input is selected from among a plurality of locations on the touch screen.

75. The method according to claim 67 wherein the variable controls a first function of a vehicle control panel.

76. The method according to claim 75 wherein the first function of the vehicle control panel includes one of a blower setting and a wiper setting.

77. The method according to claim 67 further including:

identifying a location on a touch screen corresponding to a second touch input, wherein the second touch input indicates one of a finger and a thumb in contact with the touch screen;

detecting a movement of the second touch input along the touch screen, the movement having first and second characteristics; and

controlling a value of a second variable in response to the detection of the first and second characteristics of the second movement.

78. The method according to claim 77 wherein the second characteristic of the second movement includes one of a horizontal line and an arc.

79. The method according to claim 77 wherein the first touch input and the second touch input are in simultaneous contact with the touch screen.

80. The method according to claim 77 wherein the location of the second touch input is selectable by the user from among a plurality of locations on the touch screen.

81. The method according to claim 77 wherein the second variable controls a second function of a vehicle control panel.

82. The method according to claim 81 wherein the second function includes one of a blower setting and a wiper setting.

83. A touch interface for a computer comprising:

a display screen adapted to display visually observable data; and

a control circuit adapted to identify a time-based change in the location of a touch input along the display screen corresponding to a trace pattern, wherein touch input corresponds to one of a finger and a thumb in contact with the display screen, the control circuit being further adapted to control a variable wherein the variable is selected based on a first characteristic of the trace pattern and the value of the variable is selected based on a second characteristic of the trace pattern.

84. The touch interface of claim 83 wherein the first characteristic includes at least one of the configuration and the orientation of the trace pattern.

85. The touch interface of claim 83 wherein the second characteristic includes the rate of the time-based change in the location of the touch input.

86. The touch interface of claim 83 wherein the second characteristic includes the amount of the time-based change in the location of the touch input.

87. The touch interface of claim 83 wherein the second characteristic includes the direction of the time-based change in the location of the touch input.

88. The touch interface of claim 87 wherein:

a time-based change in the location of the touch input in a first direction corresponds to an increase in the value of the variable; and

a time-based change in the location of the touch input in a second direction corresponds to a decrease in the value of the variable.

89. The touch interface of claim 83 wherein the trace pattern is one of a horizontal line and an arc.