Facial-recognition vehicle security system and automatically starting vehicle

• US 20040234109A1
• Filed: 03/04/2004
• Published: 11/25/2004
• Est. Priority Date: 05/15/1996
• Status: Active Grant

• Current Assignee: Jerome H. Lemelson, Louis J. Hofffman
• Original Assignee: Jerome H. Lemelson, Louis J. Hofffman
• Inventors: Lemelson, Jerome H., Hoffman, Louis J.
• Granted Patent: US 7,116,803 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: B60Q 1/0023 the element being a sensor, e.g. distance sensor, camera
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60R 25/252 Fingerprint recognition
• CPC Class Codes: B60R 25/255 Eye recognition
• CPC Class Codes: B60R 25/257 Voice recognition
• CPC Class Codes: B60R 25/305 using a camera
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

A movable-vehicle security system includes a facial-recognition system including a scanner such as a television or infrared camera directed at the face of a person in the driver'"'"'s seat, which system produces output control signals that are applied to enable or disable operation of the vehicle, with or without a key or other supplemental security system. In a particular embodiment, the system includes a camera mounted on the “third taillight” assembly (which is preferably mounted below the roof and inside the rear window), directed at the rear-view mirror, and coupled to a facial-recognition computer, which in turn is coupled (with appropriate security precautions) to an enabling element for the vehicle, such as a starter motor. In a further embodiment, the system can be coupled to various elements of the motive system to create an auto-starting car.

Claims

1-63. -63. (cancel)

64. A security system for a movable, engine-powered vehicle provided with an enabling system, the security system comprising:

(a) an electronic camera positioned to scan at least a portion of the face of a person located at the driver'"'"'s station of the vehicle and structured to produce image signals;

(b) an electronic facial-recognition system responsive to the image signals and controllably coupled to the enabling system; and

(c) an electronic storage device coupled to the facial-recognition system to store a set of image signals, such that the facial-recognition system provides an authorization control signal and activates the enabling system only if signals representative of select characteristics of the scanned face of the person derived from the image signals produced on the camera'"'"'s output match a member. of a set of signals stored in the electronic storage device, each member representative of select characteristics of the scanned face of an authorized operator;

(d) wherein the engine and the gearshift are coupled to cause the engine to become activated in response to the combination of the authorization control signal and a selected gear-shifting action by the person located at the driver'"'"'s station.

65. The security system of claim 64 wherein the engine becomes activated in response to the combination of the authorization control signal and the selected gear-shifting action, without any further input.

66. The security system of claim 64 wherein the vehicle further has a brake pedal coupled to a brake system, and wherein the engine is further coupled to cause the engine to become activated only if the brake pedal is depressed.

67. The security system of claim 66 wherein the engine becomes activated in response to the combination of the authorization control signal, the selected gear-shifting action, and recognition that the brake pedal is depressed, without any further input.

68. The security system of claim 64 further wherein the engine and the gearshift are coupled to cause the engine to turn off in response to a second selected gear-shifting action by the person located at the driver'"'"'s station.

69. The security system of claim 64 further comprising a key-operated switch coupled to the facial-recognition system, which switch, when activated, stores in the electronic storage device, as representative of a member of the set of authorized operators, selected signals representative of select characteristics of the scanned face of a person located at the driver'"'"'s station of the vehicle and derived from the image signals on the camera output.

70. The security system of claim 69 wherein the key-operated switch is structured to become activated by a coded sequence of turns.

71. The security system of claim 70 wherein the facial-recognition system is structured to become disabled for a predetermined period of time upon activation of the key-operated switch.

72. The security system of claim 64 wherein the camera is an infrared scanner and further comprising another electronic camera that is a reflective-light scanner sensitive to visible light, wherein both cameras are positioned to scan at least a portion of the face of the seated person and are coupled to the facial-recognition system.

73. The security system of claim 64 wherein the portion of the face scanned by the camera includes an iris of an eye of the person at the driver'"'"'s station, and wherein the electronic facial-recognition system is structured to recognize characteristics of features within the iris.

74. The security system of claim 64 wherein the camera includes an autofocus lens control.

75. The security system of claim 64 wherein the camera is mounted along the vertical center plane of the vehicle and adjacent to the rear window, and wherein the scanning axis of the camera is directed along the center plane and at a rear-view mirror of the vehicle.

76. The security system of claim 64 wherein the camera is structured to automatically become deactivated upon expiration of a predetermined period of time after it is first activated or upon recognition of an authorized driver by the facial-recognition system, whichever occurs first.

77. The security system of claim 64 wherein the camera is responsive to closure of an ignition key switch of the vehicle to become activated when the key switch is closed.

78. The security system of claim 64 wherein the camera is responsive to activation of a sensor switch to become activated when a person sits at the driver'"'"'s station of the vehicle.

79. The security system of claim 78 wherein the sensor switch is an in-seat sensor.

80. The security system of claim 79 wherein the camera is structured to become deactivated upon opening of the sensor switch.

81. The security system of claim 64 wherein the electronic storage device contains a personal code associated with each authorized operator, and wherein the facial-recognition system is further coupled to an electronic control of the vehicle so as to alter a personal setting automatically based on the code associated with the operator recognized by the facial-recognition system, said electronic control structured to control an operating setting of at least one of the following elements of the vehicle:

(a) an audio system;

(b) an electronic seat;

(c) a window;

(d) a temperature controller;

(e) a mirror; and

(f) the angle of the steering wheel column relative to the dashboard.

82. The security system of claim 64 wherein the facial-recognition system is structured to trigger an audible alarm upon failure of the facial-recognition system to effect said match after a predetermined time.

83. The security system of claim 64 wherein the facial-recognition system is structured to transmit alarm signals to a remote location upon failure of the facial-recognition system to effect said match after a predetermined time.

84. The security system of claim 64 wherein the facial-recognition system is structured to retain in non-volatile storage information derived from the signals on the camera output upon failure of the facial-recognition system to effect said match after a predetermined time.

85. The security system of claim 84 wherein the facial-recognition system is structured to activate a signal light upon failure of the facial-recognition system to effect said match after a predetermined time.

86. The security system of claim 64 wherein:

(a) the facial-recognition system provides an authorization control signal upon determining said match;

(b) the system further comprises a second personal-identification system; and

(c) the authorization control signal is produced only in response to identification of an authorized operator by both the facial-recognition system and the second personal-identification system.

87. The security system of claim 86 wherein the second personal-identification system includes a fingerprint reader.

105. The security system of claim 65p further comprising a signal light responsively coupled to the comparator.

88. A security system for a movable vehicle having a driver'"'"'s station, a gearshift, and an enabling system, the security system comprising:

(a) an electronic camera positioned to scan at least a portion of the face of a person located at the driver'"'"'s station of the vehicle and produce on an output a facial-image-signal;

(b) an electronic facial-image-signal storage device;

(c) an electronic facial-recognition-signal comparator having an output, a first input coupled to the output of the camera, and a second input coupled to the facial-image-signal storage device; and

(d) an AND gate having a first input coupled to the gearshift, a second input coupled to the comparator output, and an output coupled to the enabling system;

whereby the enabling system is coupled and controlled to cause the vehicle to operate in response to the combination of a selected gear-shifting action by the person located at the driver'"'"'s station and a match between signals representative of select characteristics of the scanned face of the person derived from the image signals produced on the camera'"'"'s output and a member of a set of signals stored in the electronic storage device, each member representative of select characteristics of the scanned face of an authorized operator.

89. The security system of claim 88 wherein the AND gate has only two inputs.

90. The security system of claim 88 wherein the vehicle further has a brake pedal coupled to a brake system, and further comprising a second AND gate having a first input coupled to the comparator output, a second input coupled to the brake, and an output coupled to the second input of the first AND gate.

91. The security system of claim 88 further wherein the enabling system and the gearshift are coupled to cause the vehicle'"'"'s engine to turn off in response to a second selected gear-shifting action by the person located at the driver'"'"'s station.

92. The security system of claim 88 further comprising a key-operated switch coupled to the storage device, which switch, when activated, stores in the storage device, as representative of a member of the set of authorized operators, selected signals representative of select characteristics of the scanned face of a person located at the driver'"'"'s station of the vehicle and derived from the facial-image-signals on the camera output.

93. The security system of claim 92 wherein the key-operated switch is structured to become activated by a coded sequence of turns.

94. The system of claim 93 wherein the enabling system and the key-operated switch are coupled so as to prevent the vehicle'"'"'s engine from being activated for a predetermined period of time upon activation of the key-operated switch.

95. The security system of claim 88 wherein the camera is an infrared scanner and further comprising another electronic camera that is a reflective-light scanner sensitive to visible light, wherein both cameras are positioned to scan at least a portion of the face of the seated person and are coupled to the comparator.

96. The security system of claim 88 wherein the portion of the face scanned by the camera includes an iris of an eye of the person at the driver'"'"'s station, and wherein the comparator is structured to recognize characteristics of features within the iris.

97. The security system of claim 88 wherein the camera includes an autofocus lens control.

98. The security system of claim 88 wherein the camera is mounted along the vertical center plane of the vehicle and adjacent to the rear window, and wherein the scanning axis of the camera is directed along the center plane and at a rear-view mirror of the vehicle.

99. The security system of claim 88 wherein the camera is structured to automatically become deactivated upon expiration of a predetermined period of time after it is first activated or upon recognition of an authorized driver by the comparator, whichever occurs first.

100. The security system of claim 88 wherein the camera is responsive to closure of an ignition key switch of the vehicle to become activated when the key switch is closed.

101. The security system of claim 88 wherein the camera is responsively coupled to an in-seat sensor.

102. The security system of claim 88 further comprising an audible alarm and a timer, responsively coupled to the comparator.

103. The security system of claim 102 further comprising a remote transmitter coupled to the alarm and the timer.

104. The security system of claim 88 further comprising a timer and a non-volatile storage information, both responsively coupled to the comparator.

106. The security system of claim 88 further comprises a second personal-identification system and where the AND gate is coupled so as to be activated only in response to identification of an authorized operator by both the comparator and the second personal-identification system.

107. The security system of claim 106 wherein the second personal-identification system includes a fingerprint reader.

108. A method of securing a movable vehicle having a driver'"'"'s station, a gearshift, and an enabling system, the method comprising:

(a) scanning at least a portion of the face of a person located at the driver'"'"'s station of the vehicle and producing image signals therefrom representative of select characteristics of the scanned person'"'"'s face;

(b) comparing the image signals to members of a set of previously stored facial image signals, each member of the set representative of select characteristics of the scanned face of an authorized operator of the vehicle;

(c) producing a control signal reflective of whether the comparing in part (b) produced a match;

(d) activating the enabling system if and only if;

(i) the control signal reflects a match; and

(ii) the gearshift is manipulated in a selected fashion.

109. The method of claim 108 wherein the conditions (i) and (ii) are sufficient to activate the enabling system.

110. The method of claim 108 wherein the movable vehicle has a brake and further comprising activating the enabling system if and only if the conditions (i) and (ii) are met and further if and only if, (iii) the brake is activated.

111. The method of claim 110 wherein the conditions (i), (ii), and (iii) are sufficient to activate the enabling system.

112. The method of claim 108 wherein the enabling system is coupled so as not to require turning of a key to cause its activation.

113. The method of claim 108 further comprising subsequently deactivating the motive force of the movable vehicle if the gearshift is manipulated in a second selected fashion.

114. The method of claim 108 further comprising the preliminary act of operating a key in the moveable vehicle to cause the storing of facial-image signals produced by scanning the face of an authorized operator located at the driver'"'"'s station.

115. The method of claim 114 wherein operating the key comprises manipulating the key through a selected sequence of turns.

116. The method of claim 115 further comprising disabling power to the vehicle for a predetermined period of time after operation of the key.

117. The method of claim 108 wherein the scanning is with respect to infrared radiant emissions from the face of the person.

118. The method of claim 108 further comprising initiating scanning by determining that the person has pressed a brake pedal of the vehicle.

119. The method of claim 108 further comprising automatically repeating acts (a) through (c) until the earlier of (i) expiration of a predetermined length of time and (ii) generation of a control signal that reflects a match.

120. The method of claim 108 further comprising electronically detecting when a person is located at the driver'"'"'s station and effecting such scanning only when a person is so detected.

121. The method of claim 108 wherein the scanning includes an iris of an eye of the person.

122. The method of claim 108 wherein the vehicle is an automobile and the scanning is performed with respect to the reflections in a rear-view mirror mounted along the centerline of the automobile near the front of a passenger cabin thereof.

123. The method of claim 108 further comprising initiating scanning by determining that an ignition key switch of the vehicle has been closed.

124. The method of claim 108 further comprising:

(a) if the image signals electronically match one of the previously stored facial image signals, generating an identification code corresponding to the identity of the recognized person; and

(b) automatically altering a personal setting based on the identification code.

125. The method of claim 124 wherein automatically altering a personal setting comprises adjusting an electronic seat to predetermined settings corresponding to the identification code.

126. The method of claim 124 wherein automatically altering a personal setting comprises adjusting an audio system to predetermined settings corresponding to the identification code.

127. The method of claim 108 further comprising triggering an audible alarm if the image signals fail to match any of the previously stored facial image signals within a predetermined time.

128. The method of claim 108 further comprising transmitting alarm signals to a remote location if the image signals fail to match any of the previously stored facial image signals within a predetermined time.

129. The method of claim 108 further comprising retaining in non-volatile storage supported by the vehicle information derived from the image signals if the image signals fail to match any of the previously stored facial image signals within a predetermined time.

130. The method of claim 129 further comprising activating a signal light adjacent to the storage if the image signals fail to match any of the previously stored facial image signals within a predetermined time.

131. A method for maintaining security of a powered vehicle, the method comprising:

(a) producing image signals by electronically scanning at least a portion of the face of a person at an operator'"'"'s station;

(b) computer analyzing the image signals and generating code signals representative of a set of predefined facial characteristics;

(c) comparing the code signals with a set of previously stored reference signals representative of the predefined facial characteristics of an authorized operator; and

(d) generating signals enabling operation of the powered vehicle if and only if;

(i) the code signals electronically match one of the reference signals, and (ii) the gearshift is manipulated in a selected fashion.

132. The method of claim 131 wherein the conditions (i) and (ii) are sufficient to enable operation of the powered vehicle.

133. The method of claim 131 wherein the powered vehicle has a brake and further comprising enabling operation of the powered vehicle if and only if the conditions (i) and (ii) are met and further if and only if, (iii) the brake is activated.

134. The method of claim 133 wherein the conditions (i), (ii), and (iii) are sufficient to enable operation of the powered vehicle.

135. The method of claim 131 wherein turning a key is not required to enable operation of the powered vehicle.

136. The method of claim 131 further comprising subsequently generating signals disenabling operation of the powered vehicle if and only if the gearshift is manipulated in a second selected fashion.

137. The method of claim 131 further comprising the preliminary act of operating a key in the moveable vehicle to cause the storing of reference signals produced by scanning the face of an authorized person located at the operator'"'"'s station.

138. The method of claim 137 wherein operating the key comprises manipulating the key through a selected sequence of turns.

139. The method of claim 137 further comprising disabling operation of the powered vehicle for a predetermined period of time after operation of the key.

140. The method of claim 131 wherein the scanning is with respect to infrared radiant emissions from the face of the person.

141. The method of claim 131 further comprising initiating scanning by determining that the person has pressed a brake pedal of the vehicle.

142. The method of claim 131 further comprising automatically repeating acts (a) through (c) until the earlier of (i) expiration of a predetermined length of time and (ii) such time as the comparing in part (c) reflects a match.

143. The method of claim 131 further comprising electronically detecting when a person is located at the driver'"'"'s station and effecting such scanning only when a person is so detected.

144. The method of claim 131 wherein the scanning includes an iris of an eye of the person.

145. The method of claim 131 wherein the vehicle is an automobile and the scanning is performed with respect to the reflections in a rear-view mirror mounted along the centerline of the automobile near the front of a passenger cabin thereof.

146. The method of claim 131 further comprising initiating scanning by determining that an ignition key switch of the vehicle has been closed.

147. The method of claim 131 further comprising:

(a) if the code signals electronically match one of the reference signals, generating an identification code corresponding to the identity of the recognized person; and

(b) automatically altering a personal setting based on the identification code.

148. The method of claim 147 wherein automatically altering a personal setting comprises adjusting an electronic seat to predetermined settings corresponding to the identification code.

149. The method of claim 147 wherein automatically altering a personal setting comprises adjusting an audio system to predetermined settings corresponding to the identification code.

150. The method of claim 131 further comprising triggering an audible alarm if the code signals fail to match any of the reference signals within a predetermined time.

151. The method of claim 131 further comprising transmitting alarm signals to a remote location if the code signals fail to match any of the reference signals within a predetermined time.

152. The method of claim 131 further comprising retaining in non-volatile storage supported by the vehicle information derived from the image signals if the code signals fail to match any of the reference signals within a predetermined time.

153. The method of claim 152 further comprising activating a signal light adjacent to the storage if the code signals fail to match any of the reference signals within a predetermined time.

154. A method of retrofitting a moveable vehicle with a security system, which vehicle has a passenger cabin and an engine compartment, a driver'"'"'s seat in the passenger cabin, a gearshift within reach of a person in the driver'"'"'s seat, and an enabling device supported in the engine compartment and structured to enable motive force to the vehicle, comprising:

(a) mounting an assembly to the vehicle, which assembly supports at least the following elements;

(i) an electronic camera having an output for picture signals;

(ii) a facial-recognition system coupled to the output of the camera; and

(iii) an electronic storage device coupled to the facial-recognition system;

(b) positioning the assembly so that the camera is directed at the expected location of the face of a person seated in the driver'"'"'s seat;

(c) wherein the facial-recognition system issues an authorization control signal only if picture signals representative of select characteristics of a face in the rear-view mirror acquired by the electronic camera match a member of a set of signals stored in said electronic storage device, each member of the stored set representative of select characteristics of the face of an authorized operator; and

(d) coupling a control unit to the enabling device and to the gearshift, which control unit activates the enabling system only upon receipt of the authorization control signal from the facial-recognition system and upon receipt of a signal reflective of a select shifting action of the gearshift.

155. The method of claim 154 wherein the coupling in part (d) is such that receipt of the authorization control signal and the signal reflective of a select shifting action are sufficient to enable operation of the moveable vehicle.

156. The method of claim 154 wherein the moveable vehicle has a brake and further comprising coupling the control unit to the brake, wherein the couplings to the control unit are such that the control unit activates the enabling system only upon receipt of the authorization control signal and receipt of the signal reflective of a select shifting action and further only if the brake is activated.

157. The method of claim 156 wherein the couplings to the control unit are such that the control unit activates the enabling system only upon receipt of the authorization control signal and receipt of the signal reflective of a select shifting action and further only if the brake is activated, without any further condition.

158. The method of claim 154 wherein the coupling in part (d) is such that receipt of a signal reflective of a second select shifting action of the gearshift will cause the control unit to deactivate the enabling system.

159. The method of claim 154 wherein part (d) comprises replacing the enabling device with an integral unit containing both the control unit and the enabling device.

160. The method of claim 154 wherein mounting the camera comprises using an infrared scanner.

161. The method of claim 154 wherein mounting the camera comprises aiming the camera at a field that includes an iris of an eye of the person.

162. The method of claim 154 wherein the moveable vehicle has a brake and further comprising coupling the brake to a trigger for the camera.

163. The method of claim 154 further comprising installing an in-seat sensor and coupling the sensor to a trigger for the camera.

164. The method of claim 154 wherein the moveable vehicle has an ignition key switch and further comprising coupling the ignition key switch to a trigger for the camera.

165. The method of claim 154 wherein part (a) includes mounting an assembly that also supports an alarm transmitter configured to transmit alarm signals if an authorization control signal is not generated within a predetermined time after the facial-recognition system is activated.

166. The method of claim 154 wherein part (a) includes mounting an assembly that also supports a non-volatile storage information coupled to store information derived from the picture signals if an authorization control signal is not generated within a predetermined time after the facial-recognition system is activated.

167. An automatically starting movable vehicle having a driver'"'"'s station and a gearshift, and an enabling system, the security system comprising:

(a) an electronic camera positioned to scan at least a portion of the face of a person located at the driver'"'"'s station of the vehicle and produce on an output a facial-image-signal;

(b) an electronic facial-image-signal storage device; and

(c) an electronic facial-recognition-signal comparator having an output, a first input coupled to the output of the camera, and a second input coupled to the facial-image-signal storage device;

(d) wherein the enabling system coupled to the gearshift and to the comparator output such that it becomes activated in response to the combination of a selected gear-shifting action and a match between signals representative of select characteristics of the scanned face of the person derived from the facial-image-signal produced on the camera'"'"'s output and a member of a set of signals stored in the facial-image-signal storage device, each member representative of select characteristics of the scanned face of an authorized operator; and

(e) wherein the enabling system is coupled so as not to require turning of a key to cause its activation.

168. The vehicle of claim 167 wherein the couplings in part (d) are such that the gear-shifting action and the match are sufficient to activate the enabling system.

169. The vehicle of claim 167 wherein the moveable vehicle has a brake and wherein the enabling system is coupled to the brake such that the enabling system is activated only if, further, the brake is activated.

170. The vehicle of claim 169 wherein the couplings to the enabling system are such that the enabling system is activated without any further condition.

171. The vehicle of claim 167 wherein the couplings in part (d) are such that receipt of a signal reflective of a second select shifting action of the gearshift will cause the control unit to deactivate the enabling system.

172. The vehicle of claim 167 further comprising a key-operated switch coupled to the storage device, which switch, when activated, stores in the storage device, as representative of a member of the set of authorized operators, selected signals representative of select characteristics of the scanned face of a person located at the driver'"'"'s station of the vehicle and derived from the facial-image-signal on the camera output.

173. The vehicle of claim 172 wherein the key-operated switch is structured to become activated by a coded sequence of turns.

174. The vehicle of claim 172 wherein the enabling system and the key-operated switch are coupled so as to prevent the vehicle'"'"'s engine from being activated for a predetermined period of time upon activation of the key-operated switch.

175. The vehicle of claim 167 wherein the camera is an infrared scanner and further comprising another electronic camera that is a reflective-light scanner sensitive to visible light, wherein both cameras are positioned to scan at least a portion of the face of the seated person and are coupled to the comparator.

176. The vehicle of claim 167 wherein the portion of the face scanned by the camera includes an iris of an eye of the person at the driver'"'"'s station, and wherein the comparator is structured to recognize characteristics of features within the iris.

177. The vehicle of claim 167 wherein the camera includes an autofocus lens control.

178. The vehicle of claim 167 wherein the camera is mounted along the vertical center plane of the vehicle and adjacent to the rear window, and wherein the scanning axis of the camera is directed along the center plane and at a rear-view mirror of the vehicle.

179. The vehicle of claim 167 wherein the camera is responsive to activation of an in-seat sensor switch to become activated when a person sits at the driver'"'"'s station of the vehicle.

180. The vehicle of claim 167 further comprises a second personal-identification system and where the AND gate is coupled so as to be activated only in response to identification of an authorized operator by both the comparator and the second personal-identification system.

181. The vehicle of claim 180 wherein the second personal-identification system includes a fingerprint reader.