Vehicular component control systems and methods

• US 20010029416A1
• Filed: 04/20/2001
• Published: 10/11/2001
• Est. Priority Date: 05/05/1992
• Status: Active Grant

• Current Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Original Assignee: Automotive Technologies International Incorporated
• Inventors: Breed, David S., Johnson, Wendell C., DuVall, Wilbur E.
• Granted Patent: US 6,442,465 B2
• Time in Patent Office: Days
• US Class Current: 701/45
• CPC Class Codes: B60J 10/00 Sealing arrangements
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/02246 Electric motors therefor
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60N 2/0248 with memory of positions
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0272 using sensors or detectors for detecting the position of seat parts
• CPC Class Codes: B60N 2/0276 reaction to emergency situations, e.g. crash
• CPC Class Codes: B60N 2/28 Seats readily mountable on, and dismountable from, existing seats or other parts of the vehicle
• CPC Class Codes: B60N 2/2806 for securing the child seat to the vehicle
• CPC Class Codes: B60N 2/2863 backward facing
• CPC Class Codes: B60N 2/829 characterised by their adjusting mechanisms, e.g. electric motors
• CPC Class Codes: B60N 2/888 with arrangements for protecting against abnormal g-forces, e.g. by displacement of the head-rest
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60R 1/088 using a cell of electrically changeable optical characteristic, e.g. liquid-crystal or electrochromic mirrors
• CPC Class Codes: B60R 11/0241 for telephones
• CPC Class Codes: B60R 16/037 for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 19/205 inflatable in the direction of an obstacle upon impending impact, e.g. using air bags
• CPC Class Codes: B60R 19/42 : extending primarily along the sides of, or completely encircling, a vehicle ornamental or guard strips B60R13/04
• CPC Class Codes: B60R 2001/1223 : with sensors or transducers
• CPC Class Codes: B60R 2021/0006 : Lateral collision
• CPC Class Codes: B60R 2021/0027 : Post collision measures, e.g. notifying emergency services
• CPC Class Codes: B60R 2021/01315 : monitoring occupant displacement
• CPC Class Codes: B60R 2021/23332 : using independent bags, one within the other
• CPC Class Codes: B60R 2021/26058 : using a combination of inflators
• CPC Class Codes: B60R 2021/26094 : characterised by fluid flow controlling valves
• CPC Class Codes: B60R 2021/2765 : comprising means to control the venting
• CPC Class Codes: B60R 2022/208 : by automatic or remote control means
• CPC Class Codes: B60R 2022/4825 : for sensing amount of belt winded on retractor
• CPC Class Codes: B60R 21/013 : including means for detecting collisions, impending collisions or roll-over
• CPC Class Codes: B60R 21/0134 : responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/0136 : responsive to actual contact with an obstacle , e.g. to vehicle deformation, bumper displacement or bumper velocity relative to the vehicle monitoring crash strength in combination with passenger seat detection B60R21/01558
• CPC Class Codes: B60R 21/01516 : using force or pressure sensing means
• CPC Class Codes: B60R 21/0152 : using strain gauges
• CPC Class Codes: B60R 21/01534 : using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 : using ultrasonic waves
• CPC Class Codes: B60R 21/01538 : for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/0154 : in combination with seat heating
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: B60R 21/01544 : detecting seat belt parameters, e.g. length, tension or height-adjustment
• CPC Class Codes: B60R 21/01548 : sensing the amount of belt winded on retractor
• CPC Class Codes: B60R 21/01552 : detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01554 : Seat position sensors
• CPC Class Codes: B60R 21/21656 : Steering wheel covers or similar cup-shaped covers
• CPC Class Codes: B60R 21/23138 : specially adapted for side protection B60R21/23184, B60R21/232 take precedence
• CPC Class Codes: B60R 21/233 : comprising a plurality of individual compartments; comprising two or more bag-like members, one within the other B60R21/232 takes precedence
• CPC Class Codes: B60R 21/276 : with means to vent the inflation fluid source, e.g. in case of overpressure B60R21/30 takes precedence; venting means on inflatable member walls B60R21/239
• CPC Class Codes: B60R 22/20 : adjustable in position, e.g. in height
• CPC Class Codes: B60R 22/26 : secured to the seat
• CPC Class Codes: B60R 22/321 : using electric means
• CPC Class Codes: B60R 25/255 : Eye recognition
• CPC Class Codes: B60W 2556/50 : of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: E05F 15/431 : specially adapted for vehicle windows or roofs
• CPC Class Codes: E05F 2015/433 : using reflection from the obstruction
• CPC Class Codes: E05F 2015/434 : with cameras or optical sensors
• CPC Class Codes: E05Y 2900/55 : Windows
• CPC Class Codes: G01F 23/20 : by measurement of weight, e.g. to determine the level of stored liquefied gas
• CPC Class Codes: G01F 23/2962 : Measuring transit time of reflected waves
• CPC Class Codes: G01F 23/804 : containing circuits handling parameters other than liquid level
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 13/88 : Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/417 : involving the use of neural networks
• CPC Class Codes: G01S 7/48 : of systems according to group G01S17/00
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/487 : Extracting wanted echo signals , e.g. pulse detection
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G08G 1/161 : Decentralised systems, e.g. inter-vehicle communication
• CPC Class Codes: G08G 1/163 : involving continuous checking
• CPC Class Codes: G08G 1/164 : Centralised systems, e.g. external to vehicles
• CPC Class Codes: G10K 2210/1282 : Automobiles
• CPC Class Codes: G10K 2210/3219 : Geometry of the configuration

Abstract

System and method for controlling operation of a vehicle or a component thereof based on recognition of a individual including a processor embodying a pattern recognition algorithm trained to identify whether a person is the individual by analyzing data derived from optical images and an optical receiving unit for receiving images including the person and deriving data from the images. The optical receiving unit provides the data to the algorithm to obtain an indication from the algorithm whether the person is the individual. A security system enables operation of the vehicle when the algorithm provides an indication that the person is an individual authorized to operate the vehicle and prevents operation of the vehicle when the algorithm does not provide an indication that the person is an individual authorized to operate the vehicle. A component adjustment system adjusts the component based on the recognition of the individual.

Claims

1. A system for controlling operation of a vehicle based on recognition of an authorized individual, comprising:

a processor embodying a pattern recognition algorithm trained to identify whether a person is the individual by analyzing data derived from images;

at least one optical receiving unit for receiving an optical image including the person and deriving data from the image, said at least one optical receiving unit being coupled to said processor to provide the data to the pattern recognition algorithm to thereby obtain an indication from the pattern recognition algorithm whether the person is the individual; and

a security system arranged to enable operation of the vehicle when the pattern recognition algorithm provides an indication that the person is an individual authorized to operate the vehicle and prevent operation of the vehicle when the pattern recognition algorithm does not provide an indication that the person is an individual authorized to operate the vehicle.

2. The system of

claim 1

, wherein the pattern recognition algorithm is a neural network.

3. The system of

claim 1

, wherein said at least one optical receiving unit is structured and arranged to receive infrared radiation.

4. The system of

claim 1

, further comprising an optical transmitting unit for transmitting electromagnetic energy arranged relative to said at least one optical receiving unit such that electromagnetic energy transmitted by said optical transmitting unit is reflected by the person and received by said at least one optical receiving unit.

5. The system of

claim 1

, wherein said at least one optical receiving unit comprises a plurality of optical receiving units arranged apart from one another.

6. The system of

claim 1

, wherein said at least one optical receiving unit comprises at least one of a CCD array and a CMOS array.

7. The system of

claim 1

, wherein said at least one optical receiving unit is arranged to receive a two-dimensional image.

8. The system of

claim 1

, wherein said at least one optical receiving unit is arranged to receive a three-dimensional image.

9. The system of

claim 1

, wherein said at least one optical receiving unit is an active pixel camera.

10. The system of

claim 1

, wherein said at least one optical receiving unit is an HDRC camera.

11. The system of

claim 1

, wherein said processor is structured and arranged to determine a position of the person based on the data.

12. The system of

claim 1

, wherein said processor is structured and arranged to determine a distance between said at least one optical receiving unit and the person based on the data

13. A method for controlling operation of a vehicle based on recognition of a person as one of a set of authorized individuals, comprising the steps of:

obtaining images including the authorized individuals by means of at least one optical receiving unit;

deriving data from the images;

training a pattern recognition algorithm on the data derived from the images which is capable of identifying a person as one of the individuals;

then

subsequently obtaining images by means of the at least one optical receiving unit;

inputting data derived from the images subsequently obtained by the at least one optical receiving unit into the pattern recognition algorithm to obtain an indication whether the person is one of the set of authorized individuals; and

providing a security system which enables operation of the vehicle when the pattern recognition algorithm provides an indication that the person is one of the set of individuals authorized to operate the vehicle and prevents operation of the vehicle when the pattern recognition algorithm does not provide an indication that the person is one of the set of individuals authorized to operate the vehicle.

14. The method of

claim 13

, wherein the pattern recognition algorithm is a neural network.

15. The method of

claim 13

, wherein the step of obtaining images comprises the step of positioning an infrared radiation receiving unit to receive infrared radiation from a passenger compartment of the vehicle.

16. The method of

claim 13

, further comprising the step of transmitting electromagnetic energy toward the person so as to enable images to be obtained by the at least one optical receiving unit.

17. The method of

claim 13

, wherein the at least one optical receiving unit comprises a plurality of optical receiving units arranged apart from one another.

18. The method of

claim 13

, wherein the at least optical receiving unit comprises at least one of a CCD array and a CMOS array.

19. The method of

claim 13

, wherein the at least optical receiving unit is arranged to receive a two-dimensional image.

20. The method of

claim 13

, wherein the at least one optical receiving unit is arranged to receive a three-dimensional image.

21. The method of

claim 13

, wherein each of the images is constituted by an array of pixels, the step of deriving data from the images comprising the step of eliminating pixels from the images which are present in multiple images.

22. The method of

claim 13

, wherein each of the images is constituted by an array of pixels, the step of deriving data from the images comprising the step of comparing the images with stored arrays of pixels and eliminating pixels from the images which are present in the stored arrays of pixels.

23. The method of

claim 13

, wherein the step of training the pattern recognition algorithm comprises the step of determining the location of specific features of the individuals.

24. A vehicle including a system for controlling a component based on recognition of an individual, comprising:

a processor embodying a pattern recognition algorithm trained to identify whether a person is the individual by analyzing data derived from images;

at least one optical receiving unit arranged to receive an optical image of the person and derive data from the image, said at least one optical receiving unit being coupled to said processor to provide the data derived from the image to the pattern recognition algorithm to thereby obtain an indication from the pattern recognition algorithm as to whether the person is the individual; and

control means coupled to the component for affecting the component based on the indication from the pattern recognition algorithm whether the person is the individual.

25. The vehicle of

claim 24

, wherein the pattern recognition algorithm is a neural network.

26. The vehicle of

claim 24

, wherein said at least one optical receiving unit is structured and arranged to receive infrared radiation.

27. The vehicle of

claim 24

, wherein the component is a rear view mirror, said control means comprise means for adjusting the rear view mirror.

28. The vehicle of

claim 24

, wherein the component is a seat on which the person is sitting, said control means comprising means for adjusting the seat.

29. The vehicle of

claim 24

, wherein the component is a seat belt, said control means comprising means for adjusting an anchorage point of the seat belt.

30. The vehicle of

claim 24

, wherein the component is a headrest associated with the seat on which the person is sitting, said control means comprising means for adjusting the headrest.

31. The vehicle of

claim 24

, wherein the component is a steering wheel, said control means comprising means for adjusting the steering wheel.

32. The vehicle of

claim 24

, wherein the component is a pedal, said control means comprising means for adjusting the pedal.

33. The vehicle of

claim 24

, further comprising an optical transmitting unit for transmitting electromagnetic energy arranged relative to said at least one optical receiving unit such that electromagnetic energy transmitted by said optical transmitting unit is reflected by the person and received by said at least one optical receiving unit.

34. The vehicle of

claim 24

, wherein said at least one optical receiving unit comprises a plurality of optical receiving units arranged apart from one another.

35. The vehicle of

claim 24

, wherein said at least one optical receiving unit comprises at least one of a CCD array and a CMOS array.

36. The vehicle of

claim 24

, wherein said at least one optical receiving unit is arranged to receive a two-dimensional image.

37. The vehicle of

claim 24

, wherein said at least one optical receiving unit is arranged to receive a three-dimensional image.

38. The vehicle of

claim 24

, wherein said at least one optical receiving unit is an active pixel camera.

39. The vehicle of

claim 24

, wherein said at least one optical receiving unit is an HDRC camera.

40. The vehicle of

claim 24

, wherein said processor is structured and arranged to determine a position of the person based on the data derived from the image, said control means being arranged to control the device based on the position of the person.

41. The vehicle of

claim 24

, wherein said processor is structured and arranged to determine a position of the person based on the data derived from the image and monitor the position of the person over time, said control means being arranged to control the device based on the position of the person and any movement of the person.

42. The vehicle of

claim 24

, wherein said processor is structured and arranged to determine a distance between said at least one optical receiving unit and the person based on the data derived from the image, said control means being arranged to control the device based on the distance between said at least one optical receiving unit and the person.

43. A method for controlling a vehicular component based on recognition of a person as one of a predetermined set of particular individuals, comprising the steps of:

obtaining images including the individuals by means of at least one optical receiving unit;

deriving data from the images;

training a pattern recognition algorithm on the data derived from the images which is capable of identifying a person as one of the individuals;

then

subsequently obtaining images by means of the at least one optical receiving unit;

inputting data derived from the images subsequently obtained by the at least one optical receiving unit into the pattern recognition algorithm to obtain an indication as to whether the person is one of the set of individuals; and

affecting the component based on the indication from the pattern recognition algorithm whether the person is one of the set of individuals.

44. The method of

claim 43

, wherein the pattern recognition algorithm is a neural network.

45. The method of

claim 43

, wherein the step of obtaining images comprises the step of positioning an infrared radiation receiving unit to receive infrared radiation from a passenger compartment of the vehicle.

46. The method of

claim 43

, wherein the component is a rear view mirror, the step of affecting the component comprising the step of adjusting the rear view mirror.

47. The method of

claim 43

, wherein the component is a seat on which the person is sitting, the step of affecting the component comprising the step of adjusting the seat.

48. The method of

claim 43

, wherein the component is a seat belt, the step of affecting the component comprising the step of adjusting an anchorage point of the seat belt.

49. The method of

claim 43

, wherein the component is a headrest associated with the seat on which the person is sitting, the step of affecting the component comprising the step of adjusting the headrest.

50. The method of

claim 43

, wherein the component is a steering wheel, the step of affecting the component comprising the step of adjusting the steering wheel.

51. The method of

claim 43

, wherein the component is a pedal, the step of affecting the component comprising the step of adjusting the pedal.

52. The method of

claim 43

, further comprising the step of transmitting electromagnetic energy toward the person so as to enable images to be obtained by the at least one optical receiving unit.

53. The method of

claim 43

, wherein the at least one optical receiving unit comprises a plurality of optical receiving units arranged apart from one another.

54. The method of

claim 43

, wherein the at least optical receiving unit comprises at least one of a CCD array and a CMOS array.

55. The method of

claim 43

, wherein the at least optical receiving unit is arranged to receive a two-dimensional image of the person.

56. The method of

claim 43

, wherein the at least one optical receiving unit is arranged to receive a three-dimensional image.

57. The method of

claim 43

, wherein each of the images is constituted by an array of pixels, the step of deriving data from the images comprising the step of eliminating pixels from the images which are present in multiple images.

58. The method of

claim 43

, wherein each of the images is constituted by an array of pixels, the step of deriving data from the images comprising the step of comparing the images with stored arrays of pixels and eliminating pixels from the images which are present in the stored arrays of pixels.

59. The method of

claim 43

, wherein the step of training the pattern recognition algorithm comprises the step of determining the location of specific features of the individuals.

60. The method of

claim 43

, further comprising the step of determining a position of the person based on the data derived from the images, the device being controlled based on the position of the person.

61. The method of

claim 43

, further comprising the steps of:

determining a position of the person based on the data derived from the images; and

determining any movement of the person based on the data derived from the images, the device being controlled based on the position of the person and any movement of the person.

62. The method of

claim 43

, further comprising the step of determining a distance between the at least one optical receiving unit and the person based on the data derived from the images, the device being controlled based on the distance between the at least one optical receiving unit and the person.