Vehicle recognition using multiple metrics

• US 20060030985A1
• Filed: 10/21/2004
• Published: 02/09/2006
• Est. Priority Date: 10/24/2003
• Status: Abandoned Application

• Current Assignee: Active Recognition Technologies, Inc.
• Original Assignee: Active Recognition Technologies, Inc., A Delaware Corporation
• Inventors: Lawida, Arthur, Sorensen, Ole
• Application Number:
  US10/971,768
• Publication Number:
  US 20060030985A1
• Time in Patent Office: Days
• US Class Current: 701/35
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 20/625 License plates
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 2201/08 Detecting or categorising vehicles
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors

Abstract

Vehicle recognition may be achieved by receiving multiple metrics from one or more vehicle sensors, analyzing the metrics to create a multi-metric vehicle identification profile comprising at least two of the multiple metrics, at least one result of the analyzing, or both, and matching the multi-metric vehicle identification profile against multiple stored vehicle sensor recordings.

Claims

1. A method for vehicle recognition, the method comprising:

receiving a plurality of metrics from one or more vehicle sensors;

analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

2. The method of claim 1 wherein said first sensor comprises a color video camera.

3. The method of claim 2, further comprising obtaining color, shape, and license number metrics from said color video camera.

4. The method of claim 2 wherein said second sensor comprises an infrared video camera.

5. The method of claim 1 wherein said plurality of metrics comprises:

vehicle color; and

vehicle license number.

6. The method of claim 5 wherein said plurality of metrics further comprises:

vehicle shape.

7. The method of claim 1, further comprising determining whether to restrict or grant access to one or more facilities, one or more services, or both, based at least in part on whether said at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile.

8. The method of claim 1, further comprising:

if at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile, presenting said at least one of said plurality of stored vehicle sensor recordings.

9. The method of claim 8 wherein said at least one of said plurality of stored sensor recordings comprises at least one video image.

10. The method of claim 1 wherein said one or more vehicle sensors comprises one vehicle sensor.

11. The method of claim 1 wherein said one or more vehicle sensors comprises a color video camera and at least one other vehicle sensor.

12. The method of claim 1 wherein said multi-metric vehicle identification profile comprises information characterizing one or more conditions under which said plurality of metrics was obtained.

13. The method of claim 1 wherein at least one of said one or more vehicle sensors comprises a stationary vehicle sensor.

14. The method of claim 1 wherein at least one of said one or more vehicle sensors comprises a mobile vehicle sensor.

15. The method of claim 1 wherein said receiving further comprises receiving said plurality of metrics in real-time.

16. The method of claim 1 wherein said receiving further comprises receiving a recording of said plurality of metrics in real-time.

17. The method of claim 1 wherein said receiving further comprises receiving a recording of said plurality of metrics.

18. The method of claim 1 wherein said receiving further comprises receiving said plurality of metrics according to one or more schedules;

and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

19. The method of claim 1 wherein said matching further comprises substituting or replacing at least one character in said multi-metric vehicle identification profile with at least one other character.

20. The method of claim 19 wherein said matching further comprises using one or more alternate character set of at least one character in said multi-metric vehicle identification profile.

21. The method of claim 19 wherein said matching further comprises using one or more alternate space sizes, locations, or both, for a license number in said multi-metric vehicle identification profile.

22. A program storage device readable by a machine, embodying a program of instructions executable by the machine to perform a method for vehicle recognition, the method comprising:

receiving a plurality of metrics from one or more vehicle sensors;

analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

23. The program storage device of claim 22 wherein said first sensor comprises a color video camera.

24. The program storage device of claim 23, said method further comprising obtaining color, shape, and license number metrics from said color video camera.

25. The program storage device of claim 23 wherein said second sensor comprises an infrared video camera.

26. The program storage device of claim 22 wherein said plurality of metrics comprises:

vehicle color; and

vehicle license number.

27. The program storage device of claim 26 wherein said plurality of metrics further comprises:

vehicle shape.

28. The program storage device of claim 22, said method further comprising determining whether to restrict or grant access to one or more facilities, one or more services, or both, based at least in part on whether said at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile.

29. The program storage device of claim 22, said method further comprising:

if at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile, presenting said at least one of said plurality of stored vehicle sensor recordings.

30. The program storage device of claim 29 wherein said at least one of said plurality of stored sensor recordings comprises at least one video image.

31. The program storage device of claim 22 wherein said one or more vehicle sensors comprises one vehicle sensor.

32. The program storage device of claim 22 wherein said one or more vehicle sensors comprises a color video camera and at least one other vehicle sensor.

33. The program storage device of claim 22 wherein said multi-metric vehicle identification profile comprises information characterizing one or more conditions under which said plurality of metrics was obtained.

34. The program storage device of claim 22 wherein at least one of said one or more vehicle sensors comprises a stationary vehicle sensor.

35. The program storage device of claim 22 wherein at least one of said one or more vehicle sensors comprises a mobile vehicle sensor.

36. The program storage device of claim 22 wherein said receiving further comprises receiving said plurality of metrics in real-time.

37. The program storage device of claim 22 wherein said receiving further comprises receiving a recording of said plurality of metrics in real-time.

38. The program storage device of claim 22 wherein said receiving further comprises receiving a recording of said plurality of metrics.

39. The program storage device of claim 22 wherein said receiving further comprises receiving said plurality of metrics according to one or more schedules;

and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

40. The program storage device of claim 22 wherein said matching further comprises substituting or replacing at least one character in said multi-metric vehicle identification profile with at least one other character.

41. The program storage device of claim 40 wherein said matching further comprises using one or more alternate character set of at least one character in said multi-metric vehicle identification profile.

42. The program storage device of claim 40 wherein said matching further comprises using one or more alternate space sizes, locations, or both, for a license number in said multi-metric vehicle identification profile.

43. An apparatus for vehicle recognition, the apparatus comprising:

receiving a plurality of metrics from one or more vehicle sensors;

means for analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

means for matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

44. The apparatus of claim 43 wherein said first sensor comprises a color video camera.

45. The apparatus of claim 44, further comprising means for obtaining color, shape, and license number metrics from said color video camera.

46. The apparatus of claim 44 wherein said second sensor comprises an infrared video camera.

47. The apparatus of claim 43 wherein said plurality of metrics comprises:

vehicle color; and

vehicle license number.

48. The apparatus of claim 47 wherein said plurality of metrics further comprises:

vehicle shape.

49. The apparatus of claim 43, further comprising means for determining whether to restrict or grant access to one or more facilities, one or more services, or both, based at least in part on whether said at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile.

50. The apparatus of claim 43, further comprising:

means for if at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile, presenting said at least one of said plurality of stored vehicle sensor recordings.

51. The apparatus of claim 50 wherein said at least one of said plurality of stored sensor recordings comprises at least one video image.

52. The apparatus of claim 43 wherein said one or more vehicle sensors comprises one vehicle sensor.

53. The apparatus of claim 43 wherein said one or more vehicle sensors comprises a color video camera and at least one other vehicle sensor.

54. The apparatus of claim 43 wherein said multi-metric vehicle identification profile comprises information characterizing one or more conditions under which said plurality of metrics was obtained.

55. The apparatus of claim 43 wherein at least one of said one or more vehicle sensors comprises a stationary vehicle sensor.

56. The apparatus of claim 43 wherein at least one of said one or more vehicle sensors comprises a mobile vehicle sensor.

57. The apparatus of claim 43 wherein said receiving further comprises receiving said plurality of metrics in real-time.

58. The apparatus of claim 43 wherein said receiving further comprises receiving a recording of said plurality of metrics in real-time.

59. The apparatus of claim 43 wherein said receiving further comprises receiving a recording of said plurality of metrics.

60. The apparatus of claim 43 wherein said receiving further comprises receiving said plurality of metrics according to one or more schedules;

and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

61. The apparatus of claim 43 wherein said matching further comprises substituting or replacing at least one character in said multi-metric vehicle identification profile with at least one other character.

62. The apparatus of claim 61 wherein said matching further comprises using one or more alternate character set of at least one character in said multi-metric vehicle identification profile.

63. The apparatus of claim 61 wherein said matching further comprises using one or more alternate space sizes, locations, or both, for a license number in said multi-metric vehicle identification profile.

64. An apparatus for vehicle recognition, the apparatus comprising:

one or more data stores comprising a plurality of stored vehicle sensor recordings; and

one or more processors adapted to;

receive a plurality of metrics from one or more vehicle sensors;

analyze said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

match said multi-metric vehicle identification profile against said plurality of stored vehicle sensor recordings.

65. The apparatus of claim 64 wherein said first sensor comprises a color video camera.

66. The apparatus of claim 65 wherein said one or more processors are further adapted to obtain color, shape, and license number metrics from said color video camera.

67. The apparatus of claim 65 wherein said second sensor comprises an infrared video camera.

68. The apparatus of claim 64 wherein said plurality of metrics comprises:

vehicle color; and

vehicle license number.

69. The apparatus of claim 68 wherein said plurality of metrics further comprises:

vehicle shape.

70. The apparatus of claim 64 wherein said one or more processors are further adapted to determine whether to restrict or grant access to one or more facilities, one or more services, or both, based at least in part on whether said at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile.

71. The apparatus of claim 64 wherein said one or more processors are further adapted to, if at least one of said plurality of stored vehicle sensor recordings matches said multi-metric vehicle identification profile, present said at least one of said plurality of stored vehicle sensor recordings.

72. The apparatus of claim 71 wherein said at least one of said plurality of stored sensor recordings comprises at least one video image.

73. The apparatus of claim 64 wherein said one or more vehicle sensors comprises one vehicle sensor.

74. The apparatus of claim 64 wherein said one or more vehicle sensors comprises a color video camera and at least one other vehicle sensor.

75. The apparatus of claim 64 wherein said multi-metric vehicle identification profile comprises information characterizing one or more conditions under which said plurality of metrics was obtained.

76. The apparatus of claim 64 wherein at least one of said one or more vehicle sensors comprises a stationary vehicle sensor.

77. The apparatus of claim 64 wherein at least one of said one or more vehicle sensors comprises a mobile vehicle sensor.

78. The apparatus of claim 64 wherein said one or more processors are further adapted to receive said plurality of metrics in real-time.

79. The apparatus of claim 64 wherein said one or more processors are further adapted to receive a recording of said plurality of metrics in real-time.

80. The apparatus of claim 64 wherein said one or more processors are further adapted to receive a recording of said plurality of metrics.

81. The apparatus of claim 64 wherein said one or more processors are further adapted to receive said plurality of metrics according to one or more schedules;

and

match said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

82. The apparatus of claim 64 wherein said one or more processors are further adapted to substitute or replace at least one character in said multi-metric vehicle identification profile with at least one other character.

83. The apparatus of claim 82 wherein said one or more processors are further adapted to use one or more alternate character set of at least one character in said multi-metric vehicle identification profile.

84. The apparatus of claim 82 wherein said one or more processors are further adapted to use one or more alternate space sizes, locations, or both, for a license number in said multi-metric vehicle identification profile.

85. A method for object recognition, the method comprising:

receiving a plurality of metrics from one or more object sensors;

analyzing said plurality of metrics to create an object identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

matching said object identification profile against a plurality of stored object sensor recordings.

86. A program storage device readable by a machine, embodying a program of instructions executable by the machine to perform a method for object recognition, the method comprising:

receiving a plurality of metrics from one or more object sensors;

analyzing said plurality of metrics to create a multi-metric object identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

matching said object identification profile against a plurality of stored object sensor recordings.

87. An apparatus for object recognition, the apparatus comprising:

means for receiving a plurality of metrics from one or more object sensors;

means for analyzing said plurality of metrics to create a multi-metric object identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

means for matching said object identification profile against a plurality of stored object sensor recordings.

88. An apparatus for object recognition, the apparatus comprising:

one or more data store comprising a plurality of stored object sensor recordings; and

one or more processors adapted to;

receive a plurality of metrics from one or more object sensors;

analyze said plurality of metrics to create a multi-metric object identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

match said object identification profile against said plurality of stored object sensor recordings.

89. A method for identifying one or more mismatches between a plurality of vehicle metrics, the method comprising:

receiving a plurality of metrics from one or more vehicle sensors;

analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both;

obtaining from a vehicle registration data store, one or more vehicle registration profiles corresponding to said at least one metric; and

indicating a mismatch if at least part of said multi-metric vehicle identification profile does not match said vehicle registration profile.

90. A program storage device readable by a machine, embodying a program of instructions executable by the machine to perform a method for identifying one or more mismatches between a plurality of vehicle metrics, the method comprising:

receiving a plurality of metrics from one or more vehicle sensors;

analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both;

obtaining from a vehicle registration data store, one or more vehicle registration profiles corresponding to said at least one metric; and

indicating a mismatch if at least part of said multi-metric vehicle identification profile does not match said vehicle registration profile.

91. An apparatus for identifying one or more mismatches between a plurality of vehicle metrics, the apparatus comprising:

means for receiving a plurality of metrics from one or more vehicle sensors;

means for analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both;

means for obtaining from a vehicle registration data store, one or more vehicle registration profiles corresponding to said at least one metric; and

means for indicating a mismatch if at least part of said multi-metric vehicle identification profile does not match said vehicle registration profile.

92. An apparatus for identifying one or more mismatches between a plurality of vehicle metrics, the apparatus comprising:

a registration data store comprising one or more vehicle registration profiles; and

one or more processors adapted to;

receive a plurality of metrics from one or more vehicle sensors;

analyze said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both;

obtain from a vehicle registration data store, one or more vehicle registration profiles in said registration data store corresponding to said at least one metric; and

indicate a mismatch if at least part of said multi-metric vehicle identification profile does not match said vehicle registration profile.

93. A method for monitoring vehicles based on vehicle type, the method comprising:

creating one or more registration profiles for at least one orientation of each of one or more vehicles categorized at least by orientation, said one or more registration profiles based at least in part on a plurality of metrics received from one or more vehicle sensors, said one or more vehicle registration profiles comprising texture information; and

matching a vehicle query profile against said one or more multi-metric vehicle identification profiles.

94. The method of claim 93 wherein said one or more vehicle information profiles are further categorized by at least vehicle make and model.

95. The method of claim 93 wherein said one or more vehicle information profiles are further categorized by at least license plate state of origin.

96. The method of claim 93 wherein said one or more vehicle information profiles are further categorized by at least license plate type.

97. The method of claim 93 wherein said one or more vehicle information profiles comprise one or more category codes and one or more category heuristic rules.

98. A program storage device readable by a machine, embodying a program of instructions executable by the machine to perform a method for monitoring vehicles based on vehicle type, the method comprising:

creating one or more registration profiles for at least one orientation of each of one or more vehicles categorized at least by orientation, said one or more registration profiles based at least in part on a plurality of metrics received from one or more vehicle sensors, said one or more vehicle registration profiles comprising texture information; and

matching a vehicle query profile against said one or more multi-metric vehicle identification profiles.

99. The program storage device of claim 98 wherein said one or more vehicle information profiles are further categorized by at least vehicle make and model.

100. The program storage device of claim 98 wherein said one or more vehicle information profiles are further categorized by at least license plate state of origin.

101. The program storage device of claim 98 wherein said one or more vehicle information profiles are further categorized by at least license plate type.

102. The program storage device of claim 98 wherein said one or more vehicle information profiles comprise one or more category codes and one or more category heuristic rules.

103. An apparatus for monitoring vehicles based on vehicle type, the apparatus comprising:

means for creating one or more registration profiles for at least one orientation of each of one or more vehicles categorized at least by orientation, said one or more registration profiles based at least in part on a plurality of metrics received from one or more vehicle sensors, said one or more vehicle registration profiles comprising texture information; and

means for matching a vehicle query profile against said one or more multi-metric vehicle identification profiles.

104. The apparatus of claim 103 wherein said one or more vehicle information profiles are further categorized by at least vehicle make and model.

105. The apparatus of claim 103 wherein said one or more vehicle information profiles are further categorized by at least license plate state of origin.

106. The apparatus of claim 103 wherein said one or more vehicle information profiles are further categorized by at least license plate type.

107. The apparatus of claim 103 wherein said one or more vehicle information profiles comprise one or more category codes and one or more category heuristic rules.

108. An apparatus for monitoring vehicles based on vehicle type, the apparatus comprising:

one or more data stores comprising one or more registration profiles; and

one or more processors adapted to;

create one or more registration profiles for at least one orientation of each of one or more vehicles categorized at least by orientation, said one or more registration profiles based at least in part on a plurality of metrics received from one or more vehicle sensors, said one or more vehicle registration profiles comprising texture information; and

match a vehicle query profile against said one or more multi-metric vehicle identification profiles.

109. The apparatus of claim 108 wherein said one or more vehicle information profiles are further categorized by at least vehicle make and model.

110. The apparatus of claim 108 wherein said one or more vehicle information profiles are further categorized by at least license plate state of origin.

111. The apparatus of claim 108 wherein said one or more vehicle information profiles are further categorized by at least license plate type.

112. The apparatus of claim 108 wherein said one or more vehicle information profiles comprise one or more category codes and one or category model heuristic rules.

113. A method for vehicle recognition, the method comprising:

receiving a first plurality of metrics from one or more vehicle sensors;

analyzing said first plurality of metrics to create a first multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing said first plurality of metrics, or both; and

storing said first multi-metric vehicle identification profile in a vehicle registration data store;

receiving a second plurality of metrics from said one or more vehicle sensors;

analyzing said second plurality of metrics to create a second multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing said first plurality of metrics, or both; and

matching said second multi-metric vehicle identification profile against at least one multi-metric vehicle identification profile in said vehicle registration data store.

114. The method of claim 113 wherein said storing further comprising storing said first multi-metric vehicle identification profile in said vehicle registration data store if said multi-metric vehicle identification profile is absent from said vehicle registration data store.

115. The method of claim 113, further comprising controlling the presence of or access for one or more vehicles in their movement from one area to another.

116. A method for license plate recognition for license plates having non-uniform character size and spacing, the method comprising:

receiving a plurality of metrics from one or more vehicle sensors;

analyzing said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

matching said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

117. A method for vehicle color characterization, the method comprising:

storing in a data store one or more vehicle color material sample image recordings and for each of said color material sample image recordings, an indication of the lighting conditions under which said color material sample image recordings were made;

receiving an image recording corresponding to a sensed vehicle and an indication of the lighting conditions under which said image recording was made; and

matching said image recording to one or more of said vehicle color material sample image recordings in said data store based at least in part on said indication of the lighting conditions under which said image recording was made.

118. A system for vehicle recognition, the system comprising:

one or more vehicle sensors adapted to sense one or more vehicle metrics; and

a recognition processing system communicatively coupled to said one or more vehicle sensors, said recognition processing system adapted to;

receive a plurality of metrics from said one or more vehicle sensors;

analyze said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

match said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

119. The system of claim 118, further comprising:

one or more application systems communicatively coupled to said recognition processing system, said one or more application systems adapted to use the result of said match to perform a process.

120. An apparatus for vehicle recognition, the apparatus comprising:

one or more vehicle sensors adapted to sense one or more vehicle metrics; and

a recognition processing system communicatively coupled to said one or more vehicle sensors, said recognition processing system adapted to;

receive a plurality of metrics from one or more vehicle sensors;

analyze said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

match said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings.

121. The apparatus of claim 120, further comprising:

one or more application systems communicatively coupled to said recognition processing system, said one or more application systems adapted to use the result of said match to perform a process.

122. The apparatus of claim 121 wherein said apparatus comprises a flashlight.

123. The apparatus of claim 121 wherein said apparatus comprises a camera.

124. A method for vehicle application system management, comprising:

receiving an indication of whether a vehicle recognition system recognized a vehicle, said vehicle recognition system adapted to;

receive a plurality of metrics from one or more vehicle sensors;

analyze said plurality of metrics to create a multi-metric vehicle identification profile comprising at least two of said plurality of metrics, at least one result of said analyzing, or both; and

match said multi-metric vehicle identification profile against a plurality of stored vehicle sensor recordings; and

making one or more determinations regarding the presence of or access for said vehicle in the movement of said vehicle from one area to another, or regarding access to one or more services.

125. The method of claim 124 wherein said area comprises at least one of a parking area, a driveway, a road, a toll road, a railway, a cableway, open water, a waterway, an airway, a space way, a dock, a marina, an airport, a space port, a trail, a path, a bridge, a lock, a gateway, a building, a ferrie, a park, a field, and an off-road area.

126. The method of claim 124 wherein said one or more services comprises at least one of a payment service, a transport service, a shipping service, a storage service, a revenue management service, a toll service, a membership service, an accounting service, a monitoring service, a tracking service, a notification service, and a communication service.