Asset Monitoring System Using Multiple Imagers

• US 20080100706A1
• Filed: 01/03/2008
• Published: 05/01/2008
• Est. Priority Date: 06/11/2002
• Status: Active Grant

• Current Assignee: Intelligent Technologies International, Inc.
• Original Assignee: Intelligent Technologies International, Inc.
• Inventors: Breed, David
• Granted Patent: US 9,151,692 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: B60C 11/24 Wear-indicating arrangements
• CPC Class Codes: B60C 19/00 Tyre parts or constructions not otherwise provided for
• CPC Class Codes: B60J 7/0573 power driven arrangements, e.g. electrical
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/015 Attaching seats directly to vehicle chassis
• CPC Class Codes: B60N 2/02246 Electric motors therefor
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60N 2/0248 with memory of positions
• CPC Class Codes: B60N 2/0252 with relations between different adjustments, e.g. height of headrest following longitudinal position of seat
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0272 using sensors or detectors for detecting the position of seat parts
• CPC Class Codes: B60N 2/0276 reaction to emergency situations, e.g. crash
• CPC Class Codes: B60N 2/067 by linear actuators, e.g. linear screw mechanisms
• CPC Class Codes: B60N 2/28 Seats readily mountable on, and dismountable from, existing seats or other parts of the vehicle
• CPC Class Codes: B60N 2/2806 for securing the child seat to the vehicle
• CPC Class Codes: B60N 2/2863 backward facing
• CPC Class Codes: B60N 2/66 Lumbar supports
• CPC Class Codes: B60N 2/829 characterised by their adjusting mechanisms, e.g. electric motors
• CPC Class Codes: B60N 2/853 characterised by their adjusting mechanisms, e.g. electric motors
• CPC Class Codes: B60N 2/888 with arrangements for protecting against abnormal g-forces, e.g. by displacement of the head-rest
• CPC Class Codes: B60Q 1/143 : combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/41 : preceding vehicle
• CPC Class Codes: B60Q 2300/42 : oncoming vehicle
• CPC Class Codes: B60R 16/037 : for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 2001/1223 : with sensors or transducers
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2021/0027 : Post collision measures, e.g. notifying emergency services
• CPC Class Codes: B60R 2021/01315 : monitoring occupant displacement
• CPC Class Codes: B60R 2021/23153 : specially adapted for rear seat passengers
• CPC Class Codes: B60R 2021/26094 : characterised by fluid flow controlling valves
• CPC Class Codes: B60R 2021/2765 : comprising means to control the venting
• CPC Class Codes: B60R 2022/208 : by automatic or remote control means
• CPC Class Codes: B60R 2022/288 : with means to adjust or regulate the amount of energy to be absorbed
• CPC Class Codes: B60R 2022/4685 : with means to adjust or regulate the tensioning force in relation to external parameters
• CPC Class Codes: B60R 2022/4825 : for sensing amount of belt winded on retractor
• CPC Class Codes: B60R 21/013 : including means for detecting collisions, impending collisions or roll-over
• CPC Class Codes: B60R 21/0132 : responsive to vehicle motion parameters , e.g. to vehicle longitudinal or transversal deceleration or speed value
• CPC Class Codes: B60R 21/0134 : responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/0136 : responsive to actual contact with an obstacle , e.g. to vehicle deformation, bumper displacement or bumper velocity relative to the vehicle monitoring crash strength in combination with passenger seat detection B60R21/01558
• CPC Class Codes: B60R 21/01516 : using force or pressure sensing means
• CPC Class Codes: B60R 21/01526 : using piezoelectric elements
• CPC Class Codes: B60R 21/0153 : using field detection presence sensors
• CPC Class Codes: B60R 21/01532 : using electric or capacitive field sensors
• CPC Class Codes: B60R 21/01534 : using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 : using ultrasonic waves
• CPC Class Codes: B60R 21/01538 : for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: B60R 21/01544 : detecting seat belt parameters, e.g. length, tension or height-adjustment
• CPC Class Codes: B60R 21/01546 : using belt buckle sensors
• CPC Class Codes: B60R 21/01548 : sensing the amount of belt winded on retractor
• CPC Class Codes: B60R 21/01552 : detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01554 : Seat position sensors
• CPC Class Codes: B60R 21/203 : in steering wheels or steering columns
• CPC Class Codes: B60R 21/21656 : Steering wheel covers or similar cup-shaped covers
• CPC Class Codes: B60R 21/276 : with means to vent the inflation fluid source, e.g. in case of overpressure B60R21/30 takes precedence; venting means on inflatable member walls B60R21/239
• CPC Class Codes: B60R 22/20 : adjustable in position, e.g. in height
• CPC Class Codes: B60R 22/201 : with the belt anchor connected to a slider movable in a vehicle-mounted track for passive restraint systems B60R22/06
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: E05F 15/43 : responsive to disruption of energy beams, e.g. light or sound
• CPC Class Codes: E05F 15/431 : specially adapted for vehicle windows or roofs
• CPC Class Codes: E05F 2015/433 : using reflection from the obstruction
• CPC Class Codes: E05Y 2900/516 : for trucks or trailers
• CPC Class Codes: E05Y 2900/542 : Roof panels
• CPC Class Codes: E05Y 2900/55 : Windows
• CPC Class Codes: G01F 23/20 : by measurement of weight, e.g. to determine the level of stored liquefied gas
• CPC Class Codes: G01F 23/2962 : Measuring transit time of reflected waves
• CPC Class Codes: G01F 23/804 : containing circuits handling parameters other than liquid level
• CPC Class Codes: G01G 19/4142 : for controlling activation of safety devices, e.g. airbag systems electrical circuits for triggering safety arrangements in case of vehicle accidents B60R21/015
• CPC Class Codes: G01M 5/0008 : of bridges
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/42 : Simultaneous measurement of distance and other co-ordinates indirect measurement G01S15/46
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/04 : Systems determining the presence of a target
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/417 : involving the use of neural networks
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06F 3/0219 : Special purpose keyboards
• CPC Class Codes: G06F 3/0233 : Character input methods
• CPC Class Codes: G06F 3/0237 : using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0238 : Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G07C 5/008 : communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0808 : Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G08B 13/1427 : with transmitter-receiver for distance detection
• CPC Class Codes: G08B 13/2462 : Asset location systems combined with EAS inventory, tracking, logistic G06Q10/00; entrance control systems G07C9/00
• CPC Class Codes: G08B 13/248 : EAS system combined with another detection technology, e.g. dual EAS and video or other presence detection system
• CPC Class Codes: G08B 21/0286 : Tampering or removal detection of the child unit from child or article
• CPC Class Codes: G08B 29/181 : due to failing power supply
• CPC Class Codes: G10K 2210/1282 : Automobiles
• CPC Class Codes: G10K 2210/3219 : Geometry of the configuration
• CPC Class Codes: H01Q 1/3291 : mounted in or on other locations inside the vehicle or vehicle body
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Asset including an arrangement for monitoring objects in an interior of the asset includes at least first and second optical imagers for obtaining images of a common area of the interior and which are spaced apart from one another, and processing circuitry coupled to the first and second imagers and arranged to derive information about objects in the interior from images obtained by the first and second imagers. A communication system may be arranged on the asset and coupled to the processing circuitry. The communication system wirelessly transmits the information about the objects to a remote facility. A location determining system may be arranged on the asset to monitor the location of the asset so that the communication system also transmits the location of the asset to the remote facility.

Claims

1. An asset including an arrangement for monitoring objects in an interior of the asset, comprising:

at least first and second optical imagers for obtaining images of a common area of the interior, said first and second imagers being spaced apart from one another; and

processing circuitry coupled to said first and second imagers and arranged to derive information about objects in the interior from images obtained by said first and second imagers.

2. The asset of claim 1, further comprising a communication system arranged on the asset and coupled to said processing circuitry, said communication system being arranged to wirelessly transmit the information about the objects to a remote facility.

3. The asset of claim 2, further comprising a location determining system arranged on the asset to monitor the location of the asset, said communication system transmitting the location of the asset to the remote facility.

4. The asset of claim 1, further comprising

a door;

and

a door status sensor arranged to detect when said door is closed, said first and second optical imagers being coupled to said door status sensor and arranged to obtain images only when said door status sensor detects when said door is closed after having been opened.

5. The asset of claim 1, further comprising

at least one light-detecting sensor arranged to detect any change in light in the proximity of the object, said first and second optical imagers being coupled to said at least one light-detecting sensor and arranged to obtain images only when a change in light is detected by said at least one light-detecting sensor.

6. The asset of claim 1, wherein said first and second optical imagers comprises an initiation device for periodically initiating said first and second optical imagers to obtain images.

7. The asset of claim 6, further comprising a wakeup sensor system for detecting the occurrence of an internal or external event, or the absence of an event for a time period, requiring a change in the frequency of monitoring of the asset, said initiation device being coupled to said wakeup sensor system and being arranged to change the rate at which it initiates said first and second optical imagers to obtain images in response to the detected occurrence of an internal or external event by said wakeup sensor system.

8. The asset of claim 1, further comprising a motion or vibration detection system arranged to detect motion or vibration of the asset, object or a part thereof, said first and second optical imagers being coupled to said motion or vibration detection system and being arranged to obtain images only after the asset, object or a part thereof is determined to have moved from a stationary position or vibrated.

9. The asset of claim 2, further comprising a wakeup sensor system for detecting the occurrence of an internal or external event relating to the condition or location of the asset, said communication system being coupled to said wakeup sensor system and being arranged to transmit a signal relating to the detected occurrence of an internal or external event.

10. The asset of claim 1, further comprising a memory unit for storing data relating to the location of the asset and the information about the objects in the interior of the asset.

11. The asset of claim 10, further comprising:

a door; and

a door status sensor arranged to detect when said door is closed,

said memory unit being arranged to store data relating to the opening and closing of said door in conjunction with the location of the asset and the information about the objects in the interior of the asset.

12. The asset of claim 1, further comprising a light source for illuminating the common area of the interior.

13. The asset of claim 12, wherein said light source is interposed between said first and second imagers.

14. The asset of claim 12, wherein said light source is arranged to project structured light into the common area.

15. The asset of claim 12, wherein said light source is approximately midway between said first and second imagers.

16. The asset of claim 1, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm.

17. The asset of claim 1, wherein said processing circuitry is arranged to derive a model of objects in the interior based on at least one initial set of images from said first and second imagers and subsequently derive information about movement of the objects based on variations between the model and subsequently obtained images from said first and second imagers.

18. The asset of claim 1, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm, said at least one pattern recognition algorithm comprising a trained pattern recognition algorithm trained in a training stage to identify different objects by obtaining images from said first and second imagers when each of a plurality of different objects is present in the common area of the interior and associating a derivation of the images with an identification of the object.

19. A method for obtaining information about objects in an asset, comprising:

mounting at least first and second optical imagers on the asset spaced apart from one another;

obtaining images of a common area of the interior using the first and second imagers; and

deriving information about objects in the interior from the obtained images.