Asset monitoring system using multiple imagers

• US 9,151,692 B2
• Filed: 01/03/2008
• Issued: 10/06/2015
• Est. Priority Date: 06/11/2002
• Status: Expired due to Fees

• Current Assignee: Intelligent Technologies International, Inc.
• Original Assignee: Intelligent Technologies International, Inc.
• Inventors: Breed, David S.
• Primary Examiner(s): Patel, Hitesh
• Application Number:
  US11/968,844
• Publication Number:
  US 20080100706A1
• Time in Patent Office: 2,833 Days
• Field of Search: 348/143, 382/118, 455/404.2, 340/989
• US Class Current: 1/1
• CPC Class Codes: B60C 11/24 Wear-indicating arrangements
• CPC Class Codes: B60C 19/00 Tyre parts or constructions not otherwise provided for
• CPC Class Codes: B60J 7/0573 power driven arrangements, e.g. electrical
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/015 Attaching seats directly to vehicle chassis
• CPC Class Codes: B60N 2/02246 Electric motors therefor
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60N 2/0248 with memory of positions
• CPC Class Codes: B60N 2/0252 with relations between different adjustments, e.g. height of headrest following longitudinal position of seat
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0272 using sensors or detectors for detecting the position of seat parts
• CPC Class Codes: B60N 2/0276 reaction to emergency situations, e.g. crash
• CPC Class Codes: B60N 2/067 by linear actuators, e.g. linear screw mechanisms
• CPC Class Codes: B60N 2/28 Seats readily mountable on, and dismountable from, existing seats or other parts of the vehicle
• CPC Class Codes: B60N 2/2806 for securing the child seat to the vehicle
• CPC Class Codes: B60N 2/2863 backward facing
• CPC Class Codes: B60N 2/66 Lumbar supports
• CPC Class Codes: B60N 2/829 characterised by their adjusting mechanisms, e.g. electric motors
• CPC Class Codes: B60N 2/853 characterised by their adjusting mechanisms, e.g. electric motors
• CPC Class Codes: B60N 2/888 with arrangements for protecting against abnormal g-forces, e.g. by displacement of the head-rest
• CPC Class Codes: B60Q 1/143 : combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/41 : preceding vehicle
• CPC Class Codes: B60Q 2300/42 : oncoming vehicle
• CPC Class Codes: B60R 16/037 : for occupant comfort , e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
• CPC Class Codes: B60R 2001/1223 : with sensors or transducers
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2021/0027 : Post collision measures, e.g. notifying emergency services
• CPC Class Codes: B60R 2021/01315 : monitoring occupant displacement
• CPC Class Codes: B60R 2021/23153 : specially adapted for rear seat passengers
• CPC Class Codes: B60R 2021/26094 : characterised by fluid flow controlling valves
• CPC Class Codes: B60R 2021/2765 : comprising means to control the venting
• CPC Class Codes: B60R 2022/208 : by automatic or remote control means
• CPC Class Codes: B60R 2022/288 : with means to adjust or regulate the amount of energy to be absorbed
• CPC Class Codes: B60R 2022/4685 : with means to adjust or regulate the tensioning force in relation to external parameters
• CPC Class Codes: B60R 2022/4825 : for sensing amount of belt winded on retractor
• CPC Class Codes: B60R 21/013 : including means for detecting collisions, impending collisions or roll-over
• CPC Class Codes: B60R 21/0132 : responsive to vehicle motion parameters , e.g. to vehicle longitudinal or transversal deceleration or speed value
• CPC Class Codes: B60R 21/0134 : responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/0136 : responsive to actual contact with an obstacle , e.g. to vehicle deformation, bumper displacement or bumper velocity relative to the vehicle monitoring crash strength in combination with passenger seat detection B60R21/01558
• CPC Class Codes: B60R 21/01516 : using force or pressure sensing means
• CPC Class Codes: B60R 21/01526 : using piezoelectric elements
• CPC Class Codes: B60R 21/0153 : using field detection presence sensors
• CPC Class Codes: B60R 21/01532 : using electric or capacitive field sensors
• CPC Class Codes: B60R 21/01534 : using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 : using ultrasonic waves
• CPC Class Codes: B60R 21/01538 : for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/01542 : detecting passenger motion
• CPC Class Codes: B60R 21/01544 : detecting seat belt parameters, e.g. length, tension or height-adjustment
• CPC Class Codes: B60R 21/01546 : using belt buckle sensors
• CPC Class Codes: B60R 21/01548 : sensing the amount of belt winded on retractor
• CPC Class Codes: B60R 21/01552 : detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60R 21/01554 : Seat position sensors
• CPC Class Codes: B60R 21/203 : in steering wheels or steering columns
• CPC Class Codes: B60R 21/21656 : Steering wheel covers or similar cup-shaped covers
• CPC Class Codes: B60R 21/276 : with means to vent the inflation fluid source, e.g. in case of overpressure B60R21/30 takes precedence; venting means on inflatable member walls B60R21/239
• CPC Class Codes: B60R 22/20 : adjustable in position, e.g. in height
• CPC Class Codes: B60R 22/201 : with the belt anchor connected to a slider movable in a vehicle-mounted track for passive restraint systems B60R22/06
• CPC Class Codes: B60R 25/25 : using biometry
• CPC Class Codes: E05F 15/43 : responsive to disruption of energy beams, e.g. light or sound
• CPC Class Codes: E05F 15/431 : specially adapted for vehicle windows or roofs
• CPC Class Codes: E05F 2015/433 : using reflection from the obstruction
• CPC Class Codes: E05Y 2900/516 : for trucks or trailers
• CPC Class Codes: E05Y 2900/542 : Roof panels
• CPC Class Codes: E05Y 2900/55 : Windows
• CPC Class Codes: G01F 23/20 : by measurement of weight, e.g. to determine the level of stored liquefied gas
• CPC Class Codes: G01F 23/2962 : Measuring transit time of reflected waves
• CPC Class Codes: G01F 23/804 : containing circuits handling parameters other than liquid level
• CPC Class Codes: G01G 19/4142 : for controlling activation of safety devices, e.g. airbag systems electrical circuits for triggering safety arrangements in case of vehicle accidents B60R21/015
• CPC Class Codes: G01M 5/0008 : of bridges
• CPC Class Codes: G01S 13/04 : Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 15/04 : Systems determining presence of a target
• CPC Class Codes: G01S 15/06 : Systems determining the position data of a target
• CPC Class Codes: G01S 15/42 : Simultaneous measurement of distance and other co-ordinates indirect measurement G01S15/46
• CPC Class Codes: G01S 15/87 : Combinations of sonar systems
• CPC Class Codes: G01S 15/88 : Sonar systems specially adapted for specific applications seismic or acoustic prospecting or detecting G01V1/00
• CPC Class Codes: G01S 17/04 : Systems determining the presence of a target
• CPC Class Codes: G01S 17/88 : Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 : for mapping or imaging
• CPC Class Codes: G01S 7/417 : involving the use of neural networks
• CPC Class Codes: G01S 7/4802 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/539 : using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G06F 3/0219 : Special purpose keyboards
• CPC Class Codes: G06F 3/0233 : Character input methods
• CPC Class Codes: G06F 3/0237 : using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0238 : Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06V 20/00 : Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G07C 5/008 : communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0808 : Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G08B 13/1427 : with transmitter-receiver for distance detection
• CPC Class Codes: G08B 13/2462 : Asset location systems combined with EAS inventory, tracking, logistic G06Q10/00; entrance control systems G07C9/00
• CPC Class Codes: G08B 13/248 : EAS system combined with another detection technology, e.g. dual EAS and video or other presence detection system
• CPC Class Codes: G08B 21/0286 : Tampering or removal detection of the child unit from child or article
• CPC Class Codes: G08B 29/181 : due to failing power supply
• CPC Class Codes: G10K 2210/1282 : Automobiles
• CPC Class Codes: G10K 2210/3219 : Geometry of the configuration
• CPC Class Codes: H01Q 1/3291 : mounted in or on other locations inside the vehicle or vehicle body
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Asset including an arrangement for monitoring objects in an interior of the asset includes at least first and second optical imagers for obtaining images of a common area of the interior and which are spaced apart from one another, and processing circuitry coupled to the first and second imagers and arranged to derive information about objects in the interior from images obtained by the first and second imagers. A communication system may be arranged on the asset and coupled to the processing circuitry. The communication system wirelessly transmits the information about the objects to a remote facility. A location determining system may be arranged on the asset to monitor the location of the asset so that the communication system also transmits the location of the asset to the remote facility.

Claims

1. A shipping container including an arrangement for monitoring inanimate objects in an interior of the shipping container, comprising:

a door;

a location determining system that monitors location of the shipping container, at least part of said location determining system being situated on the shipping container;

at least one optical imager for obtaining images of the interior of the shipping container;

a wakeup sensor system that detects occurrence of an internal or external event, or absence of an event for a time period, requiring a change in frequency of monitoring of the shipping container, said wakeup sensor system comprising a door status sensor configured to detect when said door is closed, said at least one optical imager being coupled to said door status sensor and configured to obtain images when said door status sensor detects when said door is closed after having been opened;

an initiation device coupled to said wakeup sensor system and that periodically initiates said at least one optical imager to obtain images, said initiation device being configured to change a rate at which it initiates said at least one optical imager to obtain images in response to the detected occurrence of an internal or external event by said wakeup sensor system;

processing circuitry coupled to said at least one optical imager and configured to derive information about objects in the interior of the shipping container from images obtained by said at least one optical imager; and

a communication system arranged on the shipping container and coupled to said processing circuitry, said communication system being configured to wirelessly transmit the information about the objects derived by said processing circuitry and the location of the shipping container provided by said location determining system to a remote facility separate and apart from the shipping container.

2. The shipping container of claim 1, wherein said wakeup sensor system is configured to detect the occurrence of an internal event requiring a change in the frequency of monitoring of the shipping container.

3. The shipping container of claim 1, wherein said wakeup sensor system is configured to detect the occurrence of an external event requiring a change in the frequency of monitoring of the shipping container.

4. The shipping container of claim 1, further comprising

at least one light-detecting sensor configured to detect any change in light in the proximity of the object, said at least one optical imager being coupled to said at least one light-detecting sensor and further configured to obtain images when a change in light is detected by said at least one light-detecting sensor.

5. The shipping container of claim 1, wherein said at least one optical imager comprises first and second optical imagers that are spaced apart from one another.

7. The shipping container of claim 1, further comprising a motion or vibration detection system configured to detect motion or vibration of the shipping container, of the object in the interior of the shipping container or of a part of the object in the interior of the shipping container, said at least one optical imager being coupled to said motion or vibration detection system and being configured to obtain images after the shipping container, the object or the part of the object is determined to have moved from a stationary position or vibrated.

8. The shipping container of claim 1, wherein said wakeup sensor system is further configured to detected the occurrence of an internal or external event relating to a condition or the location of the shipping container, said communication system being coupled to said wakeup sensor system and being further configured to transmit a signal relating to the detected occurrence of an internal or external event relating to the condition or location of the shipping container.

9. The shipping container of claim 1, further comprising a memory unit for storing data relating to the location of the shipping container and the information about the objects in the interior of the shipping container.

10. The shipping container of claim 9, wherein said memory unit is configured to store data relating to the opening and closing of said door in conjunction with the location of the shipping container and the information about the objects in the interior of the shipping container.

11. The shipping container of claim 1, further comprising a light source for illuminating the interior of the shipping container.

12. The shipping container of claim 11, wherein said at least one optical imager comprises first and second optical imagers and said light source is interposed between said first and second imagers.

13. The shipping container of claim 11, wherein said light source is configured to project structured light into the interior of the shipping container.

14. The shipping container of claim 1, wherein said at least one optical imager comprises first and second optical imagers.

15. The shipping container of claim 1, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm.

17. The shipping container of claim 1, wherein said processing circuitry comprises a microprocessor with at least one pattern recognition algorithm, said at least one pattern recognition algorithm comprising a trained pattern recognition algorithm trained in a training stage to identify different objects by obtaining images from said at least one optical imager when each of a plurality of different objects is present in the interior of the shipping container and associating a derivation of the images with an identification of the object.

6. A shipping container including an arrangement for monitoring inanimate objects in an interior of the shipping container, comprising:

a location determining system that monitors location of the shipping container, at least part of said location determining system being situated on the shipping container;

at least one optical imager for obtaining images of the interior of the shipping container;

a wakeup sensor system that detects occurrence of an internal or external event, or absence of an event for a time period, requiring a change in frequency of monitoring of the shipping container;

an initiation device coupled to said wakeup sensor system and that periodically initiates said at least one optical imager to obtain images, said initiation device being configured to change a rate at which it initiates said at least one optical imager to obtain images in response to the detected occurrence of an internal or external event by said wakeup sensor system;

processing circuitry coupled to said at least one optical imager and configured to derive information about objects in the interior of the shipping container from images obtained by said at least one optical imager; and

a communication system arranged on the shipping container and coupled to said processing circuitry, said communication system being configured to wirelessly transmit the information about the objects derived by said processing circuitry and the location of the shipping container provided by said location determining system to a remote facility separate and apart from the shipping container;

said wakeup sensor system being configured to detect absence of an event for a time period requiring a change in the frequency of monitoring of the shipping container.

18. The shipping container of claim 6, further comprising at least one light-detecting sensor configured to detect any change in light in the proximity of the object, said at least one optical imager being coupled to said at least one light-detecting sensor and configured to obtain images when a change in light is detected by said at least one light-detecting sensor.

19. The shipping container of claim 6, wherein said at least one optical imager comprises first and second optical imagers that are spaced apart from one another.

20. The shipping container of claim 6, further comprising a door, said wakeup sensor system comprising a door status sensor configured to detect when said door is closed, said at least one optical imager being coupled to said door status sensor and configured to obtain images when said door status sensor detects when said door is closed after having been opened.

16. A shipping container including an arrangement for monitoring inanimate objects in an interior of the shipping container, comprising:

a location determining system that monitors location of the shipping container, at least part of said location determining system being situated on the shipping container;

at least one optical imager for obtaining images of the interior of the shipping container;

a wakeup sensor system that detects occurrence of an internal or external event, or absence of an event for a time period, requiring a change in frequency of monitoring of the shipping container;

an initiation device coupled to said wakeup sensor system and that periodically initiates said at least one optical imager to obtain images, said initiation device being configured to change a rate at which it initiates said at least one optical imager to obtain images in response to the detected occurrence of an internal or external event by said wakeup sensor system;

processing circuitry coupled to said at least one optical imager and configured to derive information about objects in the interior of the shipping container from images obtained by said at least one optical imager; and

a communication system arranged on the shipping container and coupled to said processing circuitry, said communication system being configured to wirelessly transmit the information about the objects derived by said processing circuitry and the location of the shipping container provided by said location determining system to a remote facility separate and apart from the shipping container;

said at least one optical imager comprising first and second optical imagers;

said processing circuitry being configured to derive a model of objects in the interior based on at least one initial set of images from said first and second optical imagers and subsequently derive information about movement of the objects based on variations between the model of objects and subsequently obtained images from said first and second imagers.