Autonomous tracking wireless imaging sensor network including an articulating sensor and automatically organizing network nodes

• US 7,305,467 B2
• Filed: 12/23/2002
• Issued: 12/04/2007
• Est. Priority Date: 01/02/2002
• Status: Active Grant

• Current Assignee: ThinkLogix, LLC (Ascend Innovation Management, LLC)
• Original Assignee: Borgia/Cummins LLC (Intellectual Ventures LLC)
• Inventors: Kaiser, William J., Pottie, Gregory J., Newberg, Lars Fredric
• Primary Examiner(s): PATEL, HARESH N
• Application Number:
  US10/329,069
• Publication Number:
  US 20030154262A1
• Time in Patent Office: 1,807 Days
• Field of Search: 709200-203, 709217-227, 709/229, 709231-234, 709/238, 709/242, 709/243, 709/244, 709/246, 709/249, 709/250, 718/100, 719/310, 719/311, 719/318, 719/315, 719/316, 719/317, 340/539, 340/995.28, 340/855.6, 706/33
• US Class Current: 709/224
• CPC Class Codes: G01S 13/72 for two-dimensional tracking, e.g. combination of angle and range tracking, track-while-scan radar
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/87 Combinations of radar systems, e.g. primary radar and secondary radar
• CPC Class Codes: G01S 17/66 Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/87 Combinations of systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 19/14 specially adapted for specific applications
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A wireless integrated network sensor (WINS) system is provided that integrates articulating tracking systems with WINS network components including visual or infrared sensors and imaging devices to enable precise tracking and targeting of objects moving through a sensor field or past a single integrated sensing and targeting unit. Further, arrays of sensors together with local signal processing are used to trigger cameras and tracking systems, and to provide an alternative location capability for improved robustness. The system is self-configuring and remotely controllable, and enables remote systems and operators to query for collected data, including sensory and image data, and control the system in response to the collected data.

Claims

1. A method of collecting data in a sensor network, comprising:

automatically organizing a plurality of network elements including a plurality of nodes locally disposed among an environment and at least one remote client system, wherein the organizing includes automatically coupling and configuring the plurality of nodes for self-assembly and further includes coupling and controlling a flow of information among the network elements, and wherein at least one of the plurality of nodes includes an articulating sensor;

remotely controlling at least one function of the plurality of nodes;

detecting a target in the environment using at least one sensor of the plurality of nodes in addition to the articulating sensor;

tracking the target using the articulating sensor; and

collecting and transferring data associated with the target to the remote client system.

2. The method of claim 1, further comprising manipulating the collected data, wherein manipulating includes at least one of routing, fusing, processing, evaluating, and storing the collected data.

3. The method of claim 2, wherein the plurality of nodes comprises a first node, and wherein fusing comprises the first node collecting and processing data from at least another of the plurality of nodes.

4. The method of claim 1, wherein the sensor is an acoustic sensor.

5. The method of claim 1, wherein the articulating sensor is at least one of a tracking system, an antenna, and an active sensor.

6. The method of claim 5, wherein the tracking system is at least one of a laser tracking system, an optical tracking system, and an imaging system.

7. The method of claim 6, wherein the optical tracking system is a camera system.

8. The method of claim 1, further comprising:

collecting optical data of the target using at least one optical sensor of the plurality of nodes; and

identifying and designating the target using the optical data.

9. The method of claim 1, wherein the at least one sensor and the articulating sensor are on different nodes of the plurality of nodes.

10. The method of claim 1, wherein the plurality of network elements includes at least one gateway, at least one server, and components of at least one communication network.

11. A sensor network comprising a plurality of nodes, wherein the plurality of nodes are coupled to communicate with at least one remote system via at least one coupling with components of a wide area network, wherein the nodes automatically organize to form the sensor network in response to information communicated among the nodes, wherein the automatic organizing comprises automatically coupling and configuring the nodes to form the sensor network and automatically controlling data transfer, processing, and storage within the sensor network, wherein functions of the nodes are remotely controllable and programmable via internetworking among the nodes.

12. The sensor network of claim 11, wherein at least one of the nodes includes an articulating sensor, and wherein the articulating sensor is at least one of a tracking system, an imaging system, and an antenna.

13. The sensor network of claim 11, wherein the plurality of nodes include two or more node types, wherein a first node type includes at least one passive sensor and a second node type includes an articulating sensor.

14. The sensor network of claim 11, wherein at least one of the plurality of nodes is a gateway that communicates with the components of the wide area network.

15. A sensor node comprising:

at least one processor coupled to at least one communication device, wherein the at least one processor automatically couples the sensor node to and configures the sensor node among a plurality of network elements and automatically controls communication with and control of a flow of information among the network elements, wherein the network elements couple among an environment and at least one remote client system to support remote controllability of the sensor node via the remote client system; and

at least one articulating sensor coupled to the at least one processor to track detected targets.

16. The node of claim 15, further comprising at least one sensor coupled to the processor to detect at least one target.

17. The node of claim 15, further comprising a photographic system.

18. The node of claim 15, wherein the articulating sensor is at least one of tracking system, a laser tracking system, and an optical tracking system.

19. The node of claim 15, wherein the plurality of network elements includes at least one gateway, at least one server, and components of at least one wide area network.