Modular intelligent transportation system

• US 9,371,099 B2
• Filed: 07/19/2011
• Issued: 06/21/2016
• Est. Priority Date: 11/03/2004
• Status: Expired due to Fees

• Current Assignee: Wilfred J and Louisette G Lagassey Irrevocable Trust Roger J Morgan Trustee
• Original Assignee: The Wilfred J and Louisette G Lagassey Irrevocable Trust
• Inventors: Lagassey, Paul J.
• Primary Examiner(s): HULKA, JAMES R
• Application Number:
  US13/185,991
• Publication Number:
  US 20110273568A1
• Time in Patent Office: 1,799 Days
• Field of Search: 367/118
• US Class Current: 1/1
• CPC Class Codes: B62D 41/00 Fittings for identifying vehicles in case of collision; Fittings for marking or recording collision areas
• CPC Class Codes: G01C 21/26 specially adapted for navigation in a road network
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0891 Video recorder in combination with video camera
• CPC Class Codes: G08G 1/205 Indicating the location of the monitored vehicles as destination, e.g. accidents, stolen, rental
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04W 40/02 Communication route or path selection, e.g. power-based or shortest path routing
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A modular intelligent transportation system, comprising an environmentally protected enclosure, a system communications bus, a processor module, communicating with said bus, having a image data input and an audio input, the processor module analyzing the image data and/or audio input for data patterns represented therein, having at least one available option slot, a power supply, and a communication link for external communications, in which at least one available option slot can be occupied by a wireless local area network access point, having a communications path between said communications link and said wireless access point, or other modular components.

Claims

1. A multimedia apparatus, comprising:

at least one input port configured to receive video signals from a plurality of video cameras representing a scene;

at least one input port configured to receive audio signals from a plurality of microphones proximate to the scene;

a digital communication interface configured to communicate information derived from the video signals and information derived from the audio signals; and

at least one processor configured to;

receive command and control programming specific to managing functions of the multimedia apparatus, employing cryptographically secure communications over the Internet;

perform an analysis of the audio signals received by the plurality of microphones to localize a moving object in the scene, representing an audio emission source;

provide an identification of a human in dependence on at least one of the audio signals and the video signals;

perform at least one of Bayesian probabilistic processing and Hidden Markov Model processing, to probabilistically analyze the scene;

perform a model-based motion analysis of at least the moving object representing the audio emission source represented in the video signals;

recognize a predetermined sequence of activity represented in at least one of the audio signals and the video signals; and

determine whether the moving object in the scene complies with a motion-based rule dependent on a change in movement, in dependence on at least the model based motion analysis; and

to generate digital control signals based on both the audio signals and the video signals.

2. The multimedia apparatus according to claim 1, wherein the digital communication interface comprises a universal serial bus (USB) which communicates between at least two processors forming the at least one processor, at least one of said processors executing statistical audio and video analysis algorithms.

3. The multimedia apparatus according to claim 1, wherein the at least one processor performs a statistical pattern recognition with respect to a plurality of acoustic signatures.

4. The multimedia apparatus according to claim 1, further comprising at least one video camera, at least one microphone, and at least one digital signal processor in a common housing, and at least one processor in a separate housing, the digital signal processor in the common housing and the processor in the separate housing communicating through the digital communication interface.

5. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to communicate a voice signal derived from the audio signals using a voice over Internet protocol through an Ethernet port.

6. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to compare audio signals to a database of exemplar acoustic signatures, and to generate digital control signals based on both the audio signals and the video signals.

7. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to control a video camera in dependence on at least one of the audio signals and the video signals.

8. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to combine data from a plurality of video signals, and to process the data to project it into a predetermined framework.

9. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to identify objects in dependence on at least one of the audio signals and the video signals.

10. The multimedia apparatus according to claim 1, wherein the apparatus comprises two housings connected by the digital communication interface, a first housing containing at least one video camera and at least one microphone, and a second housing containing at least one of said at least one processors and a computer network interface port configured to communicate with the Internet.

11. The multimedia apparatus according to claim 1, wherein the at least one processor is further configured to output a signal representing at least one decision dependent on a sequence of action monitored by at least one of the audio signals and the video signals, the signal being delayed from at least a first action within the sequence.

12. An apparatus, comprising:

at least one video input port configured to receive video signals from at least one video camera imaging a scene;

at least one audio input port configured to receive audio signals from at least one microphone proximate to the scene;

at least one processor configured to;

receive command and control programming specific to managing functions of the multimedia apparatus, employing cryptographically secure communications over the Internet;

provide an identification of a human in dependence on the audio signals and the video signals;

recognize a characteristic type of at least one sound in the received audio signals; and

perform at least one of Bayesian probabilistic processing and Hidden Markov Model processing, to probabilistically analyze the scene;

perform a model based statistical motion analysis of at least one object in the scene imaged in the received video signals associated with the at least one recognized sound,

recognize a predetermined sequence of activity represented in at least one of the audio signals and the video signals, and

determine compliance with at least one motion-related rule dependent on a change in movement; and

a display, responsive to the at least one processor, configured to present a synthetic view of a video scene presenting the at least one object.

13. The apparatus according to claim 12, further comprising a communication port configured to communicate video signals from the video input port and audio signals from the audio input port over the Internet.

14. An apparatus, comprising:

at least one input port configured to receive audio signals and video signals representing a scene;

at least one processor configured;

receive command and control programming specific to managing functions of the apparatus, employing cryptographically secure communications over the Internet;

to identify at least one human object in the scene in dependence on at least one of the audio signals and the video signals,

perform at least one of Bayesian probabilistic processing and Hidden Markov Model processing, to probabilistically analyze the scene;

to analyze at least the audio signals to determine an object in the scene which represents a source of an audio emission,

to perform a model-based vector motion analysis of the object in the scene which represents the source of the audio emission represented in the video signals,

to recognize a predetermined sequence of activity represented in at least one of the audio signals and the video signals, and

to determine whether the object in the scene which represents the source of the audio emission represented in the video signals complies with a motion-based rule dependent on a change in movement, in dependence on at least the model based vector motion analysis; and

a serial data digital command and control interface, configured to control at least one image capture device in dependence on the analysis of both the audio signals and the video signals.

15. An apparatus, comprising:

at least one video input port configured to receive video signals from at least one video camera imaging a respective object in a scene;

at least one audio input port configured to receive audio signals from at least one microphone proximate to the scene, and to capture sounds associated with the respective object in the scene;

at least one processor configured to;

receive command and control programming specific to managing functions of the multimedia apparatus, employing cryptographically secure communications over the Internet;

characterize a type of a sound from the respective object in the scene, in the received audio signals, selectively associated with at least one event occurring with respect to the respective object in the scene;

provide an identification of a human in dependence on at least one of the audio signals and the video signals;

perform at least one of Bayesian probabilistic processing and Hidden Markov Model processing, to probabilistically analyze the scene;

analyze a motion of the respective object in the scene imaged in the received video signals and associated with the at least one event,

recognize a predetermined sequence of activity represented in at least one of the audio signals and the video signals, and

determine a compliance of the motion of the respective object in the scene with at least one motion-related rule dependent on a change in movement; and

a display, responsive to the at least one processor, configured to present a synthetic view of a video scene representing the respective object in the scene, selectively dependent on the event and the determined compliance.

16. The apparatus according to claim 15, further comprising:

a communication port configured to communicate information from the at least one video input port and the at least one audio input port through a digital communication stream,

wherein the at least one processor is further configured;

to receive the digital communication stream,

to recognize at least one sound in the received audio signals, and

to track movements of the respective object in the scene.

17. A multimedia method, comprising:

receiving video signals from a plurality of video cameras representing a scene;

receiving audio signals from a plurality of microphones proximate to the scene;

communicating information derived from the video signals and information derived from the audio signals to a control system, through a digital communication interface;

using an automated digital processor, to at least;

receive command and control programming specific to managing functions of the multimedia apparatus, employing cryptographically secure communications over the Internet;

perform an analysis of the audio signals received by the plurality of microphones to localize an object representing an audio emission source of the audio signals,

provide an identification of a human in dependence on at least one of the audio signals and the video signals;

perform at least one of Bayesian probabilistic processing and Hidden Markov Model processing, to probabilistically analyze the scene;

recognize a predetermined sequence of activities represented in at least one of the audio signals and the video signals, and

perform a model-based motion analysis of at least the object representing the audio emission source represented in the video signals; and

determining whether the object representing the audio emission source of the audio signals in the scene complies with at least one motion-based rule dependent on a change in movement, in dependence on at least the model-based motion analysis.

18. The method according to claim 17, wherein said recognizing at least one predetermined sequence of activities comprises recognizing predetermined sequence of activities represented in both the audio signals and the video signals, the method further comprising recognizing at least one object representing an audio emission source of the audio signals present in the scene.

19. The method according to claim 17, wherein said received remotely communicated command and control programming is further subject to cryptographic access restriction.