Enhanced automotive monitoring system using sound

• US 20050240324A1
• Filed: 04/26/2004
• Published: 10/27/2005
• Est. Priority Date: 04/26/2004
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Boman, Robert, Hanson, Brian, Kuhn, Roland
• Granted Patent: US 7,085,635 B2
• Time in Patent Office: Days
• US Class Current: 701/36
• CPC Class Codes: B60R 21/015 including means for detecting the presence or position of passengers, passenger seats or child seats , and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
• CPC Class Codes: B60R 21/0153 using field detection presence sensors

Abstract

The vehicular monitoring system obtains audio information from the speech of occupants within the vehicle and then processes that audio information to extract information about the behavior of the vehicle occupants. Using the behavioral information the system then assesses whether said behavior is in compliance with a predefined set of rules. Severe violations are reported to a third party via cellular telephone or other means. Less severe violations are recorded in a log file that is subsequently uploaded to a networked computer system for review and analysis. The behavioral rules used to assess violations may be modified by the administrative user.

Claims

1. A system for monitoring vehicle occupant behavior, comprising:

at least one microphone attached to said vehicle to receive audio information from the occupants of said vehicle;

a speech processing system coupled to said microphones and operable to analyze the speech of said occupants and thereby ascertain information about said occupants;

a logic processing system having a stored set of behavioral rules and operable to assess compliance with said rules based on said information about said occupants.

2. The system of claim 1 further comprising communication system coupled to said logic processing system and configured to send message information to a third party based on said compliance assessment.

3. The system of claim 2 wherein said communication system includes cellular telephone system adapted to convey said message information to at least one predefined telephone device.

4. The system of claim 2 wherein said communication system includes wireless network system adapted to convey said message information to at least one networked computer system.

5. The system of claim 1 further comprising memory system coupled to said logic processing system and adapted to store violation log information.

6. The system of claim 5 further comprising communication system coupled to said logic processing system and configured to send violation log information to a third party.

7. The system of claim 6 wherein said communication system includes wireless network system adapted to convey said violation information to at least one networked computer system.

8. The system of claim 1 further comprising memory system coupled to said logic processing system and adapted to store behavioral rules used by said logic processing system and having an interface for configuring said behavioral rules.

9. The system of claim 8 wherein said interface is remote from said vehicle.

10. The system of claim 8 further comprising a communication system that interfaces with said memory system and provides a wireless interface for configuring said behavioral rules.

11. The system of claim 1 further comprising adaptive noise canceling system coupled to said speech processing system and having an interface to an audio system of said vehicle, said adaptive noise canceling system being operable to reduce interference between said speech processing system and said audio system during times when said audio system is producing sound within the vehicle.

12. The system of claim 1, wherein said logic processing system performs a monitor control function that distinguishes between at least two different levels of behavioral rule violation.

13. The system of claim 1 wherein said logic processing system performs a monitor control function that identifies at least one predetermined class of behavioral rule violations as a severe violation and that causes communication of a message to a third party when such severe violation is detected.

14. The system of claim 1 further comprising input interface adapted to receive vehicular information selected from the group consisting of audio system information, speedometer information, engine RPM information, GPS information, door open information, door lock information, seat belt latched information, seat occupancy information, and combinations thereof.

15. The system of claim 1 further comprising speaker identification system that prompts a vehicle occupant to provide a speech utterance that is used to identify the speaker.

16. The system of claim 1 further comprising speaker clustering system that statistically analyzes the speech of plural speakers to thereby distinguish the speech of one person from that of another.

17. A method of monitoring behavior of vehicle occupants, comprising:

obtaining audio information from the speech of occupants within the vehicle;

processing said audio information to extract behavioral information about the behavior of the vehicle occupants;

using said behavioral information to assess whether said behavior is in compliance with a predefined set of rules.

18. The method of claim 17 further comprising sending a message to a third party when at least one of said predefined set of rules has been violated.

19. The method of claim 17 further comprising:

obtaining additional behavioral information selected from the group consisting of audio system information, speedometer information, engine RPM information, GPS information, door open information, door lock information, seat belt latched information, seat occupancy information, and combinations thereof, and

using said additional behavioral information in assessing whether at least one of said predefined set of rules has been violated.

20. The method of claim 17 further comprising performing speaker identification upon said speech to ascertain information about the identity of said occupants and using said identity information in assessing whether at least one of said predefined set of rules has been violated.

21. The method of claim 17 wherein said processing step includes using automatic speech recognition to generate text information from the speech of said vehicle occupants and using said text information to assess whether said behavior is in compliance with said predefined set of rules.

22. The method of claim 21 further comprising processing said text information to perform topic detection to define at least a portion of said behavioral information.

23. The method of claim 17 further comprising processing said audio information by storing at least a portion of said audio information for replay at a later time.

24. The method of claim 23 further comprising selectively flagging said portions of said audio information for use in later accessing said stored portion of said audio information.

25. The method of claim 24 wherein said selective flagging is performed by using automatic speech recognition.

26. The method of claim 17 further comprising performing speaker clustering to generate information from which the number of vehicle occupants is inferred.

27. The method of claim 26 wherein said number of vehicle occupants inferred is used in connection with said extracted behavioral information to assess whether said behavior is in compliance with a predefined set of rules.