Voice-responsive building management system

• US 9,263,032 B2
• Filed: 10/24/2013
• Issued: 02/16/2016
• Est. Priority Date: 10/24/2013
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Meruva, Jayaprakash
• Primary Examiner(s): VO, HUYEN X
• Application Number:
  US14/062,528
• Publication Number:
  US 20150120297A1
• Time in Patent Office: 845 Days
• Field of Search: 704/231, 704/235, 704/243, 704/244, 704/246, 704/247, 704/249, 704/250, 704/251, 704/255, 704/257, 704/270
• US Class Current: 1/1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces

Abstract

A voice-responsive building management system is described herein. One system includes an interface, a dynamic grammar builder, and a speech processing engine. The interface is configured to receive a speech card of a user, wherein the speech card of the user includes speech training data of the user and domain vocabulary for applications of the building management system for which the user is authorized. The dynamic grammar builder is configured to generate grammar from a building information model of the building management system. The speech processing engine is configured to receive a voice command or voice query from the user, and execute the voice command or voice query using the speech training data of the user, the domain vocabulary, and the grammar generated from the building information model.

Claims

1. A non-transitory computer readable medium for operating a voice-responsive building management system, wherein the computer readable medium has computer readable instructions stored thereon that are executable by a processor to:

receive a speech card of a user, wherein the speech card of the user includes;

speech training data of the user; and

domain vocabulary for applications of the building management system for which the user is authorized;

generate grammar from project configuration data associated with a building information model of the building management system, wherein;

the building information model is a three-dimensional building information model that includes building information modeling data associated with a building managed by the building management system; and

the project configuration data includes terms specific to projects associated with the building management system;

receive a voice command or voice query from the user; and

execute the voice command or voice query using the speech training data of the user, the domain vocabulary, and the grammar generated from the project configuration data associated with the building information model.

2. The computer readable medium of claim 1, wherein the project configuration data is pre-loaded into the building management system during installation of the building management system.

3. The computer readable medium of claim 1, wherein the instructions are executable by the processor to:

generate grammar from controller configuration data associated with the building management system; and

execute the voice command or voice query using the grammar generated from the controller configuration data.

4. The computer readable medium of claim 3, wherein the controller configuration data is dynamically loaded into the building management system during runtime of the building management system.

5. The computer readable medium of claim 1, wherein the instructions are executable by the processor to:

generate grammar from runtime data associated with the building management system; and

execute the voice command or voice query using the grammar generated from the runtime data.

6. A computer implemented method for operating a voice-responsive building management system, comprising:

receiving speech training data of a user and domain vocabulary for applications of the building management system for which the user is authorized;

generating grammar from controller configuration data associated with a building information model of the building management system, wherein;

the building information model is a three-dimensional building information model that includes building information modeling data associated with a building managed by the building management system; and

the controller configuration data includes names of controllers associated with the building management system;

receiving a voice command or voice query from the user; and

executing the voice command or voice query using the speech training data of the user, the domain vocabulary, and the grammar generated from the controller configuration data associated with the building information model.

7. The method of claim 6, wherein the method includes receiving the speech training data of the user and the domain vocabulary from a speech card issued to the user.

8. The method of claim 6, wherein the method includes receiving the speech training data of the user from a cloud-based computing system.

9. The method of claim 6, wherein executing the voice command or voice query includes displaying information associated with the voice command or voice query to the user.

10. The method of claim 6, wherein executing the voice command or voice query includes providing a voice response with information associated with the voice command or voice query to the user.

11. The method of claim 6, wherein:

the voice command or voice query includes a particular item associated with the building management system; and

executing the voice command or voice query includes displaying the particular item and data associated with the particular item.

12. The method of claim 6, wherein:

the voice command or voice query includes a particular item associated with the building management system; and

executing the voice command or voice query includes providing a voice response with data associated with the particular item.

13. The method of claim 6, wherein the method is performed without using the internet.

14. A non-transitory computer readable medium for operating a voice-responsive building management system, wherein the computer readable medium has computer readable instructions stored thereon that are executable by a processor to:

receive speech training data of a user and domain vocabulary for applications of the building management system for which the user is authorized;

generate grammar from runtime data associated with a building information model of the building management system, wherein;

the building information model is a three-dimensional building information model that includes building information modeling data associated with a building managed by the building management system; and

the runtime data includes events and alarms that occur while the building management system is running;

receive a voice command or voice query from the user; and

execute the voice command or voice query using the speech training data of the user, the domain vocabulary, and the grammar generated from the runtime data associated with the building information model.

15. The computer readable medium of claim 14, wherein the speech training data of the user includes speaker voice variations associated with the user.

16. The computer readable medium of claim 14, wherein the domain vocabulary includes:

a pronunciation lexicon for the user and the applications of the building management system for which the user is authorized; and

grammar recognition for the user and the applications of the building management system for which the user is authorized.

17. The computer readable medium of claim 14, wherein:

the speech card includes a speech password; and

the speech card includes details of the user.

18. The computer readable medium of claim 14, wherein the speech card is encrypted such that only the applications of the building management system for which the user is authorized can decrypt and use the speech card.