Frameworks, devices and methods configured for enabling a multi-modal user interface configured to display facility information

• US 9,672,006 B2
• Filed: 06/09/2014
• Issued: 06/06/2017
• Est. Priority Date: 06/10/2013
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Morrison, John D., Davis, Peter C., Laycock, Graeme
• Primary Examiner(s): CHOI, DAVID E
• Application Number:
  US14/300,103
• Publication Number:
  US 20140365896A1
• Time in Patent Office: 1,093 Days
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Described herein are frameworks, devices and methods configured for enabling display for facility information and content, in some cases via touch/gesture controlled interfaces. Embodiments of the invention have been particularly developed for allowing an operator to conveniently access a wide range of information relating to a facility via, for example, one or more wall mounted displays. While some embodiments will be described herein with particular reference to that application, it will be appreciated that the invention is not limited to such a field of use, and is applicable in broader contexts.

Claims

1. A computer implemented method for sharing content, the method comprising:

displaying a touch/gesture driven user interface that is rendered on a display screen coupled to a first terminal, wherein the touch/gesture driven user interface includes;

a map layer including image data representative of a facility, wherein the touch/gesture driven user interface is navigated by way of pan and zoom operations defined with respect to the map layer;

one or more objects superimposed on the map layer, wherein each object is associated with a building resource defined in a building management system, each building resource being associated with name data;

wherein the touch/gesture driven user interface is controllable by multiple modes, including at least one gesture-driven mode, and at least one voice-driven mode;

wherein, for at least one voice-driven mode, a voice-command processing module is configured to have access to name data for the building resources, wherein the name data defines individual unique names for each of the building resources according to a location-specific hierarchy derived naming convention, wherein attributes of a given voice command are processed thereby to identify a particular one of the building resources; and

wherein the voice-command processing module is context dependent, thereby to favor name data for resources shown on-screen over name data for resources not shown on screen at least when the given voice command does not inherently provide full location-specific hierarchy context.

2. A method according to claim 1 wherein panning and zooming operations with respect to the map layer are controllable using commands including the name data for the building resources.

3. A method according to claim 1 wherein the voice-command processing module is responsive to the given voice command by performing a command in respect of the identified building resource.

4. A method according to claim 1 wherein, in response to a predefined voice command indicative of name data for a given one of the building resources, the touch/gesture driven user interface is configured to navigate to a map layer position, in terms of pan and zoom, for displaying that given one of the building resources.

5. A method according to claim 1 wherein the at least one touch/gesture driven mode is controlled by at least one of:

(i) a touch screen;

or (ii) a motion sensing device.

6. A method according to claim 1 wherein the touch/gesture driven user interface is simultaneously controllable by the multiple modes, including at least one gesture-driven mode, and at least voice-driven mode.

7. A computer system configured to perform a method for sharing content, the computer system comprising:

a controller comprising a processor;

the controller comprising a voice-command processing module;

a display screen operatively coupled to the controller;

the controller configured to cause a touch/gesture driven user interface to be rendered on the display screen, wherein the touch/gesture driven user interface comprises;

a map layer including image data representative of a facility, wherein the touch/gesture driven user interface is navigated by way of pan and zoom operations defined with respect to the map layer;

one or more objects superimposed on the map layer, wherein each object is associated with a building resource defined in a building management system, each building resource being associated with name data;

wherein the touch/gesture driven user interface is controllable by multiple modes, including at least one gesture-driven mode, and at least voice-driven mode;

the voice-command processing module of the controller is configured to have access to name data for the building resources, wherein the name data defines individual unique names for each of the building resources according to a location-specific hierarchy derived naming convention, wherein attributes of a given voice command are processed by the voice-command processing module to identify a particular one of the building resources; and

wherein the voice-command processing module of the controller is context dependent, thereby to favor name data for resources shown on-screen over name data for resources not shown on screen at least when the given voice command does not inherently provide full location-specific hierarchy context.

8. A system according to claim 7 wherein panning and zooming operations with respect to the map layer are controllable using commands including the name data for the building resources.

9. A system according to claim 7 wherein the voice-command processing module of the controller is responsive to the given voice command by performing a command in respect of the identified building resource.

10. A system according to claim 7 wherein, in response to a predefined voice command indicative of name data for a given one of the building resources, the touch/gesture driven user interface is configured to navigate to a map layer position, in terms of pan and zoom, for displaying that given one of the building resources.

11. A system according to claim 7 wherein the at least one touch/gesture driven mode is controlled by at least one of:

(i) a touch screen;

or (ii) a motion sensing device.

12. A system according to claim 7 wherein the touch/gesture driven user interface is simultaneously controllable by the multiple modes, including at least one gesture-driven mode, and at least voice-driven mode.