FLUID HUMAN-MACHINE INTERFACE

• US 20100301995A1
• Filed: 05/28/2010
• Published: 12/02/2010
• Est. Priority Date: 05/29/2009
• Status: Active Grant

• Current Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Original Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Inventors: Scott, Steven J., Nguyen, Thong T.
• Granted Patent: US 8,890,650 B2
• Time in Patent Office: Days
• US Class Current: 340/5.2
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/33191 Data exchange combined with inductively coupled power supply
• CPC Class Codes: G05B 2219/35444 Gesture interface, controlled machine observes operator, executes commands
• CPC Class Codes: G05B 2219/35459 Knob, handle, handwheel delivers pulses, electronic handwheel, digipot
• CPC Class Codes: G05B 2219/36133 MMI, HMI: man machine interface, communication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method of operating a communication device to interface with a machine system comprises projecting a human-machine interface (HMI) system for the machine system on a surface, wherein the HMI system comprises a plurality of commands associated with the machine system, detecting an input from a user, wherein the input comprises a fluid motion in air performed by the user corresponding to a selection of a command of the plurality of commands associated with the machine system, and transferring the selected command for delivery to the machine system.

Claims

1. A method of operating a communication device to interface with a machine system, the method comprising:

projecting a human-machine interface (HMI) system for the machine system on a surface, wherein the HMI system comprises a plurality of commands associated with the machine system;

detecting an input from a user, wherein the input comprises a fluid motion in air performed by the user corresponding to a selection of a command of the plurality of commands associated with the machine system; and

transferring the selected command for delivery to the machine system.

2. The method of claim 1 further comprising:

receiving a user identifier and a machine system identifier, wherein the user identifier identifies the user and the machine identifier identifies the machine system;

determining a proximity of the user to the machine system; and

wherein projecting the HMI system for the machine system comprises projecting the HMI system if the proximity of the user to the machine system satisfies a proximity requirement.

3. The method of claim 2 wherein projecting the HMI system for the machine system comprises projecting the HMI system for the machine system based on the machine system identifier.

4. The method of claim 2 wherein projecting the HMI system for the machine system comprises selecting the HMI system for the machine system based on the machine system identifier, determining if the user is authorized to view the HMI system based on the user identifier, and if the user is authorized to view the HMI system, projecting the HMI system for the machine system if the proximity of the user to the machine system satisfies the proximity requirement.

5. The method of claim 1 wherein detecting the input from the user comprises processing the fluid motion performed by the user in relation to the projected HMI system to determine the selected command associated with the machine system.

6. The method of claim 1 wherein projecting the HMI system for the machine system on the surface comprises projecting the HMI system for the machine system on an exterior surface of the machine system.

7. The method of claim 1 wherein projecting the HMI system for the machine system on the surface comprises projecting the HMI system for the machine system on a wall.

8. A communication device configured to interface with a machine system, the device comprising:

a human-machine interface (HMI) display device configured to project an HMI system for the machine system on a surface, wherein the HMI system comprises a plurality of commands associated with the machine system;

a processing system configured to detect an input from a user, wherein the input comprises a fluid motion in air performed by the user corresponding to a selection of a command of the plurality of commands associated with the machine system; and

a communication interface configured to transfer the selected command for delivery to the machine system.

9. The communication device of claim 8 further comprising:

an input device configured to receive a user identifier and a machine system identifier, wherein the user identifier identifies the user and the machine system identifier identifies the machine system;

the processing system configured to determine a proximity of the user to the machine system; and

wherein the HMI display device configured to project the HMI system for the machine system comprises the HMI display device configured to project the HMI system if the proximity of the user to the machine system satisfies a proximity requirement.

10. The communication device of claim 9 wherein the HMI display device configured to project the HMI system for the machine system comprises the HMI display device configured to project the HMI system for the machine system based on the machine system identifier.

11. The communication device of claim 9 wherein the HMI display device configured to project the HMI system for the machine system comprises the processing system configured to select the HMI system for the machine system based on the machine system identifier and determine if the user is authorized to view the HMI system based on the user identifier, and if the user is authorized to view the HMI system, the HMI display device configured to project the HMI system for the machine system if the proximity of the user to the machine system satisfies the proximity requirement.

12. The communication device of claim 8 wherein the processing system configured to detect the input from the user comprises the processing system configured to process the fluid motion performed by the user in relation to the projected HMI system to determine the selected command associated with the machine system.

13. The communication device of claim 8 wherein the HMI display device configured to project the HMI system for the machine system on the surface comprises the HMI display device configured to project the HMI system for the machine system on an exterior surface of the machine system.

14. The communication device of claim 8 wherein the HMI display device configured to project the HMI system for the machine system on the surface comprises the HMI display device configured to project the HMI system for the machine system on a wall.

15. A computer readable medium having program instructions stored thereon that, when executed by a communication device, are configured to direct the communication device to:

project a human-machine interface (HMI) system for the machine system on a surface, wherein the HMI system comprises a plurality of commands associated with the machine system;

detect an input from a user, wherein the input comprises a fluid motion in air performed by the user corresponding to a selection of a command of the plurality of commands associated with the machine system; and

transfer the selected command for delivery to the machine system.

16. The computer readable medium of claim 15 wherein the program instructions are further configured to direct the communication device to:

receive a user identifier that identifies the user and a machine system identifier that identifies the machine system;

determine a proximity of the user to the machine system; and

wherein the program instructions configured to direct the communication device to project the HMI system for the machine system on the surface comprises the program instructions configured to direct the communication device to project the HMI system if the proximity of the user to the machine system satisfies a proximity requirement.

17. The computer readable medium of claim 16 wherein the HMI display device configured to project the HMI system for the machine system on the surface comprises the HMI display device configured to project the HMI system for the machine system based on the machine system identifier.

18. The computer readable medium of claim 16 wherein the program instructions configured to direct the communication device to project the HMI system for the machine system on the surface comprises the program instructions configured to direct the communication device to select the HMI system for the machine system based on the machine system identifier and determine if the user is authorized to view the HMI system based on the user identifier, and if the user is authorized to view the HMI system, project the HMI system for the machine system on the surface if the proximity of the user to the machine system satisfies the proximity requirement.

19. The computer readable medium of claim 15 wherein the program instructions configured to direct the communication device to detect the input from the user comprises the program instructions configured to direct the communication device to process the fluid motion performed by the user in relation to the projected HMI system to determine the selected command associated with the machine system.

20. The computer readable medium of claim 15 wherein the program instructions configured to direct the communication device to project the HMI system for the machine system on the surface comprises the program instructions configured to direct the communication device to project the HMI system for the machine system on an exterior surface of the machine system.