SYSTEM AND METHOD FOR A HUMAN MACHINE INTERFACE UTILIZING NEAR-FIELD QUASI-STATE ELECTRICAL FIELD SENSING TECHNOLOGY

• US 20160103500A1
• Filed: 05/21/2014
• Published: 04/14/2016
• Est. Priority Date: 05/21/2013
• Status: Abandoned Application

• Current Assignee: Stanley Innovation Incorporated
• Original Assignee: Stanley Innovation Incorporated
• Inventors: Hussey, Patrick, Shaffer, Benjamin
• Application Number:
  US14/892,590
• Publication Number:
  US 20160103500A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B25J 13/084 Tactile sensors in general G01L5/16, G01L5/22
• CPC Class Codes: B25J 9/161 Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
• CPC Class Codes: B25J 9/1676 Avoiding collision or forbidden zones
• CPC Class Codes: B25J 9/1694 characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 2219/35444 Gesture interface, controlled machine observes operator, executes commands
• CPC Class Codes: G05B 2219/40201 Detect contact, collision with human
• CPC Class Codes: G05B 2219/40414 Man robot interface, exchange of information between operator and robot
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/046 by electromagnetic means
• CPC Class Codes: Y10S 901/09 Closed loop, sensor feedback controls arm movement
• CPC Class Codes: Y10S 901/10 Sensor physically contacts and follows work contour

Abstract

The system and method for non-contact and/or touch-sensitive human machine interface, for use in numerous capacities wherein a lack of physical contact, with control apparatuses or devices is desirable. Electrical near field three-dimensional tracking and gesture control systems are utilized to interpret the location and movement of an operator, or to provide navigation, mapping, avoidance, localization, and the like for robotics applications.

Claims

1. A human machine interface system comprising:

a plurality of sensing electrodes configured to transmit a set of electrical signals from the system to the operator and receive a set of electrical signals based on input from an operator of the system;

at least one sensing integrated circuit; and

a microcontroller unit;

wherein the at least one sensing integrated circuit and the microcontroller unit are in electronic and data communication and wherein the microcontroller unit is configured to receive a set of three dimensional position data, raw/calibrated signal intensity data, a set of gesture data, or any combination thereof from the at least one sensing integrated circuit, wherein the microcontroller unit controls the at least one sensing integrated circuit and interprets information about an intended interaction of the operator with a device.

2. The human machine interface system of claim 1, wherein the at least one sensing integrated circuit functions as an electrical near field (“

e-field”

) three dimensional tracking and gesture controller to interpret the location and movement of an operator of the system that is detected by the plurality of sensing electrodes.

3. The human machine interface system of claim 1, wherein the microcontroller and the at least one sensing integrated circuit are configured for calibration and frequency selection to provide interference correction.

4. The human machine interface system of claim 1, wherein the human machine interface system is non-contact and touch-sensitive.

5. The human machine interface system of claim 1, wherein the human machine interlace utilizes specific algorithms for detecting changes in the emitted electric fields for the purpose of detecting and locating objects within the sensing area.

6. The human machine interface system of claim 1, wherein the microcontroller unit includes a set of embedded computer software, wherein the embedded software may include application specific algorithms for interpreting input and device-specific communication protocols for input/output.

7. The human machine interface system of claim 1, wherein the microcontroller unit is in electronic and data communication with the device and the microcontroller unit coordinates activities within the device and provides at least one feedback mechanism to the operator.

8. The human machine interface system of claim 1, wherein the at least one feedback mechanism is selected from the group consisting of visual feedback, audible feedback, and tactile feedback.

9. The human machine interface system of claim 1, wherein the microcontroller unit is in electronic communication with a plurality of sensing integrated circuits to enable larger sensing arrays.

10. The human machine interface system of claim 9, wherein the sensing electrode array is placed in a nano-wire configuration in-front of an LCD utilizing the structures inside the LCD as the transmit and/or ground planes.

11. The human machine interface system of claim 1, wherein the microcontroller unit determines when an input surface of the system has been physically touched, and potentially contaminated, by the operator.

12. The human machine interface system of claim 11, wherein the system subsequently relays information to the operator relating to the potential contamination.

13. The human machine interface system of claim 11, wherein the system subsequently initiates an auto-sanitization routine of the input surface.

14. The human machine interface system of claim 1, wherein the microcontroller unit coordinates the execution of some function within the device based on the data collected and interpreted by the microcontroller unit from the at least one sensing integrated circuit and the plurality of sensing electrodes.

15. The human machine interlace system of claim 1, wherein the device is selected from the group consisting of a user control panel, an elevator car operating panel, a hall call station, a dispatch terminal, elevator passenger interface, a door, a robot, a robotic system, a robotic arm, a manufacturing station, a machine control panel, entry access control a beverage dispensing machine, a snack dispensing machine, operating room equipment, a clean room, an Automated Teller Machine (ATM), a fuel pump, and household appliances.

16. The human machine interface system of claim 1, further comprising an amplifier on one or more transmitting electrodes to boost transmitting power.

17. A method of operating a device comprising

providing a human machine interface system having a panel wherein the human machine interface is configured to detect, locate, and interpret user interaction;

incorporating a microcontroller unit configured to interpret and abstract information from at least one sensing integrated circuit using software algorithms tailored to a specific application, device, and environment of the device;

providing communication protocols and methods to tailor the interaction to the specific device by the microcontroller unit;

providing a non-contact and touch-sensitive interface; and

indicating when the panel has been touched to indicate that the surface of the panel is potentially contaminated.

18. The method of operating a device of claim 17, wherein detecting a user interaction comprises a range from about zero to about fifteen centimeters distance from the non-contact and touch-sensitive interface.

19. The method of operating a device of claim 17, further comprising the step of initiating automated sanitization of the surface of the panel.

20. The method of operating a device of claim 17, wherein indicating the surface of the panel is potentially contaminated comprises providing at least one feedback mechanism to the user.

21. The method of operating a device of claim 17, wherein the device is selected from the group consisting of a user control panel, an elevator ear operating panel, a hail call station, a dispatch terminal, elevator passenger interface, a door, a robot, a robotic system, a robotic arm, a manufacturing station, a machine control panel, entry access control, a beverage dispensing machine, a snack dispensing machine, operating room equipment, a clean room, an Automated Teller Machine (ATM), a fuel pump, and household appliances.

22. The method of operating a device of claim 18, wherein detecting a user interaction comprises position and gesture data.

23. The method of operating a device of claim 17, further comprising executing a specific instruction to the device.

24. A method of operating a robotic device comprising

providing a plurality of sensing electrodes configured to transmit a set of electrical signals from the system to objects located in the robotic device'"'"'s surroundings and receive a set of electrical signals based on input from a robotic device'"'"'s surroundings;

providing at least one sensing integrated circuit wherein the sensing integrated circuit functions as an electrical near field (“

e-field”

) three dimensional tracking controller to interpret the location and movement of the system and objects located in the robotic device'"'"'s surroundings that are detected by the plurality of sensing electrodes; and

providing a microcontroller unit;

wherein the at least one sensing integrated circuit and the microcontroller unit are in electronic and data communication and wherein the microcontroller unit is configured to receive a set of three dimensional position data, raw/calibrated signal intensity data, a set of gesture data from the sensing integrated circuit, or any combination thereof, wherein the microcontroller unit controls the at least one sensing integrated circuit and interprets information about an intended interaction of the system with a surroundings thereby providing navigation, mapping, avoidance, and localization to a robotic device.