FOOT GESTURE-BASED CONTROL DEVICE

• US 20170336870A1
• Filed: 10/23/2015
• Published: 11/23/2017
• Est. Priority Date: 10/23/2014
• Status: Active Application

• Current Assignee: Orpyx Medical Technologies Inc.
• Original Assignee: Orpyx Medical Technologies Inc.
• Inventors: Everett, Julia Breanne, Turnquist, Llewellyn Lloyd, Stevens, Travis Michael, Coutts, Daryl David, Groenland, Marcel
• Application Number:
  US15/521,023
• Publication Number:
  US 20170336870A1
• Time in Patent Office: Days
• CPC Class Codes: A43B 13/38 Built-in insoles joined to uppers during the manufacturing process, e.g. structural insoles; Insoles glued to shoes during the manufacturing process
• CPC Class Codes: A43B 3/00 Footwear characterised by the shape or the use
• CPC Class Codes: A43B 3/34 with electrical or electronic arrangements
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G05B 19/0423 Input/output
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/08 Biomedical applications

Abstract

A hands-free, heads up and discrete system and method for controlling a peripheral device using foot gestures is provided. The system includes a foot-based sensory device that includes one or more sensors, such as pressure sensors, gyroscopes, and accelerometers, that receive sensory information from a user'"'"'s foot, interpret the information as being linked to specific commands, and transmit the commands to at least one display device for controlling the display device. The system also includes a feedback system for providing tactile, visual and/or auditory feedback to the user based on the actions performed, information provided by the display device and/or information provided from another user.

Claims

1. A foot gesture based control system comprising:

a sensory device having at least one sensor for generating an input based on a foot gesture or a force applied by at least one part of a user'"'"'s foot;

a processor for receiving the input from the sensory device and determining any output action;

a transmitter for transmitting the output action from the processor wirelessly to at least one display device for controlling the at least one display device; and

a feedback device in communication with the processor for receiving the output action to provide feedback to the user.

2. The system of claim 1 wherein the transmitter is a transmitter/receiver, and the processor receives information from the at least one display device and/or a secondary device through the transmitter/receiver for providing feedback to the user through the feedback device.

3. The system of claim 1 wherein the sensory device is a shoe insole, a sock, a shoe or a foot mat.

4. The system of claim 1 wherein the sensory device is a shoe insole and there is an array of pressure sensors distributed throughout the insole.

5. The system of claim 1 wherein the at least one sensor is any one of or combination of a pressure sensor, accelerometer and gyroscope.

6. The system of claim 1 wherein the feedback device provides tactile feedback to the user'"'"'s foot.

7. The system of claim 1 wherein the at least one display device is a head- or helmet-mounted display (HMD) or a heads up device (HUD).

8. The system of claim 1 wherein multiple foot gesture based control systems can communicate discretely with each other by sending signals using foot gestures and receiving signals through the feedback device.

12. The controller of claim 1, wherein the plurality of sensors includes any one of or combination of a pressure sensor, an accelerometer and a gyroscope.

9. A method for controlling a display device based on foot gestures and/or foot forces of a user comprising the steps of:

a) generating an input based on a foot gesture or foot force of the user using at least one sensor;

b) interpreting the input as a foot gesture linked to a specific command;

c) commanding a display device to perform the specific command; and

d) providing feedback to the user based on the command performed and/or information received from an external system.

10. A foot gesture-based controller for hands-free selection of a plurality of menu commands on a computer, the controller comprising:

i) a sensor device including a plurality of sensors configured to recognize a plurality of foot gestures, wherein each unique foot gesture of the plurality of foot gestures causes a unique sensor output signature configured to initiate a unique menu command from the plurality of menu commands on the computer; and

ii) a transmitter for transmitting the unique sensor output signature to the computer for initiation of the unique menu command.

11. The controller of claim 10, in the form of a shoe insole with an array of pressure sensors distributed throughout the insole.

13. The controller of claim 10 further comprising a feedback device for providing feedback based on the input provided and/or the generated command.

14. The controller of claim 13 wherein the feedback device provides tactile feedback to the user'"'"'s foot.

15. The controller of claim 10 wherein the computer is a heads-up device (HUD) or includes a head- or helmet-mounted display.

16. The controller of claim 10, wherein the plurality of foot gestures includes any combination of two or more of the following:

downward pressure of the tip of the hallux, downward pressure of the hallux combined with flexion of the hallux toward the ball of the foot, downward pressure of the hallux combined with extension of the hallux away from the ball of the foot hallux extension, downward pressure of substantially the entire ball of the foot, downward pressure of the left side of the ball of the foot, downward pressure of the right side of the ball of the foot, and downward pressure of the heel.

17. The controller of claim 10, wherein the menu commands are displayed in a main menu and in one or more submenus.

18. The controller of claim 10, wherein the menu commands are selected from the group consisting of:

Open Main Menu, Scroll Up/Down, Return/Enter, Exit, Take a Photo, Take A Screenshot, Record Video, Stop Recording Video, Alphanumeric Character Insertion, Backspace/Delete, Zoom In, Zoom Out, Toggle, Increase Volume, Decrease Volume, Go Forward, Go Back, Increase Intensity, and Decrease Intensity.

19. The controller of claim 10, wherein the foot gestures recognized by the input device are pre-selected from a survey for ease of performance by a survey group of users testing the controller, and wherein the easiest foot gestures determined by the survey group are assigned to the most commonly used commands.

20. The controller of claim 10, wherein the transmitter is a wireless transmitter.

21. A use of the controller of claim 10 for providing patient data to a surgeon during surgery.

22. The use of claim 21, wherein the patient data is transmitted from a patient monitor to the computer wirelessly.

23. The use of claim 21, wherein the patient data includes any one of or a combination of vital signs data, a real time video of a different field of view of the patient, and a surgical model based on the anatomy of the patient.

24. The use of claim 23, wherein the vital signs data includes any one of or a combination of blood pressure, pulse rate, body temperature, respiration rate and dissolved oxygen level.