Motion feedback

• US 9,201,545 B2
• Filed: 02/28/2013
• Issued: 12/01/2015
• Est. Priority Date: 09/02/2010
• Status: Active Grant

• Current Assignee: Elliptic Laboratories AS
• Original Assignee: Elliptic Laboratories AS
• Inventors: Dahl, Tobias Gulden, Syversrud, Bjorn Cato, Kavli, Tom ystein, Forsstrm, Erik, Vgenes, David
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): OLIVER, GERALD L
• Application Number:
  US13/781,527
• Publication Number:
  US 20130176258A1
• Time in Patent Office: 1,006 Days
• Field of Search: 345156-184, 178 1801- 2004, 715/863, 340/407.1
• US Class Current: 1/1
• CPC Class Codes: G01S 7/5273 using digital techniques
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/043 using propagating acoustic waves

Abstract

A user input to a system is processed by receiving reflections of signals from a moving input object. Information relating to the direction of movement of the input object and information relating to the speed of the input object are determined from the reflections. Continual sensory feedback is provided to the user, controlled by a parameter that is repeatedly updated based on the direction and speed of the input object. When no new determination of information relating to the speed or direction of the input object has been made since a previous update, a time-dependent change is made to the parameter.

Claims

1. A method of processing a user input to a system comprising:

receiving reflections of signals from a moving input object;

repeatedly determining information relating to the direction of movement of the input object from said reflections;

repeatedly determining information relating to the speed of the input object from said reflections;

providing continual or continuous sensory feedback to the user, controlled by a parameter;

repeatedly updating the parameter by means of an algorithm that takes, as two variable inputs, the information relating to the direction of movement of the input object, and the information relating to the speed of the input object; and

applying a time-dependent change to the parameter when no new determination of information relating to the speed or direction of movement of the input object has been made since a previous update to the parameter,

wherein the information relating to the direction of movement or speed of the input object is determined by applying a set of line filters to a matrix of impulse responses.

2. A method as claimed in claim 1 comprising applying the time-dependent change to the parameter by extrapolating from recent values of the parameter.

3. A method as claimed in claim 1 wherein the signals are ultrasonic.

4. A method as claimed in claim 1 comprising acquiring a sufficient quantity of data from the received reflections that the information relating to the direction of movement or speed of the input object satisfies a reliability criterion.

5. A method as claimed in claim 1 comprising determining the information relating to the direction of movement or speed of the input object from a characteristic of signals received on different channels.

6. A method as claimed in claim 5 wherein said characteristics relate to relative signal strength or to timing information for the signals received on the different channels.

7. A method as claimed in claim 1 comprising relating the information relating to the direction of movement or speed of the input object to one or more linear sliders and moving one or more of the sliders in response to movement of the input object.

8. A method as claimed in claim 1 comprising providing the sensory feedback to the user for as long as the input object is within a detection region.

9. A method as claimed in claim 1 wherein the sensory feedback comprises a repetitive component with the repetition rate controlled by the parameter.

10. A method as claimed in claim 1 wherein the sensory feedback comprises audible feedback.

11. A method as claimed in claim 1 wherein providing the sensory feedback comprises changing the output of an electronic display, wherein the parameter controls any one or more of the position, speed and direction of movement of a graphical element on the display.

12. A method as claimed in claim 11 comprising controlling the display of the graphical element so that the speed of movement of the graphical element is determined by a linear function of the speed of the input object.

13. A method as claimed in claim 11 comprising controlling the display of the graphical element so that the graphical element continues to move even after movement of the input object stops.

14. A method as claimed in claim 11 comprising controlling the display of the graphical element so that the graphical element moves in predominantly the direction of an allowed input gesture.

15. A method as claimed in claim 11 wherein the algorithm is such as to retard movement of the graphical element over time.

16. A method as claimed in claim 15 wherein the algorithm is such that the retardation is initiated or increased upon receipt of information indicating that the input object is moving in a particular direction or at a particular speed.

17. A method as claimed in claim 16 wherein the particular direction is different from the direction of movement of the input object that initiated the movement of the graphical element.

18. A method as claimed in claim 11 wherein the algorithm takes as input a target position related to the electronic display and is such that the updating of the parameter simulates an attractive or repellent force between the graphical display element and the target position.

19. A method as claimed in claim 1 comprising providing information relating to the position of the input object as input to the algorithm.

20. A method as claimed in claim 1 comprising determining whether the input object is within one of a plurality of predetermined zones or positional states.

21. A method as claimed in claim 1 comprising using information relating to the position of the input object so as only to respond to movement of the input object corresponding to an input pattern or gesture having an associated spatial area if the input object is located in that spatial area.

22. A method as claimed in claim 1 comprising detecting and identifying movement of the input object corresponding to a recognised input gesture, and responding to the input gesture.

23. A method as claimed in claim 22 comprising determining a most likely one of a set of recognised gestures and providing sensory feedback to the user based on the identity of the most likely gesture before the most likely gesture has been completed.

24. A method as claimed in claim 1 comprising detecting an input gesture from information relating to movement of the input object and providing a first response if an input gesture is repeated within a period of time, and providing a second, different response if the input gesture is repeated after an interval longer than the period of time.

25. A method as claimed in claim 1 comprising using information relating to the value of the parameter during a first gesture of the input object when determining the value of the parameter during a second gesture of the input object.

26. Apparatus for processing a user input to a system comprising:

a receiving arrangement configured to receive reflections of signals from a moving input object;

a feedback arrangement configured to provide continual or continuous sensory feedback to the user, controlled by a parameter; and

a processing arrangement configured to;

repeatedly determine information relating to the direction of movement of the input object from said reflections;

repeatedly determine information relating to the speed of the input object from said reflections; and

repeatedly update the parameter by means of an algorithm that takes, as two variable inputs, the information relating to the direction of movement of the input object, and the information relating to the speed of the input object,

wherein the processing arrangement is further configured to apply a time-dependent change to the parameter when no new determination of information relating to the speed or direction of movement of the input object has been made since a previous update to the parameter, and the information relating to the direction of movement or speed of the input object is determined by applying a set of line filters to a matrix of impulse responses.

27. A non-transitory computer program product, comprising a computer usable medium having a computer readable program code when run on an apparatus, to cause the apparatus to process a user input to a system, comprising:

logic for processing received reflections of signals from a moving input object;

logic for repeatedly determining information relating to the direction of movement of the input object from said reflections;

logic for repeatedly determining information relating to the speed of the input object from said reflections;

instructions for providing continual or continuous sensory feedback to the user, controlled by a parameter;

logic for repeatedly updating the parameter by means of an algorithm that takes, as two variable inputs, the information relating to the direction of movement of the input object, and the information relating to the speed of the input object; and

logic for applying a time-dependent change to the parameter when no new determination of information relating to the speed or direction of movement of the input object has been made since a previous update to the parameter,

wherein the information relating to the direction of movement or speed of the input object is determined by applying a set of line filters to a matrix of impulse responses.