Method for gesture-based operation control

• US 9,952,663 B2
• Filed: 05/09/2013
• Issued: 04/24/2018
• Est. Priority Date: 05/10/2012
• Status: Active Grant

• Current Assignee: Umoove Services Ltd
• Original Assignee: Umoove Services Ltd
• Inventors: Kempinski, Yitzchak, Barak, Yair, Elbaum, Tuvia
• Primary Examiner(s): ABDULSELAM, ABBAS I
• Application Number:
  US14/400,003
• Publication Number:
  US 20150149956A1
• Time in Patent Office: 1,811 Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A method may track a motion of a body part in a series of images captured by an imager that is associated with an electronic device, and detect in such motion a gesture of the body part that matches a pre-defined gesture. Upon such detection of the gesture, a function that is associated with the gesture is activated but only upon a contact or other input, such as a push of a button by a user. The combination of the ‘push to enable’ and the ‘gesture to activate the function’ may provide comfortable operation of the gesture activation of a function. A system and method of altering a zoom of an image displayed on an electronic device by detecting in a series of images a change in distance between the device and a viewer of the image, and zooming the image to correspond to such change in position. The captured images and detected change in distance may be interpreted by a processor as a zoom gesture that may trigger a zoom of the displayed image. A system and method of activating a scroll function for content that is displayed on an electronic screen, including capturing a series of images of a body part, such as a head, of a viewer of the content, and detecting a rotation, a change in orientation, or a change in a position of such head. A method may interpret the detected change as a gesture, and activate a scroll function to scroll the displayed content in a direction opposite the direction of the gesture or with other parameters defined by the detected gesture.

Claims

1. A method for scrolling displayed content, the method comprising:

detecting, in a series of acquired images of a user of a device on which the content is displayed, a movement of a head of the user;

determining that the detected movement corresponds to a gesture when it exceeds an ignore range of at least one of angular and positional movements;

when the movement corresponds to a gesture, scrolling the displayed content as indicated by the gesture; and

when the movement returns to the ignore range, adjusting the scrolling by at least one of stopping and changing scrolling rate,

wherein gestures that mimic natural head movements correspond to scrolling that mimics viewing of a physical object.

2. The method of claim 1, wherein a direction of the scrolling is opposite a direction of the detected head movement.

3. The method of claim 1, wherein a rate of the scrolling is determined by a magnitude of a vector that characterizes the detected head movement.

4. The method of claim 1, wherein the scrolling continues until detection of another head movement.

5. The method of claim 1, wherein an extent of the scrolling is determined by an extent of a change of an orientation of the head in the detected head movement.

6. The method of claim 5, wherein an extent of the scrolling is proportional to said change in orientation.

7. The method of claim 6, wherein said extent of a change in orientation is determined as a fraction of a head movement range.

8. The method of claim 5, wherein the scrolling comprises moving a screen object to a position that is determined by the change in the orientation.

9. The method of claim 1, wherein detecting the head comprises, in an acquired image of said series of acquired images, estimating an expected size and expected location of an image of an iris of an eye within that acquired image, and determining a location of the iris image within that acquired image by identifying a region within the expected location, a size of the region being consistent with the expected size, wherein pixels of the region have luminance values darker than pixels of other regions within the expected location.

10. The method of claim 1, wherein detection of movements is carried out with determination of head movement only.

11. The method of claim 1, wherein scrolling the displayed content comprises at least one of scrolling, panning and zooming.

12. A device comprising:

a display screen configurable to display a content;

an imaging device configurable to acquire a series of images of a head of a user of the device;

a processor configured to;

detect in the series of acquired images, a movement of the user'"'"'s head; and

determine that the detected movement corresponds to a gesture when it exceeds an ignore range of at least one of angular and positional movements;

scroll the displayed content when the detected movement corresponds to a gesture in a manner indicated by the detected movement; and

when the detected movement returns to the ignore range, adjust the scrolling by at least one of stopping and changing scrolling rate,

wherein gestures that mimic natural head movements correspond to scrolling that mimics viewing of a physical object.

13. The device of claim 12, comprising a mobile device.

14. The device of claim 12, wherein the imaging device comprises a video camera.

15. The device of claim 12, wherein the processor is configured to scroll the displayed content at a rate of that is indicated by the detected movement.

16. The device of claim 12, wherein the processor is configured to scroll the displayed content in a direction that is opposite to the detected movement.

17. The device of claim 12, wherein the processor is configured to continue to scroll the displayed content until another head movement is detected.

18. A method of activating a scroll function on an electronic display, the method comprising:

detecting, in a series of images captured by an imager, said imager associated with the display, a movement of a head of a viewer to a pre-defined orientation, said movement associated with activation of said scroll function;

determining that the detected movement exceeds an ignore range of at least one of angular and positional movements;

activating said scroll function for the duration of a period that the head retains said orientation; and

when the detected movement returns to the ignore range, adjusting the scrolling to at least one of stopping and scrolling rate change,

wherein gestures that mimic natural head movements correspond to scrolling that mimics viewing of a physical object.

19. The method as in claim 18, wherein said detecting said movement of a body part comprises detecting a direction of a movement of a head of said user, and wherein said activating said scroll function comprises, scrolling content displayed on said display in a direction opposite of said detected movement.

20. The method as in claim 18, wherein an intensity of said scrolling is a function of an intensity of said movement.