METHOD FOR GESTURE-BASED OPERATION CONTROL

• US 20150149956A1
• Filed: 05/09/2013
• Published: 05/28/2015
• Est. Priority Date: 05/10/2012
• Status: Active Grant

• Current Assignee: Umoove Services Ltd
• Original Assignee: Umoove Services Ltd
• Inventors: Kempinski, Yitzchak, Elbaum, Tuvia, Barak, Yair
• Granted Patent: US 9,952,663 B2
• Time in Patent Office: Days
• US Class Current: 715/784
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A method may track a motion of a body part in a series of images captured by an imager that is associated with an electronic device, and detect in such motion a gesture of the body part that matches a pre-defined gesture. Upon such detection of the gesture, a function that is associated with the gesture is activated but only upon a contact or other input, such as a push of a button by a user. The combination of the ‘push to enable’ and the ‘gesture to activate the function’ may provide comfortable operation of the gesture activation of a function. A system and method of altering a zoom of an image displayed on an electronic device by detecting in a series of images a change in distance between the device and a viewer of the image, and zooming the image to correspond to such change in position. The captured images and detected change in distance may be interpreted by a processor as a zoom gesture that may trigger a zoom of the displayed image. A system and method of activating a scroll function for content that is displayed on an electronic screen, including capturing a series of images of a body part, such as a head, of a viewer of the content, and detecting a rotation, a change in orientation, or a change in a position of such head. A method may interpret the detected change as a gesture, and activate a scroll function to scroll the displayed content in a direction opposite the direction of the gesture or with other parameters defined by the detected gesture.

Claims

1-39. -39. (canceled)

40. A method for scrolling displayed content, the method comprising:

detecting, in a series of acquired images of a user of a device on which the content is displayed, a movement of a head of the user; and

when the detected movement corresponds to a gesture, scrolling the displayed content as indicated by the gesture.

41. The method of claim 40, wherein a direction of the scrolling is opposite a direction of the detected head movement.

42. The method of claim 40, wherein a rate of the scrolling is determined by a magnitude of a vector that characterizes the detected head movement.

43. The method of claim 40, wherein the scrolling continues until detection of another head movement.

44. The method of claim 40, wherein an extent of the scrolling is determined by an extent of a change of an orientation of the head in the detected head movement.

45. The method of claim 44, wherein an extent of the scrolling is proportional to said change in orientation.

46. The method of claim 45, wherein said extent of a change in orientation is determined as a fraction of a head movement range.

47. The method of claim 44, wherein the scrolling comprises moving a screen object to a position that is determined by the change in the orientation.

48. The method of claim 40, wherein the detected motion corresponds to the gesture when the detected movement exceeds an ignore range.

49. The method of claim 40, wherein detecting the head comprises, in an acquired image of said series of acquired images, estimating an expected size and expected location of an image of an iris of an eye within that acquired image, and determining a location of the iris image within that acquired image by identifying a region within the expected location, a size of the region being consistent with the expected size, wherein pixels of the region have luminance values darker than pixels of other regions within the expected location.

50. A device comprising:

a display screen configurable to display a content;

an imaging device configurable to acquire a series of images of a head of a user of the device;

a processor configured to;

detect in the series of acquired images, a movement of the user'"'"'s head; and

scroll the displayed content in a manner indicated by the detected movement.

51. The device of claim 50, comprising a mobile device.

52. The device of claim 50, wherein the imaging device comprises a video camera.

53. The device of claim 50, wherein the processor is configured to scroll the displayed content at a rate of that is indicated by the detected movement.

54. The device of claim 50, wherein the processor is configured to scroll the displayed content in a direction that is opposite to the detected movement.

55. The device of claim 50, wherein the processor is configured to scroll the displayed content when the detected movement is greater than an ignore range.

56. The device of claim 50, wherein the processor is configured to continue to scroll the displayed content until another head movement is detected.

57. A method of activating a scroll function on an electronic display, the method comprising:

detecting, in a series of images captured by an imager, said imager associated with the display, a movement of a body part of a viewer to a pre-defined orientation, said movement associated with activation of said scroll function; and

activating said scroll function for the duration of a period that said body part retains said orientation.

58. The method as in claim 57, wherein said detecting said movement of a body part comprises detecting a direction of a movement of a head of said user, and wherein said activating said scroll function comprises, scrolling content displayed on said display in a direction opposite of said detected movement.

59. The method as in claim 57, wherein said detecting said pre-defined movement comprises detecting a movement of a head past an ignore range, and wherein an intensity of said scrolling is a function of an intensity of said movement.