DETECTION OF A SCROLLING GESTURE

• US 20140282224A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Pedley, Christopher
• Application Number:
  US13/844,087
• Publication Number:
  US 20140282224A1
• Time in Patent Office: Days
• US Class Current: 715/784
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

Methods, systems, computer-readable media, and apparatuses for implementation of a scrolling gesture are disclosed. In some embodiments, a control object is detected by a detection device, and movement of content on a display is matched to movement of the control object. In further embodiments, a speed of the control object is detected, and a free scrolling mode is entered when the speed exceeds a speed threshold.

Claims

1. A method comprising:

engaging, in response to a scroll initiating input from a user, a scrolling process;

detecting, based on information from one or more remote detection devices, a speed of a control object associated with the user during the scrolling process; and

executing at a computerized device one of a plurality of scroll modes during the scrolling process based on the detected speed.

2. The method of claim 1, wherein the executing comprises:

matching, as part of the scrolling process, a first content movement on a display to a first scrolling movement of the control object when the speed of the control object during the first scrolling movement of the control object is below a speed threshold; and

engaging a free scrolling mode when the speed of the control object is above the speed threshold as part of a second scrolling movement of the control object.

3. The method of claim 2, wherein the control object comprises a fingertip of the user, and wherein engaging the free scrolling mode when the speed of the control object is above the speed threshold comprises:

detecting a flicking motion of the fingertip where the speed of the fingertip exceeds the speed threshold while a speed of a hand associated with the fingertip does not exceed the speed threshold.

4. The method of claim 2 wherein the scrolling process comprises pausing matching the first content movement to the first scrolling movement of the control object when the control object moves away from a plane parallel to a display surface of the display at a first area and resuming matching the first content movement to the first scrolling movement of the control object when the control object reenters the plane parallel to the display at a second area.

5. The method of claim 4 wherein the scroll initiating input from the user comprises detecting that the control object is held in a predetermined pose for a threshold amount of time.

6. The method of claim 5 wherein detecting that the control object is held in the predetermined pose comprises detecting that the control object remains within a cubic area for the threshold amount of time.

7. The method of claim 5 wherein detecting that the control object is held in the predetermined pose for the threshold amount of time comprises:

measuring, using the one or more remote detection devices, a z-axis distance from the display surface to the control object, wherein the plane parallel to the display surface is at the z-axis distance from the display surface plus or minus an error tolerance distance in a z-axis direction; and

identifying the plane parallel to the display surface based on the z-axis distance from the display surface to the control object.

8. The method of claim 4 wherein a user selection of a scrolling mode from one of the plurality of scroll modes is made while the control object is in the plane parallel to the display surface.

9. The method of claim 4 further comprising:

setting a content scroll speed to a maximum scroll speed in response to the second scrolling movement of the control object; and

decelerating the content scroll speed at a predetermined rate.

10. The method of claim 9 further comprising detecting a poking motion normal to the plane parallel to the display surface of the display;

and

setting the content scroll speed to zero in response to the poking motion.

11. The method of claim 1 wherein detecting the speed of the control object comprises detecting a control object acceleration between a first frame and a second frame;

and

rejecting the speed of the control object associated with the first frame and the second frame as a jitter error if the control object acceleration is above a predetermined acceleration threshold.

12. The method of claim 1 wherein detecting the speed of the control object comprises detecting an average speed of the control object over at least a minimum allowable free scrolling distance.

13. The method of claim 1

wherein detecting the speed of the control object comprises receiving accelerometer data from a device held by the user.

14. The method of claim 1 wherein the scrolling process comprises a sideways motion of content in a display.

15. The method of claim 1 wherein the executing comprises causing content to scroll according to the one of the plurality of scroll modes at a display of a head mounted display, wherein content scrolls on a virtual display surface projected onto an eye of the user by the head mounted display.

16. A system comprising:

a first camera;

a first computing device communicatively coupled to the first camera; and

an output display communicatively coupled to the first computing device and communicatively coupled to the first camera;

wherein the first computing device comprises a gesture analysis module configured to;

engage, in response to a scroll initiating input from a user, a scrolling process;

detect, based on information from one or more remote detection devices, a speed of a control object associated with the user during the scrolling process; and

execute at a computerized device one of a plurality of scroll modes during the scrolling process based on the detected speed.

17. The system of claim 16 wherein the gesture analysis module is further configured to match, as part of a first scroll mode of the plurality of scroll modes, a first content movement in a display on a display surface to a first scrolling movement of the control object when the speed of the control object during the first scrolling movement of the control object is below a speed threshold.

18. The system of claim 17 wherein the first scroll mode comprises pausing matching the first content movement to the first scrolling movement of the control object when the control object moves away from a plane parallel to the display surface at a first area and resuming matching the first content movement to the first scrolling movement of the control object when the control object reenters the plane parallel to the display at a second area.

19. The system of claim 17 wherein the gesture analysis module engages a free scrolling mode as a second scroll mode of the plurality of scroll modes when the speed of the control object is above the speed threshold.

20. The system of claim 17 further comprising:

a second camera communicatively coupled to the first computing device and the output display;

wherein the gesture analysis module identifies an obstruction between the first camera and the control object and detects the first scrolling movement of the control object using a second image from the second camera.

21. The system of claim 17 wherein the gesture analysis module is further configured to engage a free scrolling mode when the speed of the control object is above the speed threshold as part of a second scrolling movement of the control object.

22. The system of claim 21 wherein the gesture analysis module is further configured to:

set a content scroll speed to a maximum scroll speed in response to the second scrolling movement of the control object; and

decelerate the content scroll speed at a predetermined rate.

23. The system of claim 22 wherein the gesture analysis module is further configured to detect a stop hand signal in a plane parallel to the display surface of the display;

and

set the content scroll speed to zero in response to the stop hand signal.

24. The system of claim 22 wherein the gesture analysis module is further configured to detect a pointing gesture in a plane parallel to the display surface of the display;

set the content scroll speed to zero in response to the pointing gesture; and

match a second content movement to a second scrolling movement of the control object following detection of the pointing gesture.

25. The system of claim 16 wherein the scroll initiating input from the user comprises the control object being held in a predetermined pose for a threshold amount of time.

26. The system of claim 25 wherein the gesture analysis module is further configured to detect that the control object is being held in the predetermined pose for the threshold amount of time by:

measuring, using the one or more remote detection devices, a z-axis distance from a display surface to the control object, wherein a plane parallel to the display surface is at the z-axis distance from the display surface plus or minus an error tolerance distance in a z-axis direction; and

identifying the plane parallel to the display surface based on the z-axis distance from the display surface to the control object.

27. The system of claim 16 wherein the gesture analysis module is configured to detect the speed of the control object by detecting a control object acceleration between a first frame and a second frame;

and

rejecting the speed of the control object associated with the first frame and the second frame as a jitter error if the control object acceleration is above a predetermined acceleration threshold.

28. The system of claim 16 wherein the scrolling process comprises a diagonal motion of content in a display.

29. A device comprising:

means for engaging, in response to a scroll initiating input from a user, a scrolling process;

means for detecting, based on information from one or more remote detection devices, a speed of a control object associated with the user during the scrolling process; and

means for executing at a computerized device one of a plurality of scroll modes during the scrolling process based on the detected speed.

30. The device of claim 29, wherein the executing comprises:

means for matching, as part of the scrolling process, a first content movement on a display to a first scrolling movement of the control object when the speed of the control object during the first scrolling movement of the control object is below a speed threshold; and

means for engaging a free scrolling mode when the speed of the control object is above the speed threshold as part of a second scrolling movement of the control object.

31. The device of claim 30 further comprising:

means for matching the first content movement to the first scrolling movement of the control object when the control object moves away from a plane parallel to a surface of the display at a first area and resuming matching the first content movement to the first scrolling movement of the control object when the control object reenters the plane parallel to the display at a second area;

means for measuring a z-axis distance from the display surface to the control object, wherein the plane parallel to the display surface is at the z-axis distance from the display surface plus or minus an error tolerance distance in a z-axis direction; and

means for identifying the plane parallel to the display surface based on the z-axis distance from the display surface to the control object.

32. A non-transitory computer readable medium comprising computer readable instructions that when executed by a processor, cause a device to:

engage, in response to a scroll initiating input from a user, a scrolling process;

detect, based on information from one or more remote detection devices, a speed of a control object associated with the user during the scrolling process; and

execute at a computerized device one of a plurality of scroll modes during the scrolling process based on the detected speed.