METHODS FOR SYSTEM ENGAGEMENT VIA 3D OBJECT DETECTION

• US 20140223385A1
• Filed: 09/23/2013
• Published: 08/07/2014
• Est. Priority Date: 02/05/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Nelson, Hui-ya Liao, Li, Ren, Ton, Phuong Lam, Van Dyken, Shaun William
• Granted Patent: US 9,720,504 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Methods and apparatuses are presented for controlling an application on a device. In some embodiments, a method may include detecting that a user is maintaining an object or gesture at a position hovering near the device for a threshold length of time. The method may also include anchoring an initial position of the object or gesture to the device based on the detection of the maintained position, and controlling the application using the anchored initial position. In some embodiments, controlling the application using the anchored initial position may include manipulating the application based on detecting within a stable zone associated with the anchored initial position a change in height of the gesture or object relative to the device, and not manipulating the application whenever the object or gesture is detected to move along a plane above and parallel to the device and within the stable zone.

Claims

1. A method for controlling an application on a device, the method comprising:

detecting that a user is maintaining an object or gesture at a position hovering near the device for a threshold length of time;

anchoring an initial position of the object or gesture to the device based on the detection of the maintained position; and

controlling the application using the anchored initial position.

2. The method of claim 1, wherein controlling the application using the anchored initial position comprises:

manipulating the application based on detecting within a stable zone associated with the anchored initial position a change in height of the gesture or object relative to the device; and

not manipulating the application whenever the object or gesture is detected to move along a plane above and parallel to the device and within the stable zone.

3. The method of claim 2, wherein controlling the application using the anchored initial position further comprises manipulating the application whenever the object or gesture is detected to hover over a region outside of the stable zone,

wherein manipulating the application comprises:

performing a first panning action having a first speed if the object or gesture is detected to hover over a first region outside of the stable zone; and

performing a second panning action having a second speed if the object or gesture is detected to hover over a second region outside of the stable zone, wherein the second region is farther away from the stable zone than the first region.

4. The method of claim 1, wherein controlling the application using the anchored initial position comprises detecting at least one movement of the object or gesture in 3-dimensional space hovering above the device.

5. The method of claim 3, wherein manipulating the application is based on the position of the object or gesture hovering over the device relative to the initial position.

6. The method of claim 3, wherein manipulating the application further comprises:

performing a third action if the object or gesture is detected to hover over a third region outside of the stable zone, wherein the third region is farther away from the stable zone than the second region.

7. The method of claim 1, further comprising detecting that the user is hovering the gesture or object at a position above the device.

8. The method of claim 1, further comprising detecting that the user is hovering the gesture or object at a position below the device.

9. The method of claim 1, wherein controlling the application comprises using a user interface anchored to the application based on the anchored initial position.

10. The method of claim 9, wherein the user interface anchored to the application is centered onto the application according to the initial position of the detected gesture or object hovering near the device.

11. An apparatus comprising:

at least one sensor configured to detect that a user is maintaining an object or gesture at a position hovering near said apparatus for a threshold length of time; and

a processor configured to;

anchor an initial position of the object or gesture to said apparatus based on the detection of the maintained position; and

control an application configured to operate on said apparatus using the anchored initial position.

12. The apparatus of claim 11, wherein the processor is further configured to:

manipulate the application based on detecting within a stable zone associated with the anchored initial position a change in height of the gesture or object relative to said apparatus; and

not manipulate the application whenever the object or gesture is detected to move along a plane above and parallel to said apparatus and within the stable zone.

13. The apparatus of claim 12, wherein the processor is further configured to:

manipulate the application whenever the object or gesture is detected to hover over a region outside of the stable zone;

perform, in the application, a first panning action having a first speed if the object or gesture is detected to hover over a first region outside of the stable zone; and

perform, in the application, a second panning action having a second speed if the object or gesture is detected to hover over a second region outside of the stable zone, wherein the second region is farther away from the stable zone than the first region.

14. The apparatus of claim 11, wherein controlling the processor is further configured to detect at least one movement of the object or gesture in 3-dimensional space hovering above said apparatus.

15. The apparatus of claim 13, wherein manipulating the application is based on the position of the object or gesture hovering over the device relative to the initial position.

16. The apparatus of claim 13, wherein the processor is further configured to:

perform, in the application, a third action if the object or gesture is detected to hover over a third region outside of the stable zone, wherein the third region is farther away from the stable zone than the second region.

17. The apparatus of claim 11, wherein the at least one sensor is further configured to detect that the user is hovering the gesture or object at a position above said apparatus.

18. The apparatus of claim 11, wherein the at least one sensor is further configured to detect that the user is hovering the gesture or object at a position below said apparatus.

19. The apparatus of claim 11, wherein the processor is further configured to control a user interface anchored to the application based on the anchored initial position.

20. The apparatus of claim 19, wherein the user interface anchored to the application is centered onto the application according to the initial position of the detected gesture or object hovering near said apparatus.

21. An apparatus comprising:

means for detecting that a user is maintaining an object or gesture at a position hovering near said apparatus for a threshold length of time;

means for anchoring an initial position of the object or gesture to said apparatus based on the detection of the maintained position; and

means for controlling an application operating on said apparatus using the anchored initial position.

22. The apparatus of claim 21, wherein the means for controlling the application using the anchored initial position comprises:

means for manipulating the application based on detecting within a stable zone associated with the anchored initial position a change in height of the gesture or object relative to said apparatus; and

means for not manipulating the application whenever the object or gesture is detected to move along a plane above and parallel to said apparatus and within the stable zone.

23. The apparatus of claim 22, wherein the means for controlling the application using the anchored initial position further comprises means for manipulating the application whenever the object or gesture is detected to hover over a region outside of the stable zone,

wherein the means for manipulating the application comprises:

means for performing a first panning action having a first speed if the object or gesture is detected to hover over a first region outside of the stable zone; and

means for performing a second panning action having a second speed if the object or gesture is detected to hover over a second region outside of the stable zone, wherein the second region is farther away from the stable zone than the first region.

24. The apparatus of claim 21, wherein the means for controlling the application using the anchored initial position comprises means for detecting at least one movement of the object or gesture in 3-dimensional space hovering above said apparatus.

25. The apparatus of claim 23, wherein the means for manipulating the application is based on the position of the object or gesture hovering over the device relative to the initial position.

26. The apparatus of claim 23, wherein the means for manipulating the application further comprises:

means for performing a third action if the object or gesture is detected to hover over a third region outside of the stable zone, wherein the third region is farther away from the stable zone than the second region.

27. The apparatus of claim 21, further comprising means for detecting that the user is hovering the gesture or object at a position above said apparatus.

28. The apparatus of claim 21, further comprising means for detecting that the user is hovering the gesture or object at a position below said apparatus.

29. The apparatus of claim 21, wherein the means for controlling the application comprises means for using a user interface anchored to the application based on the anchored initial position.

30. The apparatus of claim 29, wherein the user interface anchored to the application is centered onto the application according to the initial position of the detected gesture or object hovering near said apparatus.

31. A non-transitory processor-readable medium comprising processor-readable instructions configured to cause a processor to:

detect that a user is maintaining an object or gesture at a position hovering near a device for a threshold length of time;

anchor an initial position of the object or gesture to the device based on the detection of the maintained position; and

control an application configured to operate on the device using the anchored initial position.

32. The non-transitory processor-readable medium of claim 31, wherein the instructions are further configured to cause the processor to:

manipulate the application based on detecting within a stable zone associated with the anchored initial position a change in height of the gesture or object relative to the device; and

not manipulate the application whenever the object or gesture is detected to move along a plane above and parallel to the device and within the stable zone.

33. The non-transitory processor-readable medium of claim 32, wherein the instructions are further configured to cause the processor to:

manipulate the application whenever the object or gesture is detected to hover over a region outside of the stable zone;

perform, in the application, a first panning action having a first speed if the object or gesture is detected to hover over a first region outside of the stable zone; and

perform, in the application, a second panning action having a second speed if the object or gesture is detected to hover over a second region outside of the stable zone, wherein the second region is farther away from the stable zone than the first region.