SYSTEMS AND METHODS TO ENABLE AND DISABLE SCROLLING USING CAMERA INPUT

• US 20190019028A1
• Filed: 07/12/2017
• Published: 01/17/2019
• Est. Priority Date: 07/12/2017
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Mese, John Carl, VanBlon, Russell Speight, Peterson, Nathan J.
• Granted Patent: US 10,515,270 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

In one aspect, a device includes at least one processor, a camera, at least one sensor, a display, and storage. The storage bears instructions executable by the at least one processor to receive input from the at least one sensor and determine, based on the input, whether a user is making physical contact with the device. Based on a determination that the user is not making physical contact with the device, the instructions are executable by the at least one processor to execute scrolling of content based on input from the camera, with the content presented on the display. Based on a determination that the user is making physical contact with the device, the instructions are executable by the at least one processor to decline to execute scrolling of content based on input from the camera.

Claims

1. A device, comprising:

at least one processor;

a camera accessible to the at least one processor;

at least one sensor accessible to the at least one processor;

a display accessible to the at least one processor; and

storage accessible to the at least one processor and bearing instructions executable by the at least one processor to;

receive input from the at least one sensor;

determine, based on the input, whether a user is making physical contact with the device;

based on a determination that the user is not making physical contact with the device, execute scrolling of content based on input from the camera, the content presented on the display; and

based on a determination that the user is making physical contact with the device, decline to execute scrolling of content based on input from the camera.

2. The device of claim 1, wherein the at least one sensor comprises a touch sensor, and wherein physical contact is sensed using the touch sensor.

3. The device of claim 1, wherein the at least one sensor comprises a proximity sensor, and wherein physical contact is sensed using the proximity sensor.

4. The device of claim 1, wherein the at least one sensor comprises an accelerometer, and wherein physical contact is sensed based on input from the accelerometer indicating movement of the device.

5. The device of claim 1, wherein the at least one sensor comprises the camera, and wherein physical contact is sensed based on input from the camera.

6. The device of claim 1, wherein the at least one sensor comprises the display, and wherein physical contact is sensed based on input from the display.

7. The device of claim 1, wherein the instructions are executable by the at least one processor to:

based on a determination that the user is not making physical contact with the device and based on a determination that the display is activated, execute scrolling of content based on input from the camera.

8. The device of claim 1, wherein the instructions are executable by the at least one processor to:

based on a determination that the user is making physical contact with the device for at least a threshold amount of time, decline to execute scrolling of content based on input from the camera.

9. The device of claim 1, wherein the instructions are executable by the last least one processor to:

identify at least one context;

determine that, while the context occurs and while the user is making physical contact with the device, the user enables scrolling of content based on input from the camera; and

responsive to the user enabling scrolling of content based on input from the camera a threshold number of times while the context occurs and while the user is making physical contact with the device, subsequently enabling scrolling of content based on input from the camera during the context without additional user input to enable scrolling of content based on input from the camera.

10. The device of claim 9, wherein the context is one-handed operation of the device.

11. The device of claim 9, wherein the context pertains to a current location of the device.

12. The device of claim 9, wherein the context pertains to a current time of day.

13. The device of claim 9, wherein the context pertains to an application that is currently presenting data on the display.

14. The device of claim 9, wherein the context pertains to an activity currently engaged in by the user.

15. The device of claim 1, wherein the instructions are executable by the last least one processor to:

identify at least one context;

determine that, while the context occurs, the user disables scrolling of content based on input from the camera; and

responsive to the user disabling scrolling of content based on input from the camera a threshold number of times while the context occurs, subsequently disabling scrolling of content based on input from the camera during the context without additional user input to disable scrolling of content based on input from the camera.

16. A method, comprising:

determining whether a user is touching a device with at least a portion of the user'"'"'s body;

enabling, responsive to determining that the user is not touching the device with at least a portion of the user'"'"'s body, scrolling of content using input from a camera on the device; and

disabling, responsive to determining that the user is touching the device with at least a portion of the user'"'"'s body, scrolling of content using input from a camera on the device.

17. The method of claim 16, comprising:

disabling, responsive to determining that the user is touching the device with at least a portion of the user'"'"'s body, scrolling of content using input from a camera on the device but still enabling scrolling of content using input from a touch-enabled display on the device.

18. The method of claim 16, wherein the determining whether the user is touching the device with at least a portion of the user'"'"'s body is based on input from one or more of:

a touch-enabled display on the device, a camera on the device, a proximity sensor on the device, a heat sensor on the device, a sonar sensor on the device, a touch sensor on the device, a motion sensor on the device.

19. The method of claim 16, comprising:

identifying that the user has provided input enabling scrolling of content using input from the camera;

identifying a context that is occurring while the user provides the input enabling scrolling of content using input from the camera; and

during a future occurrence of the context, and based on the user providing the input enabling scrolling of content using input from the camera a threshold number of times while the context previously occurred, automatically enabling scrolling of content using input from the camera without additional user input to do so, the threshold number of times being greater than one.

20. A computer readable storage medium that is not a transitory signal, the computer readable storage medium comprising instructions executable by at least one processor on a device to:

receive input from at least one sensor on the device;

determine, based on the input, whether a user is touching the device;

based on a determination that the user is not touching the device, execute scrolling of content using input from a camera; and

based on a determination that the user is touching the device, disable scrolling of content using input from the camera.