Movement based graphical user interface

• US 10,134,368 B2
• Filed: 06/04/2015
• Issued: 11/20/2018
• Est. Priority Date: 06/04/2015
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: O'Neill, Megan Marie
• Primary Examiner(s): Shen, Yuzhen
• Application Number:
  US14/731,362
• Publication Number:
  US 20160358588A1
• Time in Patent Office: 1,265 Days
• Field of Search: 345156, 482 8, 482 9, 482 12
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/30 Control of display attribute

Abstract

A system or a method may be provided that may detect a movement or activity of a user via the user'"'"'s mobile and/or wearable devices. The system may adjust the display interface based on the user'"'"'s detected movement or activity. When a user is very active (biking or jogging), the user may have very limited amount of time or attention to interact with a display interface. The movement or activity of the user may be detected by a motion detection device installed on the mobile device or on the wearable device. When the user is active, the display interface may adjust to enlarge the information to make it easier for the user to view, read, or interact with. The system may also select and display important information, without other peripheral information (less important information) when the user is active.

Claims

1. A device comprising:

a non-transitory memory;

a display configured to display information to a user;

a sensor configured to detect a movement of the device; and

one or more hardware processors configured to read instructions from the non-transitory memory to cause the device to perform operations comprising;

detecting a user interaction with the display;

receiving sensor data from the sensor that indicates the movement of the device has occurred or is occurring;

accessing a stored display preference for the user based at least on the received sensor data and the user interaction, wherein the stored display preference is associated with a previously detected action of the user having performed an action to a particular portion of first information on the display in response to a previous occurrence of a movement of the device, wherein the action comprises centering the particular portion on the display; and

automatically formatting second information on the display based on the stored display preference, wherein the automatically formatting comprises automatically centering particular portion of the second information on the display.

2. The device of claim 1, wherein the sensor comprises one or more of:

a location detection device, an accelerometer, a gyroscope, a compass, or a barometer.

3. The device of claim 1, wherein the automatically formatting further comprises automatically enlarging the particular portion of the second information.

4. The device of claim 1, wherein the operations further comprise:

determining an activity of the user based on the sensor data; and

changing a text size in the second information that is displayed on the device based on a level of the activity.

5. The device of claim 1, wherein the operations further comprise:

determining an activity of the user based on the sensor data; and

changing a content of the second information that is displayed on the device based on a level of the activity.

6. The device of claim 1, wherein the operations further comprise:

determining an activity of the user based on the sensor data; and

changing a contrast of a color of the second information that is displayed on the device based on a level of the activity.

7. The device of claim 1, wherein the operations further comprise:

determining an activity of the user based on the sensor data; and

simplifying a layout of the second information that is displayed on the device based on a level of the activity.

8. The device of claim 1, wherein the operations further comprise:

determining a type of an activity of the user based on the sensor data; and

limiting an operation option in the second information that is displayed on the device based on the type of the activity of the user.

9. A system comprising:

a non-transitory memory; and

one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause the system to perform operations comprising;

detecting, in response to a movement of a device of a user, that the user has performed an action on a particular portion of first content that is displayed on the device, wherein the action comprises centering the particular portion on a display of the device;

storing the action as a display preference of the user;

after the storing, receiving sensor data from one or more sensors that indicates the movement of the device has occurred or is occurring; and

in response to the receiving, automatically formatting second content that is displayed on the device by centering a particular portion of the second content on the display.

10. The system of claim 9, wherein the one or more sensors include one or more wearable or personal devices worn or carried by the user and connected to the device.

11. The system of claim 9, wherein the one or more sensors are wearable or personal devices worn or carried by the user and configured to detect one or more of a location, a travel speed, a travel direction, an acceleration, a body posture, or a motion of the user.

12. The system of claim 9, wherein the one or more sensors are configured to detect biometric information of the user including one or more of a heart rate, a body temperature, or a skin conductance.

13. The system of claim 12, wherein the automatically formatting further comprises automatically enlarging the particular portion of the second content.

14. The system of claim 9, wherein the operations further comprise:

determining a viewing capability score indicating an ability or an availability of the user to view or read from the display.

15. The system of claim 14, wherein the viewing capability score is decreased as the movement or an activity of the user becomes more active.

16. The system of claim 14, wherein the operations further comprise:

selecting from a plurality of formats of the second content based on the viewing capability score.

17. A method for implementing movement based display interface, the method comprising:

detecting, by one or more processors, an interaction from a user with a display of a user device;

receiving, by the one or more processors, sensor data from one or more sensors that indicate a movement of the user device has occurred or is occurring;

accessing a stored display preference for the user based at least on the received sensor data and the interaction from the user with the display, wherein the stored display preference is associated with a previously detected action of the user interacting with a particular portion of first content on the display in response to a previous occurrence of a movement of the user device; and

automatically formatting second content on the display based on the stored display preference at least in part by automatically centering a particular portion of second the content on the display.

18. The method of claim 17, further comprising:

determining a change in the movement of the user device; and

updating the automatically formatting of the content based on the change in the movement of the user device.

19. The method of claim 18, wherein:

the determining the change in the movement of the user device comprises determining that the user is moving faster or slower while still being engaged in a same activity; and

the automatically formatting of the second content further comprises;

automatically increasing a text size or reducing an amount of the second content being displayed in response to a determination that the user is moving faster while still being engaged in the same activity;

or

automatically decreasing the text size or increasing the amount of the second content being displayed in response to a determination that the user is moving slower while still being engaged in the same activity.

20. The method of claim 17, wherein:

the automatically formatting comprises automatically enlarging the particular portion of the second content.