Mobile device interfaces

• US 10,394,410 B2
• Filed: 05/09/2014
• Issued: 08/27/2019
• Est. Priority Date: 05/09/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Agnetta, Bryan Todd, Donsbach, Aaron Michael, Hendricks, Catherine Ann, Kralyevich, Brian Peter, Mains, Richard Leigh, Park, Jae Pum, Rooney, Sean Anthony, Salazar, Marc Anthony, Silvis, Jason Glenn, Yuniardi, Nino
• Primary Examiner(s): Ho, Ruay L
• Application Number:
  US14/274,648
• Publication Number:
  US 20140337791A1
• Time in Patent Office: 1,936 Days
• Field of Search: 715753, 715784, 707722, 348 1402
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality

Abstract

Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Claims

1. A mobile electronic device comprising:

one or more processors;

memory;

a touch-sensitive display;

a housing defining a shape of the mobile electronic device;

a first camera disposed in a first portion of the housing;

a second camera disposed in a second portion of the housing; and

a user-interface module, stored in the memory and executable on the one or more processors to;

present, on the touch-sensitive display, a screen comprising;

an upper portion that includes a first list including icons representing applications available to the mobile electronic device, the first list being scrollable horizontally by touch gestures on the touch-sensitive display to alter an icon of the icons that has focus in the first list; and

a lower portion that includes a first icon representing a first content item associated with an application corresponding to the icon that has focus in the first list;

determine a position of at least a portion of a user relative to the mobile electronic device based at least in part on data from the first camera and the second camera;

present, at least partly in response to the position of the user relative to the mobile electronic device, an altered version of at least one of;

the icon that has focus in the first list, or

the first icon in the lower portion.

2. The mobile electronic device as recited in claim 1, further comprising a gyroscope sensor, and wherein the user-interface module is further executable to:

(i) present a left-panel screen on the touch-sensitive display in response to a first input detected by the gyroscope sensor, and (ii) present a right-panel screen on the touch-sensitive display in response to a second input detected by the gyroscope sensor.

3. The mobile electronic device as recited in claim 2, wherein:

the left-panel screen includes icons associated with content-item libraries, each content-item library including content items accessible to the mobile electronic device; and

the right-panel screen includes a grid of icons corresponding to applications accessible to the mobile electronic device.

4. The mobile electronic device as recited in claim 1, wherein the user-interface module is further executable to:

receive a first touch gesture on the touch-sensitive display, the first touch gesture generally upwards from a bottom of the screen towards a top of the screen;

present, at least partly in response to the first touch gesture, additional information in the lower portion regarding the first content item represented by the first icon;

receive a second touch gesture on the touch-sensitive display, the second touch gesture generally downwards from the top of the screen towards the bottom of the screen; and

remove, at least partly in response to the second touch gesture, the additional information regarding the first content item represented by the first icon.

5. One or more computer-readable media storing computer-executable instructions that, when executed on one or more processors, cause the one or more processors to perform acts comprising:

presenting, on a display of an electronic device, a first graphical user interface comprising;

a first portion including a first icon representing a first application available to the electronic device, the first icon being selectable to open the first application; and

a second portion that includes a second icon representing one or more content items associated with the first application corresponding to the first icon in the first portion;

receiving data from one or more optical sensors of the electronic device;

determining a change in position of the electronic device relative to at least a portion of a user based at least in part on the data; and

presenting, at least partly in response to the determining the change in position of the electronic device relative to the portion of the user, a second graphical user interface different than the first graphical user interface.

6. The one or more computer-readable media of claim 5, wherein the one or more content items comprise one or more of emails, text messages, audio albums, songs, videos, weather forecasts, or calendar appointments.

7. The one or more computer-readable media of claim 5, wherein the first portion comprises a carousel comprising the first icon representing the first application and one or more other icons representing other applications.

8. The one or more computer-readable media of claim 5, wherein the second icon representing the one or more content items presents information of the one or more content items without opening the first application.

9. The one or more computer-readable media of claim 5, wherein the one or more optical sensors comprise a first camera disposed in a first portion of a housing of the electronic device and a second camera disposed in a second portion of the housing of the electronic device.

10. The one or more computer-readable media of claim 5, wherein the determining the change in position of the electronic device relative to at least the portion of the user comprises determining a rotational motion of the electronic device about an axis parallel to the display of the electronic device.

11. The one or more computer-readable media of claim 5, further comprising:

receiving data from one or more inertial sensors;

presenting a third graphical user interface on the display of the electronic device in response to the data from the one or more inertial sensors.

12. The one or more computer-readable media of claim 11, wherein the third graphical user interface comprises an icon associated with a content-item library, the content-item library including one or more content items accessible to the electronic device.

13. The one or more computer-readable media of claim 11, wherein the third graphical user interface comprises a grid of icons corresponding to applications accessible to the electronic device.

14. The one or more computer-readable media of claim 11, wherein the third graphical user interface comprises at least one of current or upcoming appointments, weather information, recent call information, recent email information, recent messaging information, order status information, or content availability information.

15. The one or more computer-readable media of claim 5, further comprising:

receiving user input; and

presenting, at least partly in response to the user input, additional information in the second portion regarding at least one of the one or more content items represented by the second icon without opening the application.

16. A method comprising:

under control of an electronic device configured with specific instructions executable by one or more processors of the electronic device,

presenting, on a display of the electronic device, application icons in a carousel, a first application icon usable to open a first application;

receiving user input to move the first application icon to a front of the carousel;

presenting first information of one or more content items associated with the first application;

receiving data from one or more optical sensors of the electronic device;

determining a change in position of the electronic device relative to at least a portion of a user based at least in part on the data; and

presenting second information on the display at least partly in response to determining the change in position.

17. The method of claim 16, further comprising:

receiving user selection of the first application icon at the front of the carousel; and

opening the first application associated with the first application icon at the front of the carousel responsive to receiving the user selection.

18. The method of claim 16, further comprising:

receiving user input to move a second application icon of the application icons to the front of the carousel; and

presenting third information of one or more content items associated with a second application corresponding to the second application icon moved to the front of the carousel.

19. The method of claim 16, wherein the presenting the first information of the one or more content items associated with the first application corresponding to the first application icon moved to the front of the carousel is performed without opening the first application.

20. The method of claim 16, wherein the one or more optical sensors comprise a first camera disposed in a first portion of a housing of the electronic device and a second camera disposed in a second portion of the housing of the electronic device.

21. The method of claim 16, wherein the determining the change in position of the electronic device relative to at least the portion of the user comprises determining a rotational motion of the electronic device about an axis parallel to the display of the electronic device.

22. The method of claim 16, further comprising:

receiving data from one or more inertial sensors;

presenting a user interface panel on the display of the electronic device in response to the data from the one or more inertial sensors.

23. The method of claim 22, wherein the user interface panel comprises icons associated with content-item libraries, each content-item library including content items accessible to the electronic device.

24. The method of claim 22, wherein the user interface panel comprises a grid of icons corresponding to applications accessible to the electronic device.

25. The method of claim 22, wherein the user interface panel comprises at least one of current or upcoming appointments, weather information, recent call information, recent email information, recent messaging information, order status information, or content availability information.