User interface for manipulating user interface objects

• US 10,545,657 B2
• Filed: 02/20/2016
• Issued: 01/28/2020
• Est. Priority Date: 09/03/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zambetti, Nicholas, Chaudhri, Imran, Dascola, Jonathan R., Dye, Alan C., Foss, Christopher Patrick, Guzman, Aurelio, Karunamuni, Chanaka G., Kerr, Duncan Robert, Lemay, Stephen O., Maric, Natalia, Wilson, Christopher, Wilson, Eric Lance, Yang, Lawrence Y., Butcher, Gary Ian, Davydov, Anton M., Edwards, Dylan Ross, Ive, Jonathan P., Kennedy, Zachery, King, Nicholas V., Preston, Daniel Trent
• Primary Examiner(s): Belousov, Andrey
• Application Number:
  US15/049,052
• Publication Number:
  US 20160170608A1
• Time in Patent Office: 1,438 Days
• Field of Search: 715841, 715716
• CPC Class Codes: G04G 21/08 Touch switches specially adapted for time-pieces
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

User interface navigation on a personal electronics device based on movements of a crown is disclosed. The device can select an appropriate level of information arranged along a z-axis for display based on crown movement. The navigation can be based on an angular velocity of the crown.

Claims

1. A non-transitory computer-readable storage medium comprising computer-executable instructions for execution by one or more processors of a wearable electronic device, the computer-executable instructions including instructions for:

displaying a first plurality of application icons on a touch-sensitive display of the wearable electronic device, wherein the first plurality of application icons are displayed at a first aspect ratio;

receiving a first input based on a movement of a physical crown of the wearable electronic device;

in response to the received first input, replacing the first plurality of application icons with a second plurality of applications icons on the touch-sensitive display;

wherein the second plurality of application icons is a subset of the first plurality of application icons and each application icon of the second plurality of application icons is displayed at the first aspect ratio;

while displaying the second plurality of application icons, receiving a second input, wherein the second input is a swipe gesture on the touch-sensitive display in a first direction; and

in response to receiving the second input;

moving a third plurality of applications icons on the touch-sensitive display in the first direction away from a center of the touch-sensitive display and decreasing a size of each of the third plurality of application icons while maintaining the first aspect ratio for each of the third plurality of application icons, wherein the third plurality of application icons are a subset of the second plurality of application icons; and

moving a fourth plurality of applications icons on the touch-sensitive display in the first direction toward the center of the touch-sensitive display and increasing a size of at least one of the fourth plurality of application icons while maintaining the first aspect ratio for each of the fourth plurality of application icons, wherein the fourth plurality of application icons are a subset of the second plurality of application icons.

2. The non-transitory computer-readable storage medium of claim 1, wherein the wearable electronic device is a watch.

3. The non-transitory computer-readable storage medium of claim 1, wherein the movement is a push, pull on the physical crown.

4. The non-transitory computer-readable storage medium of claim 1, wherein the movement is a rotation of the physical crown.

5. The non-transitory computer-readable storage medium of claim 4, wherein the rotation is in a first rotation direction.

6. The non-transitory computer-readable storage medium of claim 4, wherein the rotation exceeds a predetermined angular velocity threshold.

7. The non-transitory computer-readable storage medium of claim 1, wherein the physical crown comprises a capacitive touch sensor configured to sense a touch input, and wherein the received first input is further based on the touch input on the physical crown.

8. The non-transitory computer-readable storage medium of claim 1, wherein a first application icon of the first plurality of application icons is associated with an application, and a second application icon of the second plurality of application icons is associated with the same application, the non-transitory computer-readable storage medium further comprising computer-executable instructions for:

displaying the second application icon with information regarding the application, when the second plurality of application icons is displayed, and

displaying the first application icon with different information regarding the application, when the first plurality of application icons is display.

9. The non-transitory computer-readable storage medium of claim 1, wherein a first density of information is associated with the first plurality of application icons and a second density of information is associated with the second plurality of application icons.

10. The non-transitory computer-readable storage medium of claim 1, wherein the received first input is a first received input in a first direction, the computer-executable instructions further comprising instructions for:

receiving a third input based on a second movement of the physical crown; and

in response to the received third input, replacing the second plurality of application icons with the first plurality of application icons on the touch-sensitive display.

11. The non-transitory computer-readable storage medium of claim 10, wherein the second movement is a rotation of the physical crown in a second direction opposite the first direction.

12. The non-transitory computer-readable storage medium of claim 10, wherein the second movement is a push or pull of the physical crown.

13. The non-transitory computer-readable storage medium of claim 1, wherein the received first input is a first received input in a first direction, the non-transitory computer-readable storage medium further comprising computer-executable instructions for:

receiving a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, replacing the display of the second plurality of application icons with a third plurality of application icons,

wherein the third plurality of application icons is a subset of the second plurality of application icons.

14. The non-transitory computer-readable storage medium of claim 1, wherein the received first input is a first received input in a first direction, the non-transitory computer-readable storage medium further comprising computer-executable instructions for:

receiving a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, launching an application associated with an application icon of the second plurality of application icons.

15. The non-transitory computer-readable storage medium of claim 1, further comprising computer-executable instructions for:

receiving information representing an activity in an application, wherein the application corresponds to a displayed application icon; and

in response to the received information, altering an appearance of the displayed application icon.

16. The non-transitory computer-readable storage medium of claim 15, wherein the altering is one or more of blinking, changing color, and animating.

17. The non-transitory computer-readable storage medium of claim 1, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is not displayed as part of the second plurality of application icons.

18. The non-transitory computer-readable storage medium of claim 1, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is displayed as a left-most application icon in a second top-most row in the second plurality of application icons.

19. The non-transitory computer-readable storage medium of claim 18, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

translating an application icon of the first plurality of application icons, from a first position of the touch-sensitive display, to a second position of the touch-sensitive display,

wherein the application icon is displayed, in whole, on the touch-sensitive display during the translating.

20. The non-transitory computer-readable storage medium of claim 18, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

displaying, at a first position of the touch-sensitive display, only a portion of an application icon of the first plurality of application icons; and

displaying the remaining portion of the application icon in a second position of the touch-sensitive display, wherein the first position and the second position are separate.

21. The non-transitory computer-readable storage medium of claim 1, wherein the physical crown is a mechanical crown.

22. The non-transitory computer-readable storage medium of claim 1, further comprising computer-executable instructions for:

detecting a force applied to the touch-sensitive display; and

replacing the first plurality of application icons based on the detected force.

23. A wearable electronic device comprising:

one or more processors;

a physical crown operatively coupled to the one or more processors; and

a touch-sensitive display operatively coupled to the one or more processors, the

one or more processors configured to;

display a first plurality of application icons on a touch-sensitive display of the wearable electronic device, wherein the first plurality of application icons are displayed at a first aspect ratio;

receive a first input based on a movement of a physical crown of the wearable electronic device;

in response to the received first input, replace the first plurality of application icons with a second plurality of applications icons on the touch-sensitive display;

wherein the second plurality of application icons is a subset of the first plurality of application icons and each application icon of the second plurality of application icons is displayed at the first aspect ratio;

while displaying the second plurality of application icons, receive a second input, wherein the second input is a swipe gesture on the touch-sensitive display in a first direction; and

in response to receiving the second input;

move a third plurality of applications icons on the touch-sensitive display in the first direction away from a center of the touch-sensitive display and decreasing a size of each of the third plurality of application icons while maintaining the first aspect ratio for each of the third plurality of application icons, wherein the third plurality of application icons are a subset of the second plurality of application icons; and

move a fourth plurality of applications icons on the touch-sensitive display in the first direction toward the center of the touch-sensitive display and increasing a size of at least one of the fourth plurality of application icons while maintaining the first aspect ratio for each of the fourth plurality of application icons, wherein the fourth plurality of application icons are a subset of the second plurality of application icons.

25. The electronic device of claim 23, wherein the wearable electronic device is a watch.

26. The electronic device of claim 23, wherein the movement is a push, pull on the physical crown.

27. The electronic device of claim 23, wherein the movement is a rotation of the physical crown.

28. The electronic device of claim 27, wherein the rotation is in a first rotation direction.

29. The electronic device of claim 27, wherein the rotation exceeds a predetermined angular velocity threshold.

30. The electronic device of claim 23, wherein the physical crown comprises a capacitive touch sensor configured to sense a touch input, and wherein the received first input is further based on the touch input on the physical crown.

31. The electronic device of claim 23, wherein a first application icon of the first plurality of application icons is associated with an application, and a second application icon of the second plurality of application icons is associated with the same application, the one or more processors further configured to:

display the second application icon with information regarding the application, when the second plurality of application icons is displayed, and

display the first application icon with different information regarding the application, when the first plurality of application icons is display.

32. The electronic device of claim 23, wherein a first density of information is associated with the first plurality of application icons and a second density of information is associated with the second plurality of application icons.

33. The electronic device of claim 23, wherein the received first input is a first received input in a first direction, the one or more processors further configured to:

receive a third input based on a second movement of the physical crown; and

in response to the received third input, replace the second plurality of application icons with the first plurality of application icons on the touch-sensitive display.

34. The electronic device of claim 33, wherein the second movement is a rotation of the physical crown in a second direction opposite the first direction.

35. The electronic device of claim 33, wherein the second movement is a push or pull of the physical crown.

36. The electronic device of claim 23, wherein the received first input is a first received input in a first direction, the one or more processors further configured to:

receive a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, replace the display of the second plurality of application icons with a third plurality of application icons,

wherein the third plurality of application icons is a subset of the second plurality of application icons.

37. The electronic device of claim 23, wherein the received first input is a first received input in a first direction, the one or more processors further configured to:

receive a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, launch an application associated with an application icon of the second plurality of application icons.

38. The electronic device of claim 23, the one or more processors further configured to:

receive information representing an activity in an application, wherein the application corresponds to a displayed application icon; and

in response to the received information, alter an appearance of the displayed application icon.

39. The electronic device of claim 38, wherein the altering is one or more of blinking, changing color, and animating.

40. The electronic device of claim 23, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is not displayed as part of the second plurality of application icons.

41. The electronic device of claim 23, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is displayed as a left-most application icon in a second top-most row in the second plurality of application icons.

42. The electronic device of claim 41, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

translating an application icon of the first plurality of application icons, from a first position of the touch-sensitive display, to a second position of the touch-sensitive display,

wherein the application icon is displayed, in whole, on the touch-sensitive display during the translating.

43. The electronic device of claim 41, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

displaying, at a first position of the touch-sensitive display, only a portion of an application icon of the first plurality of application icons; and

displaying the remaining portion of the application icon in a second position of the touch-sensitive display, wherein the first position and the second position are separate.

44. The electronic device of claim 23, wherein the physical crown is a mechanical crown.

45. The electronic device of claim 23, the one or more processors further configured to:

detect a force applied to the touch-sensitive display; and

replace the first plurality of application icons based on the detected force.

24. A method, comprising:

at a wearable electronic device;

displaying a first plurality of application icons on a touch-sensitive display of the wearable electronic device, wherein the first plurality of application icons are displayed at a first aspect ratio;

receiving a first input based on a movement of a physical crown of the wearable electronic device;

in response to the received first input, replacing the first plurality of application icons with a second plurality of applications icons on the touch-sensitive display;

wherein the second plurality of application icons is a subset of the first plurality of application icons and each application icon of the second plurality of application icons is displayed at the first aspect ratio;

while displaying the second plurality of application icons, receiving a second input, wherein the second input is a swine gesture on the touch-sensitive display in a first direction; and

in response to receiving the second input;

moving a third plurality of applications icons on the touch-sensitive display in the first direction away from a center of the touch-sensitive display and decreasing a size of each of the third plurality of application icons while maintaining the first aspect ratio for each of the third plurality of application icons, wherein the third plurality of application icons are a subset of the second plurality of application icons; and

moving a fourth plurality of applications icons on the touch-sensitive display in the first direction toward the center of the touch-sensitive display and increasing a size of at least one of the fourth plurality of application icons while maintaining the first aspect ratio for each of the fourth plurality of application icons, wherein the fourth plurality of application icons are a subset of the second plurality of application icons.

46. The method of claim 24, wherein the wearable electronic device is a watch.

47. The method of claim 24, wherein the movement is a push, pull on the physical crown.

48. The method of claim 24, wherein the movement is a rotation of the physical crown.

49. The method of claim 48, wherein the rotation is in a first rotation direction.

50. The method of claim 48, wherein the rotation exceeds a predetermined angular velocity threshold.

51. The method of claim 24, wherein the physical crown comprises a capacitive touch sensor configured to sense a touch input, and wherein the received first input is further based on the touch input on the physical crown.

52. The method of claim 24, wherein a first application icon of the first plurality of application icons is associated with an application, and a second application icon of the second plurality of application icons is associated with the same application, the method further comprising:

displaying the second application icon with information regarding the application, when the second plurality of application icons is displayed, and

displaying the first application icon with different information regarding the application, when the first plurality of application icons is display.

53. The method of claim 24, wherein a first density of information is associated with the first plurality of application icons and a second density of information is associated with the second plurality of application icons.

54. The method of claim 24, wherein the received first input is a first received input in a first direction, the method further comprising:

receiving a third input based on a second movement of the physical crown; and

in response to the received third input, replacing the second plurality of application icons with the first plurality of application icons on the touch-sensitive display.

55. The method of claim 54, wherein the second movement is a rotation of the physical crown in a second direction opposite the first direction.

56. The method of claim 54, wherein the second movement is a push or pull of the physical crown.

57. The method of claim 24, wherein the received first input is a first received input in a first direction, the method further comprising:

receiving a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, replacing the display of the second plurality of application icons with a third plurality of application icons,

wherein the third plurality of application icons is a subset of the second plurality of application icons.

58. The method of claim 24, wherein the received first input is a first received input in a first direction, the method further comprising:

receiving a third input based on a second movement of the physical crown, wherein the second movement is a rotation in the first direction; and

in response to the received third input, launching an application associated with an application icon of the second plurality of application icons.

59. The method of claim 24, further comprising:

receiving information representing an activity in an application, wherein the application corresponds to a displayed application icon; and

in response to the received information, altering an appearance of the displayed application icon.

60. The method of claim 59, wherein the altering is one or more of blinking, changing color, and animating.

61. The method of claim 24, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is not displayed as part of the second plurality of application icons.

62. The method of claim 24, wherein the first plurality of icons includes a top-right application icon and the top-right icon of the first plurality of application icons is displayed as a left-most application icon in a second top-most row in the second plurality of application icons.

63. The method of claim 62, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

translating an application icon of the first plurality of application icons, from a first position of the touch-sensitive display, to a second position of the touch-sensitive display,

wherein the application icon is displayed, in whole, on the touch-sensitive display during the translating.

64. The method of claim 62, wherein the replacing of the display of the first plurality of application icons to the second plurality of application icons comprises:

displaying, at a first position of the touch-sensitive display, only a portion of an application icon of the first plurality of application icons; and

displaying the remaining portion of the application icon in a second position of the touch-sensitive display, wherein the first position and the second position are separate.

65. The method of claim 24, wherein the physical crown is a mechanical crown.

66. The method of claim 24, further comprising:

detecting a force applied to the touch-sensitive display; and

replacing the first plurality of application icons based on the detected force.