User interface object manipulations in a user interface

• US 10,275,117 B2
• Filed: 09/03/2014
• Issued: 04/30/2019
• Est. Priority Date: 12/29/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zambetti, Nicholas, Chaudhri, Imran, Dascola, Jonathan R., Dye, Alan C., Foss, Christopher Patrick, Guzman, Aurelio, Karunamuni, Chanaka G., Kerr, Duncan Robert, Lemay, Stephen O., Maric, Natalia, Wilson, Christopher, Wilson, Eric Lance, Yang, Lawrence Y., Butcher, Gary Ian, Ive, Jonathan P.
• Primary Examiner(s): Vu, Kieu D
• Assistant Examiner(s): Calderon, IV, Alvaro R
• Application Number:
  US14/913,350
• Publication Number:
  US 20160231883A1
• Time in Patent Office: 1,700 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

Systems and processes for manipulating a graphical user interface are disclosed. One process can include receiving user input through a crown to rotate a virtual object. The process includes selecting a surface of the object from among the multiple surfaces of the object in response to determining that the crown rotation exceeded a speed threshold.

Claims

1. A computer-implemented method comprising:

displaying a first surface of a plurality of selectable surfaces of a virtual object on a touch-sensitive display of a wearable electronic device, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining a speed, wherein the speed is based on an angular velocity of the physical crown during the detected rotation of the wearable electronic device;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction; and

after rotating the virtual object about the axis parallel to the display in the first direction;

in response to the speed being determined to exceed a speed threshold, displaying, on the display, an animation of continuing to rotate the virtual object rotating about an axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the speed is below the speed threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

2. The computer-implemented method of claim 1, further comprising:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

3. The computer-implemented method of claim 2, further comprising:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

4. The computer-implemented method of claim 2, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprise instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.

5. The computer-implemented method of claim 1, wherein the virtual object is a cube.

6. The computer-implemented method of claim 1, wherein the virtual object is a multi-sided rotatable dial.

7. The computer-implemented method of claim 1, further comprising:

associating the second surface with a second data, wherein the first data and the second data are different.

8. The computer-implemented method of claim 1, wherein the speed is determined based on the rate of rotation of the virtual object.

9. The computer-implemented method of claim 1, further comprising:

determining a selection of the first surface in response to the display of the first surface-parallel to the display.

10. The computer-implemented method of claim 9, further comprising:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

11. A computer-implemented method comprising:

displaying, on a touch-sensitive display of a wearable electronic device, a first surface of a plurality of selectable surfaces of a virtual object, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining an angular velocity of the physical crown during the detected rotation;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction;

and after rotating the virtual object about the axis parallel to the display in the first direction;

in response to a determination that the angular velocity exceeds an angular velocity threshold, displaying, on the display, an animation of continuing to rotate the virtual object about the axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the angular velocity is below the angular velocity threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

12. The computer-implemented method of claim 11, further comprising:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

13. The computer-implemented method of claim 12, further comprising:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

14. The computer-implemented method of claim 12, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprise instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.

15. The computer-implemented method of claim 11, wherein the virtual object is a cube.

16. The computer-implemented method of claim 11, wherein the virtual object is a multi-sided rotatable dial.

17. The computer-implemented method of claim 11, further comprising:

associating the second surface with a second data, wherein the first data and the second data are different.

18. The computer-implemented method of claim 11, wherein the angular velocity is determined based on the rate of rotation of the virtual object.

19. The computer-implemented method of claim 11, further comprising:

determining a selection of the first surface in response to the display of the first surface-parallel to the display.

20. The computer-implemented method of claim 19, further comprising:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

21. A non-transitory computer-readable storage medium comprising instructions for:

displaying a first surface of a plurality of selectable surfaces of a virtual object on a touch-sensitive display of a wearable electronic device, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining a speed, wherein the speed is based on an angular velocity of the physical crown during the detected rotation;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction;

and after rotating the virtual object about the axis parallel to the display in the first direction;

in response to the speed being determined to exceed a speed threshold, displaying, on the display, an animation of continuing to rotate the virtual object rotating about an axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the speed is below the speed threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

22. The non-transitory computer-readable storage medium of claim 21, further comprising instructions for:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

23. The non-transitory computer-readable storage medium of claim 22, further comprising instructions for:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

24. The non-transitory computer-readable storage medium of claim 22, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprises instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.

25. The non-transitory computer-readable storage medium of claim 21, further comprising instructions for:

determining a selection of the first surface in response to the display of the first surface parallel to the display.

26. The non-transitory computer-readable storage medium of claim 25, further comprising instructions for:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

27. The non-transitory computer-readable storage medium of claim 21, wherein the virtual object is a cube.

28. The non-transitory computer-readable storage medium of claim 21, wherein the virtual object is a multi-sided rotatable dial.

29. The non-transitory computer-readable storage medium of claim 21, further comprising instructions for:

associating the second surface with a second data, wherein the first data and the second data are different.

30. The non-transitory computer-readable storage medium of claim 21, wherein the speed is determined based on the rate of rotation of the virtual object.

31. A non-transitory computer-readable storage medium comprising instructions for:

displaying, on a touch-sensitive display of a wearable electronic device, a first surface of a plurality of selectable surfaces of a virtual object, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining an angular velocity of the physical crown during the detected rotation;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction; and

after rotating the virtual object about the axis parallel to the display in the first direction;

in response to a determination that the angular velocity exceeds an angular velocity threshold, displaying, on the display, an animation of continuing to rotate the virtual object about the axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the angular velocity is below the angular velocity threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

32. The non-transitory computer-readable storage medium of claim 31, wherein the physical crown is a mechanical crown.

33. The non-transitory computer-readable storage medium of claim 31, further comprising instructions for:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

34. The non-transitory computer-readable storage medium of claim 33, further comprising instructions for:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

35. The non-transitory computer-readable storage medium of claim 33, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprise instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.

36. The non-transitory computer-readable storage medium of claim 31, wherein the virtual object is a cube.

37. The non-transitory computer-readable storage medium of claim 31, wherein the virtual object is a multi-sided rotatable dial.

38. The non-transitory computer-readable storage medium of claim 31, further comprising instructions for:

associating the second surface with a second data, wherein the first data and the second data are different.

39. The non-transitory computer-readable storage medium of claim 31, wherein the angular velocity is determined based on the rate of rotation of the virtual object.

40. The non-transitory computer-readable storage medium of claim 31, further comprising instructions for:

determining a selection of the first surface in response to the display of the first surface-parallel to the display.

41. The non-transitory computer-readable storage medium of claim 40, further comprising instructions for:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

42. An electronic device comprising:

one or more processors;

a physical crown operatively coupled to the one or more processors; and

a touch-sensitive display operatively coupled to the one or more processors, the one or more processors configured for;

displaying a first surface of a plurality of selectable surfaces of a virtual object on a touch-sensitive display of a wearable electronic device, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining a speed, wherein the speed is based on an angular velocity of the physical crown during the detected rotation;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction; and

after rotating the virtual object about the axis parallel to the display in the first direction;

in response to the speed being determined to exceed a speed threshold, displaying, on the display, an animation of continuing to rotate the virtual object rotating about an axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the speed is below the speed threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

46. The electronic device of claim 42, wherein the virtual object is a cube.

47. The electronic device of claim 42, wherein the virtual object is a multi-sided rotatable dial.

48. The electronic device of claim 42, further comprising:

associating the second surface with a second data, wherein the first data and the second data are different.

49. The electronic device of claim 42, wherein the speed is determined based on the rate of rotation of the virtual object.

50. The electronic device of claim 42, further comprising:

determining a selection of the first surface in response to the display of the first surface-parallel to the display.

51. The electronic device of claim 50, further comprising:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

43. The electronic device of 42, further comprising:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

44. The electronic device of claim 43, further comprising:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

45. The electronic device of claim 43, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprise instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.

52. An electronic device comprising:

one or more processors;

a physical crown operatively coupled to the one or more processors; and

a touch-sensitive display operatively coupled to the one or more processors, the one or more processors configured for;

displaying, on a touch-sensitive display of a wearable electronic device, a first surface of a plurality of selectable surfaces of a virtual object, the first surface associated with a first data;

detecting rotation of a physical crown of the wearable electronic device;

determining an angular velocity of the physical crown during the detected rotation;

in response to detecting rotation of the physical crown, displaying, on the display, an animation of rotating the virtual object about an axis parallel to the display in a first direction; and

after rotating the virtual object about the axis parallel to the display in the first direction;

in response to a determination that the angular velocity exceeds an angular velocity threshold, displaying, on the display, an animation of continuing to rotate the virtual object about the axis parallel to the display in the first direction to display a second surface of the plurality of selectable surfaces of the virtual object on the display, the second surface displayed parallel to the display while in a steady state; and

in response to a determination that the angular velocity is below the angular velocity threshold, displaying, on the display, an animation of rotating the virtual object about the axis parallel to the display in a second direction that is opposite to the first direction to display the first surface of the plurality of selectable surfaces of the virtual object on the display, the first surface displayed parallel to the display while in the steady state.

56. The electronic device of claim 52, wherein the virtual object is a cube.

57. The electronic device of claim 52, wherein the virtual object is a multi-sided rotatable dial.

58. The electronic device of claim 52, further comprising:

associating the second surface with a second data, wherein the first data and the second data are different.

59. The electronic device of claim 52, wherein the angular velocity is determined based on the rate of rotation of the virtual object.

60. The electronic device of claim 52, further comprising:

determining a selection of the first surface in response to the display of the first surface-parallel to the display.

61. The electronic device of claim 60, further comprising:

in response to a determining a selection of the first surface, generating a haptic output at the wearable electronic device.

53. The electronic device of 52, further comprising:

determining a selection of the second surface in response to the display of the second surface parallel to the display in the steady state.

54. The electronic device of claim 53, further comprising:

in response to determining the selection of the second surface, generating a haptic output at the wearable electronic device.

55. The electronic device of claim 53, wherein determining a selection of the second surface in response to the display of the second surface parallel to the display the steady state further comprise instructions for detecting one or more of:

a tap gesture on the second surface, a first touch with a force greater than a predetermined threshold, on the touch-sensitive display, a second touch on the physical crown, a press on the physical crown, and a third touch on a touch-sensitive surface of the wearable electronic device.