User interface for manipulating user interface objects with magnetic properties

• US 10,001,817 B2
• Filed: 08/31/2015
• Issued: 06/19/2018
• Est. Priority Date: 09/03/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zambetti, Nicholas, Chaudhri, Imran, Dascola, Jonathan R., Dye, Alan C., Foss, Christopher Patrick, Guzman, Aurelio, Karunamuni, Chanaka G., Kerr, Duncan Robert, Wilson, Christopher, Wilson, Eric Lance, Yang, Lawrence Y., Butcher, Gary Ian, De Vries, Nathan, Ive, Jonathan P., King, Nicholas V., Preston, Daniel Trent
• Primary Examiner(s): Olson, Jason C
• Application Number:
  US14/841,656
• Publication Number:
  US 20150370529A1
• Time in Patent Office: 1,023 Days
• Field of Search: 345156
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

The present disclosure relates to user interfaces for manipulating user interface objects. A device, including a display and a rotatable input mechanism, is described in relation to manipulating user interface objects. In some examples, the manipulation of the object is a scroll, zoom, or rotate of the object. In other examples, objects are selected in accordance with simulated magnetic properties.

Claims

1. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of an electronic device with a rotatable input mechanism and an audio output device, the one or more programs including instructions which, when executed by the one or more processors, cause the electronic device to:

receive a user input representing a rotation of the rotatable input mechanism;

identify a rotational attribute of the user input, wherein the rotational attribute includes an angular velocity of the rotatable input mechanism;

determine an audio characteristic based on the identified rotational attribute, wherein the audio characteristic includes a frequency determined based on the angular velocity of the rotatable input mechanism, and wherein a change in angular velocity causes a corresponding change in frequency and a change in pitch; and

output, using the audio output device, audio with the audio characteristic.

2. The non-transitory computer-readable storage medium of claim 1, wherein the audio characteristic further includes a volume.

3. The non-transitory computer-readable storage medium of claim 1, wherein the rotational attribute is one or more of:

degree of angular rotation of the rotatable input mechanism,

angular velocity of the rotatable input mechanism, and

angular acceleration of the rotatable input mechanism.

4. The non-transitory computer-readable storage medium of claim 1,

wherein the user input representing the rotation of the rotatable input mechanism comprises a first input segment and a second input segment;

wherein to identify the rotational attribute of the user input, the one or more programs include instructions which cause the electronic device to;

identify a first rotational attribute based on the first input segment; and

identify a second rotational attribute based on the second input segment;

wherein to determine an audio characteristic based on the identified rotational attribute, the one or more programs include instructions which cause the electronic device to;

determine a first audio characteristic based on the first rotational attribute; and

determine a second audio characteristic based on the second rotational attribute; and

wherein to output, using the audio output device, the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to;

output first audio with the first audio characteristic; and

output second audio with the second audio characteristic.

5. The non-transitory computer-readable storage medium of claim 4, wherein the first audio characteristic includes a first pitch and the second audio characteristic includes a second pitch different from the first pitch.

6. The non-transitory computer-readable storage medium of claim 4, wherein the first audio characteristic includes a first frequency and the second audio characteristic includes a second frequency different from the first frequency.

7. The non-transitory computer-readable storage medium of claim 4, wherein the first audio characteristic includes a first volume and the second audio characteristic includes a second volume different from the first volume.

8. The non-transitory computer-readable storage medium of claim 1, wherein the audio output device includes a speaker, and wherein outputting, using the audio output device, the audio with the audio characteristic includes speaker playback.

9. The non-transitory computer-readable storage medium of claim 1, wherein the audio output device includes a Bluetooth transceiver, and wherein to output, using the audio output device, the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Bluetooth.

10. The non-transitory computer-readable storage medium of claim 1, wherein the audio output device includes a Wi-Fi transceiver, and wherein to output, using the audio output device, the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Wi-Fi.

11. The non-transitory computer-readable storage medium of claim 1, wherein the electronic device further includes a display, and wherein the one or more programs include instructions which cause the electronic device to:

prior to receiving the user input representing the rotation of the rotatable input mechanism, display, using the display, one or more objects in accordance with one or more values of a characteristic of the one or more objects;

in response to receiving the user input representing the rotation of the rotatable input mechanism, update a value of the characteristic of an object from the one or more objects based on the user input; and

update display of the one or more objects in accordance with the updated value of the characteristic of the object.

12. The non-transitory computer-readable storage medium of claim 11, wherein to update the value of the characteristic of the object based on the user input, the one or more programs include instructions which cause the electronic device to update the value of the characteristic of the object based on the rotational attribute of the user input.

13. The non-transitory computer-readable storage medium of claim 12,

wherein the one or more objects are a plurality of objects arranged in a sequence and the characteristic of the one or more objects is a position in the sequence,

wherein to update the value of the characteristic based on the user input, the one or more programs include instructions which cause the electronic device to determine an updated position in the sequence based on the user input, and

wherein to update display of the one or more objects in accordance with the updated value of the characteristic, the one or more programs include instructions which cause the electronic device to update display of the object of the plurality of objects corresponding to the updated position.

14. The non-transitory computer-readable storage medium of claim 13, wherein the plurality of objects arranged in a sequence is a plurality of images arranged in a sequence.

15. The non-transitory computer-readable storage medium of claim 13, wherein the plurality of objects arranged in a sequence is a plurality of numeric, alphabetic, or alphanumeric characters arranged in a sequence.

16. The non-transitory computer-readable storage medium of claim 12, wherein to update display of the object in accordance with the updated value of the characteristic of the object, the one or more programs include instructions which cause the electronic device to animate the object to reflect the updated value of the characteristic of the object.

17. The non-transitory computer-readable storage medium of claim 12, wherein updating the value of the characteristic based on the user input comprises a first update based on a first rotational attribute and a second update different than the first update and based on a second rotational attribute.

18. The non-transitory computer-readable storage medium of claim 11, wherein the characteristic of the object is selected from a group consisting of scroll position, zoom size, and degree of rotation.

19. The non-transitory computer-readable storage medium of claim 11, wherein the characteristic of the object is scroll position and a predetermined subset of the range of values of the characteristic is a range of scroll positions.

20. The non-transitory computer-readable storage medium of claim 11, wherein the characteristic of the object is zoom size and a predetermined subset of the range of values of the characteristic is a range of zoom sizes.

21. A method comprising:

at an electronic device with a rotatable input mechanism and an audio output device;

receiving a user input representing a rotation of the rotatable input mechanism;

identifying a rotational attribute of the user input, wherein the rotational attribute includes an angular velocity of the rotatable input mechanism;

determining an audio characteristic based on the identified rotational attribute, wherein the audio characteristic includes a frequency determined based on the angular velocity of the rotatable input mechanism, and wherein a change in angular velocity causes a corresponding change in frequency and a change in pitch; and

outputting, using the audio output device, audio with the audio characteristic.

23. The method of claim 21, wherein the audio characteristic of further includes a volume.

24. The method of claim 21, wherein the rotational attribute is one or more of:

degree of angular rotation of the rotatable input mechanism,

angular velocity of the rotatable input mechanism, and

angular acceleration of the rotatable input mechanism.

25. The method of claim 21,

wherein the user input representing the rotation of the rotatable input mechanism comprises a first input segment and a second input segment;

wherein to identify the rotational attribute of the user input, the one or more programs include instructions which cause the electronic device to;

identify a first rotational attribute based on the first input segment; and

identify a second rotational attribute based on the second input segment;

wherein to determine an audio characteristic based on the identified rotational attribute, the one or more programs include instructions which cause the electronic device to;

determine a first audio characteristic based on the first rotational attribute; and

determine a second audio characteristic based on the second rotational attribute; and

wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to;

output first audio with the first audio characteristic; and

output second audio with the second audio characteristic.

26. The method of claim 25, wherein the first audio characteristic includes a first pitch and the second audio characteristic includes a second pitch different from the first pitch.

27. The method of claim 25, wherein the first audio characteristic includes a first frequency and the second audio characteristic includes a second frequency different from the first frequency.

28. The method of claim 25, wherein the first audio characteristic includes a first volume and the second audio characteristic includes a second volume different from the first volume.

29. The method of claim 21, wherein the electronic device includes a speaker, and wherein outputting the audio with the audio characteristic includes speaker playback.

30. The method of claim 21, wherein the electronic device includes a Bluetooth transceiver, and wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Bluetooth.

31. The method of claim 21, wherein the electronic device includes a Wi-Fi transceiver, and wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Wi-Fi.

32. The method of claim 21, wherein the one or more programs include instructions which cause the electronic device to:

prior to receiving the user input representing the rotation of the rotatable input mechanism, display one or more objects in accordance with one or more values of a characteristic of the one or more objects;

in response to receiving the user input representing the rotation of the rotatable input mechanism, update a value of the characteristic of an object from the one or more objects based on the user input; and

update display of the one or more objects in accordance with the updated value of the characteristic of the object.

33. The method of claim 32, wherein to update the value of the characteristic of the object based on the user input, the one or more programs include instructions which cause the electronic device to update the value of the characteristic of the object based on the rotational attribute of the user input.

34. The method of claim 33,

wherein the one or more objects are a plurality of objects arranged in a sequence and the characteristic of the one or more objects is a position in the sequence,

wherein to update the value of the characteristic based on the user input, the one or more programs include instructions which cause the electronic device to determine an updated position in the sequence based on the user input, and

wherein to update display of the one or more objects in accordance with the updated value of the characteristic, the one or more programs include instructions which cause the electronic device to update display of the object of the plurality of objects corresponding to the updated position.

35. The method of claim 33, wherein to update display of the object in accordance with the updated value of the characteristic of the object, the one or more programs include instructions which cause the electronic device to animate the object to reflect the updated value of the characteristic of the object.

36. The method of claim 33, wherein updating the value of the characteristic based on the user input comprises a first update based on a first rotational attribute and a second update different than the first update and based on a second rotational attribute.

22. An electronic device comprising:

one or more processors;

memory;

a rotatable input mechanism each coupled to the one or more processors and memory;

an audio output device; and

one or more programs stored in memory, the one or more programs including instructions for;

receiving a user input representing a rotation of the rotatable input mechanism;

identifying a rotational attribute of the user input, wherein the rotational attribute includes an angular velocity of the rotatable input mechanism;

determining an audio characteristic based on the identified rotational attribute, wherein the audio characteristic includes a frequency determined based on the angular velocity of the rotatable input mechanism, and wherein a change in angular velocity causes a corresponding change in frequency and a change in pitch; and

outputting, using the audio output device, audio with the audio characteristic.

37. The electronic device of claim 22, wherein the audio characteristic further includes a volume.

38. The electronic device of claim 22, wherein the rotational attribute is one or more of:

degree of angular rotation of the rotatable input mechanism,

angular velocity of the rotatable input mechanism, and

angular acceleration of the rotatable input mechanism.

39. The electronic device of claim 22,

wherein the user input representing the rotation of the rotatable input mechanism comprises a first input segment and a second input segment;

wherein to identify the rotational attribute of the user input, the one or more programs include instructions which cause the electronic device to;

identify a first rotational attribute based on the first input segment; and

identify a second rotational attribute based on the second input segment;

wherein to determine an audio characteristic based on the identified rotational attribute, the one or more programs include instructions which cause the electronic device to;

determine a first audio characteristic based on the first rotational attribute; and

determine a second audio characteristic based on the second rotational attribute; and

wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to;

output first audio with the first audio characteristic; and

output second audio with the second audio characteristic.

40. The electronic device of claim 39, wherein the first audio characteristic includes a first pitch and the second audio characteristic includes a second pitch different from the first pitch.

41. The electronic device of claim 39, wherein the first audio characteristic includes a first frequency and the second audio characteristic includes a second frequency different from the first frequency.

42. The electronic device of claim 39, wherein the first audio characteristic includes a first volume and the second audio characteristic includes a second volume different from the first volume.

43. The electronic device of claim 22, wherein the electronic device includes a speaker, and wherein outputting the audio with the audio characteristic includes speaker playback.

44. The electronic device of claim 22, wherein the electronic device includes a Bluetooth transceiver, and wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Bluetooth.

45. The electronic device of claim 22, wherein the electronic device includes a Wi-Fi transceiver, and wherein to output the audio with the audio characteristic, the one or more programs include instructions which cause the electronic device to send audio data corresponding to the audio output via Wi-Fi.

46. The electronic device of claim 22, wherein the one or more programs include instructions which cause the electronic device to:

prior to receiving the user input representing the rotation of the rotatable input mechanism, display one or more objects in accordance with one or more values of a characteristic of the one or more objects;

in response to receiving the user input representing the rotation of the rotatable input mechanism, update a value of the characteristic of an object from the one or more objects based on the user input; and

update display of the one or more objects in accordance with the updated value of the characteristic of the object.

47. The electronic device of claim 46, wherein to update the value of the characteristic of the object based on the user input, the one or more programs include instructions which cause the electronic device to update the value of the characteristic of the object based on the rotational attribute of the user input.

48. The electronic device of claim 47,

wherein the one or more objects are a plurality of objects arranged in a sequence and the characteristic of the one or more objects is a position in the sequence,

wherein to update the value of the characteristic based on the user input, the one or more programs include instructions which cause the electronic device to determine an updated position in the sequence based on the user input, and

wherein to update display of the one or more objects in accordance with the updated value of the characteristic, the one or more programs include instructions which cause the electronic device to update display of the object of the plurality of objects corresponding to the updated position.

49. The electronic device of claim 47, wherein to update display of the object in accordance with the updated value of the characteristic of the object, the one or more programs include instructions which cause the electronic device to animate the object to reflect the updated value of the characteristic of the object.

50. The electronic device of claim 47, wherein updating the value of the characteristic based on the user input comprises a first update based on a first rotational attribute and a second update different than the first update and based on a second rotational attribute.