Graphical objects that respond to touch or motion input

• US 8,839,150 B2
• Filed: 02/10/2010
• Issued: 09/16/2014
• Est. Priority Date: 02/10/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Nicholas V., Bilbrey, Brett, Benjamin, Todd
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): HUYNH, LINDA TANG
• Application Number:
  US12/703,655
• Publication Number:
  US 20110193788A1
• Time in Patent Office: 1,679 Days
• Field of Search: 345 11-689, 715200-867, 370200-916, 455 1-899
• US Class Current: 715/836
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 2210/62 Semi-transparency

Abstract

A first graphical object on a user interface of a device can be transformed to a second graphical object on the user interface. The second graphical object can be manipulated by a user on the user interface using touch input or by physically moving the device. When manipulated, the object can be animated to appear to have mass that responds to real-world, physical forces, such as gravity, friction or drag. The data represented by the second graphical object can be compressed or archived using a gesture applied to the second graphical object. Graphical objects can be visually sorted on the user interface based on their mass (size). The visual appearance of graphical objects on the user interface can be adjusted to indicate the age of data represented by the graphical objects.

Claims

1. A method performed by one or more processors, comprising:

presenting first graphical objects on a user interface shown on a display of a device;

receiving, from a first input tool, a first touch input through the user interface, the first touch input tracing a perimeter around a subset of the first graphical objects following a movement of the first input tool touching the display;

responsive to the first touch input, transforming an area of the user interface including the subset of the first graphical objects within the perimeter into a second graphical object, wherein the first graphical objects include two-dimensional file or folder icons and the second graphical object includes a three-dimensional sphere, and wherein transforming the area of the user interface into the second graphical object comprises transforming the area of the user interface enclosed by the perimeter into the sphere, wherein the file or folder icons are displayed on the sphere;

receiving a second touch input in response to a second input tool touching the second graphical object; and

responsive to the second touch input, animating the second graphical object in the user interface so that it appears to become smaller, and compressing or archiving data represented by the second graphical object.

2. The method of claim 1, where animating the second graphical object comprises:

animating the second graphical object to appear to be detached from the user interface.

3. The method of claim 1, further comprising:

receiving a motion input associated with the device; and

animating the second graphical object so that it moves in a direction on the user interface based on the motion input.

4. The method of claim 3, further comprising:

animating the second graphical object to move at a speed on the user interface according to a size of the second graphical object.

5. The method of claim 3, further comprising:

detecting presence of a second device;

establishing a communication link with the second device;

responsive to the motion input, animating the second graphical object so that it appears to leave the user interface; and

transmitting data represented by the second graphical object to the second device.

6. The method of claim 1, where the second touch input includes touching the second graphical object at two opposing points in the user interface and making a pinching gesture and a reduction in displayed dimension of the second graphical object is proportional to a pinching distance.

7. The method of claim 6, where the radius of the sphere is reduced in accordance with the pinching distance.

8. The method of claim 1, where animating the second graphical object comprises:

animating the second graphical object according to a physical characteristic of the user interface that is set by a user, where the physical characteristic is one of coefficient of friction or viscosity, and where the second graphical object is animated to move at a slower speed in a user interface with a higher coefficient of friction compared to movement of the second graphical object in a user interface with a lower coefficient of friction.

9. The method of claim 1, where the first input tool includes a finger of a user, and wherein receiving the first touch input comprises:

receiving the first touch input from the user touching the display using the finger and visually drawing a boundary around the area in the user interface including the subset of the first graphical objects; and

transforming the area into the second graphical object.

10. The method of claim 1, where animating the second graphical object comprises:

modifying color or shape of the second graphical object to indicate compression or archive of the data represented by the second graphical object.

11. The method of claim 1, where transforming the area of the user interface includes transforming the user interface from a two-dimensional user interface to a three-dimensional user interface.

12. The method of claim 1, where animating the second graphical object comprises displaying a textual indicator providing information on a reduced size of the second graphical object.

13. A system comprising:

one or more processors; and

a computer-readable medium coupled to the one or more processors and storing instructions, which, when executed by the one or more processors, cause the one or more processors to perform operations, comprising;

presenting first graphical objects on a user interface shown on a display of a device;

receiving, from a first input tool, a first touch input through the user interface, the first touch input tracing a perimeter around a subset of the first graphical objects following a movement of the first input tool touching the display;

responsive to the first touch input, transforming an area of the user interface including the subset of the first graphical objects within the perimeter into a second graphical object, wherein the first graphical objects include two-dimensional file or folder icons and the second graphical object includes a three-dimensional sphere, and wherein transforming the area of the user interface into the second graphical object comprises transforming the area of the user interface enclosed by the perimeter into the sphere, wherein the file or folder icons are displayed on the sphere;

receiving a second touch input in response to a second input tool touching the second graphical object; and

responsive to the second touch input, animating the second graphical object in the user interface so that it appears to become smaller, and compressing or archiving data represented by the second graphical object.

14. The system of claim 13, where animating the second graphical object comprises:

animating the second graphical object to appear to be detached from the user interface.

15. The system of claim 13, further comprising:

receiving a motion input associated with the device; and

animating the second graphical object so that it moves in a direction on the user interface based on the motion input.

16. The system of claim 15, further comprising:

animating the second graphical object to move at a speed on the user interface according to a size of the second graphical object.

17. The system of claim 15, further comprising:

detecting presence of a second system;

establishing a communication link with the second system;

responsive to the motion input, animating the second graphical object so that it appears to leave the user interface; and

transmitting data represented by the second graphical object to the second system.

18. The system of claim 13, where the second touch input includes touching the second graphical object at two opposing points in the user interface and making a pinching gesture and a reduction in displayed dimension of the second graphical object is proportional to a pinching distance.

19. The system of claim 18, where the radius of the sphere is reduced in accordance with the pinching distance.

20. The system of claim 13, where animating the second graphical object comprises:

animating the second graphical object according to a physical characteristic of the user interface that is set by a user, where the physical characteristic is one of coefficient of friction or viscosity, and where the second graphical object is animated to move at a slower speed in a user interface with a higher coefficient of friction compared to movement of the second graphical object in a user interface with a lower coefficient of friction.

21. The system of claim 13, where the first input tool includes a finger of a user, and wherein receiving the first touch input comprises:

receiving the first touch input from the user touching the display using the finger and visually drawing a boundary around the area in the user interface including the subset of the first graphical objects; and

transforming the area into the second graphical object.

22. The system of claim 13, where animating the second graphical object comprises:

modifying color or shape of the second graphical object to indicate compression or archive of the data represented by the second graphical object.

23. The system of claim 13, where transforming the area of the user interface includes transforming the user interface from a two-dimensional user interface to a three-dimensional user interface.

24. The system of claim 13, where animating the second graphical object comprises displaying a textual indicator providing information on a reduced size of the second graphical object.

25. A non-transitory computer-readable medium storing instructions, which, when executed by one or more processors, are configured to cause the one or more processors to perform operations comprising:

presenting first graphical objects on a user interface shown on a display of a device;

receiving, from a first input tool, a first touch input through the user interface, the first touch input tracing a perimeter around a subset of the first graphical objects following a movement of the first input tool touching the display;

responsive to the first touch input, transforming an area of the user interface including the subset of the first graphical objects within the perimeter into a second graphical object, wherein the first graphical objects include two-dimensional file or folder icons and the second graphical object includes a three-dimensional sphere, and wherein transforming the area of the user interface into the second graphical object comprises transforming the area of the user interface enclosed by the perimeter into the sphere, wherein the file or folder icons are displayed on the sphere;

receiving a second touch input in response to a second input tool touching the second graphical object; and

responsive to the second touch input, animating the second graphical object in the user interface so that it appears to become smaller, and compressing or archiving data represented by the second graphical object.

26. The non-transitory computer-readable medium of claim 25, where the second touch input includes touching the second graphical object at two opposing points in the user interface and making a pinching gesture and a reduction in displayed dimension of the second graphical object is proportional to a pinching distance.

27. The non-transitory computer-readable medium of claim 26, where the radius of the sphere is reduced in accordance with the pinching distance.

28. The non-transitory computer-readable medium of claim 25, where animating the second graphical object comprises:

animating the second graphical object to appear to be detached from the user interface.

29. The non-transitory computer-readable medium of claim 25, further comprising:

receiving a motion input associated with the device; and

animating the second graphical object so that it moves in a direction on the user interface based on the motion input.

30. The non-transitory computer-readable medium of claim 29, comprising:

animating the second graphical object to move at a speed on the user interface according to a size of the second graphical object.

31. The non-transitory computer-readable medium of claim 29, comprising:

detecting presence of a second system;

establishing a communication link with the second system;

responsive to the motion input, animating the second graphical object so that it appears to leave the user interface; and

transmitting data represented by the second graphical object to the second system.

32. The non-transitory computer-readable medium of claim 25, where animating the second graphical object comprises:

animating the second graphical object according to a physical characteristic of the user interface that is set by a user, where the physical characteristic is one of coefficient of friction or viscosity, and where the second graphical object is animated to move at a slower speed in a user interface with a higher coefficient of friction compared to movement of the second graphical object in a user interface with a lower coefficient of friction.

33. The non-transitory computer-readable medium of claim 25, where the first input tool includes a finger of a user, and wherein receiving the first touch input comprises:

receiving the first touch input from the user touching the display using the finger and visually drawing a boundary around the area in the user interface including the subset of the first graphical objects; and

transforming the area into the second graphical object.

34. The non-transitory computer-readable medium of claim 25, where animating the second graphical object comprises:

modifying color or shape of the second graphical object to indicate compression or archive of the data represented by the second graphical object.

35. The non-transitory computer-readable medium of claim 25, where transforming the area of the user interface includes transforming the user interface from a two-dimensional user interface to a three-dimensional user interface.

36. The non-transitory computer-readable medium of claim 25, where animating the second graphical object comprises displaying a textual indicator providing information on a reduced size of the second graphical object.