Touch Screen Device, Method, and Graphical User Interface for Manipulating Three-Dimensional Virtual Objects

• US 20090303231A1
• Filed: 09/29/2008
• Published: 12/10/2009
• Est. Priority Date: 06/09/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Moha, Alexandre, Robinet, Fabrice, Goossens, Thomas
• Granted Patent: US 8,477,139 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An electronic device with a touch screen display, a computer-implemented method, and a graphical user interface for navigating in three-dimensional virtual spaces and manipulating three-dimensional objects in the virtual spaces using simple finger gestures are disclosed.

Claims

1. A computer-implemented method, comprising:

at a portable electronic device with a touch screen display;

displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detecting a first finger gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the first finger gesture on the first three-dimensional virtual object, displaying an animated transition from the first perspective to a second perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the first three-dimensional virtual object on the touch screen display in the second perspective in the three-dimensional virtual space, wherein the second perspective is different from the first perspective.

2. The method of claim 1, wherein the portable electronic device is a multifunction device.

3. The method of claim 1, wherein the portable electronic device is a multifunction device with a game application.

4. The method of claim 1, wherein the touch screen display is a capacitive touch screen display.

5. The method of claim 1, wherein the touch screen display is a projected mutual capacitive touch screen display.

6. The method of claim 1, wherein the first finger gesture is a tap gesture.

7. The method of claim 6, wherein the tap gesture is a double tap with a single finger.

8. The method of claim 6, wherein the tap gesture is a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

9. The method of claim 1, wherein the first three-dimensional virtual object is an icon.

10. The method of claim 1, wherein the first three-dimensional virtual object is a virtual game object.

11. The method of claim 1, wherein the first three-dimensional virtual object is a virtual game character.

12. The method of claim 1, wherein enlarging and substantially centering the first three-dimensional virtual object comprises simultaneously zooming and translating the first three-dimensional virtual object on the touch screen display.

13. The method of claim 1, wherein enlarging the first three-dimensional virtual object comprises expanding the first three-dimensional virtual object so that the width of the first three-dimensional virtual object is at least a predetermined percentage of the width of the touch screen display.

14. The method of claim 1, including:

detecting a second finger gesture on the enlarged first three-dimensional virtual object; and

in response to detecting the second finger gesture, reducing in size the first three-dimensional virtual object on the touch screen display.

15. The method of claim 14, wherein no additional finger gestures are detected on the touch screen display between detecting the first finger gesture and detecting the second finger gesture.

16. The method of claim 14, wherein the first three-dimensional virtual object returns to its size on the touch screen display prior to being enlarged.

17. The method of claim 14, wherein the second finger gesture and the first finger gesture are the same type of finger gesture.

18. The method of claim 14, wherein the second finger gesture is a tap gesture.

19. The method of claim 18, wherein the tap gesture is a double tap with a single finger.

20. The method of claim 18, wherein the tap gesture is a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

21. The method of claim 1, including:

detecting a second finger gesture on the enlarged first three-dimensional virtual object; and

in response to detecting the second finger gesture, displaying an animated transition from the second perspective to the first perspective in the three-dimensional virtual space on the touch screen display.

22. The method of claim 21, wherein the first three-dimensional virtual object returns to its size and position on the touch screen display prior to being enlarged.

23. The method of claim 1, including:

detecting a third finger gesture different from the first finger gesture on the enlarged first three-dimensional virtual object; and

in response to detecting the third finger gesture, performing a function associated with the first three-dimensional virtual object.

24. The method of claim 23, wherein no additional finger gestures are detected on the touch screen display between detecting the first finger gesture and detecting the third finger gesture.

25. The method of claim 1, including:

while the first three-dimensional virtual object is enlarged, detecting a fourth finger gesture on a second three-dimensional virtual object other than the first three-dimensional virtual object; and

in response to detecting the fourth finger gesture, displaying an animated transition to a third perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the second three-dimensional virtual object on the touch screen display in the third perspective in the three-dimensional virtual space, wherein the third perspective is different from the second perspective.

26. The method of claim 25, wherein the fourth finger gesture and the first finger gesture are the same type of finger gesture.

27. The method of claim 25, wherein the fourth finger gesture is a tap gesture.

28. The method of claim 27, wherein the tap gesture is a double tap with a single finger.

29. The method of claim 27, wherein the tap gesture is a double tap with two fingers, a single tap with a single finger, or a single tap with two fingers.

30. The method of claim 21, including:

detecting a single finger swipe gesture on the touch screen display; and

in response to detecting the single finger swipe gesture, displaying an animated transition from the first perspective to a fourth perspective in the three-dimensional virtual space on the touch screen display, wherein the fourth perspective is different from the first perspective.

31. The method of claim 30, wherein no additional finger gestures are detected on the touch screen display between detecting the second finger gesture and detecting the single finger swipe gesture.

32. The method of claim 30, wherein the animated transition from the first perspective to the fourth perspective includes vertical, horizontal, or diagonal panning from the first perspective to the fourth perspective in the three-dimensional virtual space on the touch screen display.

33. The method of claim 30, wherein the animated transition from the first perspective to the fourth perspective is a vertical panning rather than a diagonal panning from the first perspective to the fourth perspective if the single finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display.

34. The method of claim 30, wherein the animated transition from the first perspective to the fourth perspective is a horizontal panning rather than a diagonal panning from the first perspective to the fourth perspective if the single finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display;

35. The method of claim 30, including:

detecting a fifth finger gesture on a third three-dimensional virtual object displayed in the fourth perspective; and

in response to detecting the fifth finger gesture, displaying an animated transition to a fifth perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the third three-dimensional virtual object on the touch screen display in the fifth perspective in the three-dimensional virtual space, wherein the fifth perspective is different from the fourth perspective.

36. The method of claim 1, including:

detecting a sixth finger gesture on the enlarged first three-dimensional virtual object; and

in response to detecting the sixth finger gesture, rotating the first three-dimensional virtual object on the touch screen display while maintaining display of the second perspective in the three-dimensional virtual space.

37. The method of claim 36, wherein the sixth finger gesture is a single finger gesture.

38. The method of claim 36, wherein the sixth finger gesture is a multi-finger gesture.

39. The method of claim 36, wherein the sixth finger gesture is a twisting gesture.

40. The method of claim 1, including:

detecting a change in orientation of the device; and

in response to detecting the change in orientation of the device, displaying an animated transition from the second perspective to another perspective in the three-dimensional virtual space on the touch screen display in accordance with the detected change in orientation of the device.

41. The method of claim 1, including:

detecting a multi-finger de-pinch gesture on the first three-dimensional virtual object; and

in response to detecting the multi-finger de-pinch gesture, enlarging the first three-dimensional virtual object on the touch screen display in accordance with a position of the multi-finger de-pinch gesture and an amount of finger movement in the multi-finger de-pinch gesture.

42. The method of claim 1, including:

detecting a multi-finger swipe gesture on the enlarged first three-dimensional virtual object; and

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display while maintaining display of the second perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display while maintaining display of the second perspective in the three-dimensional virtual space.

43. The method of claim 42, wherein the multi-finger swipe gesture is a two-finger swipe gesture.

44. The method of claim 42, wherein no additional finger gestures are detected on the touch screen display between detecting the first finger gesture and detecting the multi-finger swipe gesture.

45. The method of claim 42, including:

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined range of angles with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about an axis in the plane of the touch screen display that is perpendicular to the direction of movement of the multi-finger swipe gesture while maintaining display of the second perspective in the three-dimensional virtual space.

46. The method of claim 42, wherein the horizontal axis runs through the first three-dimensional virtual object.

47. The method of claim 42, wherein the horizontal axis runs through the center of the first three-dimensional virtual object.

48. The method of claim 42, wherein the horizontal axis does not run through the first three-dimensional virtual object.

49. The method of claim 42, wherein the vertical axis runs through the first three-dimensional virtual object.

50. The method of claim 42, wherein the vertical axis runs through the center of the first three-dimensional virtual object.

51. The method of claim 42, wherein the vertical axis does not run through the first three-dimensional virtual object.

52. A graphical user interface on a portable electronic device with a touch screen display, comprising:

a three-dimensional virtual space that includes a plurality of three-dimensional virtual objects;

wherein;

in response to detecting a first finger gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects, an animated transition from a first perspective to a second perspective in the three-dimensional virtual space is displayed on the touch screen display;

the animated transition includes enlarging and substantially centering the first three-dimensional virtual object on the touch screen display in the second perspective in the three-dimensional virtual space; and

the second perspective is different from the first perspective.

53. A portable electronic device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for;

displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detecting a first finger gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the first finger gesture on the first three-dimensional virtual object, displaying an animated transition from the first perspective to a second perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the first three-dimensional virtual object on the touch screen display in the second perspective in the three-dimensional virtual space, wherein the second perspective is different from the first perspective.

54. A computer readable storage medium having stored therein instructions, which when executed by a portable electronic device with a touch screen display, cause the device to:

display a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detect a first finger gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the first finger gesture on the first three-dimensional virtual object, display an animated transition from the first perspective to a second perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the first three-dimensional virtual object on the touch screen display in the second perspective in the three-dimensional virtual space, wherein the second perspective is different from the first perspective.

55. A portable electronic device, comprising:

a touch screen display;

means for displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

means for detecting a first finger gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

means for, in response to detecting the first finger gesture on the first three-dimensional virtual object, displaying an animated transition from the first perspective to a second perspective in the three-dimensional virtual space on the touch screen display, wherein the animated transition includes enlarging and substantially centering the first three-dimensional virtual object on the touch screen display in the second perspective in the three-dimensional virtual space, wherein the second perspective is different from the first perspective.

56. A computer-implemented method, comprising:

at a portable electronic device with a touch screen display;

displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detecting a multi-finger swipe gesture on a first three-dimensional virtual object in the plurality of three-dimensional virtual objects; and

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space.

57. The method of claim 56, wherein the multi-finger swipe gesture is a two-finger swipe gesture.

58. The method of claim 56, including:

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined range of angles with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about an axis in the plane of the touch screen display that is perpendicular to the direction of movement of the multi-finger swipe gesture while maintaining display of the first perspective in the three-dimensional virtual space.

59. The method of claim 56, wherein the horizontal axis runs through the first three-dimensional virtual object.

60. The method of claim 56, wherein the horizontal axis runs through the center of the first three-dimensional virtual object.

61. The method of claim 56, wherein the horizontal axis does not run through the first three-dimensional virtual object.

62. The method of claim 56, wherein the vertical axis runs through the first three-dimensional virtual object.

63. The method of claim 56, wherein the vertical axis runs through the center of the first three-dimensional virtual object.

64. The method of claim 56, wherein the vertical axis does not run through the first three-dimensional virtual object.

65. A graphical user interface on a portable electronic device with a touch screen display, comprising:

a first perspective in a three-dimensional virtual space that includes a plurality of three-dimensional virtual objects;

wherein;

in response to detecting a multi-finger swipe gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display is displayed while maintaining display of the first perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display is displayed while maintaining display of the first perspective in the three-dimensional virtual space.

66. A portable electronic device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for;

displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detecting a multi-finger swipe gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, displaying an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space.

67. A computer readable storage medium having stored therein instructions, which when executed by a portable electronic device with a touch screen display, cause the device to:

display a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

detect a multi-finger swipe gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, display an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, display an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space.

68. A portable electronic device, comprising:

a touch screen display;

means for displaying a first perspective in a three-dimensional virtual space on the touch screen display, wherein the three-dimensional virtual space includes a plurality of three-dimensional virtual objects;

means for detecting a multi-finger swipe gesture on a first three-dimensional virtual object in the plurality of three-dimensional objects; and

in response to detecting the multi-finger swipe gesture;

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly vertical with respect to the touch screen display, means for displaying an animated rotation of the first three-dimensional virtual object about a horizontal axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space; and

if the multi-finger swipe gesture initially moves within a predetermined angle of being perfectly horizontal with respect to the touch screen display, means for displaying an animated rotation of the first three-dimensional virtual object about a vertical axis with respect to the touch screen display while maintaining display of the first perspective in the three-dimensional virtual space.