Application Programming Interfaces for Gesture Operations

• US 20080168402A1
• Filed: 01/07/2007
• Published: 07/10/2008
• Est. Priority Date: 01/07/2007
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Blumenberg, Christopher
• Application Number:
  US11/620,727
• Publication Number:
  US 20080168402A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

At least certain embodiments of the present disclosure include an environment with user interface software interacting wit a software application to provide gesture operations for a display of a device. A method for operating through an application programming interface (API) in this environment includes transferring a scaling transform call The gesture operations include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points. The gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.

Claims

1. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

transferring a handle gesture event call; and

transferring a gesture change call in response to the handle gesture event call.

2. The method as in claim 1 wherein the handle gesture event call is transferred in response to a gesture event associated with a user input that comprises a plurality of input points touching the display.

3. The method as in claim 2, wherein the gesture event comprises a chord event object having a chord count, chord start event, chord change event, and chord end event.

4. The method as in claim 1, wherein transferring the handle gesture event call is either one of issuing, initiating, invoking and receiving the handle gesture event call.

5. The method as in claim 1, wherein transferring the gesture change call is either one of issuing, initiating, invoking and receiving the handle change call.

6. The method as in claim 1, wherein the device is one of;

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable devices a wireless device, and a cell phone.

7. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

transferring a handle gesture event call; and

transferring a gesture change call in response to the handle gesture event call.

8. The medium as in claim 7 wherein the handle gesture event call is transferred in response to a gesture event associated with a user input that comprises a plurality of input points touching the display.

9. The medium as in claim 7, wherein the gesture object comprises a chord event object having a chord count, chord start event, chord change event, and chord end event.

10. The medium as in claim 7, wherein transferring the handle gesture event call is either one of issuing, initiating, invoking and receiving the handle gesture event call.

11. The medium as in claim 7, wherein transferring the gesture change call is either one of issuing, initiating, invoking and receiving the handle change call.

12. The medium as in claim 7, wherein the data processing system is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

13. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for transferring a handle gesture event call; and

means for transferring a gesture change call in response to the handle gesture event call.

14. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

receiving a handle gesture event call; and

receiving a gesture change call in response to the handle gesture event call.

15. The method as in claim 14 wherein the handle gesture event call is received in response to a gesture event associated with a user input that comprises a plurality of input points touching the display.

16. The method as in claim 14, wherein the gesture event comprises a chord event object having a chord count, chord start event, chord change event, and chord end event.

17. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

receiving a handle gesture event call; and

receiving a gesture change call in response to the handle gesture event call.

18. The medium as in claim 17 wherein the handle gesture event call is received in response to a gesture event associated with a user input that comprises a plurality of input points touching the display.

19. The medium as in claim 18, wherein the gesture event comprises a chord event object having a chord count, chord start event, chord change event, and chord end event.

20. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for receiving a handle gesture event call; and

means for receiving a gesture change call in response to the handle gesture event call.

21. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

22. The method of claim 21, further comprising:

transferring a start scaling gesture call;

transferring a scaling gesture progress call; and

transferring a scaling gesture end call.

23. The method of claim 21, wherein the scaling transform comprises a minimum and maximum scale factor.

24. The method of claim 21, wherein the scaling transform varies from the minimum to the maximum scale factor based on a flag being disabled.

25. The method of claim 21, wherein the scaling transform varies from the minimum to slightly past the maximum scale factor based on the flag being enabled prior to snapping back to the maximum scale factor.

26. The method as in claim 21, wherein transferring the scaling transform call is either one of issuing, initiating, invoking and receiving the scaling transform call.

27. The method as in claim 21, wherein the device is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

28. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

29. The medium of claim 28, further comprising:

transferring a start scaling gesture call;

transferring a scaling gesture progress call; and

transferring a scaling gesture end call.

30. The medium of claim 28, wherein the scaling transform comprises a minimum and maximum scale factor.

31. The medium of claim 28, wherein the scaling transform varies from the minimum to the maximum scale factor based on a flag being disabled.

32. The medium of claim 28, wherein the scaling transform varies from the minimum to slightly past the maximum scale factor based on the flag being enabled prior to snapping back to the maximum scale factor.

33. The medium as in claim 28, wherein transferring the scaling transform call is either one of issuing, initiating, invoking and receiving the scaling transform call.

35. The medium as in claim 28, wherein the data processing system is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

36. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

37. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

receiving a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

38. The method of claim 37, further comprising:

receiving a start scaling gesture call;

receiving a scaling gesture progress call; and

receiving a scaling gesture end call.

39. The method of claim 37, wherein the scaling transform comprises a minimum and maximum scale factor.

40. The method of claim 37, wherein the scaling transform varies from the minimum to the maximum scale factor based on a flag being disabled.

41. The method of claim 37, wherein the scaling transform varies from the minimum to slightly past the maximum scale factor based on the flag being enabled prior to snapping back to the maximum scale factor.

43. The medium of claim 37, further comprising:

receiving a start scaling gesture call;

receiving a scaling gesture progress call; and

receiving a scaling gesture end call.

44. The medium of claim 37, wherein the scaling transform comprises a minimum and maximum scale factor.

45. The medium of claim 37, wherein the scaling transform varies from the minimum to the maximum scale factor based on a flag being disabled.

46. The medium of claim 37, wherein the scaling transform varies from the minimum to slightly past the maximum scale factor based on the flag being enabled prior to snapping back to the maximum scale factor.

42. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

receiving a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

47. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for receiving for transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

48. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

setting a gesture scaling transform flag to determine a scaling transform for a view associated with a user input having a plurality of input points.

49. The method of claim 48, wherein the scaling transform flag scales either from a current scale factor to a minimum scale factor or from the current scale factor to a maximum scale factor.

50. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

setting a gesture scaling transform flag to determine a scaling transform for a view associated with a user input having a plurality of input points.

51. The medium of claim 50, wherein the scaling transform flag scales either from a current scale factor to a minimum scale factor or from the current scale factor to a maximum scale factor.

52. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for setting a gesture scaling transform flag to determine a scaling transform for a view associated with a user input having a plurality of input points.

53. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

transferring a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points.

54. The method of claim 53, further comprising:

transferring a start rotation gesture call;

transferring a gesture rotation progress call; and

transferring a rotation gesture end call.

55. The method of claim 53, wherein the rotation transform comprises a minimum and maximum degree of rotation for associated minimum and maximum rotation views.

56. The method as in claim 53, wherein transferring the rotation transform call is either one of issuing, initiating, invoking and receiving the scaling transform call.

57. The method as in claim 53, wherein the device is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

58. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

transferring a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points.

59. The medium of claim 58, further comprising:

transferring a start rotation gesture call;

transferring a gesture rotation progress call, and

transferring a rotation gesture end call.

60. The medium of claim 58, wherein the rotation transform comprises a minimum and maximum degree of rotation for associated minimum and maximum rotation views.

61. The medium as in claim 58, wherein transferring the rotation transform call is either one of issuing, initiating, invoking and receiving the scaling transform call.

62. The medium as in claim 58 wherein the data processing system is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

63. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for transferring a rotation transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

64. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

receiving a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points.

65. The method of claim 64, further comprising:

receiving a start rotation gesture call;

receiving a gesture rotation progress call; and

receiving a rotation gesture end call.

66. The method of claim 64, wherein the rotation transform comprises a minimum and maximum degree of rotation for associated minimum and maximum rotation views.

67. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

receiving a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points.

68. The medium of claim 67, further comprising:

receiving a start rotation gesture call;

receiving a gesture rotation progress call; and

receiving a rotation gesture end call.

69. The medium of claim 67, wherein the rotation transform comprises a minimum and maximum degree of rotation for associated minimum and maximum rotation views.

70. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for receiving a rotation transform call to determine a scaling transform for a view associated with a user input having a plurality of input points.

71. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

transferring a delegate call to notify a delegate of a gesture event.

72. The method of claim 71, wherein the delegate call notifies the delegate of the gesture event associated with a scaling transform on a view in order for the delegate operating under the control of the software application to change other views in response to the view being modified by the gesture event.

73. The method as in claim 71, wherein transferring the delegate call is either one of issuing, initiating, invoking and receiving the delegate call.

74. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

transferring a delegate call to notify a delegate of a gesture event.

75. The medium of claim 74, wherein the delegate call notifies the delegate of the gesture event associated with a scaling transform on a view in order for the delegate operating under the control of the software application to change other views in response to the view being modified by the gesture event.

76. The medium as in claim 74, wherein transferring the delegate call is either one of issuing, initiating, invoking and receiving the delegate call.

77. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for transferring a delegate call to notify a delegate of a gesture event.

78. In an environment with a device having a display with multiple views and user interface software interacts with a software application, a method for operating through an application programming interface (API), comprising:

receiving a delegate call to notify a delegate of a gesture event.

79. The method of claim 78, wherein the delegate call notifies the delegate of the gesture event associated with a scaling transform on a view in order for the delegate operating under the control of the software application to change other views in response to the view being modified by the gesture event.

81. The medium of claim 78, wherein the delegate call notifies the delegate of the gesture event associated with a scaling transform on a view in order for the delegate operating under the control of the software application to change other views in response to the view being modified by the gesture event.

80. A machine readable medium storing executable program instructions which when executed cause a data processing system to perform a method comprising:

receiving a delegate call to notify a delegate of a gesture event.

82. In an environment with a user interface software interacting with a software application, an apparatus, comprising:

means for receiving a delegate call to notify a delegate of a gesture event.

83. A device comprising:

an input panel which is configured to receive user input in the form of two or more input points;

a display device integrated with the input panel;

a central processing unit coupled to the input panel;

a memory coupled to the processor;

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs including;

instructions for detecting a movement of an user input on or near the input panel;

instructions for handling a gesture event associated with a view in response to detecting the user input.

84. The device as in claim 83 further comprising instructions for performing a scaling transform associated with the view.

85. The device as in claim 83 wherein the processor is configured to determine which view the user input intends to select based on having positive and negative charges for each contact of the input panel.

86. The method as in claim 83, wherein the device is one of:

a data processing device, a portable device, a portable data processing device, a multi touch device, a multi touch portable device, a wireless device, and a cell phone.

87. A computer read medium containing executable instructions, comprising:

program code configured, when executed, to transfer a scaling transform call through an application programming interface to determine a scaling transform for a view associated with a user input having a plurality of input points.

88. The medium as in claim 87, wherein transferring the scaling transform call is either one of issuing, initiating, invoking or receiving the scaling transform call.

89. A computer read medium containing executable instructions, comprising:

program code configured, when executed, to transfer a rotation transform call through an application programming interface to determine a rotation transform for a view associated with a user input having a plurality of input points.

90. The medium as in claim 89, wherein transferring the rotation transform call is either one of issuing, initiating, invoking or receiving the rotation transform call.

91. A platform for performing scrolling operations, comprising:

a processing unit coupled to an input panel;

a memory coupled to the processor; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processing unit, the programs including;

instructions for transferring a scaling transform call through an application programming interface to determine a scaling transform for a view associated with a user input having a plurality of input points.

92. The platform of claim 91, wherein the one or more programs further comprise instructions for transferring a rotation transform call through an application programming interface to determine a rotation transform for a view associated with a user input having a plurality of input points.

93. The platform as in claim 91, wherein transferring the scaling transform call is either one of issuing, initiating, invoking or receiving the scaling transform call.

94. The platform as in claim 92, wherein transferring the rotation transform call is either one of issuing, initiating, invoking or receiving the rotation transform call.

95. A framework for performing scrolling operations, comprising:

a directory for storing one or more programs and associated resources, wherein the programs contain instructions that when executed provide an application programming interface to specify a scaling transform for a view associated with a user input having a plurality of input points.

96. The framework of claim 95, wherein the one or more programs further comprise instructions that when executed provide an application programming interface to specify a rotation transform for a view associated with a user input having a plurality of input points.