Touch-sensitive electronic apparatus for media applications, and methods therefor

• US 9,024,884 B2
• Filed: 12/17/2004
• Issued: 05/05/2015
• Est. Priority Date: 09/02/2003
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Lengeling, Gerhard, Rubinstein, Jonathan Jake
• Primary Examiner(s): Nguyen, Kevin M
• Assistant Examiner(s): Said, Mansour M
• Application Number:
  US11/015,978
• Publication Number:
  US 20060022956A1
• Time in Patent Office: 3,791 Days
• Field of Search: 345156-160, 345/162, 345165-166, 345168-169, 345172-173, 178/18.01, 178/19.01, 178/20.01
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/03548 Sliders, in which the moving part moves in a plane
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios

Abstract

An electronic apparatus, such as an electronic mixing apparatus and an electronic keyboard apparatus, and associated methods are disclosed. The electronic mixing apparatus or the electronic keyboard apparatus is provided on a touch screen that provides user input and display capabilities. In one embodiment, the touch screen is a multipoint touch screen so that multiple user touch inputs can be simultaneously acquired. In another embodiment, surface guides can be provided on the touch screen to assist with user input.

Claims

1. A method comprising:

at a computing device having a multi-point touch screen and a processor;

executing a media mixing software application that provides media mixing functionality;

while the media mixing software application is executing, displaying a mixing console Graphical User Interface (GUI) on the multi-point touch screen, the mixing console GUI having a plurality of graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials;

while displaying the mixing console GUI a plurality of having graphically depicted media mixing controls, detecting a plurality of simultaneous touch inputs on the multi-point touch screen;

identifying a plurality of distinct graphically depicted media mixing controls that are associated with the plurality of simultaneous touch inputs on the multi-point touch screen, wherein each respective touch input in the plurality of simultaneous touch inputs on the multi-point touch screen corresponds to a different graphically depicted media mixing control in the plurality of distinct graphically depicted media mixing controls;

determining modifications to the identified plurality of distinct graphically depicted media mixing controls based on the plurality of simultaneous touch inputs, wherein a respective modification to a respective graphically depicted media mixing control in the identified plurality of distinct graphically depicted media mixing controls is based on the respective touch input that corresponds to the respective graphically depicted media mixing control;

updating the identified plurality of distinct graphically depicted media mixing controls of the mixing console GUI to reflect the determined modifications; and

determining input data for media mixing operations in the media mixing software application based on the detected plurality of simultaneous touch inputs on the multi-point touch screen and the identified plurality of distinct graphically depicted media mixing controls that are associated with the detected plurality of simultaneous touch inputs.

2. The method of claim 1, wherein determining input data for media mixing operations in the media mixing software application is based in part on a pressure applied by a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

3. The method of claim 1, wherein determining input data for media mixing operations in the media mixing software application is based in part on a velocity of a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

4. The method of claim 1, further comprising:

detecting an input corresponding to a request to change configuration of the mixing console GUI;

in response to detecting the input corresponding to a request to change the configuration of the mixing console GUI, changing the display of at least one of the graphically depicted media mixing controls.

5. The method of claim 4, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the type of at least one of the graphically depicted media mixing controls.

6. The method of claim 4, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the number of the graphically depicted media mixing controls that are displayed on the multi-point touch screen.

7. The method of claim 4, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the position of the at least one of the graphically depicted media mixing controls with respect the mixing console GUI.

8. The method of claim 1, further comprising:

detecting a touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI; and

in response to detecting the touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI, replacing the display of the mixing console GUI with display of a keyboard GUI comprising an array of a plurality of graphically depicted keys on the multi-point touch screen.

9. The method of claim 1, wherein one or more surface guides are provided on the multi-point touch screen to assist with the plurality of simultaneous touch inputs.

10. The method of claim 9, wherein configurations of the one or more surface guides correspond to configurations of the graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials.

11. The method of claim 9, wherein an overlay sheet is provided on the multi-point touch screen, the one or more surface guides are provided on a front surface of the overlay sheet, and a back surface of the overlay sheet is affixed to the multi-point touch screen.

12. An electronic device, comprising:

a multi-point touch screen;

a processor;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the one or more programs including instructions for;

executing a media mixing software application that provides media mixing functionality;

while the media mixing software application is executing, displaying a mixing console Graphical User Interface (GUI) on the multi-point touch screen, the mixing console GUI having a plurality of graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials;

while displaying the mixing console GUI having a plurality of graphically depicted media mixing controls, detecting a plurality of simultaneous touch inputs on the multi-point touch screen;

identifying a plurality of distinct graphically depicted media mixing controls that are associated with the plurality of simultaneous touch inputs on the multi-point touch screen, wherein each respective touch input in the plurality of simultaneous touch inputs on the multi-point touch screen corresponds to a different graphically depicted media mixing control in the plurality of distinct graphically depicted media mixing controls;

determining modifications to the identified plurality of distinct graphically depicted media mixing controls based on the plurality of simultaneous touch inputs, wherein a respective modification to a respective graphically depicted media mixing control in the identified plurality of distinct graphically depicted media mixing controls is based on the respective touch input that corresponds to the respective graphically depicted media mixing control;

updating the identified plurality of distinct graphically depicted media mixing controls of the mixing console GUI to reflect the determined modifications; and

determining input data for media mixing operations in the media mixing software application based on the detected plurality of simultaneous touch inputs on the multi-point touch screen and the identified plurality of distinct graphically depicted media mixing controls that are associated with the detected plurality of simultaneous touch inputs.

13. The device of claim 12, wherein determining input data for media mixing operations in the media mixing software application is based in part on a pressure applied by a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

14. The device of claim 12, wherein determining input data for media mixing operations in the media mixing software application is based in part on a velocity of a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

15. The device of claim 12, wherein the one or more programs further comprise instructions for:

detecting an input corresponding to a request to change configuration of the mixing console GUI;

in response to detecting the input corresponding to a request to change the configuration of the mixing console GUI, changing the display of at least one of the graphically depicted media mixing controls.

16. The device of claim 15, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the type of at least one of the graphically depicted media mixing controls.

17. The device of claim 15, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the number of the graphically depicted media mixing controls that are displayed on the multi-point touch screen.

18. The device of claim 15, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the position of the at least one of the graphically depicted media mixing controls with respect the mixing console GUI.

19. The device of claim 12, wherein the one or more programs further comprise instructions for:

detecting a touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI; and

in response to detecting the touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI, replacing the display of the mixing console GUI with display of a keyboard GUI comprising an array of a plurality of graphically depicted keys on the multi-point touch screen.

20. The device of claim 12, wherein one or more surface guides are provided on the multi-point touch screen to assist with the plurality of simultaneous touch inputs.

21. The device of claim 20, wherein configurations of the one or more surface guides correspond to configurations of the graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials.

22. The device of claim 20, wherein an overlay sheet is provided on the multi-point touch screen, the one or more surface guides are provided on a front surface of the overlay sheet, and a back surface of the overlay sheet is affixed to the multi-point touch screen.

23. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a multi-point touch screen and a processor, cause the device to:

execute a media mixing software application that provides media mixing functionality;

while the media mixing software application is executing, display a mixing console Graphical User Interface (GUI) on the multi-point touch screen, the mixing console GUI having a plurality of graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials;

while displaying the mixing console GUI having a plurality of graphically depicted media mixing controls, detect a plurality of simultaneous touch inputs on the multi-point touch screen;

identify a plurality of distinct graphically depicted media mixing controls that are associated with the plurality of simultaneous touch inputs on the multi-point touch screen, wherein each respective touch input in the plurality of simultaneous touch inputs on the multi-point touch screen corresponds to a different graphically depicted media mixing control in the plurality of distinct graphically depicted media mixing controls;

determine modifications to the identified plurality of distinct graphically depicted media mixing controls based on the plurality of simultaneous touch inputs, wherein a respective modification to a respective graphically depicted media mixing control in the identified plurality of distinct graphically depicted media mixing controls is based on the respective touch input that corresponds to the respective graphically depicted media mixing control;

update the identified plurality of distinct graphically depicted media mixing controls of the mixing console GUI to reflect the determined modifications; and

determine input data for media mixing operations in the media mixing software application based on the detected plurality of simultaneous touch inputs on the multi-point touch screen and the identified plurality of distinct graphically depicted media mixing controls that are associated with the detected plurality of simultaneous touch inputs.

24. The non-transitory computer readable storage medium of claim 23, wherein determining input data for media mixing operations in the media mixing software application is based in part on a pressure applied by a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

25. The non-transitory computer readable storage medium of claim 23, wherein determining input data for media mixing operations in the media mixing software application is based in part on a velocity of a touch input in the detected plurality of simultaneous touch inputs on the multi-point touch screen.

26. The medium of claim 23, wherein the one or more programs further comprise instructions, which when executed by the device, cause the device to:

detect an input corresponding to a request to change configuration of the mixing console GUI;

in response to detecting the input corresponding to a request to change the configuration of the mixing console GUI, change the display of at least one of the graphically depicted media mixing controls.

27. The medium of claim 26, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the type of at least one of the graphically depicted media mixing controls.

28. The medium of claim 26, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the number of the graphically depicted media mixing controls that are displayed on the multi-point touch screen.

29. The medium of claim 26, wherein changing the display of at least one of the graphically depicted media mixing controls comprises changing the position of the at least one of the graphically depicted media mixing controls with respect the mixing console GUI.

30. The medium of claim 23, wherein the one or more programs further comprise instructions, which when executed by the device, cause the device to:

detect a touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI; and

in response to detecting the touch input on the multi-point touch screen corresponding to a request to replace the display of the mixing console GUI with display of a keyboard GUI, replacing the display of the mixing console GUI with display of a keyboard GUI comprising an array of a plurality of graphically depicted keys on the multi-point touch screen.

31. The medium of claim 23, wherein one or more surface guides are provided on the multi-point touch screen to assist with the plurality of simultaneous touch inputs.

32. The medium of claim 31, wherein configurations of the one or more surface guides correspond to configurations of the graphically depicted media mixing controls including graphically depicted sliders, buttons, and/or dials.

33. The medium of claim 31, wherein an overlay sheet is provided on the multi-point touch screen, the one or more surface guides are provided on a front surface of the overlay sheet, and a back surface of the overlay sheet is affixed to the multi-point touch screen.