Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen

• US 8,049,730 B2
• Filed: 02/23/2005
• Issued: 11/01/2011
• Est. Priority Date: 02/23/2004
• Status: Expired due to Fees

• Current Assignee: Nissha Printing Company Limited (Nissha Co., Ltd.)
• Original Assignee: Stantum SAS
• Inventors: Joguet, Pascal, Largillier, Guillaume
• Primary Examiner(s): Wang; Quan-Zhen
• Assistant Examiner(s): Nguyen; Jennifer T
• Application Number:
  US10/590,306
• Publication Number:
  US 20070198926A1
• Time in Patent Office: 2,442 Days
• Field of Search: 345173-178, 345/156, 178 1801- 1809, 846/00, 84615-620, 84653-665
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/047 using sets of wires, e.g. crossed wires
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G10H 1/055 by switches with variable impedance elements
• CPC Class Codes: G10H 1/34 Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
• CPC Class Codes: G10H 2220/096 using a touch screen
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes

Abstract

A process for controlling computerized equipment with a device including a multi-contact bidimensional sensor that acquires tactile information and a calculator that generates command signals as a function of the tactile information, including graphical objects on a screen placed under a transparent multi-contact tactile sensor, each graphical object associated with at least one specific processing rule such that the sensor delivers during each acquisition phase a plurality of tactile information, and each piece of the tactile information forms an object of a specific processing determined by its localization relative to a position of one of the graphical objects.

Claims

1. A method for controlling a computerized device by a multi-contact touch screen, the method comprising:

displaying first and second graphical objects on the multi-contact touch screen at first and second object positions, respectively;

associating first and second specific processing rules to the first and second graphical objects, respectively;

detecting first and second touch points on the multi-contact touch screen and defining first and second touch positions for the first and second touch points, respectively;

applying the first specific processing rule of the first graphical object as a function of a relative position between the first touch position and the first object position;

applying the second specific processing rule of the second graphical object as a function of a relative position between the second touch position and the second object position;

modifying at least one of the first graphical object or the first object position based on a result of said applying the first specific processing rule; and

modifying at least one of the second graphical object or the second object position based on a result of said applying the second specific processing rule.

2. The method according to claim 1, wherein said step of detecting further comprises:

sequentially scanning rows and columns of the multi-contact touch screen.

3. The method according to claim 1, wherein the calculating step further includes:

generating first and second contact zones from the first and the second touch points;

first calculating a bounding zone for the first and second contact zones; and

second calculating a cursor position for first and second contact zones.

4. The method according to claim 3, wherein said step of second calculating further calculates the cursor position based on a barycenter of the bounding zone.

5. The method according to claim 1, wherein said step of detecting further comprises:

measuring an electrical characteristic of row-column intersections by sequentially scanning rows and columns of the multi-contact touch screen.

6. The method according to claim 5, wherein said electrical characteristic is a voltage.

7. The method according to claim 1,

wherein the first specific processing rule is different from the second specific processing rule, and the first specific processing rule is not applied to the second graphical object.

8. The method according to claim 1, wherein the first specific processing rule defines an interaction law between a cursor and the first graphical object.

9. The method according to claim 8, wherein the interaction law includes a physical law.

10. The method according to claim 9, wherein the physical law is a spring-loaded system.

11. The method according to claim 9, wherein the physical law is a vibration of a string.

12. The method according to claim 9, wherein the physical law is a law of gravity associated to the first graphical object.

13. The method according to claim 9, wherein the physical law is an electromagnetic law.

14. The method according to claim 9, wherein the physical law is a principle of inertia.

15. The method according to claim 9, wherein the physical law manages a collision between the first and second graphical object.

16. The method according to claim 9, wherein the interaction law includes interaction between the first graphical object and another graphical object, the first graphical object located inside the another graphical object.

17. The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on a coefficient of friction.

18. The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on a rebound.

19. The method according to claim 16, wherein the interaction between the first graphical object inside the another graphical object is based on an attraction.

20. The method according to claim 1, wherein the first specific processing rule includes a pressure measurement.

21. The method according to claim 1, wherein the first specific processing rule takes into account a speed of a movement of the first touch position relative to the multi-contact touch screen.

22. The method according to claim 1, wherein the first specific processing rule takes into account an acceleration of a movement of the first touch position relative to the multi-contact touch screen.

23. The method according to claim 1, wherein the first specific processing rule takes into account a trajectory of a movement of the first touch position.

24. The method according to claim 23, wherein the first specific processing rule performs a shape recognition of the trajectory of the movement of the first touch position.

25. A device to control a computerized apparatus comprising:

memory to store first and second graphical objects and first and second specific processing rules that are associated to the first and the second graphical objects, respectively;

a multi-contact touch screen to detect first and second touch points on the multi-contact touch screen and defining a first and a second touch position for the first and the second touch points, respectively;

a graphic display unit to display the first and second graphical objects at a first and a second object position, respectively; and

a processor configured to apply the first specific processing rule associated to the first graphical object as a function of a relative position between the first touch position and the first object position, configured to apply the second specific processing rule associated to the second graphical object as a function of a relative position between the second touch position and the second object position, configured to modify at least one of the first graphical object or the first object position based on a result of said processing said first specific processing rule, and configured to modify at least one of the second graphical object or the second object position based on a result of said processing said second specific processing rule.

26. The device according to claim 25, wherein the multi-contact touch screen comprises:

a transparent matrix sensor.

27. The device according to claim 26, wherein the transparent matrix sensor includes an array of a plurality of conductive rows and columns.

28. The device according to claim 27, wherein the conductive rows and columns are made of Indium Tin Oxyde (ITO).

29. The device according to claim 27, wherein the conductive rows are insulated from the conductive columns by an insulation layer.

30. The device according to claim 25, further comprising:

a controller configured to sequentially scan rows and columns of the matrix sensor to measure an electrical characteristic of row-column intersections to detect the first and the second touch points.

31. The device according to claim 30, wherein the electrical characteristic of row-column intersections is a voltage.

32. The device according to claim 25, wherein the processor is further configured to generate first and second contact zones from the first and second touch points, respectively, configured to calculate a bounding zone for the first and second contact zone, and configured to calculate a cursor position for the contact zone.

33. The device according to claim 32, wherein said processor is further configured to calculate the cursor position based on a barycenter of the bounding zone.

34. The device according to claim 25,

wherein the first specific processing rule is different from the second specific processing rule, and the first specific processing rule is not applied to the second graphical object.

35. The device according to claim 25, further comprising:

a switch configured to switch between a graphical user interface that includes the first and the second graphical objects, to another graphical user interface.

36. The device according to claim 35, wherein the switch is a button.

37. The device according to claim 35, wherein the switch is a control pedal board.

38. A method for controlling a computerized device by a multi-contact touch screen, the method comprising:

displaying first and second graphical objects on the multi-contact touch screen at first and second object positions, respectively;

associating first and second specific processing rules to the first and second graphical objects, respectively;

detecting a touch zone including first and second touch points on the multi-contact touch screen and defining a zone position for the touch zone based on a location of both the first and second touch points;

detecting a third touch point on the multi-contact touch screen and defining a touch position for the third touch point;

applying the first specific processing rule of the first graphical object as a function of a relative position between the zone position and the first object position;

applying the second specific processing rule of the second graphical object as a function of a relative position between the touch position and the second object position;

modifying at least one of the first graphical object or the first object position based on a result of said applying the first specific processing rule; and

modifying at least one of the second graphical object or the second object position based on a result of said applying the second specific processing rule.