METHOD AND DEVICE FOR CONTROLLING THE BEHAVIOR OF VIRTUAL OBJECTS ON A DISPLAY

• US 20130241832A1
• Filed: 09/07/2011
• Published: 09/19/2013
• Est. Priority Date: 09/07/2010
• Status: Abandoned Application

• Current Assignee: Zrro Technologies 2009 Ltd.
• Original Assignee: Zrro Technologies 2009 Ltd.
• Inventors: Rimon, Ori, Zachut, Rafi
• Application Number:
  US13/821,444
• Publication Number:
  US 20130241832A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for use in controlling images on a screen, including identifying each object from some objects with respect to a sensing surface, and assigning a dedicated image to that object for presentation on a screen, sensing behavior of that object by monitoring its position contacting the sensing surface and generating position data indicative thereof, and selectively identifying a break in contact between the contacting object and the sensing surface and generating data indicative thereof, processing the position data and generating transformation data between the coordinate system of the sensing surface and a virtual coordinate system of the screen, and selectively generating and storing data indicative of a last position in the virtual coordinate system of an image corresponding to a contacting object, when the contacting object breaks contact with the sensing surface; and using the transformation data for controlling the image associated with each contacting object on the screen.

Claims

1. A method for use in controlling images on a screen, the method comprising:

identifying each object from multiple touching objects with respect to a sensing surface, and assigning a dedicated image to each of the identified objects for presentation on a screen, assignment of the object to its corresponding dedicated image being kept when the object returns from a no contacting state to contacting state;

sensing behavior of each of the multiple objects, said sensing comprising;

monitoring a position of the object contacting the sensing surface and generating position data indicative thereof, and selectively identifying a break in contact between a contacting object and the sensing surface and generating data indicative thereof;

processing the position data for each of the contacting objects and generating transformation data between the first coordinate system of the sensing surface and a virtual coordinate system of the screen, and selectively generating and storing data indicative of a last position in the virtual coordinate system of the images corresponding to the contacting objects, when said contacting objects breaks contact with the sensing surface;

using said transformation data for controlling the image associated with each contacting object on the screen.

4. The method of claim 1, wherein the objects are fingers of one or two hands of a user.

5. The method of claim 1, wherein:

said sensing comprises detecting one or more hovering objects, that have broken contact with the sensing surface, in a vicinity of the sensing surface; and

said controlling comprises manipulating the image associated with a hovering object from the last position, when the hovering object returns to the contacting state and re-touches the sensing surface.

6. The method of claim 1, comprising monitoring a movement of each user'"'"'s finger from a plurality of fingers touching the sensing surface and controlling movement of each of a plurality of corresponding images on the screen in accordance with the fingers'"'"' movement.

7. The method of claim 1, wherein said sensing is carried out substantially simultaneously for the multiple identified objects.

2-3. -3. (canceled)

8. A method for controlling a plurality of images on a screen corresponding to a plurality of objects, the method comprising:

identifying each object from the plurality of contacting and hovering objects with respect to a sensing surface, and assigning to each object a dedicated image for presentation on a screen, the assignment of each hovering object to its dedicated image being preserved when the hovering object returns to a contacting state;

substantially simultaneously sensing behavior of the objects with respect to the sensing surface, said sensing comprising;

monitoring a position of each of the objects contacting the sensing surface in a first coordinate system of the sensing surface and generating position data indicative thereof;

selectively detecting a hovering object in a vicinity of the sensing surface and generating data indicative thereof when a break in contact between said contacting object and the sensing surface occurs,

processing and analyzing the position data for the contacting objects and generating transformation data between a first coordinate system of the sensing surface and a virtual coordinate system of the screen, and selectively generating and storing data indicative of a last position in the virtual coordinate system of images corresponding to the contacting objects respectively, when said contacting objects break contact with the sensing surface; and

using said transformation data for manipulating images on the screen for each of the contacting objects.

9. A system for monitoring behavior of multiple objects, the system comprising:

a sensor device, the sensor device being configured and operable to carry out a first sensing mode to determine a position of each of the multiple objects touching a sensing surface of said sensor device in a first coordinate system of the sensor device, and generate first position data indicative of a position of the touching objects in said first coordinate system, said sensor device being configured and operable to selectively carry out a second sensing mode to detect hovering objects in a vicinity of the sensing surface and generate second data indicative thereof;

a control unit comprising;

an identifier utility configured and operable for carrying out the following;

identifying touching and hovering objects with respect to the sensing surface, and assigning a dedicated image to the identified object for presentation on a screen;

analyzing the data generated by the sensor device and identifying a break in contact between said touching object and the sensing surface;

a memory utility for storing last position of the images assigned to the hovering objects before the hovering objects broke contact with the sensing surface;

a transformation utility configured and operable for processing the position data for the contacting objects and generating transformation data between a first coordinate system of the sensing surface and a virtual coordinate system of the screen, thereby enabling to use said transformation data for controlling images on the screen for each of the contacting objects, said transformation of the position data including data indicative of a last position for the hovering objects in the virtual coordinate system before the contact break with the sensing surface.

10. The system of claim 9, wherein said sensing device comprises a single proximity sensing unit defining the sensing surface and configured and operable for carrying out both the first and the second sensing.

11. The system of claim 9, wherein said sensing device comprises a first sensing unit defining the sensing surface and configured and operable for detecting objects touching said sensing surface, and a second sensing unit configured and operable for detecting at least hovering objects.

12. The system of claim 9, wherein said sensing surface is selected from the following:

a capacitive sensing surface, a resistive sensing surface, a surface acoustic waves sensing surface, and an optical sensing surface.

13. The system of claim 9, further comprising a screen device defining a virtual coordinate system and configured and operable for receiving the transformation data and presenting the images of the objects.

14. A control system for controlling multiple images on a screen each image corresponding to a remote object, the system comprising:

the monitoring system of claim 9; and

a screen device defining the virtual coordinate system and connectable to the monitoring system, the screen device being configured and operable for receiving the transformation data from the monitoring system, and presenting the corresponding images.