Method for manipulating a graphical object and an interactive input system employing the same

• US 9,588,673 B2
• Filed: 03/30/2012
• Issued: 03/07/2017
• Est. Priority Date: 03/31/2011
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Van Ieperen, Taco, Hill, Douglas Blair
• Primary Examiner(s): Pham, Linh K
• Assistant Examiner(s): NICHOLAS, WENDY K
• Application Number:
  US13/436,832
• Publication Number:
  US 20120254782A1
• Time in Patent Office: 1,803 Days
• Field of Search: 715/765, 715/853, 345/619
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method comprises receiving an input event generated when at least one contact is made on an interactive surface at a location corresponding to a graphical object; determining the number of contacts associated with the input event; tracking movement of the at least one contact on the interactive surface; identifying a graphical object manipulation based on the number of contacts, the movement of the at least one contact, and the graphical object type; and performing the graphical object manipulation.

Claims

1. A method comprising:

generating, by an interactive device that communicates with and controls information displayed on at least one remote display device, an input event in response to an input received from one of a mouse, keyboard, or interactive surface, wherein the input event is defined by an input ID identifying the input source, a surface ID identifying an interactive surface on which a pointer input is received and a contact ID distinguishing between multiple simultaneous contacts;

in response to determining the input event corresponds to one of a mouse or keyboard input, setting the surface ID and the contact ID to a default value;

determining an input contact down event in response to at least one contact made on an interactive surface of the interactive device, the interactive surface having at least one region representative of the at least one display device;

determining if the at least one contact made on the interactive surface of the interactive device corresponds to a location of a graphical object displayed on the interactive surface;

processing, in response to determining the at least one contact on the interactive surface does not correspond to a location of the graphical object, the contact as a writing, drawing or command to control the execution of an application program; and

processing, in response to determining the at least one contact on the interactive surface does correspond to a location of the graphical object, the contact as a manipulation of the graphical object by;

determining the number of contacts associated with the input contact down event;

tracking movement of the at least one contact on the interactive surface; and

in response to a subsequent contact up event;

identifying a graphical object manipulation based on the number of contacts, the movement of the at least one contact, whether the graphical object is manipulated such that the graphical object, at least partially, overlaps with the at least one region, and the graphical object type;

performing the identified graphical object manipulation on the graphical object, the manipulation being done relative to the at least one region; and

displaying only a portion of the manipulated graphical object on the at least one display device in the event that the manipulated graphical object overlaps, only partially, with the at least one region, the portion of the manipulated graphical object displayed on the at least one display device corresponding to the portion of the manipulated graphical object that overlaps with the at least one region.

2. The method of claim 1 wherein the at least one contact is made by at least one finger.

3. The method of claim 1 wherein identifying the graphical user object manipulation comprises examining a lookup table to identify the graphical object manipulation.

4. The method of claim 3 wherein the lookup table is customizable by a user.

5. The method of claim 1 wherein the graphical object type is one of a computer program icon, an image, and a window.

6. The method of claim 5 wherein when the graphical object type is the computer program icon, the graphical object manipulation is one of a graphical object moving manipulation and a graphical object copy and paste manipulation.

7. The method of claim 5 wherein when the graphical object type is the image, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object moving with snap manipulation, a graphical object moving with resizing manipulation, a graphical object copy and paste manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation, a graphical object cropping manipulation, a graphical object rotating manipulation, a graphical object selecting manipulation and a graphical object deleting manipulation.

8. The method of claim 5 wherein when the graphical object type is the window, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation and a graphical object closing manipulation.

9. The method of claim 1 wherein said interactive surface comprises a plurality of regions, each region representative of a respective display device and wherein during the displaying, in the event that the manipulated graphical object overlaps, only partially, with one of said regions, the portion of the manipulated graphical object is displayed on the respective display device associated with the one region.

10. The method of claim 9 wherein the at least one contact is made by at least one finger.

11. The method of claim 9 wherein identifying the graphical user object manipulation comprises examining a lookup table to identify the graphical object manipulation.

12. The method of claim 11 wherein the lookup table is customizable by a user.

13. The method of claim 9 wherein the graphical object type is one of a computer program icon, an image, and a window.

14. The method of claim 13 wherein when the graphical object type is the computer program icon, the graphical object manipulation is one of a graphical object moving manipulation and a graphical object copy and paste manipulation.

15. The method of claim 13 wherein when the graphical object type is the image, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object moving with snap manipulation, a graphical object moving with resizing manipulation, a graphical object copy and paste manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation, a graphical object cropping manipulation, a graphical object rotating manipulation, a graphical object selecting manipulation and a graphical object deleting manipulation.

16. The method of claim 13 wherein when the graphical object type is the window, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation and a graphical object closing manipulation.

17. The method of claim 1 wherein the default value is null.

18. An interactive input system comprising:

a plurality of display devices;

an interactive device configured to communicate with said display devices and control information presented on said display devices, said interactive device comprising an interactive surface having a plurality of regions, each region representative of a respective one of said display devices; and

processing structure configured to;

receive an input event in response to an input received from one of a mouse, keyboard, or interactive surface, wherein the input event is defined by an input ID identifying the input source, a surface ID identifying an interactive surface on which a pointer input is received and a contact ID distinguishing between multiple simultaneous contacts;

in response to determining the input event corresponds to one of a mouse or keyboard input, set the surface ID and the contact ID to a default value;

determine an input contact down event generated by the interactive device when at least one contact is made on the interactive surface in response to said input contact down event determine if the at least one contact made on the interactive surface corresponds to a location of a graphical object displayed on the interactive surface,

process, in response to a determination that the at least one contact on the interactive surface does not correspond to a location of the graphical object, the contact as a writing, drawing or command to control the execution of an application program, and

in response to a determination that the at least one contact on the interactive surface does correspond to a location of the graphical object,

determine a number of contacts associated with the input contact down event,

track movement of the at least one contact on the interactive surface,

in response to a subsequent contact up event;

identify a graphical object manipulation based on the number of contacts, the movement of the at least one contact, whether the graphical object is manipulated such that the graphical object, at least partially, overlaps with one of said regions, and the graphical object type,

perform the identified graphical object manipulation, the manipulation being done relative to the one region, and

in the event that said manipulated graphical object overlaps, only partially, with the region, display only a portion of the manipulated graphical object on the respective display device associated with the one region, the portion of the manipulated graphical object displayed on the respective display device corresponding to the portion of the manipulated graphical object that overlaps with the one region.

19. The interactive input system of claim 18 wherein the processing structure examines a lookup table to identify the graphical object manipulation.

20. The interactive input system of claim 18 wherein the at least one contact is made by at least one finger.

21. The interactive input system of claim 18 wherein the graphical object type is one of a computer program icon, an image, and a window.

22. The interactive input system of claim 21 wherein when the graphical object type is the computer program icon, the graphical object manipulation is one of a graphical object moving manipulation and a graphical object copy and paste manipulation.

23. The interactive input system of claim 21 wherein when the graphical object type is the image, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object moving with snap manipulation, a graphical object moving with resizing manipulation, a graphical object copy and paste manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation, a graphical object cropping manipulation, a graphical object rotating manipulation, a graphical object selecting manipulation and a graphical object deleting manipulation.

24. The interactive input system of claim 21 wherein when the graphical object type is the window, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation and a graphical object closing manipulation.

25. The interactive input system of claim 18 wherein the default value is null.

26. A non-transitory computer readable medium embodying a computer program for execution by a computer, the computer program comprising:

program code for receiving an input event in response to an input received from one of a mouse, keyboard, or interactive surface, wherein the input event is defined by an input ID identifying the input source, a surface ID identifying an interactive surface on which a pointer input is received and a contact ID distinguishing between multiple simultaneous contacts;

program code for setting, in response to determining the input event corresponds to one of a mouse or keyboard input, the surface ID and the contact ID to a default value;

program code for determining an input contact down event generated by an interactive device that communicates with and controls information displayed on at least one display device when at least one contact is made on an interactive surface of the interactive device, the interactive surface having at least one region representative of the at least one display device;

program code for determining if the at least one contact made on the interactive surface of the interactive device corresponds to a location of a graphical object displayed on the interactive surface;

in response to determining the at least one contact on the interactive surface does not correspond to a location of the graphical object, program code for processing the contact as a writing, drawing or command to control the execution of an application program;

program code for determining the number of contacts associated with the input contact down event in response to determining that the at least one contact on the interactive surface does correspond to a location of the graphical object;

program code for tracking movement of the at least one contact on the interactive surface; and

in response to a subsequent contact up event detected after determining the at least one contact on the interactive surface does correspond to a location of the graphical object;

program code for identifying a graphical object manipulation based on the number of contacts, the movement of the at least one contact, whether the graphical object is manipulated such that the graphical object, at least partially, overlaps with the at least one region, and the graphical object type;

program code for performing the identified graphical object manipulation, the manipulation being done relative to the at least one region; and

program code for displaying only a portion of the manipulated graphical object on the at least one display device in the event that said manipulated graphical object overlaps, only partially, with the at least one region, the portion of the manipulated graphical object displayed on the at least one display device corresponding to the portion of the manipulated graphical object that overlaps with the at least one region.

27. An apparatus comprising:

a plurality of display devices;

an interactive device configured to communicate with said display devices and control information presented on said display devices, said interactive device comprising an interactive surface having a plurality of regions, each region representative of a respective one of said display devices;

memory storing program instructions; and

one or more processors communicating with said memory, interactive device and display devices, said one or more processors, in response to execution of said program instructions, being configured to cause said apparatus to;

receive an input event in response to an input received from one of a mouse, keyboard, or interactive surface, wherein the input event is defined by an input ID identifying the input source, a surface ID identifying an interactive surface on which a pointer input is received and a contact ID distinguishing between multiple simultaneous contacts;

in response to determining the input event corresponds to one of a mouse or keyboard input, set the surface ID and the contact ID to a default value;

determine an input contact down event generated by said interactive device when at least one contact is made on the interactive surface;

determine if the at least one contact made on the interactive surface of the interactive device corresponds to a location of a graphical object displayed on the interactive surface;

process, in response to determining the at least one contact on the interactive surface does not correspond to a location of the graphical object, the contact as a writing, drawing or command to control the execution of an application program; and

in response to said input contact down event after determining the at least one contact on the interactive surface does correspond to a location of the graphical object;

determine a number of contacts associated with the input contact down event;

track movement of the at least one contact on the interactive surface; and

in response to a subsequent contact up event;

identify a graphical object manipulation based on the number of contacts, the movement of the at least one contact, whether the graphical object is manipulated such that the graphical object, at least partially, overlaps with one of said regions, and the graphical object type;

perform the identified graphical object manipulation, the manipulation being done relative to the one region; and

in the event that said manipulated graphical object overlaps, only partially, with the one region, display only a portion of the manipulated graphical object on the respective display associated with the one region, the portion of the manipulated graphical object displayed on the respective display device corresponding to the portion of the manipulated graphical object that overlaps with the one region;

determining if the at least one contact made on the interactive surface of the interactive device corresponds to a location of a graphical object displayed on the interactive surface.

28. The apparatus of claim 27 wherein the one or more processors examine a lookup table to identify the graphical object manipulation.

29. The apparatus of claim 27 wherein the at least one contact is made by at least one finger.

30. The apparatus of claim 27 wherein the graphical object type is one of a computer program icon, an image, and a window.

31. The apparatus of claim 30 wherein when the graphical object type is the computer program icon, the graphical object manipulation is one of a graphical object moving manipulation and a graphical object copy and paste manipulation.

32. The apparatus of claim 30 wherein when the graphical object type is the image, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object moving with snap manipulation, a graphical object moving with resizing manipulation, a graphical object copy and paste manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation, a graphical object cropping manipulation, a graphical object rotating manipulation, a graphical object selecting manipulation and a graphical object deleting manipulation.

33. The apparatus of claim 30 wherein when the graphical object type is the window, the graphical object manipulation is one of a graphical object moving manipulation, a graphical object resizing manipulation, a graphical object maximizing manipulation, a graphical object minimizing manipulation and a graphical object closing manipulation.