Method of interfacing with multi-point display device

• US 8,405,628 B2
• Filed: 12/21/2010
• Issued: 03/26/2013
• Est. Priority Date: 12/23/2009
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Luu, David Ngan
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Zhou, Hong
• Application Number:
  US12/974,267
• Publication Number:
  US 20110148791A1
• Time in Patent Office: 826 Days
• Field of Search: 345156-174, 345/422, 345/629, 345/638, 715766-799, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods (1000), apparatuses (100), and computer readable storage mediums for interfacing with a multi-point input display device (181, 204, 304) are disclosed. A visual object is displayed (1010) on a multi-point input display device (181, 204, 304). The position of a first input contacting the multi-point input display device (181, 204, 304) is detected (1020). At least the displayed visual object is selected (1030) based on the position of the first input. The position of a second input contacting the multi-point input display device (181, 204, 304) is detected (1040) contemporaneously with the first input. A separation line across the visual object is determined (1050) so as to define a first portion and a second portion of the visual object. A change in the position of the second input is identified (1060). A change in a display characteristic of the first portion relative to the second portion is controlled (1070) in accordance with the identified change in the position of the second input.

Claims

1. A method of interfacing with a display device, said method comprising steps of:

displaying at least two visual objects on a display device;

detecting a single position of a first input contacting the display device,

selecting a first displayed visual object based on the single position of the first input;

detecting a single position of a second input contacting the display device;

defining a first portion and a second portion of the first displayed visual object;

identifying a change in the single position of the second input;

controlling a change in a display characteristic of the first portion relative to the second portion of the first displayed visual object in accordance with the identified change in the single position of the second input;

detecting a movement of a second displayed visual object on the display device; and

detecting a relative z-order of the first displayed visual object and the second displayed visual object in accordance with the detected movement of the second displayed visual object relative to the changed display characteristic of the first portion of the first displayed visual object.

2. The method as claimed in claim 1, wherein the second input contacts the display device in a region of an edge of the first displayed visual object.

3. The method as claimed in claim 1, wherein a separation line across the first displayed visual object defines the first portion and the second portion of the first displayed visual object, the separation line being substantially perpendicular to an axis extending through at least the first input.

4. The method as claimed in claim 1, wherein the display characteristic defines an ordering of two or more visual objects displayed on the input display device in a z-order axis perpendicular to a plane of the display of the display device.

5. The method as claimed in claim 1, wherein a gesture is performed by two or more inputs to the display device.

6. The method as claimed in claim 1, wherein any of a user'"'"'s fingers is used to contact the display device.

7. The method as claimed in claim 6, wherein a user contacts said display device to provide said first input and the second input using one or more hands.

8. The method as claimed in claim 1, wherein each of the at least two visual objects is a digital image, a digital photograph, a bitmap, a photo album, or a page in a book.

9. The method as claimed in claim 1, wherein the second input contacting the display device is within a region of the first displayed visual object.

10. The method as claimed in claim 1, further comprising a step of detecting a single position of at least a third input contacting the display device contemporaneously with the first input.

11. The method as claimed in claim 10, wherein said second input and the third input contacting said display device are translated.

12. The method as claimed in claim 1, wherein a further visual object is displayed being at least partly overlaid by said first displayed visual object.

13. The method as claimed in claim 1, further comprising a step of performing an animated peel back of a portion of the first displayed visual object dependent upon said second input being translated.

14. The method as claimed in claim 13, wherein an underlying object is at least partly displayed by said animated peel back.

15. The method as claimed in claim 13, wherein a portion of an underside of the first displayed visual object is displayed by said animated peel back.

16. The method as claimed in claim 13, wherein the display characteristic is represented as a fold in the first displayed visual object, the first portion being flat and the second portion being folded.

17. The method as claimed in claim 1, wherein the display device is a multi-point input display device.

18. The method as claimed in claim 1, wherein the single position of the second input contacting the display device is detected contemporaneously with the first input.

19. An apparatus for interfacing with a display device, comprising:

a memory for storing data and a computer program; and

a processor coupled to the memory for executing the computer program, said memory and said processor configured to interface with the display device, the computer program comprising;

code for displaying at least two visual objects on a display device;

code for detecting a single position of a first input contacting the display device;

code for selecting a first displayed visual object based on the single position of the first input;

code for detecting a single position of a second input contacting the display device;

code for defining a first portion and a second portion of the first displayed visual object;

code for identifying a change in the single position of the second input;

code for controlling a change in a display characteristic of the first portion relative to the second portion of the first displayed visual object in accordance with the identified change in the single position of the second input;

detecting a movement of a second displayed visual object on the display device; and

detecting a relative z-order of the first displayed visual object and the second displayed visual object in accordance with the detected movement of the second displayed visual object relative to the changed display characteristic of the first portion.

20. A non-transitory computer readable storage medium having recorded thereon a computer program for interfacing with a display device, the computer program comprising:

code for displaying at least two visual objects on a display device;

code for detecting a single position of a first input contacting the display device,

code for selecting a first displayed visual object based on the single position of the first input;

code for detecting a single position of a second input contacting the display device;

code for defining a first portion and a second portion of the first displayed visual object;

code for identifying a change in the single position of the second input;

code for controlling a change in a display characteristic of the first portion relative to the second portion of the first displayed visual object in accordance with the identified change in the single position of the second input;

detecting a movement of a second displayed visual object on the display device; and

detecting a relative z-order of the first displayed visual object and the second displayed visual object in accordance with the detected movement of the second displayed visual object relative to the changed display characteristic of the first portion of the first displayed visual object.

21. A method of interfacing with a display device to change a z-order of a plurality of visual objects displayed on the display device, said method comprising steps of:

detecting a single position of a first input contacting the display device,

selecting a first displayed visual object based on the single position of the first input;

detecting a single position of a second input contacting the display device;

determining a separation line based on the single position of the second input, said separation line separating the selected first displayed visual object into a first portion and a second portion; and

controlling the z-order of the selected first displayed visual object relative to a second displayed visual object that is moved toward the selected first displayed visual object based on a movement of the second displayed visual object relative to the separation line.