System and method for detecting the position of an actuation member on a display screen

• US 9,965,070 B2
• Filed: 01/14/2014
• Issued: 05/08/2018
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: Commissariat a L'Energie Atomique (French Alternative Energies and Atomic Energy Commission), ISORG SA
• Original Assignee: Commissariat a L'Energie Atomique (French Alternative Energies and Atomic Energy Commission), ISORG SA
• Inventors: Vaillant, Jrme
• Primary Examiner(s): Dinh, Duc
• Application Number:
  US14/760,730
• Publication Number:
  US 20150355784A1
• Time in Patent Office: 1,575 Days
• Field of Search: 345173-175, 345181
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

The invention relates to a method including the steps of: displaying first successive images on a screen; acquiring at least one second image; searching for the position of at least one actuation member relative to the screen based on an analysis of the second image; and modifying at least one of the next first images to be displayed if conditions of determination of the position of the actuation member in the second image are only partially fulfilled.

Claims

1. A method comprising the steps of:

displaying successive first images on a screen;

acquiring at least one second image, the second image being a color image comprising at least two sub-images associated with different colors;

searching for a position of at least one actuation member relative to the screen based on a detection, in each sub-image, of a reflection of the first image by the actuation member or a shadow of the actuation member by determining whether conditions of determination of the position of the actuation member in the second image are fulfilled, the conditions of determination of the position of the actuation member being fulfilled if the reflection of the first image by the actuation member is detected at a same position in each sub-image or if the shadow of the actuation member is detected at the same position in each sub-image; and

modifying at least one of next first images to be displayed if the conditions of determination of the position of the actuation member in the second image are only partially fulfilled, the conditions of determination of the position of the actuation member being only partially fulfilled if the reflection of the first image by the actuation member is detected in at least one of the sub-images and is not detected in all sub-images or if the shadow of the actuation member is detected in at least one of the sub-images and is not detected in all sub-images.

2. The method of claim 1, wherein the second image corresponds to the image of light reaching the screen.

3. The method of claim 1, wherein an intensity of at least certain pixels of the next first image to be displayed is increased or decreased.

4. The method of claim 1, wherein a portion only of the next first image to be displayed is modified.

5. The method of claim 1, comprising searching in each sub-image for at least one first given pattern representative of the reflection of the first image by the actuation member.

6. The method of claim 1, comprising searching in each sub-image for at least one second given pattern representative of the shadow of the actuation member.

7. A system comprising:

a screen for displaying successive first images;

a device of acquisition of at least one second image, the second image being a color image comprising at least two sub-images associated with different colors;

a device for searching for a position of at least one actuation member relative to the screen based on a detection, in each sub-image, of a reflection of the first image by the actuation member or a shadow of the actuation member by determining whether conditions of determination of the position of the actuation member in the second image are fulfilled, the conditions of determination of the position of the actuation member being fulfilled if the reflection of the first image by the actuation member is detected at a same position in each sub-image or if the shadow of the actuation member is detected at the same position in each sub-image; and

a device for modifying the next first images to be displayed if conditions of determination of the position of the actuation member in the second image are only partially fulfilled, the conditions of determination of the position of the actuation member being only partially fulfilled if the reflection of the first image by the actuation member is detected in at least one of the sub-images and is not detected in all sub-images or if the shadow of the actuation member is detected in at least one of the sub-images and is not detected in all sub-images.

8. The system of claim 7, wherein the acquisition device comprises an array of photon sensors, wherein the screen comprises an array of light display pixels and wherein the array of photon sensors covers the screen or is integrated to the display pixel array.