METHOD FOR OBTAINING 3D POSITION INFORMATION, COMPUTER PROGRAM, DATA PROCESSOR, AND DISPLAY PANEL INCORPORATING THE SAME

• US 20120050258A1
• Filed: 08/27/2010
• Published: 03/01/2012
• Est. Priority Date: 08/27/2010
• Status: Abandoned Application

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: KAY, Andrew, PRYCE-JONES, Glyn Barry
• Application Number:
  US12/869,959
• Publication Number:
  US 20120050258A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A method for obtaining three-dimensional (3D) position information of one or more user-controlled objects positioned above a display panel, the display panel providing a plurality of two-dimensional (2D) directional views of the user-controlled objects from corresponding different directions. The method includes the steps of: detecting the presence of 2D objects within each of the directional views, and estimating corresponding 2D position information; estimating 3D position information for one or more 3D objects which would account for the detected 2D objects within the directional views; determining quality measures for the estimated 2D position information and/or the estimated 3D position information; and determining 3D position information of the one or more user-controlled objects as a function of the estimated 3D position information and the quality measures.

Claims

1. A method for obtaining three-dimensional (3D) position information of one or more user-controlled objects positioned above a display panel, the display panel providing a plurality of two-dimensional (2D) directional views of the user-controlled objects from corresponding different directions, the method comprising the steps of:

detecting the presence of 2D objects within each of the directional views, and estimating corresponding 2D position information;

estimating 3D position information for one or more 3D objects which would account for the detected 2D objects within the directional views;

determining quality measures for the estimated 2D position information and/or the estimated 3D position information; and

determining 3D position information of the one or more user-controlled objects as a function of the estimated 3D position information and the quality measures.

2. The method according to claim 1, wherein the step of determining quality measures comprises determining quality measures of the 2D objects detected in the detecting step, and the step of estimating the 3D position information estimates the 3D position information as a function of the quality measures of the 2D objects.

3. The method according to claim 2, wherein the quality measures of the 2D objects are a function of an area of the corresponding 2D object.

4. The method according to claim 2, wherein the quality measures of the 2D objects are a function of an aspect ratio of the corresponding 2D object.

5. The method according to claim 2, wherein the quality measures of the 2D objects are a function of location of the corresponding 2D object relative to a border of the directional view within which the 2D object is detected.

6. The method according to claim 1, wherein the step of determining quality measures comprises determining quality measures of the 3D objects of which the 3D positions are estimated, and the step of determining 3D position information of the one or more user-controlled objects determines the 3D position information as a function of the quality measures of the 3D objects.

7. The method according to claim 6, wherein the quality measure of a 3D object which would account for the detected 2D objects within the directional views is a function of consistency of position of the detected 2D objects in relation to at least one of the 2D dimensions.

8. The method according to claim 6, wherein the quality measure of a 3D object which would account for the detected 2D objects within the directional views is a function of similarity of at least one of size and shape of the detected 2D objects.

9. The method according to claim 6, wherein the step of determining 3D position information of the one or more user-controlled objects determines the 3D position information by weighting the estimated 3D position information of the 3D objects by the corresponding quality measures.

10. The method according to claim 1, wherein in the step of determining 3D position information of the one or more user-controlled objects the estimated 3D position information for a plurality of 3D objects is subjected to a clustering algorithm.

11. The method according to claim 1, wherein the step of estimating 3D position information for one or more 3D objects which would account for the detected 2D objects within the directional views comprises pairing each 2D object detected in a given one of the directional views with each 2D object detected in the other directional views and estimating, for each pairing, 3D position information for a 3D object which would account for the paired 2D objects.

12. The method according to claim 1, wherein the step of determining 3D position information of the one or more user-controlled objects comprises subjecting the estimated 3D position information obtained from the pairings to a clustering algorithm.

13. The method according to claim 1, wherein the step of detecting the presence of 2D objects within each of the directional views, and estimating corresponding 2D position information comprises at least one filtering step.

14. The method according to claim 1, wherein the step of estimating 3D position information for one or more 3D objects which would account for the detected 2D objects within the directional views comprises at least one filtering step.

15. A computer program stored on a non-transitory machine readable medium, the computer program when executed by a data processor causing the data processor to carry out the method recited in claim 1.

16. A data processor configured to carry out the method recited in claim 1.

17. A display panel, comprising:

a sensor array layer which provides a plurality of two-dimensional (2D) directional views from different directions of one or more user-controlled objects above the display panel; and

a data processor configured to carry out the steps of;

detecting the presence of 2D objects within each of the directional views, and estimating corresponding 2D position information;

estimating 3D position information for one or more 3D objects which would account for the detected 2D objects within the directional views;

determining quality measures for the estimated 2D position information and/or the estimated 3D position information; and

determining 3D position information of the one or more user-controlled objects as a function of the estimated 3D position information and the quality measures.