Interactive input system and method of detecting objects

• US 9,323,322 B2
• Filed: 02/04/2013
• Issued: 04/26/2016
• Est. Priority Date: 02/02/2012
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: McGibney, Grant
• Primary Examiner(s): Bukowski, Kenneth
• Application Number:
  US13/758,592
• Publication Number:
  US 20130201100A1
• Time in Patent Office: 1,177 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

A method comprises capturing image frames of an input area using a plurality of imaging devices, each having a field of view encompassing at least a portion of the input area; processing captured image frames to identify a plurality of targets therein; analyzing the identified plurality of targets to determine if the targets represent a plurality of projections of an input object; and if so, identifying a pattern of the projections thereby to identify the input object.

Claims

1. A method comprising:

capturing image frames of an input area using a plurality of imaging devices, each imaging device having a field of view encompassing at least a portion of the input area;

processing captured image frames to identify a plurality of targets therein;

analyzing the identified plurality of targets to determine when the targets represent a plurality of physical projections extending from a body of a user manipulatable input object, the body of the user manipulatable input object being outside of the fields of view of the imaging devices and not appearing in captured image frames; and

when the targets represent the plurality of physical projections extending from the body of the user manipulatable input object, identifying a pattern of the projections thereby to identify the user manipulatable input object.

2. The method of claim 1, wherein during said analyzing, the location of each of said projections is resolved and wherein during said identifying, the pattern of the projections is identified based on the resolved locations.

3. The method of claim 2, further comprising analyzing the identified pattern to determine an orientation of the input object with respect to the input area.

4. The method of claim 3, further comprising calculating the location of the input object with respect to the input area.

5. The method of claim 2, further comprising calculating the location of the input object with respect to the input area.

6. The method of claim 1, further comprising calculating the location of the input object with respect to the input area.

7. The method of claim 1, wherein said identifying comprises comparing the pattern to a set of predefined patterns.

8. The method of claim 7, further comprising calculating the location of the input object with respect to the input area.

9. The method of claim 8, further comprising analyzing the identified pattern to determine an orientation of the input object with respect to the input area.

10. The method of claim 2, wherein said analyzing comprises examining a configuration of said targets to determine if said targets represent the plurality of projections of said input object.

11. The method of claim 10, wherein said examining comprises determining if said targets are fixed distances from one another.

12. The method of claim 10, wherein said examining comprises determining if said targets remain fixed distances from one another during movement of said input object.

13. The method of claim 10, wherein said examining comprises determining if said targets have predetermined widths.

14. The method of claim 13, wherein said predetermined widths are widths below a threshold.

15. The method of claim 10, further comprising calculating the location of the input object with respect to the input area.

16. The method of claim 15, further comprising analyzing the identified pattern to determine an orientation of the input object with respect to the input area.

17. The method of claim 1, wherein said analyzing comprises examining a configuration of said targets to determine if said targets represent the plurality of projections of said input object.

18. The method of claim 17, wherein said examining comprises determining if said targets are fixed distances from one another.

19. The method of claim 17, wherein said examining comprises determining if said targets remain fixed distances from one another during movement of said input objects.

20. The method of claim 17, wherein said examining comprises determining if said targets have predetermined widths.

21. An interactive input system comprising:

a plurality of imaging devices having at least partially overlapping fields of view encompassing an input area and configured to capture image frames; and

processing structure configured to process image frames captured by the imaging devices to identify a plurality of targets, analyze the identified plurality of targets to determine when the targets represent a plurality of physical projections extending from a body of a user manipulatable input object, the body of the user manipulatable input object being outside of the fields of view of the imaging devices and not appearing in captured image frames, and when the targets represent the plurality of physical projections extending from the body of the user manipulatable input object, identify a pattern of the projections thereby to identify the user manipulatable input object.

22. The interactive input system of claim 21, wherein the processing structure is configured to analyze the identified pattern to determine an orientation of the input object with respect to the input area.

23. The interactive input system of claim 21, wherein the processing structure is configured to calculate the location of the object with respect to the input area.

24. The interactive input system of claim 21, wherein the processing structure is configured to compare the pattern to a pattern set.

25. The interactive input system of claim 21, wherein the processing structure, during the analyzing, is configured to examine a configuration of said targets to determine if said targets represent the plurality of projections of said input object.

26. The interactive input system of claim 25, wherein said processing structure, during the examining, is configured to determine if said targets are fixed distances from one another.

27. The interactive input system of claim 25, wherein said processing structure, during said examining, is configured to determine if said targets remain fixed distances from one another during movement of said input object.

28. The interactive input system of claim 25, wherein said processing structure, during said examining, is configured to determine if said targets have predetermined widths.

30. The interactive input system of claim 21, further comprising said input object and wherein said projections are pins have predetermined widths.

31. The interactive input system of claim 30, wherein said pins are arranged in subgroups, the pins of each subgroup having different shapes.

32. The interactive input system of claim 30, wherein said body has a geometric shape.

29. A non-transitory computer readable medium embodying a computer program for execution by a computing device to perform a method of identifying at least one input object, the computer program comprising:

program code for processing image data from captured image frames to identify a plurality of targets;

program code for analyzing the plurality of targets to determine when the targets represent a plurality of physical projections extending from a body of a user manipulatable input object, the body of the user manipulatable input object being outside of fields of view of imaging devices capturing the image frames and not appearing in captured image frames; and

program code for identifying a pattern of the projections thereby to identify the user manipulatable input object when the targets represent the plurality of physical projections extending from the body of the user manipulatable input object.