3D interactive input system and method

• US 8,860,688 B2
• Filed: 03/02/2011
• Issued: 10/14/2014
• Est. Priority Date: 03/02/2011
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Tse, Edward, Weinmayr, Patrick, Kroeker, Wallace I., Popovich, David G.
• Primary Examiner(s): BOYD, JONATHAN A
• Application Number:
  US13/038,810
• Publication Number:
  US 20120223909A1
• Time in Patent Office: 1,322 Days
• Field of Search: 345/174, 345/419
• US Class Current: 345/174
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A three-dimensional (3D) interactive input system comprises a holographic image generator defining an enclosed space to accommodate a 3D object and configured to generate a holographic image of the 3D object that appears adjacent an input region of the holographic image generator. A projection unit is configured to project image data onto the 3D object, the image data projected onto the 3D object appearing on the holographic image. A sensing unit is configured to detect user proximity to the input region. Processing structure is configured to process sensing unit output and in response, update image data projected by the projection unit.

Claims

1. A three-dimensional (3D) interactive input system comprising:

a holographic image generator defining an enclosed space to accommodate a 3D object and configured to generate a holographic image of the 3D object that appears adjacent an input region of said holographic image generator;

a projection unit configured to project image data onto the 3D object, the image data projected onto the 3D object appearing on said holographic image;

a sensing unit configured to detect user proximity to the input region;

processing structure configured to process sensing unit output and in response, update image data projected by the projection unit;

wherein said processing structure processes sensing unit output to recognize user input gestures and in response, updates image data projected by the projection unit;

wherein said holographic image generator comprises a pair of opposing, generally concave mirrors having facing reflected surfaces and defining the enclosed space therebetween, said 3D object being positioned adjacent the center of one of said mirrors, the other of said mirrors having an opening therein adjacent the center thereof at which said holographic image appears, the opening defining said input region;

wherein the sensing unit comprises a plurality of capacitive sensors positioned circularly around the perimeter of the input region;

and wherein the sensors are oriented in a spiral pattern.

2. The 3D interactive input system of claim 1 wherein said user input gestures comprise at least one of finger movement, hand movement and fist movement adjacent said input region.

3. The 3D interactive input system of claim 2 wherein said processing unit updates image data projected by the projection unit such that the holographic image is manipulated in a manner consistent with user movement adjacent said input region.

4. The 3D interactive input system of claim 1 wherein the projection unit comprises a projector and at least one lens element, said at least one lens element receiving image data projected by said projector and directing the image data onto the surface of the 3D object.

5. The 3D interactive input system of claim 4 wherein said at least one lens element is a fisheye lens.

6. The 3D interactive input system of claim 1 wherein the image data represents texture on the 3D object.

7. The 3D interactive input system of claim 1 wherein the image data represents a plurality of possible answers to a question.

8. The 3D interactive input system of claim 3 wherein said processing structure compares user input gestures with a library to recognize the user input gestures and updates image data projected by the projection unit when user input gestures are recognized.

9. The 3D interactive input system of claim 1 further comprising a 3D object positioning unit configured to position the 3D object in the enclosed space.

10. The 3D interactive input system of claim 9 wherein said 3D object positioning unit supports a plurality of 3D objects and is actuable to position a selected one of said 3D objects in said enclosed space.

11. The 3D interactive input system of claim 10 wherein the one mirror has an opening therein adjacent the center thereof, said 3D object positioning unit inserting the selected 3D object through the opening in said one mirror and into the enclosed space.

12. The 3D interactive input system of claim 11 wherein said 3D object positioned unit comprises a carousel that is rotatable to align the selected 3D object with the opening in said one mirror.

13. The 3D interactive input system of claim 12 wherein said carousel is moveable towards and away from said one mirror to insert and remove the 3D object from the enclosed space.

14. A method comprising:

projecting image data onto a 3D object positioned within a holographic image generator, the projected image data appearing on a holographic image of the 3D object generated by said holographic image generator;

detecting user input gestures made proximate the holographic image by sensing unit;

updating the image data projected on the 3D object based on detected user input gestures, thereby to manipulate the holographic image;

processing sensing unit output to recognize user input gestures and in response, updating projected image;

wherein said holographic image generator comprises a pair of opposing, generally concave mirrors having facing reflected surfaces and defining the enclosed space therebetween, said 3D object being positioned adjacent the center of one of said mirrors, the other of said mirrors having an opening therein adjacent the center thereof at which said holographic image appears, the opening defining said input region;

wherein the sensing unit comprises a plurality of capacitive sensors positioned circularly around the perimeter of the input region;

and wherein the sensors are oriented in a spiral pattern.

15. The method of claim 14 wherein the detecting comprise detecting user proximity and movement adjacent an input region proximate said holographic image to recognize user input gestures.

16. The method of claim 14 wherein the image data is manipulated in a manner consistent with user movement adjacent the holographic image.