Three dimensional tangible interface for interacting with spatial-temporal data using infrared light sources and infrared detectors

• US 7,181,362 B2
• Filed: 04/16/2004
• Issued: 02/20/2007
• Est. Priority Date: 04/16/2003
• Status: Expired due to Fees

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Ishii, Hiroshi, Wang, Yao, Piper, Benjamin Tarquinn Fielding, Biderman, Assaf, Ratti, Carlo Filippo
• Primary Examiner(s): Barlow, Jr.; John E.
• Assistant Examiner(s): Bhat; Aditya S.
• Application Number:
  US10/825,702
• Publication Number:
  US 20050013477A1
• Time in Patent Office: 1,040 Days
• Field of Search: 702/152, 702/159
• US Class Current: 702/152
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/008 Cut plane or projection plane definition
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects

Abstract

An interface that allows a user to model and analyze the properties of three dimensional surface and the regions surrounding such surfaces. The user manipulates a deformable bed of translucent glass beads that defines the geometry of a surface. An array of light emitting diodes underneath the beads transmits infrared light upwardly through the beads such that the intensity of radiation from each position on the surface of the beads is related to the depth of the beads at that position. A digital camera captures radiation image data which is then processed to create elevation data specifying the geometry of the surface. A processor processes the elevation data using a selected analysis function to produce result data representing computed characteristics of the surface or its surrounding region. The result data is projected as an image onto the surface of the beads. The interface permits the user to modify a surface geometry and directly visualize the characteristics of the modified geometry in real time.

Claims

1. Apparatus for modeling and evaluating the characteristics of three-dimensional forms which comprises, in combination,

a deformable translucent material that may be easily manually shaped to define a surface that can be shaped and once shaped retains its shape,

means for transmitting electromagnetic energy through said material to produce radiation from individual regions of said surface, said radiation from each given one of said regions having an intensity that is related to the position of said given region,

means for measuring the intensity of said radiation to produce surface geometry data indicative of the shape and position of said surface, means for processing said surface geometry data to generate result data which specifies one or more characteristics of said surface at different points on or near said surface, and

means for projecting an image corresponding to said result data onto said surface.

2. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said deformable material comprises a bed of translucent beads.

3. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said deformable material is supported on a rotatable turntable.

4. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said means for measuring is a three-dimensional optical distance measuring device.

5. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said means for measuring is a camera for capturing a radiation image produced by said radiation from individual regions of said surface.

6. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 5 wherein electromagnetic energy is infrared light energy.

7. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 5 wherein said means for projecting an image corresponding to said result data is located near said camera.

8. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 7 wherein said deformable material is a bed of translucent beads that is illuminated from beneath by a source of said electromagnetic energy and wherein said camera and said means for projecting an image are both located above said bed of translucent beads.

9. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 5 wherein said camera produces digital image data.

10. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 9 wherein said means for measuring the intensity of said radiation further comprises means for converting said digital image data into said surface geometry data.

11. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 10 wherein said means for converting said digital image data into said surface geometry data further comprises means for compensating for the nonlinear relationship between the intensity of the radiation for each given one of said regions and the position of said given region.

12. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 9 wherein camera produces a sequence of radiation image data captured at different exposure times and wherein said means for measuring the intensity of said radiation further comprises means for combining said sequence of radiation image data to produce said surface geometry data.

13. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 12 further comprises means for compensating for the nonlinear relationship between the intensity of the radiation for each given one of said regions and the position of said given region.

14. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said means for processing said surface data comprises means for translating said surface geometry data into a standard geometry format and means for selecting and executing an analysis routine from a library of available analysis routines for processing said data in said first standard form to generate said result data.

15. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 14 wherein said means for processing further comprises means for representing said result data in a standard graphical display format and for thereafter processing said result data in said standard graphical display format into image data supplied to said means for projecting an image corresponding to said result data onto said surface.

16. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 14 wherein means for processing includes means for generating different sets of result data using corresponding ones of said available analysis routines, and wherein said means for projecting projects a plurality of images concurrently, each of which corresponds to one of said sets of result data, whereby a user can simultaneously view different characteristics of said said surface.

17. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said means for processing further comprises means for representing said result data in a standard graphical display format and for thereafter processing said result data in said standard graphical display format into image data supplied to said means for projecting an image corresponding to said result data onto said surface.

18. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 wherein said surface geometry data comprises an array of values each of which specifies the elevation of said surface at a particlular location in two-dimensional array of locations.

19. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 18 wherein said surface geometry data conforms to the Digital Elevation Model for representing topgraphical data.

20. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 19 wherein said means for processing said surface geometry data comprises means for selecting and executing a routine in a library of routines for processing said data into result data.

21. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 20 wherein said surface is a topological landscape surface and wherein said library includes for generating result data which specifies characteristics of said surface selected from a group consisting of:

slope, curvature. shadowing, solar radiation, field of view, cost of passage, water flow and land erosion characteristics.

22. Apparatus for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 1 further comprising means for storing said result data as a voxel dataset representing the characteristics of said surface and a three dimensional region surrounding said surface, means for measuring the position of a second surface, and means for projecting an image corresponding to a selected portion of said voxel dataset defined by the position of said second surface relative to said first surface.

23. The method for modeling and evaluating the characteristics of three-dimensional forms which comprises, in combination, the steps of:

manually shaping a deformable translucent material with ease to define a surface model that can be shaped and once shape retains its shape,

transmitting electromagnetic energy through said material to produce radiation from individual regions of said surface model, said radiation from each given one of said regions having an intensity that is related to the position of said given region,

measuring the intensity of said radiation to produce shape data indicative of the shape and position of said surface model,

processing said shape data to generate result data which specifies one or more characteristics of said surface model at different points on or near said surface, and

projecting an image corresponding to said result data onto said surface model.

24. The method for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 23 wherein said deformable translucent material is a bed of translucent beads.

25. The method for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 24 wherein said step of transmitting said electromagnetic energy comprises transmitting infrared light through said material from an array of light emitting diodes positioned beneath said bed of translucent beads.

26. The method for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 25 wherein said step of measuring the intensity of said radiation to produce shape data comprises using a digital camera to capture digital image data representing the intensity of said radiation.

27. The method for modeling and evaluating the characteristics of three-dimensional forms as set forth in claim 26 wherein said step of using said digital camera comprises capturing a sequence of radiation image data taken at differing exposure times and combining said sequence of radiation image data to produce composite image data having a greater dynamic range.