Method and system for free-space imaging display and interface

• US 6,857,746 B2
• Filed: 05/07/2003
• Issued: 02/22/2005
• Est. Priority Date: 07/01/2002
• Status: Expired due to Fees

• Current Assignee: IO2 Technology LLC
• Original Assignee: IO2 Technology LLC
• Inventors: Dyner, Chad D.
• Primary Examiner(s): Nguyen, Judy
• Assistant Examiner(s): BLACKMAN, ROCHELLE ANN J
• Application Number:
  US10/430,977
• Publication Number:
  US 20040001182A1
• Time in Patent Office: 657 Days
• Field of Search: 353/28, 353/62, 353/122, 359/443, 359/460, 239/16, 239/18, 239/20, 239/275, 239/519, 239/523, 239/524, 239/522, 239/590.5
• US Class Current: 353/28
• CPC Class Codes: G03B 21/608 Fluid screens
• CPC Class Codes: G09F 19/18 involving the use of optical projection means, e.g. projection of images on clouds projection apparatus per se G03B

Abstract

This invention comprises a method and system for displaying free-space, full color, high-resolution video or still images while simultaneously enabling the user to have real-time direct interaction with the visual images. The system comprises a self-generating means for creating a dynamic, non-solid particle cloud by ejecting atomized condensate present in the surrounding air, in a controlled fashion, into an invisible particle cloud. A projection system consisting of an image generating means and projection optics, projects an image onto the particle cloud. Any physical intrusion, occurring spatially within the image region, is captured by a detection system and the intrusion information is used to enable real-time user interaction in updating the image. This input/output (I/O) interface provides a display and computer link, permitting the user to select, translate and manipulate free-space floating visual information beyond the physical constraints of the device creating the image.

Claims

1. A system for creating a free-space display comprising a heat pump, means to introduce ambient air through the heat pump, means to create a thermal differential in the heat pump, means to extract condensate from the ambient air using the thermal differential, means to pass the condensate into an expansion chamber, means to atomize the condensate in the expansion chamber to create particle cloud material, ejection nozzle means to eject the particle cloud material into the air to create a particle cloud screen, means to eject a parallel laminar air stream enclosing the particle cloud, means to generate an image or images, projection means to project an image or images onto the particle cloud screen.

3. The system of claim 1 or 2 in which the heat pump comprises a compressor based reverse-cycle cooling dehumidification system.

4. The system of claim 1 or 2 in which the heat pump comprises a thermoelectric Peltier-junction based system.

5. The system of claim 1 or 2 in which heat pump comprises a fuel cell or means to use cooled gases or liquids.

6. The system of claim 1 or 2 further comprising a holding vessel for collection of the condensate.

7. The system of claim 1 or 2, further comprising means to atomize the condensate into a microscopic particle cloud of individual particulates with a mean diameter of 1 to 10 microns.

8. The system of claim 1 or 2, further comprising means to atomize the condensate into a microscopic particle cloud of individual particulates with a mean diameter greater than 10 microns.

9. The system of claim 1 or 2, in which the atomization means comprises electro-mechanical or ultrasonic means.

10. The system of claim 1 or 2 further comprising fluorescence tracers or dyes in the particle cloud.

11. The system of claim 1 or 2, further comprising a co-linear ejection nozzle to eject the particles into the air to create a co-linear ejected particle cloud.

12. The system of claim 11 comprising an ejection nozzle of a geometry corresponding to the depth and width of the particle cloud screen, where the third dimension is the extruded particle cloud ejection distance.

13. The system of claim 1 or 2, in which the ejected particles generate a laminar, semi-laminar or turbulent particle cloud.

14. The system of claim 1 or 2, in which the particle cloud comprises an invisible, near invisible or visible particle cloud.

15. The system of claim 1 or 2, in which the particle cloud comprises a medium to reflect, refract and transmit light or images from a projection source directed at said particle cloud.

16. The system of claim 1 or 2, in which the particle cloud comprises a medium with a higher transmissive illumination coefficient than a reflective and refractive illumination coefficient.

17. The system of claim 1 or 2 in which the means to create the laminar airflow comprises parallel linear baffles, vents, meshes or a combination thereof with fans or blowers disposed at the opposite orifice end of the laminar airflow.

18. The system of claim 17 in which the means to create the laminar airflow comprises a series of stacked parallel, linear baffles, vents, or meshes with the fan or blower at one orifice end, and laminar airflow at the other orifice end.

19. The system of claim 18 further comprising a single air space or plurality of air spaces between the baffles, vents, or meshes, to create a velocity equalization chamber.

20. The system of claim 1 or 2 further comprising means to monitor the visibility of the particle cloud screen.

21. The system of claim 20 further comprising light emitting means and light detecting means directed towards each other, with the particle cloud between the light emitting means and light detecting means to measure the light transmissivity and reflectivity of the particle cloud screen.

22. The system of claim 21 in which the light emitting means comprises a light emitting diode or laser and the light detecting means comprises a photo-detector.

23. The system of claim 20 further comprising an ambient particulate counter to monitor the particulate count of the particle cloud screen.

24. The system of claim 20 further comprising means to monitor the ambient humidity, ambient temperature and ambient luminosity.

25. The system of claim 20 in which responsive to the monitored data environmental management control means regulates the ejection velocity of the particle cloud material, the particle cloud manufacturing intensity, or a combination thereof to maximize particle cloud invisibility.

26. The system of claim 25 in which the environmental management control means regulates ejection velocity by utilizing fan speed control means.

27. The system of claim 1 or 2 in which the image generating means creates a still or video image.

28. The system of claim 27 further comprising utilizing polarized, random, coherent, visible or invisible wavelengths of light combined with the image generating means to create an image projector.

29. The system of claim 27 in which said image-generating means comprises a liquid crystal display, digital light processing panel, organic light emitting diode, optical modulation or a laser scanner.

30. The system of claim 1 or 2 comprising a single projector means directed and aligned towards the particle cloud screen for imaging.

31. The system of claim 1 or 2 comprising a plurality of projectors directed towards the particle cloud screen for imaging.

32. The system of claim 1 or 2 further comprising a single projector or plurality of projectors which comprise optical or electronic anamorphic keystone imaging distortion correction for one or more axis.

33. The system of claim 1 or 2 further comprising optical means to collimate a projection beam towards a phantom source, said optical means comprising beam steering or reflecting means surrounding the particle cloud, that redirect the projection beam onto said particle cloud.

34. The system of claim 1 or 2 further comprising a single projector or plurality of projectors which comprise optical or electronic anamorphic keystone focal distance correction for one or more axis.

35. The system of claim 1 or 2 comprising a single projection means, means to direct a projection beam towards a single or plurality of phantom sources, said means to direct the projection beam comprising beam steering or reflecting means surrounding the particle cloud that redirect the beam towards said particle cloud.

36. The system of claim 35 comprising multiple projection beam-splitting, beam-steering, beam-beam chopping or a combination thereof to divide the projection image into a plurality of projection beams.

37. The system of claim 36 further comprising beam splitters, polka dot splitters, band-pass filters, wedge prisms, prisms, static mirrors, rotating mirrors, digital light processing, electronic or physical shutters, optical choppers, or a combination thereof to split the projection beam into a plurality of beams aimed towards a plurality of phantom redirecting sources surrounding the particle cloud.

38. The system of claim 1 or 2 comprising means to project identical images or discrete images from discrete or identical sources towards the particle cloud to compose similar or discrete images on said particle cloud.

55. The system of claim 1 or 2 further comprising an aspirator disposed at the end of the particle cloud trajectory, to collect condensate and means to transfer the condensate to the expansion chamber for particle cloud manufacturing.

56. The system of claim 55 further comprising a heat pump with the aspirator.

2. A system for creating a free-space display comprising a heat pump, means to introduce ambient air through the heat pump, means to create a thermal differential in the heat pump, means to extract condensate from the ambient air using the thermal differential, means to pass the condensate into an expansion chamber, means to atomize the condensate in the expansion chamber to create particle cloud material, ejection nozzle means to eject the particle cloud material into the air to create a particle cloud screen, means to eject a parallel laminar air stream enclosing the particle cloud, means to generate an image or images, projection means to project an image or images onto the particle cloud screen, detection means located adjacent to the particle cloud screen and adapted to capture intrusion within or adjacent to the projected image, means to read the location of each intrusion, means to send the intrusion location information to a controller, means to modify the image generator means in response to the intrusion location information.

39. The system of claim 2 further comprising a visible or invisible illumination source directed at the particle cloud region for user input tracking.

40. The system of claim 39, in which the illumination source comprises a halogen lamp, incandescent lamp, light emitting diode or laser.

41. The system of claim 40 in which the illumination source produces light in the infrared or near infrared spectrum.

42. The system of claim 2 in which the means to detect physical intrusion within the particle cloud comprises machine vision, optical capturing means comprising optical detectors and sensors, video cameras, complementary metal-oxide silicon sensors, or charged coupled devices.

43. The system of claim 42 further comprising a band-pass filter.

44. The system of claim 39 comprising a single illumination detection plane.

45. The system of claim 39 further comprising a plurality of illumination detection planes.

46. The system of claim 44 or 45 further comprising cylindrical lenses, collimating lenses, rotating faceted mirrors, or a combination thereof, to compose a single or plurality of detection planes.

47. The system of claim 2 comprising a plurality of detectors to track user input intrusion within the particle cloud in two or three-dimensional space.

48. The system of claim 42 further comprising means to communicate illuminated, detected positional data to a controller, processor or computer.

49. The system of claim 42 further comprising motion-tracking software to interpret illuminated, detected positional data to navigate within software application environments or graphic user environments.

50. The system of claim 49 in which the tracking software comprises blob recognition, crescent recognition or gesture recognition software.

51. The system of claim 49 further comprising noise filtering software.

52. The system of claim 49 further comprising navigation utilizing mouse emulation software.

53. The system of claim 49 comprising means to modify the projection generating means in response to the illuminated detection positional data registered by the detector, coupled with tracking software running mouse emulation software or navigation software to direct the operating system or software application controlling the projection software.

54. The system of claim 2 comprising a computer running tracking software projector content, for controlling the image projectors.

57. A method for creating a free-space display comprising dehumidifying air, capturing the humidity, atomizing the humidity to create particle cloud material one to ten microns in diameter, ejecting the particle cloud material to create a particle cloud, surrounding the particle cloud with a parallel laminar air stream microenvironment of equal or similar velocity and trajectory to the particle cloud, generating an image or images, projecting the image or images onto the particle cloud.

59. The method of claim 57 or 58 further comprising splitting the projected image or images into a plurality of projection beams, redirecting the plurality of projection beams and focusing said projection beams onto the particle cloud to create a free-space image.

61. The method of claim 57 or 58 comprising generating a differential temperature drop of 10 degrees or more Celsius between the heat pump and ambient air to extract condensate from the ambient air.

62. The method of claim 57 or 58, further comprising ejecting a laminar airflow microenvironment surrounding one or more parallel sides of said particle cloud screen to enhance boundary layer performance between the particle cloud screen and ambient air.

63. The method of claim 62 in which the laminar airflow microenvironment velocity and trajectory is the same or similar in velocity and trajectory to that of the particle cloud.

58. A method for creating an interactive free-space display comprising dehumidifying air, capturing the humidity, atomizing the humidity to create particle cloud material one to ten microns in diameter, ejecting the particle cloud material to create a particle cloud, surrounding the particle cloud with a parallel laminar air stream microenvironment of equal or similar velocity and trajectory to the particle cloud, generating an image or images, projecting the image or images onto the particle cloud, detecting an intrusion within or adjacent to the free-space display by detecting said intrusion to create trackable data and using the trackable data to computationally update the projection of the image.

60. A method for creating an interactive free-space display comprising dehumidifying air, capturing the humidity and ejecting it to re-humidify the air to create a surface or volume particle cloud comprising individual one to ten micron mean diameter particulates, surrounding the particle cloud with a microenvironment of equal or similar velocity, illuminating said cloud using an illumination source, passing the illumination onto, reflecting or passing through an image generating means to split projected images into a plurality of projection beams, redirecting projection beams and focusing said projection image from projection means onto the particle cloud to reflect, refract, and transmit light to generate a free-space image, detecting the intrusion of a physical object within or adjacent to the free-space image by video capture means by illuminating said intrusion and detecting said illumination in order to create trackable data and using the trackable data as input to computationally update the projection means.

64. The method of claim 60, in which the detection illumination coexists spatially and parallel to the particle cloud image region.

65. A system for creating a free-space display comprising a compressor-based condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the particle cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based upon the monitoring of the visibility of the particle cloud, an image projector directed towards and illuminating the particle cloud, to generate an image upon the particle cloud.

66. A system for creating a free-space display comprising a thermo-electric condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airatreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based on the monitoring of the visibility of the particle cloud, an image projector directed towards and illuminating the particle cloud, to generate an image upon the particle cloud.

67. A system for creating an interactive free-space display comprising a compressor-based condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the particle cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel arstreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based upon the monitoring of the visibility of the particle cloud, an image projector directed towards and illuminating the particle cloud, light emitters to create one or more planes of light parallel to or coplanar with the particle cloud, optical sensors to detect physical intrusion within the planes of light, position-tracking software to track physical intrusion in the planes of light for controlling the image projection within a graphic user environment.

68. A system for creating an interactive free-space display comprising a thermo-electric condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the particle cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based upon the monitoring of the visibility of the particle cloud, an image projector directed towards and illuminating the particle cloud, light emitters to create one or more planes of light parallel to or coplanar with the particle cloud, optical sensors to detect physical intrusion within the planes of light, position-tracking software to track physical intrusion in the planes of light for controlling the image projection within a graphic user environment.

69. A system for creating a free-space display comprising a compressor-based condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the particle cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based upon the monitoring of the visibility of the particle cloud, an image projector directed towards a plurality of mirrors to split and redirect the projected image towards locations surrounding the particle cloud and focus the projected image onto the particle cloud.

70. A system for creating free-space display comprising a thermo-electric condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detecors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based on the monitoring of the visibility of the particle cloud, an image projector directed towards a plurality of mirrors to split and redirect the projected image towards locations surrounding the particle cloud and focus the projected image onto the particle cloud.

71. A system for creating free-space display comprising a compressor-based condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the particle cloud into the air, battles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detectors directed towards each other with the particle cloud in between to monitor the visibility of the particle cloud, a system for controlling the quantity of ejected particle cloud based upon the monitoring of the visibility of the particle cloud, an image projector directed towards a plurality of mirrors to split and redirect the projected image towards locations surrounding the particle cloud and focus the projected image onto the particle cloud, light emitters to create one or more planes of light parallel to or coplanar with the particle cloud, optical sensors to detect physical intrusion within the plane of light, position-tracking software to track physical intrusion into the plane of light for controlling the image projection within a graphic user environment.

72. A system for creating a free-space display comprising a thermo-electric condensing system to extract condensate from air, a holding vessel for collecting the condensate, an opening in the holding vessel for introduction of additional liquid, an atomizer to generate a particle cloud of condensate in an expansion chamber, an expansion chamber, an ejection nozzle connected to the expansion chamber to eject the particle cloud into the air, fans connected to the expansion chamber to move the cloud into the air, baffles or vents parallel to and spaced from the ejection nozzle, fans disposed adjacent to the baffles or vents to blow air through the baffles or vents, enclosing the particle cloud with parallel airstreams, light emitters and light detectors directed towards each other with the particle cloud in between them to monitor the visibility of the particle cloud, a control system for the atomizer to control particle cloud conditions based on the monitoring of the visibility of the particle cloud, an image projector directed towards a plurality of mirrors to split and redirect the projected image towards locations surrounding the particle cloud and focus the projected image onto the particle cloud, light emitters to create one or more planes of light parallel to or coplanar with the particle cloud, optical sensors to detect physical intrusion within the plane of light, position-tracking software to track physical intrusion in the plane of light for controlling the image projection within a graphic user environment.

73. A method for creating a free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting images onto the particle cloud.

74. A method for creating a free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting images onto the particle cloud from a plurality of sources surrounding the particle cloud.

75. A method for creating an interactive free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting images onto the particle cloud, and tracking the position of physical intrusion adjacent to or within the particle cloud for controlling the image projection within a graphic user environment.

76. A method for creating an interactive free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting images onto the particle cloud from a plurality of sources surrounding the particle cloud, and tracking the position of physical intrusion adjacent to or within the particle cloud for controlling the image projection within a graphic user environment.

77. A method for creating a free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting separate stereo images onto the particle cloud.

78. A method for creating an interactive free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting separate stereo images onto the particle cloud, while tracking the position of physical intrusion adjacent to or within the particle cloud for controlling the image projection within a graphic user environment.

79. A method for creating a free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting intersecting beams from a plurality of sources onto the particle cloud.

80. A method for creating a free-space display comprising condensing moisture from air and ejecting the moisture into the air to generate a particle cloud and projecting intersecting beams from a plurality of sources onto the particle cloud, while tracking the position of physical intrusion adjacent to or within the particle cloud for controlling the projection within a graphic user environment.