Interactive projector system and method

• US 8,651,666 B2
• Filed: 12/29/2010
• Issued: 02/18/2014
• Est. Priority Date: 10/05/2007
• Status: Active Grant

• Current Assignee: Kenneth J. Huebner
• Original Assignee: Kenneth J. Huebner
• Inventors: Huebner, Kenneth J.
• Primary Examiner(s): Sohn, Seung C
• Application Number:
  US12/980,966
• Publication Number:
  US 20110115823A1
• Time in Patent Office: 1,147 Days
• Field of Search: 353/28, 353/30, 353/46, 353/69
• US Class Current: 353/28
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/10 Projectors with built-in or built-on screen
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An interactive image projecting device that projects an image onto a display surface and controls the projected image based upon movement of the image projecting device or the detection of another image. The image projecting device includes a projector that generates an image from a control unit. The device includes a position indicating emitter that generates a position indicator and an image sensor that is operable to detect the position indicator from either the device including the image sensor or a position indicator from another device. Based upon the sensed position indicator from another device, the control unit operates to modify the image projected from the device such that the image from a first device can interact with an image from a second device. The first and second devices each have a wireless transceiver such that the devices can communicate with each other during operation.

Claims

1. An interactive image projecting device, comprising:

an outer housing;

a control unit contained within the outer housing;

a projector mounted within the housing and coupled to the control unit, the projector being operable to project an image created by the control unit from the housing;

at least one position indicating emitter coupled to the control unit and operable to project a position indicator from the housing; and

an image sensor coupled to the control unit, wherein the image sensor is operable to detect another position indicator from another image projecting device,

wherein the control unit modifies the image projected by the projector based upon the detected position indicator from the other image projecting device.

2. The device of claim 1 wherein the image sensor includes at least one photo sensor operable to detect the other position indicator from the other image projecting device, wherein the control unit modifies the image projected by the projector based upon the detected position indicator from the other image projecting device.

3. The device of claim 2 wherein the at least one photo sensor is a photo diode.

4. The device of claim 2 wherein the image sensor includes a plurality of photo sensors that each form a field of view, wherein the plurality of photo sensors are positioned such that the field of view of each of the plurality of photo sensors diverge from each other.

5. The device of claim 4 wherein the plurality of photo sensors are each coupled to the control unit and the control unit combines the divergent fields of view of the plurality of photo sensors such that the control unit is able to detect the position indicator from the other image projecting device in the combined field of view which is greater than the field of view of any one of the photo sensors.

6. The device of claim 1 wherein the control unit modifies the image projected by the projector such that the image combines with an image projected from the other image projecting device.

7. The device of claim 1 further comprising a range locator contained within the outer housing and in communication with the control unit, wherein the range locator is operable to determine the distance from the outer housing to a display surface.

8. The device of claim 1 further comprising a spatial position sensor mounted within the housing and operable to generate a movement signal based upon movement of the housing, wherein the movement signal is received by the control unit and the control unit modifies the image projected by the projector to simulate the movement of the image based upon the movement signal from the spatial position sensor.

9. The device of claim 8 further comprising a sound synthesizer and a speaker contained within the outer housing, wherein the control unit generates an audible sound that adapts to movement of the device as detected by the spatial position sensor.

10. The device of claim 1 further comprising a microphone contained within the outer housing and coupled to the control unit, wherein the control unit modifies the image projected by the projector based upon an audio signal received from the microphone.

11. The device of claim 1 further comprising a gesture device having a wireless transmitter, wherein the interactive image projecting device includes a wireless receiver such that the control unit modifies the image projected by the projector based upon detection of the gesture device.

12. The device of claim 1 wherein the other position indicator is an anisotropic shape or pattern such that the control unit can determine a rotational orientation of the other position indicator from the other image projecting device.

13. An interactive image projecting device, comprising:

an outer housing of hand held size;

a control unit contained within the outer housing;

a projector mounted within the housing and coupled to the control unit, the projector being operable to project an image created by the control unit from the housing;

at least one illuminating emitter operable to project an illumination light source from the housing; and

an image sensor within the housing and coupled to the control unit, wherein the image sensor is operable to detect the presence of an object illuminated by the light source in the vicinity of the housing.

14. The device of claim 13 wherein the at least one illuminating emitter is an infrared light emitter and the image sensor is an infrared light sensor.

15. The device of claim 13 wherein the image sensor has a viewing angle that is larger than a projected light angle of the projector.

16. The device of claim 13 further includes a range locator that is operable to determine the distance from the housing to the detected object.

17. The device of claim 16 wherein the control unit is operable to modify the image projected by the projector when the detected object is the same distance from the housing as a display surface.

18. The device of claim 13 wherein the control unit modifies the image upon detection of at least one hand or finger by the image sensor.

19. The device of claim 13 wherein the object is a gesture device selectively movable relative to the outer housing, wherein the control unit modifies the image upon detection of the gesture device by the image sensor.

20. A method of integrating the operation of a first image projecting device and a second image projecting device, comprising the steps of:

generating a first image from a projector of the first image projecting device and a position indicator from a position indicating emitter of the first image projecting device;

operating an image sensor of the second image projecting device to detect the location of the first image based upon the position of the position indicator; and

modifying a second image from a projector of the second image projecting device based upon the determined location of the first image,

wherein the second image is modified such that the first image and second image appear combined as a coherent image.

21. A method of operating an interactive image projecting device of hand held size, comprising:

operating a projector to project an image from the image projecting device;

operating an image sensor to detect light in the vicinity of a housing of the device; and

modifying the image projected by the projector based upon the detected light in the vicinity of the housing.

22. The method of claim 21 further comprising the step of operating an illuminating emitter to project an illumination light source from the housing, wherein the image sensor is operable to detect the presence of an object positioned in the vicinity of the housing as illuminated by the illuminating emitter.

23. The method of claim 22 further comprising the steps of:

detecting an object located in the vicinity of the housing;

distinguishing whether the object is a human finger by a control unit; and

determining a spatial position of the finger relative to the housing and modifying the projected image based upon the spatial position of the finger relative to the housing.

24. The method of claim 22 further comprising the steps of:

detecting an object located in the vicinity of the housing;

distinguishing whether the object is a human finger by a control unit;

determining a spatial position of the finger relative to a projection surface; and

modifying the projected image based upon the spatial position of the finger relative to the projection surface.

25. The method of claim 24 further comprising:

the step of detecting when the finger touches the projection surface;

determining a position of the finger relative to the projected image; and

modifying the projected image based upon the position of the finger relative to the projected image when the finger touches the projection surface.

26. The method of claim 22 further comprising:

the step of detecting a hand gesture movement; and

modifying the projected image such that the modified projection image corresponds to the movement of the hand gesture.

27. The method of claim 21 further comprising the steps of:

generating a first position indicator from another image projecting device at a first location on a display surface;

generating a second position indicator from the other image projecting device at a second location on the display surface;

operating the image sensor to detect both the first and second position indicators of the other image projecting device; and

determining the relative rotation angle between the image projecting devices based upon the detected first and second position indicators.

28. A hand held interactive image projecting device, comprising:

an outer housing sized to be held by a user;

a control unit contained within the outer housing;

a projector mounted within the housing and coupled to the control unit, the projector being operable to project an image created by the control unit from the housing; and

a range locator coupled to the control unit and operable to detect a spatial distance to a projection surface onto which the image is projected, wherein the control unit modifies the logical zoom of the image projected by the projector based upon the spatial distance to the projection surface.

29. The projecting device of claim 28 wherein the control unit modifies the logical zoom of the projected image such that the visual scale of the projected image remains approximately constant as the outer housing moves toward and away from the projection surface.

30. The projecting device of claim 29 further comprising a spatial position sensor mounted within the housing and operable to generate a movement signal based upon the movement of the housing, wherein the movement signal is received by the control unit and the control unit modifies the image projected by the projector based upon the movement signal such that the image projected by the projector adapts to the movement of the outer housing.

31. The projecting device of claim 28 wherein the range locator is comprised of at least one position indicating emitter coupled to the control unit and operable to project a position indicator on the projection surface;

and

an image sensor coupled to the control unit, wherein the image sensor is operable to detect the position indicator on the projection surface.