Virtual showcases

• US 20040135744A1
• Filed: 02/06/2003
• Published: 07/15/2004
• Est. Priority Date: 08/10/2001
• Status: Abandoned Application

• Current Assignee: Fraunhofer CRCG Incorporated
• Original Assignee: Fraunhofer CRCG Incorporated
• Inventors: Encarnacao, L Miguel, Bimber, Oliver
• Application Number:
  US10/344,287
• Publication Number:
  US 20040135744A1
• Time in Patent Office: Days
• US Class Current: 345/32
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 30/24 involving temporal multiplexing, e.g. using sequentially activated left and right shutters
• CPC Class Codes: G02B 30/25 using polarisation techniques
• CPC Class Codes: G02B 30/35 using reflective optical elements in the optical path between the images and the observer
• CPC Class Codes: H04N 13/346 using prisms or semi-transparent mirrors
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

Tecniques that employ a virtual reality system that includes a projection plane to make virtual showcases. Where a real showcase has glass, the virtual showcase has half-silvered mirrors (402) that reflect the projection plane (403) when the mirror is viewed by a person. The virtual reality system receives input from a tracker (407) that tracks the position of the person'"'"'s head and produces an object space on the projection plane such that when the object is reflected in the portion of the mirrors that are visible from the person'"'"'s point of view, the reflection is an image space and appears as the person would expect it to appear from the person'"'"'s point of view. In producing the object space, the virtual reality system takes into account the user'"'"'s point of view, the portion of the reflective surface that the person can see from that point of view, and the effect of the position and form the mirror on the reflection of the object space.

Claims

1. Apparatus for producing an image space comprising:

apparatus for producing an object space;

a convex reflective surface having a position relative to the object space such that there is a reflection of the object space in the reflective surface; and

a tracker that tracks the position of the head of a person who is looking into the convex reflective surface,

the apparatus for producing the object space receiving the position information from the tracker, using the position information to determine the person'"'"'s field of view in the reflective surface, and producing the object space such that the image space appears in the field of view.

2. The apparatus for producing an image space set forth in claim 1 wherein:

the image space does not appear to the person to be distorted.

3. The apparatus for producing an image space set forth in claim 1 wherein:

the reflective surface comprises a plurality of planar reflective surfaces.

4. The apparatus for producing an image space set forth in claim 3 wherein:

when the field of view includes more than one of the planar reflective surfaces, the apparatus for producing the object space produces the object space such that the reflections of the object space in all of the planar reflective surfaces included in the field of view contain the same image space.

5. The apparatus for producing an image space set forth in claim 3 wherein:

the apparatus for producing the object space produces a separate image space in each of the plurality of planar reflective surfaces.

6. The apparatus for producing an image space set forth in claim 5 wherein:

the apparatus for producing the object space produces the separate image space in a given one of the plurality of planar reflective surfaces whenever the field of view includes the given planar reflective surface.

7. The apparatus for producing an image space set forth in claim 6 wherein:

there is a plurality of fields of view.

8. The apparatus for producing an image space set forth in claim 3 wherein:

there is a plurality of the object spaces; and

individual ones of the planar reflective surfaces reflect separate ones of the object spaces

9. The apparatus for producing an image space set forth in claim 3 wherein:

the plurality of planar reflective surfaces are sides of a pyramid.

10. The apparatus for producing an image space set forth in claim 9 wherein:

the pyramid is truncated.

11. The apparatus for producing an image space set forth in claim 9 wherein:

the plurality of planar reflective surfaces includes all of the sides of the truncated pyramid.

12. The apparatus for producing an image space set forth in claim 11 wherein:

the truncated pyramid has four sides.

13. The apparatus for producing an image space set forth in claim 1 wherein:

the reflective surface is curved.

14. The apparatus for producing an image space set forth in claim 1 wherein:

the curved surface is a conical surface.

15. The apparatus for producing an image space set forth in claim 14 wherein:

the conical surface is closed.

16. The apparatus for producing an image space set forth in claim 15 wherein:

the conical surface is truncated.

17. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the object space is above the reflective surface.

18. The apparatus for producing an image space set forth in any one of claims 1 through #All wherein:

the object space is below the reflective surface.

19. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the apparatus for producing the object space produces the object space on a projection plane.

20. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the apparatus for producing the object space employs active stereo projection.

21. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the apparatus for producing the object space employs passive stereo projection.

22. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the tracker is an electromagnetic tracker.

23. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the tracker is an optical tracker.

24. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

there is an object behind the reflective surface relative to the person; and

the reflective surface has the property that when the object is illuminated, the object becomes visible to the person through the reflective surface.

25. The apparatus for producing an image space set forth in claim 24 wherein:

the object belongs to the image space and the reflection of the object space augments the object.

26. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the object space is produced in a plurality of separate display devices.

27. The apparatus for producing an image space set forth in claim 26 wherein:

the apparatus for producing the object space includes a network of processors.

28. The apparatus for producing an image space set forth in any one of claims 1 through 16 wherein:

the reflective surface is in a position analogous to that of a transparent surface in a conventional showcase.

29. A method of producing an object space such that the object space'"'"'s reflection in a reflecting surface when the reflecting surface contains an image space as viewed from a specific point of view,

the method comprising the steps of:

generating the image space;

determining how the image space must be modified to produce an object space which, when produced on the projection plane, will result in a reflection in the reflecting surface that contains the image space; and

producing the object space.

30. The method set forth in claim 29 further comprising the step performed after the step of determining of:

further modifying the image space to compensate for geometry distortion that occurs when the object space is produced on the projection plane.

31. The method set forth in either claim 29 or claim 30 wherein:

the reflecting surface has the property that when an object behind the reflecting surface relative to the specific point of view is illuminated, the object is visible through the reflecting surface;

the object belongs to the image space; and

the method further comprises the step of;

further modifying the image space to compensate for refraction of light from the illuminated object by the reflecting surface.

32. Apparatus for producing an image space comprising:

apparatus for producing an object space;

a reflective surface that has a position relative to the object space such that there is a reflection of the object space in the reflective surface; and

a tracker that tracks the position of the head of a person who is looking into the reflective surface,

the apparatus for producing the object space receiving position information from the tracker, using the position information to determine a point of view, and producing the object space such that the reflection contains the image space as seen from the point of view.

33. A method of transforming an image space to produce a planar object space such that when a reflection of the object space in a curved reflective surface is seen from a given point of view, the reflection contains the image space,

the method comprising the steps of:

making a geometric representation of the image space that includes vertices of the image space and in which each line of sight from the given point of view into the image space intersects its vertex in the geometric representation; and

for each ray that spans the given point of view and a vertex,

determining an intersection of the ray with a curved surface whose geometry is that of the reflective surface and a reflection of the ray from the curved surface at the intersection; and

making a projection of the ray'"'"'s reflection onto the object space'"'"'s plane.

34. The method set forth in claim 33 wherein

the planar object space is produced by a projector with distortion;

and

the method farther includes the step of;

for each ray that is distorted by the projector, modifying the projection of the ray'"'"'s reflection onto the object space'"'"'s plane to counteract the ray'"'"'s distortion.

35. The method set forth in either claim 33 or claim 34 wherein

the image space includes an object that is seen through the reflecting surface;

light that passes through the reflecting surface is refracted; and

the method further includes the step of;

for each ray, modifying the intersection of the ray with the curved surface to take refraction by the reflecting surface into account.