Projection of visual elements and graphical elements in a 3D UI

• US 20080295035A1
• Filed: 05/25/2007
• Published: 11/27/2008
• Est. Priority Date: 05/25/2007
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Makela, Kaj, Reponen, Erika, Mattila, Jouka
• Application Number:
  US11/807,146
• Publication Number:
  US 20080295035A1
• Time in Patent Office: Days
• US Class Current: 715/848
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A method includes determining user interface data based at least on a projection of visual element information from a projector at a first location in a three-dimensional space onto a screen object defined in the space. The screen object forms at least a portion of a user interface. The method includes determining an area of the screen object viewable by a camera positioned in a second location in the three dimensional space, and communicating the user interface data corresponding to the area to a display interface suitable for coupling to one or more displays. Apparatus and computer-readable media are also disclosed.

Claims

1. A method comprising:

determining user interface data based at least on a projection of visual element information from a projector at a first location in a three-dimensional space onto a screen object defined in the space, wherein the screen object forms at least a portion of a user interface;

determining an area of the screen object viewable by a camera positioned in a second location in the three dimensional space; and

communicating the user interface data corresponding to the area to a display interface suitable for coupling to at least one display.

2. The method of claim 1, wherein the screen object comprises a plane in the space.

3. The method of claim 1, wherein the screen object comprises a three-dimensional surface in the space.

4. The method of claim 1, wherein the visual element information comprises at least one of a video, at least one image, or user interface information.

5. The method of claim 1, wherein the visual element information comprises a light spectrum.

6. The method of claim 1, further comprising displaying the portion of the user interface on the at least one display.

7. The method of claim 1, wherein the projection is modified at least in part through interaction between the projection and at least one graphical element positioned in the space between the projector and the screen object.

8. The method of claim 7, wherein one of the at least one graphical elements comprises a shader map.

9. The method of claim 8, wherein the shader map corresponds to one of an image or a video.

10. The method of claim 7, wherein one of the at least one graphical elements comprises a two-dimensional object and interaction of the two dimensional object with the projection causes a corresponding shadow on the screen object.

11. The method of claim 10, wherein the two-dimensional object is based on a picture.

12. The method of claim 11, wherein another of the at least one graphical elements comprises indicia of a name, and wherein the indicia is placed in the space such that interaction of the indicia with the projection causes a name on the screen object that is proximate the shadow.

13. The method of claim 1, wherein the projection is modified at least in part by particles generated in the space using at least one particle generator.

14. The method of claim 7, wherein the at least one graphical element is defined to reside at least in part on a plane between the projector and the screen object.

15. The method of claim 7, wherein one of the at least one graphical elements comprises a user interface element associated with an application.

16. The method of claim 15, wherein the at least one user interface element is defined to reside at least in part on a plane between the projector and the screen object.

17. The method of claim 1, wherein determining an area further comprises determining the area of the screen object viewable by a camera using at least a field of view of the camera.

18. An apparatus comprising:

a display interface suitable for coupling to at least one display; and

at least one processor, the at least one processor configured to determine user interface data based at least on a projection of visual element information from a projector at a location in a three-dimensional space onto a screen object defined in the space, wherein the screen object forms at least a portion of a user interface, the at least one processor further configured to determine an area of the screen object viewable by a camera positioned in a second location in the three dimensional space, and the at least one processor also configured to communicate the user interface data corresponding to the area to the display interface.

19. The apparatus of claim 18, wherein the at least one processor is implemented on at least one integrated circuit.

20. The apparatus of claim 18, wherein the screen object comprises one of a plane in the space or a three-dimensional surface in the space.

21. The apparatus of claim 18, wherein the visual element information comprises at least one of a video, at least one image, or user interface information.

22. The apparatus of claim 18, wherein the visual element information comprises a light spectrum.

23. The apparatus of claim 18, wherein the projection is modified at least in part through interaction between the projection and at least one graphical element positioned in the space between the projector and the screen object.

24. The apparatus of claim 23, wherein one of the at least one graphical elements comprises a shader map.

25. The apparatus of claim 23, wherein one of the at least one graphical elements comprises a two-dimensional object and interaction of the two dimensional object with the projection causes a corresponding shadow on the screen object.

26. The apparatus of claim 18, wherein at least one processor implements at least one particle generation and wherein the projection is modified at least in part by particles generated in the space using the at least one particle generator.

27. The apparatus of claim 23, wherein the at least one graphical element is defined to reside at least in part on a plane between the projector and the screen object.

28. The apparatus of claim 23, wherein one of the at least one graphical elements comprises a user interface element associated with an application.

29. The apparatus of claim 23, wherein the at least one user interface element is defined to reside at least in part on a plane between the projector and the screen object.

30. The apparatus of claim 18, wherein determining an area further comprises determining the area of the screen object viewable by a camera using at least a field of view of the camera.

31. A computer-readable medium comprising program instructions tangibly embodied thereon, execution of the program instructions resulting in operations comprising:

determining user interface data based at least on a projection of visual element information from a projector at a first location in a three-dimensional space onto a screen object defined in the space, wherein the screen object forms at least a portion of a user interface;

determining an area of the screen object viewable by a camera positioned in a second location in the three dimensional space; and

communicating the user interface data corresponding to the area to a display interface suitable for coupling to at least one display.

32. The computer-readable medium of claim 31, wherein the visual element information comprises at least one of a video, at least one image, or user interface information.

33. The computer-readable medium of claim 31, wherein the visual element information comprises a light spectrum.

34. The computer-readable medium of claim 31, wherein the projection is modified at least in part through interaction between the projection and at least one graphical element positioned in the space between the projector and the screen object.

35. An apparatus comprising:

means for determining user interface data based at least on a projection of visual element information from a projector at a first location in a three-dimensional space onto a screen object defined in the space, wherein the screen object forms at least a portion of a user interface;

means for determining an area of the screen object viewable by a camera positioned in a second location in the three dimensional space; and

means for communicating the user interface data corresponding to the area to a display interface suitable for coupling to at least one display.