Method and system for displaying visual content in a virtual three-dimensional space

• US 8,035,635 B2
• Filed: 05/22/2002
• Issued: 10/11/2011
• Est. Priority Date: 05/22/2001
• Status: Active Grant

• Current Assignee: Yoav Shefi
• Original Assignee: Yoav Shefi
• Inventors: Shefi, Yoav
• Primary Examiner(s): Broome; Said
• Application Number:
  US10/152,066
• Publication Number:
  US 20020176636A1
• Time in Patent Office: 3,429 Days
• Field of Search: None
• US Class Current: 345/419
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

A system and system for positioning content elements in a virtual 3D space. A 2D base plane is designated in the 3D space, and the visual content is positioned in the 3D space with at least one page being parallel to the base plane. A viewpoint and a viewing ray are selected in the 3D space from which to view the 3D space with the viewing ray being neither parallel or perpendicular to the base plane. A 2D surface is then positioned in the 3D space so that the 2D surface intersects the view ray between the viewpoint and the base plane. At least a portion of the 3D space is then projected onto the 2D surface by a perspective projection determined by the viewing ray. The process may be repeated as desired each time optionally selecting a new viewpoint and/or selecting a new viewing ray and/or altering a property of one or more content elements. The projection onto the viewing surface may be displayed on a display device such as a computer monitor.

Claims

1. A method for displaying a projection of a virtual three-dimensional (3D) space onto a display device, comprising:

(a) designating a 2D base plane in a virtual three-dimensional (3D) space;

(b) loading or downloading a document file and all or part of any related resources embedded in or linked to the document file;

(c) parsing the document file or components thereof, as well as any related resources, into at least one page and at least one content element thereof using a native parser corresponding to each said page and each said content element, wherein each page is a 2D array of 2D and/or volumetric 3D content elements and each page has a layout;

(d) selecting a page for positioning relative to the base plane;

(e) isolating and tagging each content element in or related to the page to identify (1) content elements to remain in the plane of the page, (2) content elements intended to be rotated with respect to the base plane, (3) content elements intended to be translated with respect to the base plane, and (4) content elements intended to be projected as volumetric 3D;

(f) rasterizing each tagged content element, other than any content elements tagged as a content element intended to be projected as volumetric 3D, to a designated raster area;

(g) positioning said page in the 3D space parallel to the base plane;

(h) translating and rotating the content elements tagged for translation or rotation;

(i) selecting a second page or a content element;

(j) isolating and tagging each content element in or related to the second page or content element selected in step (i) to identify (1) content elements to remain in the plane of the page, (2) content elements intended to be rotated with respect to the base plane, (3) content elements intended to be translated with respect to the base plane, and (4) content elements intended to be projected as volumetric 3D;

(k) rasterizing each tagged content element other than any intended to be projected as volumetric 3D to a designated raster area;

(l) positioning said second page or content element in the 3D space;

(m) translating and rotating the content elements tagged for translation or rotation;

(n) repeating steps (i) to (m) for any additional page or content element;

(o), selecting a viewpoint and a viewing ray extending from the viewpoint and intersecting the base plane at an angle between 0 and 90°

;

(p) positioning a first planar 2D surface in the 3D space so that the first planar 2D surface intersects the viewing ray between the viewpoint and the base plane so as to define a viewing frustum, within which is a viewing space, wherein the viewing space contains at least a portion of the first page and at least a portion of the second page or content element;

(q) projecting the entire viewing space onto the first planar 2D surface by a single perspective projection determined by the viewing ray, such that for every point in the viewing space that is projected onto a corresponding point on the first 2D surface, that point of the viewing space, the corresponding point projected onto the first 2D surface and the viewpoint are collinear;

(r) optionally projecting the single perspective projection on the first 2D surface onto a second 2D surface; and

(s) displaying the first 2D planar surface or the second 2D surface on a display device.

2. The method according to claim 1 including said step of projecting the projection on the first 2D surface onto a second 2D surface, the second 2D surface being a flat surface, a spherical surface, a cylindrical surface, or an irregular surface, and said displaying step comprises displaying the second 2D surface on the display device.

3. The method according to claim 1 wherein two adjacent pages are separated from each other in the base plane.

4. The method according to claim 1 wherein at least one page contains at least one 3D volumetric content element.

5. The method according to claim 1 further comprising a step of parsing a page into content elements and repositioning one or more of the content elements in the 3D space.

6. The method according to claim 5 wherein and the page'"'"'s content elements are repositioned in the 3D space so as to preserve the layout.

7. The method according to claim 5 or 6 wherein a content element is repositioned in the base plane next to the page.

8. The method according to claim 5 or 6 wherein a content element is repositioned out of the base plane.

9. The method according to claim 8 wherein a 2D content element is positioned parallel to the base plane.

10. The method according to claim 8 wherein a 2D content element is repositioned so that it projects from the base plane.

11. The method according to claim 1 further comprising a step of positioning in the 3D space one or more additional content elements.

12. The method according to claim 11 wherein one or more of the additional content elements are advertising.

13. The method according to claim 12 wherein a content element is positioned equidistantly between two pages.

14. The method according to claim 12 wherein a content element is positioned between two adjacent pages closer to one of the pages than the other.

15. The method according to claim 1 wherein a content element executes a response when the viewing ray or the viewpoint satisfies a predetermined condition.

16. The method according to claim 15 wherein the predetermined condition is selected from the group comprising:

(a) a distance from the viewpoint to the content element is less than a predetermined distance;

(b) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle;

(c) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint moves towards the content element;

(d) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint moves away from the content element;

(e) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint accelerates or decelerates;

(f) the viewpoint passes by the content element; and

(g) the user requests a response from a content element using a computer input device.

17. The method according to claim 15 or 16 wherein the response is selected from the group consisting of:

the content element becomes animated;

the content element is repositioned; and

the content element issues sounds.

18. The method according to claim 1, wherein said step (r) is not present and said displaying step comprises displaying the first 2D surface on the display device.

19. The method according to claim 18 wherein the display device is a computer monitor, a television, or a set-top box.

20. The method according to claim 18 wherein one or more of the display devices is remotely located.

21. The method according to claim 1 further comprising:

(a) designating one or more planes in the 3D space in addition to the base plane, the additional planes being parallel to the base plane; and

(b) positioning one or more pages or content elements in the additional planes.

22. The method according to claim 21 further comprising:

(a) selecting a plane from among the base plane and the additional planes; and

removing the other planes from the 3D space; and

(b) projecting at least a portion of the 3D space onto the 2D surface by a perspective projection determined by the viewing ray.

23. The method according to claim 1 wherein at least one page is an application window.

24. The method according to claim 23 wherein the window contains a content element that is at least a portion of a document page.

25. The method according to claim 1 further including a step of designating in the base plane one or more regions for positioning a page and/or content element.

26. The method according to claim 1 further comprising a step of replacing a page or a content element in the base plane when a distance between the viewpoint and the page or content element is greater than a predetermined distance.

27. The method according to claim 1 wherein the base plane is subdivided into content areas by a grid.

28. The method according to claim 27 wherein the grid designates areas in the base plane for one or more pages, areas surrounding pages, or areas between the designated areas surrounding pages.

29. The method according to claim 1 wherein one or more of the pages are results of a search query.

30. The method according to claim 1, wherein a first content element is positioned between a second content element and a third content element in a different page.

31. The method according to claim 1 further comprising transmitting content elements or pages in the 3D with their positions in the 3D space to a local disk or a remote location.

32. The method according to claim 1, further including repeating said steps (c)-(g) at least once, each time optionally selecting a new viewpoint and/or selecting a new viewing ray and/or altering a property of one or more content elements or one or more pages in the 3D space.

33. The method according to claim 1, wherein the first 2D surface is a flat surface, a spherical surface, a cylindrical surface, or an irregular surface.

35. The method according to claim 1, further comprising repeating steps (b) to (s) at least once, each time optionally selecting a new viewpoint and/or selecting a new viewing ray and/or altering a property of one or more content elements or one or more pages in the 3D space.

36. A computer readable non-transitory medium encoded with computer program code for performing the steps of claim 1 when said program code is executed by a processor.

37. The system according to claim 4, wherein the first 2D surface is a flat surface, a spherical surface, a cylindrical surface, or an irregular surface.

38. The system according to claim 37 processor is configured to execute the step of projecting the projection on the first 2D surface onto a second 2D surface, wherein the second 2D surface is a flat surface, a spherical surface, a cylindrical surface, or an irregular surface, and said processor displays the second 2D surface on the display device.

39. The system according to claim 37 wherein two adjacent pages are separated from each other in the base plane.

40. The system according to claim 37 wherein at least one page contains at least one 3D volumetric content element.

41. The system according to claim 37 wherein the processor is further configured to parse a page into content elements and reposition one or more of the content elements in the 3D space.

42. The system according to claim 41 wherein and the processor is further configured to reposition a page'"'"'s content element so as to preserve the page'"'"'s layout.

43. The system according to claim 41 wherein the processor is further configured to reposition a content element in the base plane next to the page.

44. The system according to claim 41 wherein the processor is further configured to reposition a content element out of the base plane.

45. The system according to claim 44 wherein the processor is further configured to position a 2D content element parallel to the base plane.

46. The system according to claim 44 wherein the processor is further configured to reposition a 2D content element so that it projects from the base plane.

47. The system according to claim 37 wherein the processor is further configured to position in the 3D space one or more additional content elements.

48. The system according to claim 47 wherein one or more of the additional content elements are advertising.

49. The system according to claim 48 wherein a content element is positioned equidistantly between two pages.

50. The system according to claim 48 wherein a content element is positioned between two adjacent pages closer to one of the pages than the other.

51. The system according to claim 37 wherein a content element executes a response when the viewing ray or the viewpoint satisfies a predetermined condition.

52. The system according to claim 51 wherein the predetermined condition is selected from the group comprising:

(h) a distance from the viewpoint to the content element is less than a predetermined distance;

(i) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle;

(j) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint moves towards the content element;

(k) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint moves away from the content element;

(l) the content element intersects a cone centered around the viewing ray having a vertex at the viewpoint and a predetermined apical angle as the viewpoint accelerates or decelerates;

(m) the viewpoint passes by the content element; and

(n) the user requests a response from a content element using a computer input device.

53. The system according to claim 51 or 52 wherein the response is selected from the group consisting of:

the content element becomes animated;

the content element is repositioned; and

the content element issues sounds.

54. The system according to claim 41 wherein said step (r) is not present and said processor displays the first 2D surface on the display device.

55. The system according to claim 54 wherein the display device is a computer monitor, a television, or a stereo viewer.

56. The system according to anyone of claim 54 or 55 wherein one or more of the display devices is remotely located.

57. The system according to claim 37, wherein the processor is further configured to repeat steps (b) to (s) at least once, each time optionally selecting a new viewpoint and/or selecting a new viewing ray and/or altering a property of one or more content elements or one or more pages in the 3D space.

58. A computer readable non-transitory medium encoded with computer program code which can be executed by the processor to perform steps (a) to (s) according to claim 37.

34. A system for displaying a projection of a virtual three-dimensional (3D) space onto a display device, comprising a processor and the display device, wherein the processor is configured to:

(a) designate a 2D base plane in a virtual three-dimensional (3D) space;

(b) load or download a document file and all or part of any related resources embedded in or linked to the document file;

(c) parse the document file or components thereof, as well as any related resources, into at least one page and at least one content element thereof using a native parser corresponding to each said page and each said content element, wherein each page is a 2D array of 2D and/or volumetric 3D content elements and each page has a layout;

(d) select a page for positioning relative to the base plane;

(e) isolate and tag each content element in or related to the page to identify (1) content elements to remain in the plane of the page, (2) content elements intended to be rotated with respect to the base plane, (3) content elements intended to be translated with respect to the base plane, and (4) content elements intended to be projected as volumetric 3D;

(f) rasterize each tagged content element, other than any content elements tagged as a content element intended to be projected as volumetric 3D, to a designated raster area;

(g) position said page in the 3D space parallel to the base plane;

(h) translate and rotate the content elements tagged for translation or rotation;

(i) select a second page or a content element;

(j) isolate and tag each content element in or related to the second page or content element selected in step (i) to identify (1) content elements to remain in the plane of the page, (2) content elements intended to be rotated with respect to the base plane, (3) content elements intended to be translated with respect to the base plane, and (4) content elements intended to be projected as volumetric 3D;

(k) rasterize each tagged content element other than any intended to be projected as volumetric 3D to a designated raster area;

(l) position said second page or content element in the 3D space;

(m) translate and rotate the content elements tagged for translation or rotation;

(n) repeat steps (i) to (m) for any additional page or content element;

(o) select a viewpoint and a viewing ray extending from the viewpoint and intersecting the base plane at an angle between 0 and 90°

;

(p) position a first planar 2D surface in the 3D space so that the first planar 2D surface intersects the viewing ray between the viewpoint and the base plane so as to define a viewing frustum, within which is a viewing space, wherein the viewing space contains at least a portion of the first page and at least a portion of the second page or content element;

(q) project the entire viewing space onto the first planar 2D surface by a single perspective projection determined by the viewing ray, such that for every point in the viewing space that is projected onto a corresponding point on the first 2D surface, that point of the viewing space, the corresponding point projected onto the first 2D surface and the viewpoint are collinear;

(r) optionally project the single perspective projection on the first 2D surface onto a second 2D surface; and

(s) display the first 2D planar surface or the second 2D surface on a display device.