Method and apparatus for web-based augmented reality application viewer

• US 9,870,429 B2
• Filed: 11/30/2011
• Issued: 01/16/2018
• Est. Priority Date: 11/30/2011
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Stirbu, Vlad Alexandru, Murphy, David Joseph
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US13/308,083
• Publication Number:
  US 20130135344A1
• Time in Patent Office: 2,239 Days
• Field of Search: 345629
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
• CPC Class Codes: G06F 21/1062 Editing
• CPC Class Codes: G06F 2221/032 Protect output to user by software means
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G09G 2300/0452 Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
• CPC Class Codes: G09G 2320/0276 for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

An approach is provided for generating web-based augmented reality application viewer. A web-based server application receives a request from a web client for visualization information associated with a web application that renders a perspective-based display. The web-based server application facilitates a processing of the request to execute the web application. One or more web-based server applications at one or more web-based servers cause a generation of one or more images, one or more sequences of the one or more images, or a combination thereof based, at least in part, on the execution of the web application, wherein the one or more images, the one or more sequences, or a combination thereof depict a rendering of a user interface of the web application. The one or more applications transmit the one or more images, the one or more sequences, or a combination thereof as the visualization information for presentation.

Claims

1. A method comprising:

receiving, by an apparatus via a network, a request from a web client on a user device for visualization information associated with a web application that renders a perspective-based display of a geographic area that identifies a position of the web client and a position of at least one object, and content;

processing, by the apparatus, the request to cause an execution of the web application based, at least in part, on one or more parameters specified in the request, wherein the one or more parameters indicate the position of the at least one object and one or more viewing locations for viewing the at least one object, wherein the one or more viewing locations are different from the position of the user device, and wherein the position of the web client, the position of at least one object, and the one or more viewing locations are identified on a map displayed within in the perspective-based display;

simulating, by the apparatus, one or more image sequences showing the at least one object viewed from the one or more viewing locations as in a physical world, wherein the one or more image sequences are augmented into a rendering of a user interface of the web application; and

initiating, by the apparatus, a transmission of the one or more image sequences as the visualization information viewed from the one or more viewing locations via the network to the user device.

2. A method of claim 1, further comprising:

determining the one or more viewing locations based, at least in part, on a movement along at least one travel path specified in the request; and

initiating a generation of a preview of the perspective-based display of the geographic area including the at least one object viewed from the one or more viewing locations using virtual reality,

wherein the one or more image sequences depict a rendering of the user interface of the web application along the at least one travel path in a real time manner with the movement.

3. A method of claim 2,

wherein the one or more parameters include, at least in part, one or more object models, one or more locations of the one or more object models, one or more viewing locations, or a combination thereof for rendering by the web application.

4. A method of claim 2, further comprising:

initiating an adjustment of the preview, in response to the one or more parameters as updated via the web client,

processing the request to determine content information associated with the content; and

initiating a rendering of the content information in the user interface, together with the one or more images, the one or more sequences, or a combination thereof.

5. A method of claim 1, wherein the generation of the one or more images, the one or more sequences, or a combination thereof is based, at least in part, on display capability information, viewport information, or a combination thereof associated with the web client, and wherein one or more user interface menu options are available for interacting with the at least one object, the content, or a combination thereof.

6. A method of claim 1, further comprising:

processing the one or more images, the one or more sequences, or a combination thereof to cause, at least in part, a generation of one or more user interaction elements; and

grouping the one or more user interaction elements with the one or more images, the one or more sequences, or a combination thereof,

wherein the one or more images include one or more three dimensional simulated images.

7. A method of claim 6, wherein the one or more user interaction elements include, at least in part, one or more asynchronous scripting elements,

wherein the one or more three dimensional simulated images are augmented into the user interface in place of or in addition to a live camera view.

8. A method of claim 7, wherein the one or more asynchronous scripting elements include, at least in part, a tiling of the one or more images, the one or more sequences, or a combination thereof for supporting, at least in part, scrolling, panning, zooming, or a combination thereof, and wherein a user may select from one or more user interface menu options for interacting with the at least one object, content, or combination thereof.

9. A method of claim 1, wherein the request is generated by a selection of one or more options in a user interface presented at the web client, wherein one or more user interface menu options are selected for interacting with the at least one object, the content, or a combination thereof.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

receive, via a network, a request from a web client on a user device for visualization information associated with a web application that renders a perspective-based display of a geographic area that identifies a position of the web client and a position of at least one object, and content;

process the request to cause an execution of the web application based, at least in part, on one or more parameters specified in the request, wherein the one or more parameters indicate the position of the at least one object and one or more viewing locations for viewing the at least one object, wherein the one or more viewing locations are different from the position of the user device, and wherein the position of the web client, the position of at least one object, and the one or more viewing locations are identified on a map displayed within in the perspective-based display;

simulate one or more image sequences showing the at least one object viewed from the one or more viewing locations as in a physical world, wherein the one or more image sequences are augmented into a rendering of a user interface of the web application; and

initiate a transmission of the one or more image sequences as the visualization information viewed from the one or more viewing locations via the network to the user device.

11. An apparatus of claim 10, wherein the apparatus is further caused to:

determine the one or more viewing locations based, at least in part, on a movement along at least one travel path specified in the request; and

initiating a generation of a preview of the perspective-based display of the geographic area including the at least one object viewed from the one or more viewing locations using virtual reality,

wherein the one or more image sequences depict a rendering of the user interface of the web application along the at least one travel path in a real time manner with the movement.

12. An apparatus of claim 11, wherein the one or more parameters include, at least in part, one or more object models, one or more locations of the one or more object models, one or more viewing locations, or a combination thereof for rendering by the web application.

13. An apparatus of claim 10, wherein the apparatus is further caused to:

process the request to determine content information; and

initiate a rendering of the content information in the user interface, the one or more images, the one or more sequences, or a combination thereof.

14. An apparatus of claim 10, wherein the generation of the one or more images, the one or more sequences, or a combination thereof is based, at least in part, on display capability information, viewport information, or a combination thereof associated with the web client, and wherein a user may select from one or more user interface menu options for interacting with the at least one object, content, or combination thereof.

15. An apparatus of claim 10, wherein the apparatus is further caused to:

process the one or more images, the one or more sequences, or a combination thereof to cause, at least in part, a generation of one or more user interaction elements; and

cause, at least in part, a grouping of the one or more user interaction elements with the one or more images, the one or more sequences, or a combination thereof.

16. An apparatus of claim 15, wherein the one or more user interaction elements include, at least in part, one or more asynchronous scripting elements.

17. An apparatus of claim 16, wherein the one or more asynchronous scripting elements include, at least in part, a tiling of the one or more images, the one or more sequences, or a combination thereof for supporting, at least in part, scrolling, panning, zooming, or a combination thereof, and wherein a user may select from one or more user interface menu options for interacting with the at least one object, content, or combination thereof.

18. An apparatus of claim 10, wherein the request is generated by a selection of one or more options in a user interface presented at the web client, and wherein one or more user interface menu options are selected for interacting with the at least one object, the content, or a combination thereof.