Method, system, terminal, and server for implementing mobile augmented reality service

• US 20140120887A1
• Filed: 05/28/2012
• Published: 05/01/2014
• Est. Priority Date: 06/24/2011
• Status: Abandoned Application

• Current Assignee: ZTE Corporation
• Original Assignee: ZTE Corporation
• Inventors: Huang, Cheng
• Application Number:
  US14/125,123
• Publication Number:
  US 20140120887A1
• Time in Patent Office: Days
• US Class Current: 455/414.1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04W 4/02 Services making use of location information

Abstract

A method for implementing a mobile Augmented Reality (AR) service is disclosed. The method includes: a mobile AR server selects an AR target and/or AR content; and the mobile AR server delivers the AR target and/or the AR content to a mobile AR client. A system for implementing a mobile AR service, a mobile AR client and a mobile AR server are disclosed. The disclosure solves the problem of difficult application development, a high service deployment cost and an inconsistent user experience of an existing AR solution, and facilitates the development of an AR market greatly. The method for implementing a mobile AR service of the disclosure adapts to recognition of different types of AR targets and acquisition of AR contents, has desirable expansibility, and provides a uniform service experience for user'"'"'s in different application scenarios.

Claims

1. A method for implementing a mobile Augmented Reality (AR) service, comprising:

searching, by a mobile AR server, for an AR target, selecting and acquiring AR content according to a request received from a mobile AR client or a received push request related to delivery of the AR target and/or the AR content; and

delivering, by the mobile AR server, the AR target and/or the AR content to the mobile AR client.

2. The method according to claim 1, wherein the searching, by a mobile AR server, for an AR target comprises:

searching for the AR target according to a parameter in the request of the mobile AR client or the push request, and/or user AR personalization and context.

4. The method according to claim 1, further comprising:

searching, by the mobile AR server, for the AR target based on at least one of followings;

a user position, a user setting and a feature of the AR target, wherein the user setting at lease comprises a search radius and/or a search category of the AR target.

6. The method according to claim 1, further comprising:

selecting, by the mobile AR server, and acquiring the AR content based on at least one of followings;

an identifier of the AR content, a feature of the AR content, an identifier of the AR target, a user terminal capability, a deployment rule of the AR content and a strategy for controlling access of the AR content.

7. The method according to claim 1, wherein the selecting and acquiring AR content by the mobile AR server comprises:

acquiring, by the mobile AR server, the AR content from an AR content server, or acquiring, by the mobile AR server, the AR content from a local cache.

8. The method according to claim 1, wherein the receiving a push request related to delivery of the target and/or the AR content comprises:

receiving, by the mobile AR server, the push request related to delivery of the AR target and/or the AR content according to a push setting of the AR target and/or the AR content.

9. The method according to claim 8, wherein the push setting of the AR target and/or the AR content comprises:

a user context, wherein the user context comprises;

a user position, a terminal present status; and

/or a preset push time interval.

10. The method according to claim 1, further comprising:

filtering, by the mobile AR server, the AR target and/or the AR content according to user AR personalization and context.

11. The method according to claim 10, wherein the user AR personalization and context comprises at least one of followings:

a type of the AR target, a category of the AR target, a feature of the AR target, a type of the AR content, a user position and a terminal capability.

12. The method according to claim 1, further comprising:

aggregating, by the mobile AR server, the AR target and/or the AR content according to at least one of followings;

a position of the AR target and/or the AR content position, a direction of the AR target and/or the AR content direction, and a correlation between AR targets or between AR contents.

16. The method according to claim 1, wherein the delivering, by the mobile AR server, the AR target and/or the AR content to the mobile AR client comprises:

returning the AR target and/or the AR content in response to the request of the mobile AR client;

or

actively pushing the AR target and/or the AR content to the mobile AR client.

17. The method according to claim 16, comprising:

selecting and delivering, by the mobile AR server, following information to the mobile AR client;

the AR target and/or the AR content;

a reference of the AR target and/or the AR content; and

a no-information instruction.

21. The method according to claim 1, further comprising:

receiving, by the mobile AR server, AR measure data and a user feedback reported by the mobile AR client, and creating an AR measure report; and

sending, by the mobile AR server, the AR measure report to an AR content server according to a subscription-notification-relation of the AR measure report, as well as user AR personalization and context.

32. The method according to claim 2, further comprising:

searching, by the mobile AR server, for the AR target based on at least one of followings;

a user position, a user setting and a feature of the AR target, wherein the user setting at lease comprises a search radius and/or a search category of the AR target.

3. (canceled)

5. (canceled)

33. The method according to claim 5, further comprising:

selecting, by the mobile AR server, and acquiring the AR content based on at least one of followings;

an identifier of the AR content, a feature of the AR content, an identifier of the AR target, a user terminal capability, a deployment rule of the AR content and a strategy for controlling access of the AR content.

13. (canceled)

14. (canceled)

15. (canceled)

18. (canceled)

19. (canceled)

20. (canceled)

22. A mobile Augmented Reality (AR) server, comprising:

an AR content/target selection function, configured to;

search for an AR target, select and acquire AR content according to a request received from a mobile AR client or a push request related to delivery of the AR target and/or the AR content;

an AR content/target delivery function, configured to;

in responding to the request of the mobile AR client, deliver the AR content and/or the AR target to the mobile AR client;

or

initiate a request of delivering the AR target and/or the AR content to the mobile AR client;

an AR content/target management function, configured to store and manage deployment information of the AR target, publish information of the AR content, a caching strategy of the AR content and the AR content cached in the mobile AR client;

an AR measure processing function, configured to;

collect AR measure data from the mobile AR client and interactions between a user and the AR content, add known information of the mobile AR server into the collected AR measure data, and process the AR measure data and other related data to generate an integrated report; and

an AR personalization and context management function, configured to collect and manage a user personalization preference and user context information.

23. The mobile AR server according to claim 22, further comprising:

a fourth interface provided to the AR content server; and

the mobile AR server provides the AR content through the fourth interface, and accesses functions opened by the mobile AR server, wherein the functions comprise;

requesting for association/disassociation between the AR content and the AR target, requesting to publish an accessible status of the AR content, setting a deployment rule of the AR content, accessing an anonymous feedback related to user interaction and AR measure.

24. A mobile Augmented Reality (AR) terminal, comprising a terminal capability component, a mobile AR client, an AR application and a support service client, wherein the mobile AR client is configured to:

access user/terminal personalization and context information, request the mobile AR server to search for an AR target, select and acquire AR content, and control a fusion display of the AR target and/or the AR content with a real scene shot by the terminal capability component.

25. The mobile AR terminal according to claim 24, further comprising:

an AR content/target acquisition function, configured to request the mobile AR server to acquire the AR content and/or the AR target according to a request of the AR application;

an AR content/target display function, configured to provide an AR content display mechanism according to the request of the AR application;

a user interaction support function, configured to support interaction of a user with the AR target and related AR content on a display screen of a terminal;

an AR measure processing function, configured to;

collect the interactions between the user and the AR content, as well as a user feedback on the AR content, and report AR measure data and the user feedback to the mobile AR server; and

a user/terminal data management function, configured to collect and manage information related to a user AR service setting and a terminal status.

26. The mobile AR terminal according to claim 24, wherein a first interface is further provided between the mobile AR client and the AR application;

and

the first interface is configured to;

access the AR target and/or the AR content provided by the mobile AR client, and access other AR service functions provided by the mobile AR client, wherein the other AR service functions at least comprise;

reporting AR measure data to the mobile AR client.

27. The mobile AR terminal according to claim 24, wherein a second interface is provided between the mobile AR client and the mobile AR server;

the mobile AR server, through the second interface,

receives a request of searching for the AR target from the mobile AR client, and returns a response to the mobile AR client;

receives a request of acquiring the AR content from the mobile AR client, and returns a response to the mobile AR client;

receives a request of reporting an AR measure and a user feedback from the mobile AR client, and returns a response to the mobile AR client;

receives a request of setting or updating a user preference from the mobile AR client, and returns a response to the mobile AR client; and

informs the mobile AR client to cancel AR content locally cached in the mobile AR client; and

the mobile AR client, through the second interface,

requests the mobile AR server to find the AR target, requests the mobile AR server to acquire the AR content, requests to set or update a user preference setting, and requests to report the AR measure and the user feedback to the mobile AR server.

28. The mobile AR terminal according to claim 24, wherein a third interface is provided between the mobile AR client and the mobile AR server;

the mobile AR client receives, through the third interface, the AR content and/or the AR target pushed by the mobile AR server; and

the mobile AR server, through the third interface, directly pushes the AR content and/or the AR target to the mobile AR client, or pushes a notification of indirectly acquiring the AR content and/or the AR target to the mobile AR client.

29. A mobile Augmented Reality (AR) system, comprising:

a mobile AR client, configured to;

access a user terminal capability, request a mobile AR server to search for the AR target, acquire the AR content, and control display of the AR target and/or the AR content;

a mobile AR server, configured to;

search for the AR target according to a request received from the mobile AR client or a push request related to delivery of the AR target and/or the AR content, select and acquire the AR content, and deliver the AR target and/or the AR content to the mobile AR client; and

an AR content server, configured to provide storage and management of the AR content.

30. (canceled)

31. (canceled)