Method for discovering augmented reality object, and terminal

• US 9,436,874 B2
• Filed: 12/17/2014
• Issued: 09/06/2016
• Est. Priority Date: 01/28/2013
• Status: Active Grant

• Current Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Inventors: Li, Guoqing, JIN, Zhihao
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/573,178
• Publication Number:
  US 20150104069A1
• Time in Patent Office: 629 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: H04W 4/024 Guidance services

Abstract

A method for discovering an augmented reality (AR) object is provided that is applicable to the field of AR technologies. The method for discovering an AR object includes, when it is determined, according to a pre-generated navigation route and a movement speed of a terminal, that a vicinity of a preselected AR object is reached, determining a status of the terminal; when it is determined that the terminal is in a searching state, starting a camera and acquiring a picture; and when the acquired picture includes the AR object, notifying of the AR object.

Claims

1. A method for discovering an augmented reality (AR) object, comprising:

determining a status of a terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected AR object is reached;

starting a camera and acquiring a picture when it is determined that the terminal is in a searching state;

extracting N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;

processing M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;

processing N-M of the N focused objects using a precise recognition algorithm;

determining whether the M and the N-M of the N focused objects in the picture include the AR object; and

notifying of the AR object when the picture comprises the AR object.

2. The method according to claim 1, wherein that it is determined, according to the pre-generated navigation route and the movement speed of the terminal, that the vicinity of the preselected AR object is reached comprises:

acquiring a distance between a position of the AR object and a starting position of the terminal according to the pre-generated navigation route;

acquiring, according to a movement manner preselected by the user, an average movement speed of the movement manner, wherein the movement manner selected from walking, bicycling, and driving;

calculating, according to the distance and the average movement speed, an expected time for the terminal to reach the vicinity of the AR object; and

determining that the vicinity of the AR object is reached after the terminal starts from the starting position of the terminal and has moved the expected time.

3. The method according to claim 1, wherein the method further comprises:

collecting a current position parameter of the terminal by using a navigation and positioning system when the picture does not comprise the AR object; and

correcting the navigation route according to the position parameter.

4. The method according to claim 3, wherein the position parameter comprises at least one of positioning parameter information of a current position of the terminal and an obvious sign of the current position of the terminal.

5. The method according to claim 1, wherein determining the status of the terminal comprises determining, according to whether a gyroscope and preset functions are used, whether the terminal is in the searching state, wherein the preset functions comprise a voice call, a short message service message, a multimedia messaging service, an alarm, and a calendar event.

6. The method according to claim 1, further comprising outputting warning information when it is determined that the terminal moves irregularly in the vicinity of the AR object and finally goes far away from the AR object, wherein the warning information comprises vibration, ringing, and light emitting.

13. The method according to claim 1, further comprising:

determining a difference value by which a current movement speed of the terminal is lower than an average movement speed of the terminal; and

determining that the terminal is in a searching state when the difference value is greater than a preset threshold.

14. The method according to claim 1, further comprising:

determining that the terminal is in a focusing state when a change in an angle of view of a user during a particular time is less than a threshold value; and

processing the picture after determining that the terminal is in the focusing state.

7. A terminal, comprising:

a computer processor configured to;

determine a status of the terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected augmented reality (AR) object is reached;

start a camera and acquire a picture when determined that the terminal is in a searching state;

extract N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;

process M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;

process N-M of the N focused objects using a precise recognition algorithm;

determine whether the M and the N-M of the N focused objects in the picture include the AR object; and

notify of the AR object when the picture comprises the AR object.

8. The terminal according to claim 7, wherein the computer processor is configured to:

acquire a distance between a position of the AR object and a starting position of the terminal according to the pre-generated navigation route;

acquire, according to a movement manner preselected by the user, an average movement speed of the movement manner, wherein the movement manner is selected from walking, bicycling, and driving;

calculate, according to the distance and the average movement speed, an expected time for the terminal to reach the vicinity of the AR object; and

determine that the vicinity of the AR object is reached after the terminal starts from the starting position of the terminal and has moved the expected time.

9. The terminal according to claim 7, wherein the computer processor is configured to:

collect a current position parameter of the terminal by using a navigation and positioning system when the picture does not comprise the AR object; and

correct the navigation route according to the position parameter.

10. The terminal according to claim 9, wherein the position parameter comprises at least one of positioning parameter information of a current position of the terminal and an obvious sign of the current position of the terminal.

11. The terminal according to claim 7, wherein the computer processor is configured to determine, according to whether a gyroscope and preset functions are used, whether the terminal is in the searching state when it is determined, according to the pre-generated navigation route and the movement speed of the terminal, that the vicinity of the preselected AR object is reached, wherein the preset functions comprise a voice call, a short message service message, a multimedia messaging service, an alarm, and a calendar event.

12. The terminal according to claim 7, wherein the computer processor is configured to output warning information when it is determined that the terminal moves irregularly in the vicinity of the AR object and finally goes far away from the AR object, wherein the warning information comprises vibration, ringing, and light emitting.

15. The terminal according to claim 7, wherein the computer processor is configured to:

determine a difference value by which a current movement speed of the terminal is lower than an average movement speed of the terminal; and

determine that the terminal is in a searching state when the difference value is greater than a preset threshold.

16. The terminal according to claim 7, wherein the computer processor is configured to:

determine that the terminal is in a focusing state when a change in an angle of view of a user during a particular time is less than a threshold value; and

process the picture after determining that the terminal is in the focusing state.

17. A non-transitory computer-readable medium having instructions stored thereon, that when executed by a computer processor, cause the computer processor to perform a method comprising:

determining a status of a terminal when it is determined, according to a pre-generated navigation route and a movement speed of the terminal, that a vicinity of a preselected AR object is reached;

starting a camera and acquiring a picture when it is determined that the terminal is in a searching state;

extracting N focused objects from the picture using an image recognition algorithm, wherein N is an integer greater than or equal to one;

processing M of the N focused objects using a high-speed and low-precision algorithm, wherein M is an integer greater than or equal to one and less than or equal to N;

processing N-M of the N focused objects using a precise recognition algorithm;

determining whether the M and the N-M of the N focused objects in the picture include the AR object; and

notifying of the AR object when the picture comprises the AR object.