AUGMENTED REALITY OBJECT PROVIDING METHOD AND SERVER USING IMAGE AUTHENTICATION

• US 20190318076A1
• Filed: 10/19/2017
• Published: 10/17/2019
• Est. Priority Date: 10/19/2016
• Status: Active Grant

• Current Assignee: Jong-Yoon Chun
• Original Assignee: Jong-Yoon Chun
• Inventors: CHUN, Sol Jee, KIM, Youngwook
• Granted Patent: US 11,023,572 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04M 2203/359 Augmented reality
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

The present invention relates to an augmented reality object providing method and server using image authentication and, more specifically, to an augmented reality object providing method and server using image authentication, wherein an augmented reality object is registered using a first real-world image captured by a first mobile terminal and an input message, and according to the registration of the augmented reality object, a notification message is transmitted to a second mobile terminal corresponding to recipient information, so as to allow a second user of the second mobile terminal to experience augmented reality by outputting the registered augmented reality object in a second real-world image captured by the second mobile terminal.

Claims

1. An augmented reality object providing method using image authentication, comprising:

a first mobile terminal information reception step in which an augmented reality object providing server receives, from a first mobile terminal, a captured first real-world image, first location information on a first location in which the first real-world image has been captured, user set image information selected in the first real-world image, an input message, and at least one recipient information;

an image setting step in which the augmented reality object providing server sets a user set image included in the first real-world image as a first image by using the user set image information;

an augmented reality object registration step in which the augmented reality object providing server registers the input message inputted by a first user of the first mobile terminal as an augmented reality object for the first image;

a notification message transmission step in which the augmented reality object providing server generates a notification message and transmits the notification message to a second mobile terminal corresponding to the recipient information;

a second mobile terminal information reception step in which the augmented reality object providing server receives, from the second mobile terminal, a captured second real-world image and second location information on a second location in which the second real-world image has been captured;

a user authentication step in which the augmented reality object providing server determines whether the second mobile terminal corresponds to the recipient information;

a location comparison step in which the augmented reality object providing server determines whether the first location information on the first location in which the first real-world image has been captured and the second location information on the second location in which the second real-world image has been captured are within a preset critical range;

an image comparison step in which the augmented reality object providing server determines whether a second image corresponding to the first image exists in the second real-world image; and

an augmented reality object transmission step in which, if it is determined that the second mobile terminal corresponds to the recipient information in the user authentication step, the first location information and the second location information are within the preset critical range in the location comparison step, and the second image corresponding to the first image exists in the image comparison step, the augmented reality object providing server transmits the augmented reality object corresponding to the first image to the second mobile terminal such that the augmented reality object is outputted in the second real-world image of the second mobile terminal.

2. The augmented reality object providing method using image authentication according to claim 1, wherein, in the location comparison step, the first location information is included in attribution information of the first real-world image and the second location information is included in attribution information of the second real-world image.

3. The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the user set image information includes at least one of a name of the user set image, a location of the user set image, an outmost edge of the user set image, and the user set image.

4. The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the input message is data inputted to or stored in the first mobile terminal and includes at least one of text, image, animation, and sound (including voice).

5. The augmented reality object providing method using image authentication according to claim 1, wherein, in the notification message transmission step, the notification message includes at least one of the first location information on the first location in which the first real-world image has been captured and the first image.

6. The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the recipient information is recipient information included in at least one of applications installed in the first mobile terminal.

7. The augmented reality object providing method using image authentication according to claim 6, wherein, in the notification message transmission step, the notification message is transmitted through an application server of an application corresponding to the recipient information.

8. The augmented reality object providing method using image authentication according to claim 1, wherein, in the notification message transmission step, the augmented reality object providing server compares current location information received from the second mobile terminal with the first location information, and if a distance between the current location information and the first location information is within a critical region, the augmented reality object providing server transmits the generated notification message to the second mobile terminal.

9. An augmented reality object providing server using image authentication, comprising:

a storage receives, from a first mobile terminal, a first real-world image, first location information on a first location in which the first real-world image has been captured, user set image information selected in the first real-world image, an input message, and at least one recipient information;

a controller that sets a user set image included in the first real-world image as a first image by using the user set image information, and registers the input message inputted by a first user of the first mobile terminal as an augmented reality object for the first image;

a notification message generator that generates a notification message;

a message transmitter that transmits the notification message to a second mobile terminal corresponding to the recipient information;

a user authenticator that determines whether the second mobile terminal corresponds to the recipient information if a captured second real-world image and second location information on a second location in which the second real-world image has been captured are received from the second mobile terminal;

a location comparator that determines whether the first location information and the second location information are within a preset critical range if the captured second real-world image and the second location information on the second location in which the second real-world image has been captured are received from the second mobile terminal; and

an image comparator that determines whether a second image corresponding to the first image exists in the second real-world image if the captured second real-world image and the second location information on the second location in which the second real-world image has been captured are received from the second mobile terminal; and

wherein, if the user authenticator determines that the second mobile terminal corresponds to the recipient information, the location comparator determines that the first location information and the second location information are within the preset critical range, and the image comparator determines that the second image corresponding to the first image exists, the message transmitter transmits the augmented reality object corresponding to the first image to the second mobile terminal such that the augmented reality object is outputted in the second real-world image of the second mobile terminal.

10. The augmented reality object providing server using image authentication according to claim 9, wherein the first location information is included in attribution information of the first real-world image and the second location information is included in attribution information of the second real-world image.

11. The augmented reality object providing server using image authentication according to claim 9, wherein the user set image information includes at least one of a name of the user set image, a location of the user set image, an outmost edge of the user set image, and the user set image.

12. The augmented reality object providing server using image authentication according to claim 9, wherein the input message is data inputted to or stored in the first mobile terminal and includes at least one of text, image, animation, and sound (including voice).

13. The augmented reality object providing server using image authentication according to claim 9, wherein the notification message includes at least one of the first location information on the first location in which the first real-world image has been captured and the first image.

14. The augmented reality object providing server using image authentication according to claim 9, wherein the recipient information is recipient information included in at least one of applications installed in the first mobile terminal.

15. The augmented reality object providing server using image authentication according to claim 14, wherein the message transmitter transmits the notification message through an application server of an application corresponding to the recipient information.

16. The augmented reality object providing server using image authentication according to claim 9, wherein, if the location comparator compares current location information received from the second mobile terminal with the first location information and determines that a distance between the current location information and the first location information is within a critical region, the message transmitter additionally transmits the notification message to the second mobile terminal.