Augmented Reality System

• US 20170331924A1
• Filed: 02/09/2015
• Published: 11/16/2017
• Est. Priority Date: 10/20/2014
• Status: Abandoned Application

• Current Assignee: Yoshiyuk Katori
• Original Assignee: Yoshiyuk Katori
• Inventors: Katori, Yoshiyuk
• Application Number:
  US15/520,744
• Publication Number:
  US 20170331924A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

[Problem] To provide an augmented reality system that is capable of obtaining information regarding a deceased person together with information in reality at a memorial installation.

[Solution] An augmented reality system of the invention has a server 50 that can communicate with a portable terminal 10 equipped with a camera 11. The server 50 has a deceased information storage part 60 that stores information regarding a deceased, and a control part 51 that transmits and receives information to and from the portable terminal 10. When a predetermined marker 2 installed to the memorial installation is captured by the camera 11, the portable terminal 10 transmits predetermined information to the server 50, based on information contained in the marker 2. The control part 51 of the server 50 which received the predetermined information transmits, to the portable terminal 10, the information regarding the deceased stored in the deceased information storage part 60. The portable terminal 10, upon receiving the information regarding the deceased, displays on a screen 13 the information regarding the deceased superimposed on the video captured by the camera 11.

Claims

1. An augmented reality system comprising a server capable of communicating with a portable terminal equipped with a camera,

the server having a deceased information storage part for storing information regarding a deceased, a location information storage part for storing location information of a memorial place and a control part for transmitting and receiving information to and from the portable terminal, and

the portable terminal having a location detecting part for detecting location of the terminal itself and a transmitting/receiving part for transmitting information including the information of the location detected by the location detecting part as well as for receiving information from the server,

wherein, if the location of the terminal itself detected by the location detecting part corresponds to the location information of the memorial installation stored in the location information storage part, the control part of the server transmits the information regarding the deceased stored in the deceased information storage part to the portable terminal for displaying the information regarding the deceased on a screen of the portable terminal which received the information regarding the deceased, superimposed on a video captured by the camera, and

the portable terminal transmits the information of the location of the terminal itself detected by the location detecting part to the server at predetermined timing, and

the control part compares the information of the location received from the portable terminal and the information of the location stored in the location information storage part and transmits the information to the portable terminal if a distance between the two locations is smaller than a predetermined distance.

2. The augmented reality system according to claim 1, wherein the control part of the server determines that the location of the terminal itself matches the location information of the memorial place if the location of the terminal itself detected by the location detecting part of the portable terminal is within a predetermined range from the location of the memorial place stored in the location information storage part.

3. The augmented reality system according to claim 2, wherein a marker is installed at the memorial place, and when the marker is captured by the portable terminal, the server receives the location information detected by the location detecting part from the portable terminal and stores the received location information in the location information storage part.

4. An augmented reality system comprising a server capable of communication with a portable terminal equipped with a camera,

the server having a deceased information storage part for storing information regarding the deceased and a control part for transmitting and receiving information to and from the portable terminal,

wherein by capturing a marker installed to the memorial installation by the camera, the portable terminal transmits predetermined information to the server based on the information contained in the marker, and the control part of the server which received predetermined information transmits the information regarding the deceased stored in the deceased information storage part, and the portable terminal which received the information regarding the deceased displays the information regarding the deceased superimposed on a video captured by the camera on its screen, and

the portable terminal transmits the information of the location of the terminal itself detected by the location detecting part to the server at predetermined timing, and

the control part compares the information of the location received from the portable terminal and the information of the location stored in the location information storage part and transmits the information to the portable terminal if a distance between the two locations is smaller than a predetermined distance.

5. The augmented reality system according to claim 4, wherein more than one set of information to be displayed on the portable terminal are included in the information regarding the deceased which is stored in the deceased information storage part, and the control part transmits one set among the sets of information regarding the deceased to the portable terminal.

6. The augmented reality system according to claim 5, wherein information on conditions of transmitting the information regarding the deceased is stored in association with the information regarding the deceased in the deceased information storage part.

7. The augmented reality system according to claim 6, wherein the information regarding the deceased is stored in association with the information for identifying the marker in the deceased information storage part.

8. The augmented reality system according to claim 6, wherein the server is provided with a user information storage part for storing information regarding a user and an authentication part for performing an authentication of a user who logged in referring to the user information storage part, and the control part is configured to transmit one set of information among the information regarding the deceased to the portable terminal based on the user authenticated by the authentication part.

9. The augmented reality system according to claim 4, wherein the portable terminal comprising a location detecting part for detecting a location of the terminal itself, and when the marker is captured by the camera, the portable terminal detects the location of the terminal itself by the location detecting part and transmits predetermined information including the information of the detected location to the server, and the server is provided with a location information storage part for storing the information of location detected in association with the information of the user when the marker is captured by the camera of the portable terminal.

10. The augmented reality system according to claim 9, wherein the control part of the server creates map information of the memorial installation which associates the location of the memorial installation stored in the location information storage part and the user information.

11. The augmented reality system according to claim 10, wherein the control part transmits the information of the location associated with the information of the user to a terminal of the user or other terminal based on the request from the user.

12. The augmented reality system according to claim 4, wherein the server is comprised of a company information storage part for storing information of a company that provides services and a place of the company in association with one another, and

the portable terminal is configured so that it can transmit information of service request along with the information of the location of the terminal itself detected by the location detecting part to the server, and the control part of the server which received the information on the service request selects information of a company nearest from the location of the portable terminal from the company information storage part and transmits the selected information to the portable terminal.

13. The augmented reality system according to claim 12, wherein the control part transmits first confirmation information, which can be responded, to a first user at a predetermined timing, and transmits second confirmation information to a second user different from the first user if there is no response from the portable terminal for the first confirmation information within a predetermined period.