Augmented Reality method and system for line-of-sight interactions with people and objects online

• US 20180043263A1
• Filed: 08/12/2017
• Published: 02/15/2018
• Est. Priority Date: 08/15/2016
• Status: Abandoned Application

• Current Assignee: Emmanuel Brian Cao
• Original Assignee: Emmanuel Brian Cao
• Inventors: Cao, Emmanuel Brian
• Application Number:
  US15/675,707
• Publication Number:
  US 20180043263A1
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

Designed is a system and method for providing line of sight interaction in an AR environment between users of portable devices with the camera. The system and method uses computer-generated images to represent other system users and real or fictional objects with the precise location in 3 dimensional space. This Digital scene is overlaid onto and combined with the current real world environment as seen on the users'"'"' viewfinder. The invention is a novel system and method for allowing users to aim their portable devices and interact or communicate with the CGI images or other users of the same system, creating an augmented reality experience that is enhanced by a line of sight style communication.

Claims

1-13. -13. (canceled)

14. A system for users to interact with each in an Augmented Reality environment by pointing and aiming their mobile devices at one another, known as line-of-sight interactions, and said system comprising:

a) smart mobile devices that contain a i) forward facing camera;

ii) a viewfinder; and

iii) processing computer

b) distributed software applications to be implemented on the mobile devices in a)

c) programmable servers that i) tracks and distributes all user positions and orientations relative to each other; and

ii) provide connectivity between all mobile devices and AR system

15. The system of claim 14, wherein LOS Interactions are created by communicating orientation, position, and interaction information between servers and mobile devices

16. The system of claim 14, wherein the medium of interaction is a mobile AR game that is based on LOS style interactions

17. The system of claim 14, wherein a messaging platform in which users of the invention can send multimedia messages by aiming their devices at target users

18. The system of claim 14, wherein the software interface comprises of an overlay on the user viewfinder in order to interact and view information about the AR environment

19. The system for claim 18, wherein the overlay comprises of a reticle on the overlay to allow for the fine aiming of the mobile device

20. The system for claim 14, wherein the server distributes CGI objects from the AR environment

21. The system for claim 20, wherein the server contains a library of CGI images that are accurately georegistered in three-dimensional space

22. The system for claim 21, wherein a library of markers is applied to active users of the system, so that they appear to float over their position as seen in the mobile overlay

23. The system for claim 14, wherein users receive feedback notifications for any type of LOS interactions

24. The system for claim 23, wherein system interactions are scored and recorded

25. The system for claim 24, wherein users'"'"' progress and application progress is recorded and builds upon in the embodiment of the system

26. The system for claim 17, wherein users modify their visibility in the AR Environment