AUGMENTED REALITY COLLABORATIVE MESSAGING SYSTEM
First Claim
1. A distributed augmented reality platform which interacts between several mobile devices and a server, comprising:
- an image recognition application located on the mobile device which receives a live, real-time image imaged by an imaging component of the mobile device, and which identifies the orientation and location of the device;
a client application located on the mobile device which receives the above said data from the image recognition application, and is capable of generating, sending, receiving and rendering multimedia messages in a variety of formats, including video, audio, text and virtual 3D content;
a server application located on the server which receives the transmission of the a client message, saves these messages for later retrieval, determines any content that may need to be provided to the mobile device based on the coordinates, and sends the content or message thereto to a mobile device.
0 Assignments
0 Petitions
Accused Products
Abstract
An augmented reality messaging platform is provided which interacts between one or more mobile device and a server via a communication network. The augmented reality platform includes an image recognition application located on the mobile device which receives a live, real-time image and identifies objects, such as markers or logos, within the environment to determine the pose (position and orientation) of the camera. The data, in combination with user information, is used to send, retrieve and display digital, spatialized (those registered with the physical world) multimedia messages, including audio, video, text and virtual object. A server application provided on the server may receive and store the messages from the client application or may deliver appropriate messages to a receiving mobile device, based on a set of privacy rules. The client application on the mobile device processes and renders this content thereto and forms an augmented reality image on a display of the mobile device based on the live, real-time image and the content. The client application is further capable of uploading new message content to be stored on a centralized server through methods which are specific to the medium of the message.
63 Citations
15 Claims
-
1. A distributed augmented reality platform which interacts between several mobile devices and a server, comprising:
-
an image recognition application located on the mobile device which receives a live, real-time image imaged by an imaging component of the mobile device, and which identifies the orientation and location of the device; a client application located on the mobile device which receives the above said data from the image recognition application, and is capable of generating, sending, receiving and rendering multimedia messages in a variety of formats, including video, audio, text and virtual 3D content; a server application located on the server which receives the transmission of the a client message, saves these messages for later retrieval, determines any content that may need to be provided to the mobile device based on the coordinates, and sends the content or message thereto to a mobile device. - View Dependent Claims (2, 3, 4)
-
-
5. A method of providing an augmented reality experience on a mobile device, comprising:
-
creating messages in the form of multimedia elements, including video, audio, text and/or virtual objects. obtaining a live, real-time image using an imaging component of the mobile device; determining the location and orientation of the mobile device; providing the ability for users to create, send and receive multimedia messages of a wide variety of formats. rendering of a wide variety of media formats, including the superimposition of virtual content within the physical environment - View Dependent Claims (6, 7, 8, 9, 10, 11)
-
-
12. A mobile device comprising:
-
an imaging component which obtains a live, real-time image, and converts the image into coordinates; a transmitting unit which transmits a data packet including the coordinates and message to be delivered; a receiving unit which receives appropriate messages containing a variety of multimedia content that may include audio, video, text and/or virtual objects; and a display which capable of displaying this content in a spatialized way—
that is, the virtual content is registered with the physical world. - View Dependent Claims (13, 14, 15)
-
Specification