Methods and systems for generating and joining shared experience

• US 9,691,184 B2
• Filed: 07/31/2015
• Issued: 06/27/2017
• Est. Priority Date: 04/13/2011
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Aurasma Limited (HP Inc.)
• Inventors: Blanchflower, Sean Mark, Hayhurst, Simon
• Primary Examiner(s): Ng, Fan
• Application Number:
  US14/815,767
• Publication Number:
  US 20150339839A1
• Time in Patent Office: 697 Days
• Field of Search: None
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

According to an example, a computer may receive characteristics information of an object in a video stream captured by a first computing device, generate a signature based on the characteristics information, identify an augmented reality information associated with the signature, transmit the augmented reality information to the first computing device, receive, from a second computing device, a set of characteristics information of the object in an image captured by the second computing device, determine that the set of characteristics information from the second computing device has a second signature that matches the signature generated based on the characteristics information received form the first computing device, and transmit the identified augmented reality information to the second computing device.

Claims

1. A mobile computing device comprising:

a display screen, a video camera, a wireless communication module, and a processor; and

a memory on which is stored machine readable instructions that are to cause the processor to;

capture an image of a trigger along with background information associated with the trigger in a video frame using the video camera;

identify characteristics information of the trigger and the associated background information;

transmit the characteristics information of the trigger and the associated background information to a server computing device connected to a network using the wireless communication module;

receive an augmented reality corresponding to the characteristics information of the trigger and the associated background information from the server computing device; and

present the augmented reality on the display screen, wherein the augmented reality associated with the first mobile computing device is shared and time synchronized with an augmented reality previously transmitted by the server computing device to another mobile computing device, wherein the server computing device is to generate signature information based on the characteristics information of the trigger and the associated background information, identify the augmented reality associated with the signature information, and wherein the machine-readable instructions are further to cause the processor to present the augmented reality by overlaying the augmented reality onto a portion of the display screen that is defined by a bounding area that bounds the trigger.

2. The mobile computing device of claim 1, wherein the another mobile computing device is to transmit to the server computing device the characteristics information of the trigger and the associated background information as captured by a video camera built into the second mobile computing device prior to the transmission of the characteristics information by the processor to the server computing device.

3. The mobile computing device of claim 2, wherein the server computing device is to generate signature information based on the characteristics information and the associated background information transmitted by the another mobile computing device, to determine whether the signature information associated with the mobile computing device is similar to the signature information associated with the another mobile computing device, and based on the two signature information being similar, the machine readable instructions are further to cause the processor to receive the same augmented reality as previously transmitted to the another mobile computing device.

4. The mobile computing device of claim 1, wherein the machine readable instructions are further to cause the processor to receive information about existing triggers from the server computing device.

5. The mobile computing device of claim 1, wherein the machine readable instructions are further to cause the processor to receive information about existing augmented realities from the server computing device.

6. The mobile computing device of claim 5, wherein the information about the existing augmented realities is categorized.