Methods and systems for an augmented reality service delivery platform

• US 8,803,916 B1
• Filed: 05/03/2012
• Issued: 08/12/2014
• Est. Priority Date: 05/03/2012
• Status: Active Grant

• Current Assignee: T-Mobile Innovations LLC (Deutsche Telekom AG)
• Original Assignee: Sprint Communications Company LP (Deutsche Telekom AG)
• Inventors: Paczkowski, Lyle W., Rajagopal, Arun, Schlesener, Matthew Carl
• Primary Examiner(s): Wu, Xiao
• Assistant Examiner(s): BUTTRAM, ALAN T
• Application Number:
  US13/463,756
• Time in Patent Office: 831 Days
• Field of Search: 345629-633, 709230-235
• US Class Current: 345/633
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

In some embodiments, a method is provided. The method includes receiving an augmented reality request from a mobile access terminal. The method also includes identifying a context for the augmented reality request and a feature set supported by the mobile access terminal associated with the augmented reality request. The method also includes mapping the identified feature set and the context to a subset of available augmented reality operations. The method also includes executing the subset of available augmented reality operations to generate augmented reality content corresponding to the augmented reality request. The method also includes streaming the augmented reality content to the mobile access terminal associated with the augmented reality request for playback.

Claims

1. A method comprising:

receiving an augmented reality request from a mobile access terminal;

identifying a context for the augmented reality request and a feature set supported by the mobile access terminal associated with the augmented reality request;

mapping the identified feature set and the context to a subset of available augmented reality operations;

executing the subset of available augmented reality operations to generate augmented reality content corresponding to the augmented reality request;

streaming the augmented reality content to the mobile access terminal associated with the augmented reality request for playback, wherein said receiving, said identifying, said mapping, said executing, and said streaming are performed in accordance with a predefined augmented reality latency threshold; and

setting the predefined augmented reality latency threshold based on a local caching scheme for images used to determine the context of the augmented reality request.

2. The method of claim 1, wherein receiving the augmented reality request comprises receiving a dataset comprising a picture frame, a location identifier, and accelerometer data.

3. The method of claim 1, wherein the setting the predefined augmented reality latency threshold is further based on high-performance hardware for interlacing images with augmented reality content.

4. The method of claim 1, wherein the setting the predefined augmented reality latency threshold is further based on a synchronization protocol to align the augmented reality request with the streamed augmented reality content.

5. An augmented reality service delivery platform system comprising:

an identification component to receive an augmented reality request from a mobile access terminal, to identify a context for the augmented reality request, and to identify a feature set supported by the mobile access terminal associated with the augmented reality request;

a mapping component to map the identified feature set and the context to a subset of available augmented reality applications;

an interlacing component to execute the subset of available augmented reality applications and to generate augmented reality content corresponding to the augmented reality request; and

a streaming component to stream the augmented reality content to the mobile access terminal associated with the augmented reality request for playback,

wherein the identification component, the mapping component, the interlacing component, and the streaming component operate in accordance with a predefined augmented reality latency threshold, and

wherein the predefined augmented reality latency threshold is met based on localized caching used by the identification component to expedite identifying the context for the augmented reality request and the feature set supported by the mobile access terminal associated with the augmented reality request.

6. The system of claim 5, wherein the received augmented reality request comprises a dataset comprising a picture frame, a location identifier, and accelerometer data.

7. The system of claim 5, wherein the augmented reality request comprises a camera image and wherein the augmented reality content comprises the camera image interlaced with augmented reality image content.

8. The system of claim 5, wherein the augmented reality request comprises a video and wherein the augmented reality content comprises the video interlaced with augmented reality image content.

9. The system of claim 5, wherein the predefined augmented reality latency threshold is met further based on hardware of the interlacing component being optimized to interlace images with augmented reality content.

10. The system of claim 5, wherein the predefined augmented reality latency threshold is met further based on at least one of the identification component, the mapping component, the interlacing component, and the streaming component implementing a synchronization protocol to expedite alignment of the augmented reality request with the augmented reality content.

11. The system of claim 5, wherein the localized caching stores images and wherein the identification component compares a picture frame included with the augmented reality request to the images in the localized caching to identify the context for the augmented reality request.

12. An augmented reality service delivery platform server, comprising:

a processor; and

a non-transitory computer-readable medium in communication with the processor and storing augmented reality service delivery platform instructions that, when executed, cause the processor to;

receive an augmented reality request from a mobile access terminal,

identify a context for the augmented reality request,

identify a feature set supported by the mobile access terminal associated with the augmented reality request,

map the identified feature set and the context to a subset of available augmented reality operations,

interlace an image based on the subset of available augmented reality operations to generate augmented reality content corresponding to the augmented reality request,

stream the augmented reality content to the mobile access terminal associated with the augmented reality request for playback, and

in response to receiving a second augmented reality request, send a service denial response or fractional augmented reality content based upon at least one of identifying that the mobile access terminal is a type of mobile access terminal that is capable of generating the augmented reality content associated with the second augmented reality request within a predefined augmented reality latency threshold or identifying a heavy augmented reality request traffic condition.

13. The augmented reality service delivery platform server of claim 12, wherein the augmented reality service delivery platform instructions, when executed, further cause the processor to identify the context for the augmented reality request based on a picture frame, a location identifier, and accelerometer data included with the augmented reality request.

14. The augmented reality service delivery platform server of claim 12, wherein the augmented reality service delivery platform instructions, when executed, further cause the processor to identify the context for the augmented reality request based on a localized caching scheme for images.

15. The augmented reality service delivery platform server of claim 12, wherein the augmented reality service delivery platform instructions, when executed, further cause the processor to perform synchronization operations to synchronize the augmented reality content with the augmented reality request.