Augmented reality system

• US 9,092,061 B2
• Filed: 01/06/2012
• Issued: 07/28/2015
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: David Elmekies
• Original Assignee: David Elmekies
• Inventors: Elmekies, David
• Primary Examiner(s): HANNETT, JAMES M
• Application Number:
  US13/345,069
• Publication Number:
  US 20120176516A1
• Time in Patent Office: 1,299 Days
• Field of Search: 348/239
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: H04N 5/265 Mixing

Abstract

The present invention is directed to a video display and user control for the video display. In the preferred embodiment, multiple video feeds are combined into a single video display, where one feed, preferably live, includes an encoded marker which is used by a computer to select a second and display a second feed, wherein the location and orientation of the second feed changes based on the location and orientation of the encoded marker in the first feed. At least a portion of the display gives the appearance of depth, such as through use of superimposed animation. The live image is controlled by the user'"'"'s movement, causing at least a part of the display to move in concert with the user'"'"'s motion, thereby creating an enhanced three dimensional effect for a superimposed display.

Claims

1. A system for concurrently displaying a live video feed in combination with a processor-identified entry, said entry replacing an object in said live video feed comprising:

a video camera,

a processor-controlled computer,

a video display,

a data library with entries including digital content and display instructions for displaying video, and

a tracker to track the movement and orientation of an object in a field of vision of said video camera;

wherein said video camera captures a live feed of content in its field of vision, delivers said content to said processor, said processor identifies said object and said object'"'"'s movement and orientation in said field of vision, said processor generates a query to said data library for an entry corresponding to said object, said processor replaces said object in said live feed with said entry thereby creating a combined feed, said processor delivers said combined feed to said video display for presentation, and said processor receives input from said tracker and synchronizes any changes in movement or orientation of said object in said field of vision with corresponding changes of said entry in said combined feed.

2. The system of claim 1, wherein said content changes based on user input, where said input includes at least one of physical movement of the object or camera, a keystroke, multitouch, or audio.

3. The system of claim 1, wherein said processor identified entry appears as a three dimensional overlay.

4. The system of claim 1, wherein said combined feed appears on a mobile device.

5. The system of claim 1, wherein said replacement displays as a rotating image.

6. The system of claim 1, wherein the display of said processor identified entry includes an augmented reality effect.

7. The system of claim 6, wherein the augmented reality effect is adjusted based on the changing position or orientation of the object.

8. The system of claim 1, wherein the movement of the physical object in the live video feed is controlled by the viewer.

9. The system of claim 1, wherein said processor identified entry displays as a moving image.

10. The system of claim 1, wherein said processor identified entry displays as a rotating image.