AUGMENTED REALITY SYSTEM

• US 20120176516A1
• Filed: 01/06/2012
• Published: 07/12/2012
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: David Elmekies
• Original Assignee: David Elmekies
• Inventors: ELMEKIES, David
• Granted Patent: US 9,092,061 B2
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: H04N 5/265 Mixing

Abstract

The present invention is directed to a video display and user control for the video display. In the preferred embodiment, multiple video feeds are combined into a single video display, where one feed, preferably live, includes an encoded marker which is used by a computer to select a second and display a second feed, wherein the location and orientation of the second feed changes based on the location and orientation of the encoded marker in the first feed. At least a portion of the display gives the appearance of depth, such as through use of superimposed animation. The live image is controlled by the user'"'"'s movement, causing at least a part of the display to move in concert with the user'"'"'s motion, thereby creating an enhanced three dimensional effect for a superimposed display.

Claims

1. A method for a video display controlled by a processor to concurrently display a plurality of video feeds comprising the steps of:

obtaining a live video feed from a video camera,

identifying an encoding in said live feed, said encoding included in an image in the field of vision of said video camera and included in said live feed, including identifying said encoding'"'"'s position and orientation, and

obtaining data and instruction from an entry in a library, wherein said data and instruction cause said processor to direct said video display to display a second video feed including a superimposed image.

2. The method of claim 1, wherein said superimposed image is positioned and oriented in said video display based on the position and orientation of the encoding in said live feed.

3. The method of claim 1, wherein said processor tracks movement of said encoding and correspondingly changes the position of said superimposed image.

4. The method of claim 1, wherein said processor tracks orientation of said encoding and correspondingly changes the position of said superimposed image.

5. The method of claim 1, wherein said method further includes a audio player and said processor concurrently delivers audio to said audio player and said superimposed image changes at least in part based on said audio.

6. The method of claim 1, wherein said superimposed image changes based on user input, where said input includes at least one of a keystroke, multi-touch, or audio.

7. The method of claim 6 wherein said audio is selected by said processor based on at least one of a microphone input or audio playback from said computer or an external sound delivery device.

8. The method of claim 1, wherein said superimposed image appears as a three dimensional overlay.

9. The method of claim 1, wherein said superimposed image appears on a mobile device.

10. A system for concurrently displaying a plurality of video feeds comprising:

a video camera,

a processor-controlled computer,

a video display,

an encoded object, and

a data library with entries including digital content and instructions for displaying video;

wherein one of said video feeds is received from said video camera delivering a live video feed to said video display, and

wherein said processor identifies an encoding in said live feed including identifying its position and orientation, said encoding included in an image in the field of vision of said video camera and included in said live feed, said processor selects an entry from said library wherein said entry is selected so as to correspond to said encoding, and said processor delivers a second video feed including a superimposed image to said video display.

11. The system of claim 10, wherein said superimposed image is positioned and oriented in said video display based on the position and orientation of the encoding in said live feed.

12. The system of claim 10, wherein said processor tracks movement of said encoding and correspondingly changes the position of said superimposed image.

13. The system of claim 10, wherein said processor tracks orientation of said encoding and correspondingly changes the position of said superimposed image.

14. The system of claim 10, wherein said system further includes a audio player and said processor concurrently delivers audio to said audio player and said superimposed image changes at least in part based on said audio.

15. The system of claim 10, wherein said superimposed image changes based on user input, where said input includes at least one of a keystroke, multi-touch, or audio.

16. The system of claim 15 wherein said audio is selected by said processor based on at least one of a microphone input or audio playback from said computer or an external sound delivery device.

17. The system of claim 10, wherein said superimposed image appears as a three dimensional overlay.

18. The system of claim 10, wherein said superimposed image appears on a mobile device.