VISUALLY PASSING DATA THROUGH VIDEO

• US 20140035951A1
• Filed: 08/03/2012
• Published: 02/06/2014
• Est. Priority Date: 08/03/2012
• Status: Active Grant

• Current Assignee: APX Labs, Inc.
• Original Assignee: John A. Martellaro
• Inventors: Martellaro, John A., Ballard, Brian
• Granted Patent: US 9,224,322 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A method and a system involve the insertion of digital data into a number of video frames of a video stream, such that the video frames contain both video content and the inserted digital data. The video, including the inserted digital data is then visually conveyed to and received by an augmented reality device without the use of a network connection. In the augmented reality device, the digital data is detected, processed and used to provide computer-generated data and/or information. The computer-generated data and/or information is then presented on a display associated with the augmented reality device or otherwise reproduced through the augmented reality device, where the computer-generated data and/or information supplements the video content so as to enhance the viewing experience of the augmented reality device user.

Claims

1. A method of visually conveying digital data to an augmented reality device through video, the method comprising:

inserting digital data into each of a plurality of video frames associated with the video, such that each of the plurality of video frames includes both video content and the inserted digital data; and

displaying the video including each of the plurality of video frames such that the video including each of the plurality of video frames are available to be visually received by the augmented reality device, wherein the digital data represents data and/or information that supplements the video content.

2. The method of claim 1, wherein inserting digital data into each of a plurality of video frames associated with the video comprises:

integrating the digital data with the video content.

3. The method of claim 1, wherein inserting digital data into each of a plurality of video frames associated with the video comprises:

inserting the digital data as one or more codes into one or more peripheral portions of each of the plurality of video frames.

4. The method of claim 3, wherein inserting the digital data as one or more codes into one or more peripheral portions of each of the plurality of video frames comprises:

Inserting the digital data as one or more QR codes.

5. The method of claim 3, wherein inserting the digital data as one or more codes into one or more peripheral portions of each of the plurality of video frames comprises:

Inserting the digital data as one or more bar codes.

6. The method of claim 3, wherein inserting the digital data as one or more codes into one or more peripheral portions of each of the plurality of video frames comprises:

Inserting the digital data as one or more block codes.

7. The method of claim 1, wherein inserting digital data into each of a plurality of video frames associated with the video comprises:

inserting digital data into each and every video frame associated with the video.

8. The method of claim 1 further comprising:

inserting into at least one video frame associated with the video, a first marker indicating the presence of the digital data in the plurality of video frames.

9. The method of claim 8 further comprising:

inserting into at least one video frame associated with the video, a second marker, wherein the first marker further indicates a first one of the plurality of video frames containing the digital data, and wherein the second marker indicates a last one of the plurality of video frames containing the digital data.

10. The method of claim 1, wherein inserting digital data into each of a plurality of video frames associated with the video comprises:

inserting different digital data into each of the plurality of video frames.

11. A method of visually receiving digital data in an augmented reality device through video, the method comprising:

visually capturing a plurality of video frames, wherein each of the plurality of video frames includes video content and digital data that has been inserted therein;

processing the digital data that was inserted into each of the plurality of visually received video frames and generating there from data and/or information that supplements the video content; and

presenting, through the augmented reality device, the data and/or information that supplements the video content.

12. The method of claim 11 further comprising:

detecting the digital data in each of the plurality of video frames; and

storing the digital data in memory.

13. The method of claim 11, wherein the plurality of video frames containing the digital data is less than all of the video frames associated with the video, the method further comprising:

capturing video frames that contain the digital data and capturing video frames that do not contain the digital data; and

determining which video frames contain the digital data based on a first predefined marker indicating the presence of the digital data.

14. The method of claim 13, wherein determining which video frames contain the digital data based on a second predefined marker, the first marker indicating a first video frame containing the digital data and the second marker indicating the last video frame containing data.

15. The method of claim 13, wherein each of the plurality of video frames containing digital data include a marker indicating the presence of the digital data.

16. The method of claim 11, presenting, through the augmented reality device, the data and/or information that supplements the video content comprises:

rendering the data and/or information that supplements the video content on a display of the augmented reality device.

17. The method of claim 16, wherein the data and/or information is text.

18. The method of claim 16, wherein the data and/or information are graphics.

19. The method of claim 16, wherein the data and/or information is animation.

20. The method of claim 16, wherein the data and/or information is additional video.

21. The method of claim 11, wherein presenting, through the augmented reality device, the data and/or information that supplements the video content comprises:

reproducing sound through a sound reproduction component of the augmented reality device.

22. The method of claim 11, wherein presenting, through the augmented reality device, the data and/or information that supplements the video content comprises:

downloading the data/information into the augmented reality device over a network connection.

23. An augmented reality device comprising:

a video sensor configured to visually capture video, wherein the video comprises a plurality of video frames, each including video content and digital data inserted therein;

a visual processor configured to process the digital data that was inserted into each of the plurality of visually received video frames and to generate there from data and/or information that supplements the video content; and

a rendering module configured to presenting, through the augmented reality device, the data and/or information that supplements the video content.

24. The augmented reality device of claim 23, wherein the video sensor is a camera.

25. The augmented reality device of claim 23, wherein the plurality of video frames containing the digital data is less than all of the video frames associated with the video, and wherein the visual processor is further configured to capture video frames that contain the digital data, capture video frames that do not contain the digital data, and determine which video frames contain the digital data and which video frames do not contain the digital data based on a predefined marker indicating the presence of the digital data.

26. The augmented reality device of claim 25, wherein the visual processor is further configured to determine which video frames contain the digital data and which video frames do not contain the digital data based on a second predefined marker, the predefined marker indicating a first video frame containing the digital data and the second predefined marker indicating the last video frame containing data.

27. The augmented reality device of claim 25, wherein the visual processor is further configured to determine which video frames contain the digital data and which video frames do not contain digital data by detecting the predefined marker in each of the plurality of video frames that contain the digital data.

28. The augmented reality device of claim 23 further comprising a display, and wherein the rendering module is further configured to render the data and/or information that supplements the video content on the display of the augmented reality device.

29. The augmented reality device of claim 28, wherein the data and/or information is text.

30. The augmented reality device of claim 28, wherein the data and/or information are graphics.

31. The augmented reality device of claim 28, wherein the data and/or information is animation.

32. The augmented reality device of claim 28, wherein the data and/or information is additional video.

33. The augmented reality device of claim 23 further comprising a sound reproduction component, wherein the rendering module is further configured to reproduce sound through the sound reproduction component.

34. The augmented reality device of claim 23 further comprises a network services interaction module configured to provide a network connection for the augmented reality device, over which, the data and/or information that supplements the video content is downloaded.