VIDEO PROCESSING SYSTEM PROVIDING ASSOCIATION BETWEEN DISPLAYED VIDEO AND MEDIA CONTENT AND RELATED METHODS

• US 20110083087A1
• Filed: 10/05/2009
• Published: 04/07/2011
• Est. Priority Date: 10/05/2009
• Status: Active Grant

• Current Assignee: Ollnova Technologies Limited (Atlantic IP Services Limited)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Sanders, Marsha C., Mikulka, Thomas E., Bakir, Tariq
• Granted Patent: US 8,677,240 B2
• Time in Patent Office: Days
• US Class Current: 715/756
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56

Abstract

A video processing system may include a display and a video processor coupled to the display. The video processor may be configured to ingest a time-referenced video and media content, correlate the media content to corresponding points in time in the time-referenced video, and generate on the display a video window for playing the time-referenced video and a media window for displaying the media content. The video processor may also be configured to bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of media content in the media window changes the video play to reflect corresponding points in time in the time-referenced video.

Claims

1. A video processing system comprising:

a display; and

a video processor coupled to said display and configured to

ingest a time-referenced video and media content,

correlate the media content to corresponding points in time in the time-referenced video,

generate on said display a video window for playing the time-referenced video and a media window for displaying the media content, and

bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of media content in the media window changes the video play to reflect corresponding points in time in the time-referenced video.

2. The video processing system of claim 1 wherein the media content comprises time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

3. The video processing system of claim 1 wherein the media content comprises time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

4. The video processing system of claim 1 wherein the media content comprises time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

5. The video processing system of claim 1 wherein the media content comprises time-referenced still images;

and wherein the media window comprises a still image window for displaying the time-referenced still images.

6. The video processing system of claim 1 wherein said video processor is configured to change the media window by selectively highlighting displayed media content based upon a point in time of the time-referenced video.

7. The video processing system of claim 1 wherein said video processor is configured to change the media window by scrolling through displayed media events based upon a point in time of the time-referenced video.

8. The video processing system of claim 1 wherein the time-referenced media content comprises Extensible Markup Language (XML) formatted media content.

9. The video processing system of claim 1 wherein the time-referenced video comprises a georeferenced video.

10. The video processing system of claim 1 further comprising a user input device coupled to said video processor;

and wherein said video processor is configured to select media content in the media window based upon said user input device.

11. A video processing system comprising:

a display;

user input device coupled to said video processor; and

a video processor coupled to said display and said user input device and configured to

ingest a time-referenced georeferenced video and media content,

correlate the media content to corresponding points in time in the time-referenced georeferenced video,

generate on said display a video window for playing the time-referenced georeferenced video and a media window for displaying the media content, and

bi-directionally associate the video window and the media window so that playing of the time-referenced georeferenced video changes the media window based upon reaching corresponding points in time in the time-referenced georeferenced video, and so that selection of media content in the media window via said user input device changes the video play to reflect corresponding points in time in the time-referenced georeferenced video.

12. The video processing system of claim 11 wherein the media content comprises time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

13. The video processing system of claim 11 wherein the media content comprises time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

14. The video processing system of claim 11 wherein the media content comprises time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

15. A video processor comprising:

at least one ingest module configured to ingest a time-referenced video and media content;

a correlation module configured to correlate the media content to corresponding points in time in the time-referenced video; and

a rendering module configured to

generate on a display a video window for playing the time-referenced video and a media window for displaying the media content, and

bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of media content in the media window changes the video play to reflect corresponding points in time in the time-referenced video.

16. The video processor of claim 15 wherein the media content comprises time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

17. The video processor of claim 15 wherein the media content comprises time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

18. The video processor of claim 15 wherein the media content comprises time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

19. A video processing method comprising:

ingesting a time-referenced video and media content;

correlating the media content to corresponding points in time in the time-referenced video;

generating on a display a video window for playing the time-referenced video and a media window for displaying the media content; and

bi-directionally associating the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of media content in the media window changes the video play to reflect corresponding points in time in the time-referenced video.

20. The method of claim 19 wherein the media content comprises time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

21. The method of claim 19 wherein the media content comprises time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

22. The method of claim 19 wherein the media content comprises time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.