Video processing system providing association between displayed video and media content and related methods

• US 8,677,240 B2
• Filed: 10/05/2009
• Issued: 03/18/2014
• Est. Priority Date: 10/05/2009
• Status: Active Grant

• Current Assignee: Ollnova Technologies Limited (Atlantic IP Services Limited)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Sanders, Marsha C., Mikulka, Thomas E., Bakir, Tariq
• Primary Examiner(s): HAILU, TADESSE
• Application Number:
  US12/573,509
• Publication Number:
  US 20110083087A1
• Time in Patent Office: 1,625 Days
• Field of Search: 715/203, 715716-735
• US Class Current: 715/716
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56

Abstract

A video processing system may include a display and a video processor coupled to the display. The video processor may be configured to ingest a time-referenced video and media content, correlate the media content to corresponding points in time in the time-referenced video, and generate on the display a video window for playing the time-referenced video and a media window for displaying the media content. The video processor may also be configured to bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of media content in the media window changes the video play to reflect corresponding points in time in the time-referenced video.

Claims

1. A video processing system comprising:

a display; and

a video processor coupled to said display and configured to

ingest a plurality of different time-referenced videos and a plurality of different media content entries,

correlate the plurality of different media content entries to corresponding points in time in respective time-referenced videos,

generate on said display a video window for playing at least one of the time-referenced videos and a media window for simultaneously displaying at least some of the plurality of different media content entries, and

bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of a given media content entry from among the plurality of different media content entries in the media window changes the video play to reflect a corresponding point in time in the time-referenced video and to switch to at least one other video with which the selected media content item is associated.

2. The video processing system of claim 1 wherein the different media content entries comprise different time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

3. The video processing system of claim 1 wherein the different media content entries comprise different time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

4. The video processing system of claim 1 wherein the different media content entries comprise different time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

5. The video processing system of claim 1 wherein the different media content entries comprise different time-referenced still images;

and wherein the media window comprises a still image window for displaying the time-referenced still images.

6. The video processing system of claim 1 wherein said video processor is configured to change the media window by selectively highlighting displayed media content entries based upon a point in time of the at least one time-referenced video.

7. The video processing system of claim 1 wherein said video processor is configured to change the media window by scrolling through displayed media content event entries based upon a point in time of the at least one time-referenced video.

8. The video processing system of claim 1 wherein the media content entries comprise Extensible Markup Language (XML) formatted media content entries.

9. The video processing system claim 1 wherein the time-referenced videos comprise georeferenced videos.

10. The video processing system of claim 1 further comprising a user input device coupled to said video processor;

and wherein said video processor is configured to select media content entries in the media window based upon said user input device.

11. A video processing system comprising:

a display;

user input device; and

a video processor coupled to said display and said user input device and configured to

ingest a plurality of different time-referenced georeferenced videos and a plurality of different media content entries,

correlate the media content entries to corresponding points in time in respective time-referenced georeferenced videos,

generate on said display a video window for playing at least one of the time-referenced georeferenced videos and a media window for displaying at least some of the plurality of different media content entries, and

bi-directionally associate the video window and the media window so that playing of the time-referenced georeferenced video changes the media window based upon reaching corresponding points in time in the time-referenced georeferenced video, and so that selection of a given media content entry from among the plurality of different media content entries in the media window via said user input device changes the video play to reflect a corresponding point in time in the time-referenced georeferenced video and to switch to at least one other video with which the selected media content item is associated.

12. The video processing system of claim 11 wherein the different media content entries comprise different time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

13. The video processing system of claim 11 wherein the different media content entries comprise different time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

14. The video processing system of claim 11 wherein the different media content entries comprise different time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

15. A video processor comprising:

a memory and a processor coupled to said memory and configured to

ingest a of different time-referenced videos and a plurality of different media content entries;

correlate the plurality of different media content entries to corresponding points in time in respective time-referenced videos;

generate on a display a video window for playing at least one of the time-referenced videos and a media window for displaying at least some of the plurality of different media content, entries; and

bi-directionally associate the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of a given media content entry from among the plurality of different media content entries in the media window changes the video play to reflect a corresponding point in time in the time-referenced video and to switch to at least one other video with which the selected media content item is associated.

16. The video processor of claim 15 wherein the different media content entries comprise different time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

17. The video processor of claim 15 wherein the different media content entries comprise different time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

18. The video processor of claim 15 wherein the different media content entries comprise different time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.

19. A video processing method comprising:

ingesting a plurality of different time-referenced videos and a plurality of different media content entries;

correlating the plurality of different media content entries to corresponding points in time in respective time-referenced videos;

generating on a display a video window for playing at least one of the time-referenced videos and a media window for simultaneously displaying at least some of the plurality of different media content entries; and

bi-directionally associating the video window and the media window so that playing of the video changes the media window based upon reaching corresponding points in time in the time-referenced video, and so that selection of a given media content entry from among the plurality of different media content entries in the media window changes the video play to reflect a corresponding point in time in the time-referenced video and to switch to at least one other video with which the selected media content item is associated.

20. The method of claim 19 wherein the different media content entries comprise different time-referenced geospatial coordinates;

and wherein the media window comprises a mapping window for displaying time-referenced geospatial coordinate points within the mapping window.

21. The method of claim 19 wherein the different media content entries comprise different time-referenced user chat entries;

and wherein the media window comprises a chat window for sequentially displaying the time-referenced chat entries.

22. The method of claim 19 wherein the different media content entries comprise different time-referenced landmark entries;

and wherein the media window comprises a landmark window for sequentially displaying the time-referenced landmarks.