Media asset management system for managing video segments from an aerial sensor platform and associated method

• US 20050257241A1
• Filed: 04/29/2004
• Published: 11/17/2005
• Est. Priority Date: 04/29/2004
• Status: Active Grant

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: Wilson, Eric D., Morris, Tahia Infantes, Fox, Kevin L., Faulkner, Gary J.
• Granted Patent: US 8,230,467 B2
• Time in Patent Office: Days
• US Class Current: 725/92
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A method for managing video segments from an aerial sensor platform using a media asset management system includes collecting the video segments from the aerial sensor platform, associating corresponding geospatial data with each video segment, and creating a search thesaurus including search descriptors with cross-references therebetween. At least one respective search descriptor from the search thesaurus is associated with each video segment. The method further includes storing each video segment, its geospatial data and its at least one search descriptor on the media asset management system for later search and retrieval, such as by a surveillance organization. The search descriptors may be geospatial search descriptors that are cross-referenced in a hierarchical relationship.

Claims

1. A method for managing video segments from an aerial sensor platform using a media asset management system comprising:

collecting the video segments from the aerial sensor platform;

associating corresponding geospatial data with each video segment;

creating a search thesaurus comprising a plurality of search descriptors with cross-references therebetween;

associating at least one respective search descriptor from the search thesaurus with each video segment; and

storing each video segment, its geospatial data and its at least one search descriptor on the media asset management system for later search and retrieval.

2. A method according to claim 1 wherein the aerial sensor platform comprises an unmanned aerial vehicle.

3. A method according to claim 1 wherein collecting the video segments and associating the corresponding geospatial data are performed using a geospatial video recorder.

4. A method according to claim 1 wherein the geospatial data comprises latitude and longitude.

5. A method according to claim 1 wherein the plurality of search descriptors comprise a plurality of geospatial search descriptors.

6. A method according to claim 5 wherein the plurality of geospatial search descriptors are cross-referenced in a hierarchical relationship.

7. A method according to claim 1 further comprising associating content data with the video segments.

8. A method according to claim 7 wherein the content data comprises a date and a time each video segment was collected.

9. A method according to claim 7 wherein the content data comprises at least one of a topic, a location term, a landmark and an event.

10. A method according to claim 1 further comprising associating textual data with the video segments.

11. A method according to claim 10 wherein associating textual data with the video segments comprises transcribing audio from the video segments into text.

12. A method according to claim 1 wherein the media asset management system is web based.

13. A method according to claim 1 wherein the video segments are stored in both a low resolution mode and a high resolution mode.

14. A method according to claim 1 further comprising:

generating at least one user search query;

comparing the at least one user search query with the search thesaurus for identifying at least one additional search query;

searching the video segments based upon the at least one user search query and the at least one additional search query; and

retrieving at least one video segment based upon the search.

15. A method according to claim 14 further comprising playing back the at least one retrieved video segment while displaying a map corresponding to its geospatial data.

16. A method according to claim 15 further comprising analyzing the at least one retrieved video segment using a scene detection algorithm.

17. A method according to claim 1 further comprising:

selecting a geographical area of interest on a map display;

generating at least one user search query; and

searching the video segments based upon the at least one user search query and the geographical area of interest.

18. A method according to claim 17 further comprising comparing the at least one user search query with the search thesaurus for identifying at least one additional search query.

19. A method for searching and retrieving video segments from an aerial sensor platform stored on a media asset management system, the media asset management system also having stored thereon a geospatial search thesaurus comprising a plurality of geospatial search descriptors with cross-references therebetween, and each video segment having corresponding geospatial data associated therewith and also having at least one respective geospatial search descriptor from the geospatial search thesaurus associated therewith, the method comprising:

generating at least one user search query, the at least one user search query including geospatial data;

comparing the at least one user search query with the geospatial search thesaurus for identifying at least one additional search query;

searching the video segments based upon the at least one user search query and the at least one additional search query; and

retrieving at least one video segment based upon the search.

20. A method according to claim 19 wherein the aerial sensor platform comprises an unmanned aerial vehicle.

21. A method according to claim 19 wherein the geospatial data comprises latitude and longitude.

22. A method according to claim 19 wherein the plurality of geospatial search descriptors are cross-referenced in a hierarchical relationship.

23. A method according to claim 19 wherein content data is associated with the video segments.

24. A method according to claim 23 wherein the content data comprises a date and a time each video segment was collected.

25. A method according to claim 23 wherein the content data comprises at least one of a topic, a location term, a landmark and an event.

26. A method according to claim 19 wherein textual data is associated with the video segments by transcribing audio from the video segments.

27. A method according to claim 19 wherein the video segments are stored in both a low resolution mode and a high resolution mode.

28. A method according to claim 19 wherein the media asset management system is web based.

29. A method according to claim 19 further comprising playing back the at least one retrieved video segment while displaying a map corresponding to its geospatial data.

30. A method according to claim 29 further comprising analyzing the at least one retrieved video segment using a scene detection algorithm.

31. A method according to claim 19 further comprising selecting a geographical area of interest on a map display;

and wherein searching the video segments is also based upon the geographical area of interest.

32. A media asset management system for video segments from an aerial sensor platform comprising:

a media interface for collecting video segments from the aerial sensor platform, each video segment having corresponding geospatial data associated therewith;

a memory for storing a search thesaurus comprising a plurality of search descriptors with cross-references therebetween;

a processor for associating each video segment with at least one respective search descriptor from the search thesaurus; and

a database for storing each video segment, its geospatial data and its at least one search descriptor for later search and retrieval by a surveillance organization.

33. A media asset management system according to claim 32 wherein the aerial sensor platform comprises an unmanned aerial vehicle.

34. A media asset management system according to claim 32 wherein the geospatial data comprises latitude and longitude.

35. A media asset management system according to claim 32 wherein the plurality of search descriptors comprise a plurality of geospatial search descriptors.

36. A media asset management system according to claim 35 wherein the plurality of geospatial search descriptors are cross-referenced in a hierarchical relationship.

37. A media asset management system according to claim 32 further comprising a user input interface for permitting a user to input content data;

and wherein said processor associates the content data with the video segments.

38. A media asset management system according to claim 37 wherein the content data comprises a date and a time each video segment was collected.

39. A media asset management system according to claim 37 wherein the content data comprises at least one of a topic, a location term, a landmark and an event.

40. A media asset management system according to claim 32 wherein said processor associates textual data with the video segments by transcribing audio from the video segments into text.

41. A media asset management system according to claim 32 wherein each video segment is stored in both a low resolution mode and a high resolution mode.

42. A media asset management system according to claim 32 wherein the media asset management system is web based.

43. A media asset management system according to claim 32 further comprising a user input interface for permitting a user to generate at least one user search query;

and wherein said processor;

compares the at least one user search query with the search thesaurus for identifying at least one additional search query; and

searches said database based upon the at least one user search query and the at least one additional search query for retrieving at least one video segment.

44. A media asset management system according to claim 43 further comprising a display for playing back the at least one retrieved video segment while displaying a map corresponding to its geospatial data.

45. A media asset management system according to claim 44 wherein said processor monitors the at least one retrieved video segment using a scene detection algorithm.

46. A media asset management system according to claim 32 further comprising:

a map display;

a user input interface for permitting a user to select a geographical area of interest on said map display and to generate at least one user search query; and

said processor searching the video segments based upon the at least one user search query and the geographical area of interest.

47. A media asset management system for video segments from an aerial sensor platform comprising:

a memory for storing a geospatial search thesaurus comprising a plurality of search descriptors with cross-references therebetween;

a database for storing video segments from the aerial sensor platform, each video segment having corresponding geospatial data associated therewith and also having at least one geospatial search descriptor from the geospatial search thesaurus associated therewith;

a user input interface for permitting a user to generate at least one user search query, the at least one user search query including geospatial data;

a processor for comparing the at least one user search query with the geospatial search thesaurus for identifying at least one additional search query, and searching the video segments based upon the at least one user search query and the at least one additional search query; and

a display for displaying at least one retrieved video segment.

48. A media asset management system according to claim 47 wherein the aerial sensor platform comprises an unmanned aerial vehicle.

49. A media asset management system according to claim 47 wherein the geospatial data comprises latitude and longitude.

50. A media asset management system according to claim 47 wherein the plurality of geospatial search descriptors are cross-referenced in a hierarchical relationship.

51. A media asset management system according to claim 47 wherein said user input interface also permits the user to generate content data.

52. A media asset management system according to claim 51 wherein the content data comprises a date and a time each video segment was collected.

53. A media asset management system according to claim 51 wherein the content data comprises at least one of a topic, a location term, a landmark and an event.

54. A media asset management system according to claim 47 wherein textual data is associated with the video segments.

55. A media asset management system according to claim 54 wherein the textual data comprises transcribed audio from the video segments.

56. A media asset management system according to claim 47 wherein the video segments are stored in said database in both a low resolution mode and a high resolution mode.

57. A media asset management system according to claim 47 wherein the media asset management system is web based.

58. A media asset management system according to claim 47 wherein said display displays the at least one retrieved video segment while also displaying a map corresponding to its geospatial data.

59. A media asset management system according to claim 58 wherein said processor comprises a scene detection algorithm for analyzing the at least one retrieved video segment.

60. A media asset management system according to claim 47 wherein said display comprises a map display;

and wherein said user input interface also permits the user to select a geographical area of interest on said map display; and

wherein said processor searches the video segments based upon the at least one user search query and the geographical area of interest.