Video data filtering method and system

• US 8,694,667 B2
• Filed: 01/05/2011
• Issued: 04/08/2014
• Est. Priority Date: 01/05/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rakshit, Sarbajit K.
• Primary Examiner(s): Daftuar, Saket K
• Application Number:
  US12/984,744
• Publication Number:
  US 20120173750A1
• Time in Patent Office: 1,189 Days
• Field of Search: 709/223, 709/224, 709/225, 709/226, 709/227, 709/228, 709/229, 709/230, 709/231, 709/236, 707/709, 707/736, 707/737, 707/740, 707/786, 707/899, 707/822, 707/E17.01, 707/E17.044, 707/767, 707/E17.069, 707/771, 707/E17.014, 707/E17.028, 705/1, 705/14.36, 705/14.4, 705/14.49, 705/14.58, 705/14.67, 725/14, 725/87, 725/151, 725/114, 370/401, 370/389, 715/723, 715/863, 715/753, 715/201, 715/763, 715/765, 715/853, 715/851, 715/855, 715/738, 715/762, 715/735, 715/736
• US Class Current: 709/231
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4318 by altering the content in the rendering process, e.g. blanking, blurring or masking an image region image enhancement or restoration in general G06T5/00
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/4545 Input to filtering algorithms, e.g. filtering a region of the image
• CPC Class Codes: H04N 21/45452 applied to an object-based stream, e.g. MPEG-4 streams
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895

Abstract

A filtering method and system. The method includes receiving by a computer processor an audio/video data file and filtering data. The computer processor analyzes the filtering data with respect to the audio/video data file and retrieves specified audio/video data portions comprising data objects within frames of the audio/video data file. The computer processor removes gaps existing in the audio/video data file and receives tags comprising instructions for presenting video data of the audio/video data file, audio data of the audio/video data file, and the specified audio/video data portions. The computer processor stores the video data in a first layer of a multimedia file, the audio data in a second layer of the multimedia file, and the specified audio/video data portions in additional layers of the multimedia file. Each of the first layer, the second layer, and the additional layers comprises a tag layer comprising the tags.

Claims

1. A method comprising:

receiving, by a computer processor of a computing system, an audio/video data file comprising audio voice data, audio music data, title data, and video data;

receiving, by said computer processor, filtering data associated with filtering said audio/video data file;

first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;

determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;

retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;

removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;

receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;

storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags;

storing, by said computer processor in a memory device, said multimedia file comprising said video data, said audio voice data, said audio music data, said title data, said tags, and said specified data portions; and

presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

2. The method of claim 1, further comprising:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.

3. The method of claim 2, further comprising:

receiving, by said computer processor from a second user accessing a second device, a command for enabling said audio/video data file, said second user differing from said first user;

retrieving, by said computer processor from said second device, a second user profile associated with said second user, second user profile differing from said first user profile;

third analyzing, by said computer processor, said second user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said second user profile user via said second device in response to results of said second analyzing, said video data, said audio voice data, and second audio/video data portions of said specified audio/video data portions, wherein said second audio/video data portions differ from said first audio/video data portions, wherein said second audio/video data portions are associated with said second user profile, and wherein said second device presents said video data, said audio voice data, and said second audio/video data portions to said second user.

4. The method of claim 1, further comprising:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing, a message indicating that said first user is not authorized to receive any of said multimedia files.

5. The method of claim 1, further comprising:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said first audio/video data portions to said first user.

6. The method of claim 1, wherein said first device comprises a device selected from the group consisting of an Internet enabled television, an Internet portal, and a wireless device.

7. The method of claim 1, wherein each audio/video data portion of said specified audio/video data portions comprises data selected from the group consisting of a video object within a video frame, audio speech data, and text data.

8. The method of claim 1, wherein said filtering data comprises rules associated with determining said specified audio/video data portions, and wherein said rules are selected from the group consisting of location based rules, age group based rules, organizational structure based rules, and confidential information based rules.

9. The method of claim 1, further comprising:

receiving, by said computer processor from a user, filtering criteria indicating additionally filtering said audio/video data file;

retrieving, by said computer processor from said audio/video data file in response to said filtering criteria, additionally specified audio/video data portions from said audio/video data file; and

removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said additionally specified audio/video data portions.

10. The method of claim 1, further comprising:

receiving, by said computer processor, scenario based filtering data associated with filtering said audio/video data file;

second analyzing, by said computer processor, said scenario based filtering data with respect to said audio/video data file;

determining, by said computer processor based on results of said second analyzing, second specified audio/video data portions of said audio/video data file;

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

determining, by said computer processor based on said scenario based filtering data, that said second specified audio/video data portions should be removed; and

retrieving, by said computer processor from said audio/video data file, said second specified audio/video data portions from said audio/video data file.

11. The method of claim 1, further comprising:

providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in said computing system, wherein the code in combination with the computing system is capable of performing;

said receiving said audio/video file, said receiving said filtering data, said first analyzing, said determining, said retrieving, said removing, said receiving said tags, said storing said video data, and said storing said multimedia file.

12. A computer program product, comprising a computer readable storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a computer processor of a computing system implements a method comprising:

receiving, by said computer processor, an audio/video data file comprising audio voice data, audio music data, title data, and video data;

receiving, by said computer processor, filtering data associated with filtering said audio/video data file;

first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;

determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;

retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;

removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;

receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;

storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags;

storing, by said computer processor in a memory device, said multimedia file comprising said video data, said audio voice data, said audio music data, said title data, said tags, and said specified data portions; and

presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

13. The computer program product of claim 12, wherein said method further comprises:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.

14. The computer program product of claim 13, wherein said method further comprises:

receiving, by said computer processor from a second user accessing a second device, a command for enabling said audio/video data file, said second user differing from said first user;

retrieving, by said computer processor from said second device, a second user profile associated with said second user, second user profile differing from said first user profile;

third analyzing, by said computer processor, said second user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said second user profile user via said second device in response to results of said second analyzing, said video data, said audio voice data, and second audio/video data portions of said specified audio/video data portions, wherein said second audio/video data portions differ from said first audio/video data portions, wherein said second audio/video data portions are associated with said second user profile, and wherein said second device presents said video data, said audio voice data, and said second audio/video data portions to said second user.

15. The computer program product of claim 12, wherein said method further comprises:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing, a message indicating that said first user is not authorized to receive any of said multimedia files.

16. The computer program product of claim 12, wherein said method further comprises:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to results of said second analyzing first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said first audio/video data portions to said first user.

17. The computer program product of claim 12, wherein said first device comprises a device selected from the group consisting of an Internet enabled television, an Internet portal, and a wireless device.

18. The computer program product of claim 12, wherein each audio/video data portion of said specified audio/video data portions comprises data selected from the group consisting of a video object within a video frame, audio speech data, and text data.

19. A computing system comprising a computer processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the computer processor implements a method comprising:

receiving, by said computer processor, an audio/video data file comprising audio voice data, audio music data, title data, and video data;

receiving, by said computer processor, filtering data associated with filtering said audio/video data file;

first analyzing, by said computer processor, said filtering data with respect to said audio/video data file;

determining, by said computer processor based on results of said first analyzing, specified audio/video data portions of said audio/video data file, wherein said specified audio/video data portions comprise data objects within frames of said audio/video data file;

retrieving, by said computer processor from said audio/video data file in response to said determining, said specified audio/video data portions from said audio/video data file;

removing, by said computer processor, gaps existing in said audio/video data file resulting from said retrieving said specified audio/video data portions;

receiving, by said computer processor, tags comprising instructions for presenting said video data of said audio/video data file, said audio voice data of said audio/video data file, said audio music data, said title data, and said specified audio/video data portions;

storing, by said computer processor, said video data of said audio/video data file in a first individual layer of a multimedia file, said audio voice data of said audio/video data file in a second individual layer of said multimedia file, said audio music data in a third individual layer of said multimedia file, said title data in a fourth individual layer of said multimedia file, and said specified audio/video data portions in additional individual layers of said multimedia file, wherein each of said first individual layer, said individual second layer, said third individual layer, said individual fourth layer, and said additional individual layers comprises a dedicated tag layer comprising associated tags of said tags;

storing, by said computer processor in a memory device, said multimedia file comprising said video data, said audio voice data, said audio music data, said title data, said tags, and said specified data portions; and

presenting, by said computer processor, a graphical user interface (GUI) illustrating said video data in said first individual layer, said audio voice data of said audio/video data file in said second individual layer, said audio music data in said third individual layer, said title data in said fourth individual layer, said specified audio/video data portions in said additional individual layers, and each said dedicated tag layer comprising said associated tags, wherein GUI presents each said dedicated tag layer comprising an associated tag such that each said dedicated tag layer is presented adjacent to an associated layer of said first individual layer, said second individual layer, said third individual layer, said fourth individual layer, and each of said additional individual layers.

20. The computing system of claim 19, wherein said method further comprises:

receiving, by said computer processor from a first user accessing a first device, a command for enabling said audio/video data file;

retrieving, by said computer processor from said first device, a first user profile associated with said first user;

second analyzing, by said computer processor, said first user profile with respect to each tag of said tags; and

transmitting, by said computer processor to said first user via said first device in response to said second analyzing, said video data, said audio voice data, and first audio/video data portions of said specified audio/video data portions, wherein said first audio/video data portions are associated with said first user profile, and wherein said first device presents said video data, said audio voice data, and said first audio/video data portions to said first user.