Multiple audio/video data stream simulation method and system

• US 8,259,992 B2
• Filed: 06/13/2008
• Issued: 09/04/2012
• Est. Priority Date: 06/13/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Kanevsky, Dimitri, Kelley, Edward Emile, Ramabhadran, Bhuvana
• Primary Examiner(s): SKED, MATTHEW J
• Application Number:
  US12/138,996
• Publication Number:
  US 20090313015A1
• Time in Patent Office: 1,544 Days
• Field of Search: None
• US Class Current: 382/100
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes

Abstract

A multiple audio/video data stream simulation method and system. A computing system receives first audio and/or video data streams. The first audio and/or video data streams include data associated with a first person and a second person. The computing system monitors the first audio and/or video data streams. The computing system identifies emotional attributes comprised by the first audio and/or video data streams. The computing system generates second audio and/or video data streams associated with the first audio and/or video data streams. The second audio and/or video data streams include the first audio and/or video data streams data without the emotional attributes. The computing system stores the second audio and/or video data streams.

Claims

1. A method, comprising:

receiving, by a computing system, a first video data stream, wherein said first video data stream comprises first video data associated with a first person;

receiving, by said computing system, a second video data stream, wherein said second video data stream comprises second video data associated with a second person;

monitoring, by said computing system, said first video data stream and said second video data stream;

identifying, by said computing system in response to said monitoring said first video data stream, first emotional attributes comprised by said first video data;

generating, by said computing system in response to said identifying said first emotional attributes, a third video data stream associated with said first video data stream, wherein said third video data stream comprises third video data associated with said first person, and wherein said third video data does not comprise said first emotional attributes;

identifying, by said computing system in response to said monitoring said second video data stream, second emotional attributes comprised by said second video data;

identifying, by said computing system, a first emotional attribute of said second emotional attributes;

associating, by said computing system, a first visual object of said second video data stream with said first emotional attribute of said second emotional attributes; and

generating, by said computing system, a first viewable label for said first visual object, wherein said first viewable label indicates said first emotional attribute of said second emotional attributes;

applying, by said computing system, said first viewable label to said first visual object;

generating, by said computing system in response to said applying said first viewable label, a fourth video data stream associated with said second video data stream, wherein said fourth video data stream comprises said second emotional attributes, said second video data, and said first visual object comprising said first viewable label;

first combining, by said computing system, said fourth video data stream with said third video data stream;

generating, by said computing system in response to said first combining, a fifth video data stream, wherein said fifth video data stream comprises said fourth video data stream and said third video data stream;

storing, by said computing system, said fifth video data stream;

receiving, by said computing system, a first audio data stream, wherein said first audio data stream comprises first speech data associated with said first person;

receiving, by said computing system, a second audio data stream, wherein said second audio data stream comprises second speech data associated with said second person;

monitoring, by said computing system, said first audio data stream and said second audio data stream;

identifying, by said computing system in response to said monitoring said first audio data stream, third emotional attributes comprised by said first audio data stream;

generating, by said computing system in response to said identifying said third emotional attributes, a third audio data stream associated with said first audio data stream, wherein said third audio data stream comprises said first speech data, and wherein said third audio data stream does not comprise said third emotional attributes;

identifying, by said computing system in response to said monitoring said second audio data stream, fourth emotional attributes comprised by said second audio data stream;

identifying, by said computing system, a second emotional attribute of said third emotional attributes;

associating, by said computing system, a first audible portion of said second audio data stream with said second emotional attribute of said third emotional attributes;

generating, by said computing system, a first audible label for said first audible portion of said second audio data stream, wherein said first audible label indicates said second emotional attribute of said third emotional attributes;

applying, by said computing system, said first audible label to said first audible portion of said second audio data stream;

generating, by said computing system in response to said applying said first audible portion, a fourth audio data stream associated with said second audio data stream, wherein said fourth audio data stream comprises said forth emotional attributes, said second audio data stream, and said first audible portion of said second audio data stream comprising said first audible label;

second combining, by said computing system, said fourth audio data stream with said third audio data stream;

generating, by said computing system in response to said second combining, a fifth audio data stream, wherein said fifth audio data stream comprises said fourth audio data stream and said third audio data stream; and

storing, by said computing system, said fifth audio data stream.

2. The method of claim 1, further comprising:

synchronizing, by said computing system, portions of said fifth audio data stream with associated portions of said fifth video data stream;

generating, by said computing system in response to said synchronizing, a first audio/video data stream associated with said fifth audio data stream and said fifth video data stream; and

broadcasting, by said computing system, said first audio/video data stream.

3. The method of claim 1, further comprising:

enabling, by said computing system, said third video data stream;

monitoring, by said computing system, said third video data stream;

identifying, by said computing system in response to said monitoring said third video data stream, a first visual image of said third video data stream, wherein said first visual image comprises a second visual object and a third visual object, wherein said second visual object is an intended main viewing object of said first visual image, and wherein said third visual object is an intended background viewing object of said first visual image;

generating, by said computing system from said first visual image, a second visual image, wherein said second visual image comprises said second visual object and said third visual object, wherein said second visual object comprised by said second visual image is an intended background viewing object of said second visual image, and wherein said third visual object comprised by said second visual image is an intended main viewing object of said second visual image;

generating, by said computing system, a sixth video data stream, wherein said generating, said sixth video data stream comprises removing said first visual image from said second video data stream and placing said second visual image in said second video data stream; and

storing, by said computing system, said sixth video data stream.

4. The method of claim 3, further comprising:

generating, by said computing system, a second viewable label for said third visual object comprised by said second visual image, wherein said second viewable label indicates that said third visual object comprised by said second visual image is an intended main viewing object of said second visual image;

applying, by said computing system, said second viewable label to said third visual object comprised by said second visual image;

generating, by said computing system in response to said applying said second viewable label, a seventh video data stream associated with said sixth video data stream, wherein said seventh video data stream comprises said sixth video data stream and said third visual object comprising said second viewable label; and

storing, by said computing system, said seventh video data stream.

5. The method of claim 1, wherein said first emotional attributes comprise facial expressions of said first person, and wherein said second emotional attributes comprise facial expressions of said second person.

6. A computer program product, comprising a computer storage device storing a computer readable program code, said computer readable program code configured to perform the method of claim 1 upon being executed by a processor of a computing system.

7. A computing system comprising a processor coupled to a computer-readable memory unit, said memory unit comprising a computer readable code configured to be executed by the processor to perform the method of claim 1.

8. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing the method of claim 1.

9. A method, comprising:

receiving, by a computing system, a first audio/video data stream;

extracting, by said computing system from said first audio/video data stream, a first audio/video data sub-stream and a second audio/video data sub-stream;

extracting, by said computing system from said first audio/video data sub-stream, a first video data stream and a first audio data stream, wherein said first video data stream comprises first video data associated with a first person, and wherein said first audio data stream comprises first speech data associated with said first person;

extracting, by said computing system from said second audio/video data sub-stream, a second video data stream and a second audio data stream, wherein said second video data stream comprises second video data associated with a second person, and wherein said second audio data stream comprises second speech data associated with said second person;

monitoring, by said computing system, said first video data stream and said second video data stream;

identifying, by said computing system in response to said monitoring said first video data stream, first emotional attributes comprised by said first video data;

generating, by said computing system in response to said identifying said first emotional attributes, a third video data stream associated with said first video data stream, wherein said third video data stream comprises third video data associated with said first person, and wherein said third video data does not comprise said first emotional attributes;

identifying, by said computing system in response to said monitoring said second video data stream, second emotional attributes comprised by said second video data;

identifying, by said computing system, a first emotional attribute of said second emotional attributes;

associating, by said computing system, a first visual object of said second video data stream with said first emotional attribute of said second emotional attributes;

generating, by said computing system, a first viewable label for said first visual object, wherein said first viewable label indicates said first emotional attribute of said second emotional attributes;

applying, by said computing system, said first viewable label to said first visual object;

generating, by said computing system in response to said applying said first viewable label, a fourth video data stream associated with said second video data stream, wherein said fourth video data stream comprises said second emotional attributes, said second video data, and said first visual object comprising said first viewable label;

first combining, by said computing system, said fourth video data stream with said third video data stream;

generating, by said computing system in response to said first combining, a fifth video data stream, wherein said fifth video data stream comprises said fourth video data stream and said third video data stream;

storing, by said computing system, said fifth video data stream;

monitoring, by said computing system, said first audio data stream and said second audio data stream;

identifying, by said computing system in response to said monitoring said first audio data stream, third emotional attributes comprised by said first audio data stream;

generating, by said computing system in response to said identifying said third emotional attributes, a third audio data stream associated with said first audio data stream, wherein said third audio data stream comprises said first speech data, and wherein said third audio data stream does not comprise said third emotional attributes;

identifying, by said computing system in response to said monitoring said second audio data stream, fourth emotional attributes comprised by said second audio data stream;

identifying, by said computing system, a second emotional attribute of said third emotional attributes;

associating, by said computing system, a first audible portion of said second audio data stream with said second emotional attribute of said third emotional attributes;

generating, by said computing system, a first audible label for said first audible portion of said second audio data stream, wherein said first audible label indicates said second emotional attribute of said third emotional attributes;

applying, by said computing system, said first audible label to said first audible portion of said second audio data stream;

generating, by said computing system in response to said applying said first audible portion, a fourth audio data stream associated with said second audio data stream, wherein said fourth audio data stream comprises said forth emotional attributes, said second audio data stream, and said first audible portion of said second audio data stream comprising said first audible label;

second combining, by said computing system, said fourth audio data stream with said third audio data stream;

generating, by said computing system in response to said second combining, a fifth audio data stream, wherein said fifth audio data stream comprises said fourth audio data stream and said third audio data stream; and

storing, by said computing system, said fifth audio data stream.

10. The method of claim 9, further comprising:

synchronizing, by said computing system, portions of said fifth audio data stream with associated portions of said fifth video data stream;

generating, by said computing system in response to said synchronizing, a second audio/video data stream associated with said fifth audio data stream and said fifth video data stream; and

broadcasting, by said computing system, said second audio/video data stream.

11. A computer program product, comprising a computer storage device storing a computer readable program code, said computer readable program code configured to perform the method of claim 9 upon being executed by a processor of a computing system.

12. A computing system comprising a processor coupled to a computer-readable memory unit, said memory unit comprising a computer readable code configured to be executed by the processor to perform the method of claim 9.

13. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing the method of claim 9.