SIMULATION METHOD AND SYSTEM

• US 20090310939A1
• Filed: 06/12/2008
• Published: 12/17/2009
• Est. Priority Date: 06/12/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Ramabhadran, Bhuvana, Kanevsky, Dimitri, Kelley, Edward Emile
• Granted Patent: US 8,237,742 B2
• Time in Patent Office: Days
• US Class Current: 386/239
• CPC Class Codes: G10L 15/25 using position of the lips, movement of the lips or face analysis
• CPC Class Codes: G10L 2021/0135 Voice conversion or morphing
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33

Abstract

A simulation method and system. A computing system receives a first audio and/or video data stream. The first audio and/or video data stream includes data associated with a first person. The computing system monitors the first audio and/or video data stream. The computing system identifies emotional attributes comprised by the first audio and/or video data stream. The computing system generates a second audio and/or video data stream associated with the first audio and/or video data stream. The second audio and/or video data stream includes the data without the emotional attributes. The computing system stores the second audio and/or video data stream.

Claims

1. A simulation method, comprising:

receiving, by a computing system, a first audio data stream, wherein said first audio data stream comprises first speech data associated with a first person;

monitoring, by said computing system, said first audio data stream;

identifying, by said computing system in response to said monitoring said first audio data stream, first emotional attributes comprised by said first audio data stream;

generating, by said computing system in response to said identifying said first emotional attributes, a second audio data stream associated with said first audio data stream, wherein said second audio data stream comprises said first speech data, and wherein said second audio data stream does not comprise said first emotional attributes; and

storing, by said computing system, said second audio data stream.

2. The method of claim 1, further comprising:

broadcasting, by said computing system, said second audio data stream.

3. The method of claim 1, wherein said first emotional attributes comprise audible vocal expressions of said first person.

4. The method of claim 1, further comprising:

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first audible portion of said second audio data stream with said first attribute; and

generating, by said computing system, an audible label for said first audible portion of said second audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said second audio data stream;

generating, by said computing system in response to said applying, a third audio data stream associated with said second audio data stream, wherein said third audio data stream comprises said second audio data stream and said first audible portion of said second audio data stream comprising said audible label; and

storing, by said computing system, said third audio data stream.

5. A computer program product, comprising a computer storage medium comprising a computer readable program code embodied therein, said computer readable program code configured to perform the method of claim 1 upon being executed by a processor of a computing system.

6. A computing system comprising a processor coupled to a computer-readable memory unit, said memory unit comprising a computer readable code configured to be executed by the processor to perform the method of claim 1.

7. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing the method of claim 1.

8. A simulation method, comprising:

receiving, by a computing system, a first video data stream, wherein said first video data stream comprises first video data associated with a first person;

monitoring, by said computing system, said first video data stream;

identifying, by said computing system in response to said monitoring said first video data stream, first emotional attributes comprised by said first video data;

generating, by said computing system in response to said identifying said first emotional attributes, a second video data stream associated with said first video data stream, wherein said second video data stream comprises second video data associated with said first person, and wherein said second video data does not comprise said first emotional attributes; and

storing, by said computing system, said second video data stream.

9. The method of claim 8, further comprising:

receiving, by said computing system, a first audio data stream, wherein said first audio data stream comprises first speech data associated with said first person;

monitoring, by said computing system, said first audio data stream;

identifying, by said computing system in response to said monitoring said first audio data stream, second emotional attributes comprised by said first audio data stream;

generating, by said computing system in response to said identifying said second emotional attributes, a second audio data stream associated with said first audio data stream, wherein said second audio data stream comprises said first speech data, and wherein said second audio data stream does not comprise said second emotional attributes; and

storing, by said computing system, said second audio data stream.

10. The method of claim 9, further comprising:

identifying, by said computing system, a first attribute of said second emotional attributes;

associating, by said computing system, a first audible portion of said second audio data stream with said first attribute; and

generating, by said computing system, an audible label for said first audible portion of said second audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said second audio data stream;

generating, by said computing system in response to said applying, a third audio data stream associated with said second audio data stream, wherein said third audio data stream comprises said second audio data stream and said first audible portion of said second audio data stream comprising said audible label; and

storing, by said computing system, said third audio data stream.

11. The method of claim 10, further comprising:

synchronizing, by said computing system, portions of said third audio data stream with associated portions of said second video data stream;

generating, by said computing system in response to said synchronizing, a first audio/video data stream associated with said third audio data stream and said second video data stream; and

broadcasting, by said computing system, said first audio/video data stream.

12. The method of claim 9, further comprising:

synchronizing, by said computing system, portions of said second audio data stream with associated portions of said second video data stream;

generating, by said computing system in response to said synchronizing, a first audio/video data stream associated with said second audio data stream and said second video data stream; and

broadcasting, by said computing system, said first audio/video data stream.

13. The method of claim 8, further comprising:

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first visual object of said second video data with said first attribute; and

generating, by said computing system, a viewable label for said first visual object, wherein said viewable label indicates said first attribute;

applying, by said computing system, said viewable label to said first visual object;

generating, by said computing system in response to said applying, a third video data stream associated with said second video data stream, wherein said third video data stream comprises said second video data and said first visual object comprising said viewable label; and

storing, by said computing system, said third video data stream.

14. The method of claim 8, wherein said viewable label comprises a label selected from the group consisting of a polygon label comprising a perimeter for surrounding said first visual object and a label comprising different color applied to said first visual object.

15. The method of claim 8, wherein said first emotional attributes comprise facial expressions of said first person.

16. The method of claim 8, further comprising:

enabling, by said computing system, said second video data stream;

monitoring, by said computing system, said second video data stream;

identifying, by said computing system in response to said monitoring said second video data stream, a first visual image of said second video data stream, wherein said first visual image comprises a first visual object and a second visual object, wherein said first visual object is an intended main viewing object of said first visual image, and wherein said second visual object is an intended background viewing object of said first visual image;

generating, by said computing system from said first visual image, a second visual image, wherein said second visual image comprises said first visual object and said second visual object, wherein said first visual object comprised by said second visual image is an intended background viewing object of said second visual image, and wherein said second visual object comprised by said second visual image is an intended main viewing object of said second visual image;

generating, by said computing system, a third video data stream, wherein said generating, said third video data stream comprises removing said first visual image from said second video data stream and placing said second visual image in said second video data stream; and

storing, by said computing system, said third video data stream.

17. The method of claim 16, further comprising:

generating, by said computing system, a viewable label for said second visual object comprised by said second visual image, wherein said viewable label indicates that said second visual object comprised by said second visual image is an intended main viewing object of said second visual image;

applying, by said computing system, said viewable label to said second visual object comprised by said second visual image;

generating, by said computing system in response to said applying, a fourth video data stream associated with said third video data stream, wherein said fourth video data stream comprises said third video data stream and said second visual object comprising said viewable label; and

storing, by said computing system, said fourth video data stream.

18. A computer program product, comprising a computer storage medium comprising a computer readable program code embodied therein, said computer readable program code configured to perform the method of claim 8 upon being executed by a processor of a computing system.

19. A computing system comprising a processor coupled to a computer-readable memory unit, said memory unit comprising a computer readable code configured to be executed by the processor to perform the method of claim 8.

20. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing the method of claim 8.