Simulation method and system

• US 8,493,410 B2
• Filed: 05/01/2012
• Issued: 07/23/2013
• Est. Priority Date: 06/12/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Kanevsky, Dimitri, Kelley, Edward Emile, Ramabhadran, Bhuvana
• Primary Examiner(s): Richer, Joni
• Application Number:
  US13/460,926
• Publication Number:
  US 20120213489A1
• Time in Patent Office: 448 Days
• Field of Search: None
• US Class Current: 345/629
• CPC Class Codes: G10L 15/25 using position of the lips, movement of the lips or face analysis
• CPC Class Codes: G10L 2021/0135 Voice conversion or morphing
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: G11B 27/028 with computer assistance
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: H04N 21/44213 Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33

Abstract

A simulation method and system. A computing system receives a first audio and/or video data stream. The first audio and/or video data stream includes data associated with a first person. The computing system monitors the first audio and/or video data stream. The computing system identifies emotional attributes comprised by the first audio and/or video data stream. The computing system generates a second audio and/or video data stream associated with the first audio and/or video data stream. The second audio and/or video data stream includes the data without the emotional attributes. The computing system stores the second audio and/or video data stream.

Claims

1. A simulation method, comprising:

receiving, by a computing system, a first audio/video data stream, wherein said first audio/video data stream comprises first speech data associated with a first person;

monitoring, by said computing system, said first audio/video data stream;

identifying, by said computing system in response to said monitoring said first audio/video data stream, first emotional attributes comprised by said first audio/video data stream;

generating, by said computing system in response to said identifying said first emotional attributes, an audio data stream associated with said first audio/video data stream, wherein said audio data stream comprises said first speech data, and wherein said audio data stream does not comprise said first emotional attributes;

storing, by said computing system, said audio data stream;

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first audible portion of said audio data stream with said first attribute;

generating, by said computing system, an audible label for said first audible portion of said audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said audio data stream;

generating, by said computing system in response to said applying, a second audio data stream associated with said audio data stream, wherein said second audio data stream comprises said audio data stream and said first audible portion of said audio data stream comprising said audible label;

generating, by said computing system, a video data stream associated with said audio/video data stream, wherein said video data stream comprises video data associated with said first person, and wherein said video data does not comprise said first emotional attributes;

associating, by said computing system, a first visual object of said video data with said first attribute of said first emotional attributes;

generating, by said computing system, a viewable label for said first visual object, wherein said viewable label indicates said first attribute of said first emotional attributes;

applying, by said computing system, said viewable label to said first visual object;

generating, by said computing system in response to said applying, a second audio/video data stream associated with said second video data stream and said second audio data stream, wherein said second audio/video data stream comprises said audio data stream, said first audible portion of said audio data stream comprising said audible label, said second video data, and said first visual object comprising said viewable label; and

storing, by said computing system, said second audio/video data stream.

2. The method of claim 1, further comprising:

broadcasting, by said computing system, said second audio/video data stream.

3. The method of claim 1, wherein said first emotional attributes comprise audible and visual vocal expressions of said first person.

4. The method of claim 1, wherein said viewable label comprises a label selected from the group consisting of a polygon label comprising a perimeter for surrounding said first visual object and a label comprising different color applied to said first visual object.

5. The method of claim 1, wherein said first emotional attributes comprise facial expressions of said first person.

6. A computer program product, comprising a computer storage device storing a computer readable program code, said computer readable program code configured to perform a method upon being executed by a processor of a computing system, said method comprising:

receiving, by said computing system, a first audio/video data stream, wherein said first audio/video data stream comprises first speech data associated with a first person;

monitoring, by said computing system, said first audio/video data stream;

identifying, by said computing system in response to said monitoring said first audio/video data stream, first emotional attributes comprised by said first audio/video data stream;

generating, by said computing system in response to said identifying said first emotional attributes, an audio data stream associated with said first audio/video data stream, wherein said audio data stream comprises said first speech data, and wherein said audio data stream does not comprise said first emotional attributes;

storing, by said computing system, said audio data stream;

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first audible portion of said audio data stream with said first attribute;

generating, by said computing system, an audible label for said first audible portion of said audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said audio data stream;

generating, by said computing system in response to said applying, a second audio data stream associated with said audio data stream, wherein said second audio data stream comprises said audio data stream and said first audible portion of said audio data stream comprising said audible label;

generating, by said computing system, a video data stream associated with said audio/video data stream, wherein said video data stream comprises video data associated with said first person, and wherein said video data does not comprise said first emotional attributes;

associating, by said computing system, a first visual object of said video data with said first attribute of said first emotional attributes;

generating, by said computing system, a viewable label for said first visual object, wherein said viewable label indicates said first attribute of said first emotional attributes;

applying, by said computing system, said viewable label to said first visual object;

generating, by said computing system in response to said applying, a second audio/video data stream associated with said second video data stream and said second audio data stream, wherein said second audio/video data stream comprises said audio data stream, said first audible portion of said audio data stream comprising said audible label, said second video data, and said first visual object comprising said viewable label; and

storing, by said computing system, said second audio/video data stream.

7. The computer program product of claim 6, wherein said method further comprises:

broadcasting, by said computing system, said second audio/video data stream.

8. The computer program product of claim 6, wherein said first emotional attributes comprise audible and visual vocal expressions of said first person.

9. The computer program product of claim 6, wherein said viewable label comprises a label selected from the group consisting of a polygon label comprising a perimeter for surrounding said first visual object and a label comprising different color applied to said first visual object.

10. The computer program product of claim 6, wherein said first emotional attributes comprise facial expressions of said first person.

11. A computing system comprising a processor coupled to a computer-readable memory unit, said memory unit comprising a computer readable code configured to be executed by the processor to perform a method comprising:

receiving, by said computing system, a first audio/video data stream, wherein said first audio/video data stream comprises first speech data associated with a first person;

monitoring, by said computing system, said first audio/video data stream;

identifying, by said computing system in response to said monitoring said first audio/video data stream, first emotional attributes comprised by said first audio/video data stream;

generating, by said computing system in response to said identifying said first emotional attributes, an audio data stream associated with said first audio/video data stream, wherein said audio data stream comprises said first speech data, and wherein said audio data stream does not comprise said first emotional attributes;

storing, by said computing system, said audio data stream;

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first audible portion of said audio data stream with said first attribute;

generating, by said computing system, an audible label for said first audible portion of said audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said audio data stream;

generating, by said computing system in response to said applying, a second audio data stream associated with said audio data stream, wherein said second audio data stream comprises said audio data stream and said first audible portion of said audio data stream comprising said audible label;

generating, by said computing system, a video data stream associated with said audio/video data stream, wherein said video data stream comprises video data associated with said first person, and wherein said video data does not comprise said first emotional attributes;

associating, by said computing system, a first visual object of said video data with said first attribute of said first emotional attributes;

generating, by said computing system, a viewable label for said first visual object, wherein said viewable label indicates said first attribute of said first emotional attributes;

applying, by said computing system, said viewable label to said first visual object;

generating, by said computing system in response to said applying, a second audio/video data stream associated with said second video data stream and said second audio data stream, wherein said second audio/video data stream comprises said audio data stream, said first audible portion of said audio data stream comprising said audible label, said second video data, and said first visual object comprising said viewable label; and

storing, by said computing system, said second audio/video data stream.

12. The computing system of claim 11, wherein said method further comprises:

broadcasting, by said computing system, said second audio/video data stream.

13. The computing system of claim 11, wherein said first emotional attributes comprise audible and visual vocal expressions of said first person.

14. The computing system of claim 11, wherein said viewable label comprises a label selected from the group consisting of a polygon label comprising a perimeter for surrounding said first visual object and a label comprising different color applied to said first visual object.

15. The computing system of claim 11, wherein said first emotional attributes comprise facial expressions of said first person.

16. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing a method comprising:

receiving, by said computing system, a first audio/video data stream, wherein said first audio/video data stream comprises first speech data associated with a first person;

monitoring, by said computing system, said first audio/video data stream;

identifying, by said computing system in response to said monitoring said first audio/video data stream, first emotional attributes comprised by said first audio/video data stream;

generating, by said computing system in response to said identifying said first emotional attributes, an audio data stream associated with said first audio/video data stream, wherein said audio data stream comprises said first speech data, and wherein said audio data stream does not comprise said first emotional attributes;

storing, by said computing system, said audio data stream;

identifying, by said computing system, a first attribute of said first emotional attributes;

associating, by said computing system, a first audible portion of said audio data stream with said first attribute;

generating, by said computing system, an audible label for said first audible portion of said audio data stream, wherein said audible label indicates said first attribute;

applying, by said computing system, said audible label to said first audible portion of said audio data stream;

generating, by said computing system in response to said applying, a second audio data stream associated with said audio data stream, wherein said second audio data stream comprises said audio data stream and said first audible portion of said audio data stream comprising said audible label;

generating, by said computing system, a video data stream associated with said audio/video data stream, wherein said video data stream comprises video data associated with said first person, and wherein said video data does not comprise said first emotional attributes;

associating, by said computing system, a first visual object of said video data with said first attribute of said first emotional attributes;

generating, by said computing system, a viewable label for said first visual object, wherein said viewable label indicates said first attribute of said first emotional attributes;

applying, by said computing system, said viewable label to said first visual object;

generating, by said computing system in response to said applying, a second audio/video data stream associated with said second video data stream and said second audio data stream, wherein said second audio/video data stream comprises said audio data stream, said first audible portion of said audio data stream comprising said audible label, said second video data, and said first visual object comprising said viewable label; and

storing, by said computing system, said second audio/video data stream.

17. The process of claim 16, wherein said method further comprises:

broadcasting, by said computing system, said second audio/video data stream.

18. The process of claim 16, wherein said first emotional attributes comprise audible and visual vocal expressions of said first person.

19. The process of claim 16, wherein said viewable label comprises a label selected from the group consisting of a polygon label comprising a perimeter for surrounding said first visual object and a label comprising different color applied to said first visual object.

20. The process of claim 16, wherein said first emotional attributes comprise facial expressions of said first person.