Method and assembly for improved audio signal presentation of sounds during a video recording

• US 9,240,213 B2
• Filed: 11/24/2011
• Issued: 01/19/2016
• Est. Priority Date: 11/25/2010
• Status: Active Grant

• Current Assignee: Institut Fur Rundfunktechnik GmbH
• Original Assignee: Institut Fur Rundfunktechnik GmbH
• Inventors: Gerstlberger, Iris, Hartmann, Christian, Meier, Michael
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): ADAMS, EILEEN M
• Application Number:
  US13/988,732
• Publication Number:
  US 20140003796A1
• Time in Patent Office: 1,517 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 5/60 for the sound signals

Abstract

In order to achieve an improved audio presentation of sounds, in particular sports specific sounds, at reduced technical effort during any video recording, it is suggested to capture sensor-based and analyze image contents of video images. From the information obtained hereby, fitting sound events (audio samples) are selected according to predefined criteria from an audio database. The selected sound events are automatically added to the components of a video accompanying sound.

Claims

1. A method for improved presentation of sounds during a video recording, wherein the video recording is a recording of a sport event, the method comprising:

capturing image contents of video images included in the video recording of the sport event with sensors, wherein the video recording includes a video accompanying sound;

analyzing the captured image contents to identify specific sport actions during the sport event;

based on information obtained from the specific sport actions identified from the captured images, selecting audio events corresponding to said sport actions from an audio database according to predefined criteria; and

automatically adding the selected audio events corresponding to said sports actions to components of the video accompanying sound of the video recording.

2. The method according to claim 1, wherein during sensor-based capturing of the image contents of currently transmitted video images (transmission images), an analysis of the transmission images is performed using algorithms from a field of “

machine vision”

, wherein the algorithms are configured to separate and trace moving objects against an image background, and determine their positions in dependency of an image section.

3. The method according to claim 1, wherein during the sensor-based capturing of the image contents, instead of currently transmitted video images (transmission images), the signal of a dedicated and statically installed tracking camera is employed that is calibrated to a corresponding image scene, and external information about the transmission image is used for the analysis.

4. The method according to claim 1, wherein for more detailed definition and capturing of motion sequences, additional sensor-based parameters are captured that determine the actions of actors appearing in the video images in a physical way.

5. The method according to claim 1, wherein the information about the image section of the video image is taken into account when selecting the sound events.

6. The method according to claim 1, wherein parameters, captured sensor-based, for the description of the video image are logically linked to each other according to predefined rules, and control commands for the selection of archived individual sounds, referred to as “

audio samples”

, are generated according to the resulting information.

7. The method according to claim 6, wherein the audio events are sorted in the audio database in dependency of the specific features of the audio events (“

sample mapping”

).

8. The method according to claim 7, wherein for the “

sample mapping”

in a case of a soccer game to be joined with realistic sounds, audio events are distinguished in the groups “

body”

, “

shots” and

“

passes”

for different playing techniques in the form of ball receptions and deliveries by the body or foot of a player.

9. The method according to claim 7, wherein for the “

sample mapping”

in a case of a soccer game to be joined with realistic sounds, audio events with varying volume are arranged depending on playing intensity detected, and different audio events take a tonal differences of different playing powers of shots, passes, and body receptions into account as well.

10. The method according to claim 1, wherein the method is carried out in real time.

11. The method according to claim 10, wherein a real time sound editing of the audio events played back from the audio database is performed in dependence of an analysis of the video image.

12. The method according to claim 11, wherein during the selection of the audio events from the audio database and real-time sound editing, distinction is made between the following features:

type of the sound

volume of the sound (velocity)

reverberation addition (spatiality)

panning (assigning direction to the sound).

13. The method according to claim 1, characterized in that audio signals of the video images are recorded and analyzed, which characterize specific actions of the images.

14. An assembly for improved presentation of sounds during a video recording of a sport event, the assembly comprising:

a sensor for detection of characteristic image contents of a video recording of a sport event, wherein the video recording includes a video accompanying sound

an analysis and processing unit for analyzing the detected image contents of the video recording,

an audio database for archiving individual sound events that correspond to specific actions, and

a mixer console,

wherein the sensor is adapted to identify specific sport actions during the sport event,

the analysis and processing unit is adapted to select an audio event from the audio events archived in the audio database that corresponds to the specific sport action identified by the sensor in the video recording, and

the mixer console is adapted to mix the audio event selected by the analysis and processing unit corresponding to the specific sport action to the video accompanying sound of the video recording.