Perspective-based dynamic audio volume adjustment

  • US 10,592,199 B2
  • Filed: 01/24/2017
  • Issued: 03/17/2020
  • Est. Priority Date: 01/24/2017
  • Status: Active Grant
  • ×
    • Pin Icon | RPX Insight
    • Pin
First Claim
Patent Images

1. A computer-implemented method comprising:

  • obtaining multimedia content by a hardware processor, the multimedia content comprising a plurality of video frames of a scene and audio content for playing in conjunction with display of the plurality of video frames, the audio content comprising a plurality of audio portions corresponding to a plurality of objects in the scene, wherein the plurality of video frames of the scene are captured by a camera, wherein the multimedia content comprises a multimedia data file including metadata, the metadata including object distance information indicating distances between the plurality of objects in the scene and the camera, and wherein the multimedia data file comprises, for each object of the plurality of objects, an audio volume level, for the object, determined based on a respective distance, of the object distance information, measured between the camera and the object; and

    based on a user selection of a viewing perspective from which the user is to view the scene, the selection made from a plurality of available viewing perspectives available from which to view the scene and each of the plurality of available viewing perspectives corresponding to a respective unique virtual position within the scene and having a unique set of distances from the objects in the scene, determining, by the hardware processor, an audio mix for the plurality of audio portions given the selected viewing perspective, the determining the audio mix comprising determining, for each object of the plurality of objects in the scene, a respective audio volume level for an audio portion, of the plurality of audio portions, corresponding to the object, the respective audio volume level based at least in part on a position of the object relative to the selected viewing perspective and the camera, wherein the audio volume level corresponding to the object is determined as a function of at least (i) the respective distance measured between the camera and the object and (ii) a baseline loudness for the object at a given distance, as obtained from a knowledgebase.

View all claims
    ×
    ×

    Thank you for your feedback

    ×
    ×