Methods, systems, and media for rewinding media content based on detected audio events

• US 10,073,674 B2
• Filed: 01/25/2016
• Issued: 09/11/2018
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Stout, James
• Primary Examiner(s): Nabi, Reza
• Application Number:
  US15/005,439
• Publication Number:
  US 20160154625A1
• Time in Patent Office: 960 Days
• Field of Search: 715716
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 25/84 for discriminating voice from noise
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

Methods, systems, and media for rewinding media content based on detected audio events are provided. In some embodiments, a method for providing media guidance is provided, the method comprising: causing media content to be presented; receiving, using an audio input device, audio data that includes ambient sounds in an environment in which the media content is being presented; receiving a user command to rewind the media content; detecting that a portion of the audio data corresponds to an audio event that occurred during the presentation of the media content in response to receiving the user command to rewind the media content; determining a playback position in the media content based on the audio event; and causing the media content to be presented from the determined playback position.

Claims

1. A method for providing media guidance, the method comprising:

causing, using a hardware processor, media content to be presented, wherein the media content includes an audio portion;

receiving, using an audio input device, audio data that includes ambient sounds in an environment in which the media content is being presented;

generating an audio fingerprint from the received audio data;

detecting that a portion of the audio data corresponds to an audio event that occurred during the presentation of the media content by comparing the audio fingerprint with a plurality of audio fingerprints representing one or more audio events;

placing one or more identifiers within a media content file corresponding to the presented media content that identifies the one or more audio events based on the comparison;

receiving a user command to rewind the media content by identifying a voice input from the audio data that corresponds to a request to rewind the media content;

determining a playback position in the media content based on the audio event, wherein the playback position corresponds to a position in the media content file that is a given time period prior to an identifier within the media content file that identifies the audio event; and

causing the media content to be presented from the determined playback position in response to receiving the user command to rewind the media content.

2. The method of claim 1, wherein receiving the user command to rewind the media content further comprises detecting that the user command has been received from a remote control.

3. The method of claim 1, further comprising:

determining a plurality of absolute ambient noise levels in the audio data; and

comparing each of the plurality of absolute ambient noise levels with a predetermined threshold value;

wherein the audio event is detected during the presentation of the media content based on the comparison of each of the plurality of absolute ambient noise levels with the predetermined threshold value.

4. The method of claim 1, further comprising:

detecting a type of audio event from the audio data; and

determining the playback position based on the type of audio event.

5. The method of claim 1, further comprising:

calculating a plurality of relative ambient noise level information in the audio data based on the audio portion, wherein the audio fingerprint includes the plurality of relative ambient noise level information.

6. The method of claim 1, further comprising:

comparing the generated audio fingerprint with an audio fingerprint of the presented media content, wherein the one or more identifiers are placed within the media content file that identify the one or more audio events based on the comparison of the generated audio fingerprint of the received audio data with the audio fingerprint of the presented media content.

7. A system for providing media guidance is provided, the system comprising:

an audio input device;

a storage device; and

at least one hardware processor that is configured to;

cause media content to be presented, wherein the media content includes an audio portion;

store audio data received using the audio input device in the storage device, wherein the audio data includes ambient sounds in an environment in which the media content is being presented;

generate an audio fingerprint from the received audio data;

detect that a portion of the audio data corresponds to an audio event that occurred during the presentation of the media content by comparing the audio fingerprint with a plurality of audio fingerprints representing one or more audio events;

place one or more identifiers within a media content file corresponding to the presented media content that identifies the one or more audio events based on the comparison;

receive a user command to rewind the media content by identifying a voice input from the audio data that corresponds to a request to rewind the media content;

determine a playback position in the media content based on the audio event, wherein the playback position corresponds to a position in the media content file that is a given time period prior to an identifier within the media content file that identifies the audio event; and

cause the media content to be presented from the determined playback position in response to receiving the user command to rewind the media content.

8. The system of claim 7, wherein the hardware processor is further configured to detect that the user command has been received from a remote control.

9. The system of claim 7, wherein the hardware processor is further configured to:

determine a plurality of absolute ambient noise levels in the audio data; and

compare each of the plurality of absolute ambient noise levels with a predetermined threshold value;

wherein the audio event is detected during the presentation of the media content based on the comparison of each of the plurality of absolute ambient noise levels with the predetermined threshold value.

10. The system of claim 7, wherein the hardware processor is further configured to:

detect a type of audio event from the audio data; and

determine the playback position based on the type of audio event.

11. The system of claim 7, wherein the hardware processor is further configured to:

calculate a plurality of relative ambient noise level information in the audio data based on the audio portion, wherein the audio fingerprint includes the plurality of relative ambient noise level information.

12. The system of claim 7, wherein the hardware processor is further configured to:

compare the generated audio fingerprint with an audio fingerprint of the presented media content, wherein the one or more identifiers are placed within the media content file that identify the one or more audio events based on the comparison of the generated audio fingerprint of the received audio data with the audio fingerprint of the presented media content.

13. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for presenting a media file, the method comprising:

causing media content to be presented, wherein the media content includes an audio portion;

receiving audio data that includes ambient sounds in an environment in which the media content is being presented;

generating an audio fingerprint from the received audio data;

detecting that a portion of the audio data corresponds to an audio event that occurred during the presentation of the media content by comparing the audio fingerprint with a plurality of audio fingerprints representing one or more audio events;

placing one or more identifiers within a media content file corresponding to the presented media content that identifies the one or more audio events based on the comparison;

receiving a user command to rewind the media content by identifying a voice input from the audio data that corresponds to a request to rewind the media content;

determining a playback position in the media content based on the audio event, wherein the playback position corresponds to a position in the media content file that is a given time period prior to an identifier within the media content file that identifies the audio event; and

causing the media content to be presented from the determined playback position in response to receiving the user command to rewind the media content.

14. The non-transitory computer-readable medium of claim 13, wherein the method further comprises detecting that the user command has been received from a remote control.

15. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

determining a plurality of absolute ambient noise levels in the audio data; and

comparing each of the plurality of absolute ambient noise levels with a predetermined threshold value;

wherein the audio event is detected during the presentation of the media content based on the comparison of each of the plurality of absolute ambient noise levels with the predetermined threshold value.

16. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

detecting a type of audio event from the audio data; and

determining the playback position based on the type of audio event.

17. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

calculating a plurality of relative ambient noise level information in the audio data based on the audio portion, wherein the audio fingerprint includes the plurality of relative ambient noise level information.

18. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

comparing the generated audio fingerprint with an audio fingerprint of the presented media content, wherein the one or more identifiers are placed within the media content file that identify the one or more audio events based on the comparison of the generated audio fingerprint of the received audio data with the audio fingerprint of the presented media content.