REAL-TIME DIGITAL ASSISTANT KNOWLEDGE UPDATES

• US 20150382079A1
• Filed: 09/26/2014
• Published: 12/31/2015
• Est. Priority Date: 06/30/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: LISTER, Patrick M., ORR, Ryan M., CRAWFORD, Jared A.
• Granted Patent: US 10,659,851 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/73 Querying
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/93 Regeneration of the television signal or of selected parts thereof

Abstract

Systems and processes are disclosed for real-time updating of virtual assistant media knowledge. Virtual assistant knowledge can be updated with timely information associated with playing media (e.g., a sporting event, a television show, or the like). A data feed can be received that includes data relating events to particular times in a media stream. A user request can be received based on speech input, and the user request can be associated with an event in a media stream or show. In response to receiving the request, the media stream can be cued to commence playback at a time in the media stream associated with the event referred to in the request. In another example, a response to the user request can be generated based on the data relating to the events. The response can then be delivered to the user (e.g., spoken aloud, displayed, etc.).

Claims

1. A method for voice control of media playback, the method comprising:

at an electronic device;

receiving a data feed, wherein the data feed comprises data relating to an event associated with a time in a media stream;

receiving a user request based on speech input, wherein the user request is associated with the event; and

in response to receiving the user request, causing playback of the media stream to commence at the time in the media stream associated with the event.

2. The method of claim 1, further comprising:

interpreting the user request based on currently playing media.

3. The method of claim 1, further comprising:

interpreting the user request based on a current playback position of currently playing media.

4. The method of claim 1, further comprising:

interpreting the user request based on one or more of on-screen actors, on-screen players, a list of game participants, a list of actors in a show, a list of characters in a show, or a team roster.

5. The method of claim 1, wherein the media stream comprises a sporting event, and wherein the data relating to the event comprises one or more of a characteristic of a player, a score, a penalty, a statistic, or a game segment designator.

6. The method of claim 1, wherein the media stream comprises an awards show, and wherein the data relating to the event comprises one or more of a characteristic of a participant, a performance description, or an award presentation designator.

7. The method of claim 1, wherein the media stream comprises a television program, and wherein the data relating to the event comprises one or more of a performance description or a show segment designator.

8. The method of claim 1, wherein the user request comprises a request for highlights in the media stream.

9. The method of claim 1, further comprising:

in response to receiving the user request, causing consecutive playback of a plurality of segments of the media stream.

10. The method of claim 1, wherein causing playback of the media stream comprises causing media playback on a playback device other than the electronic device.

11. The method claim 10, further comprising:

interpreting the user request based on information displayed by the electronic device.

12. The method of claim 10, further comprising:

interpreting the user request based on information displayed by the playback device.

13. The method of claim 1, wherein the data relating to the event comprises closed captioning text.

14. The method of claim 13, further comprising:

determining the time in the media stream associated with the event based on the closed captioning text.

15. The method of claim 1, wherein the data relating to the event comprises one or more of secondary screen experience data, secondary camera view data, or social network feed data.

16. The method of claim 1, further comprising:

receiving a bookmark indication from the user, wherein the bookmark corresponds to a particular playback position in the media stream.

17. The method of claim 16, further comprising:

receiving a user request to share the bookmark; and

in response to receiving the user request to share the bookmark, causing cue information associated with the particular playback position to be transmitted to a server.

18. The method of claim 1, further comprising:

interpreting the user request based on one or more of a user'"'"'s favorite team, a user'"'"'s favorite sport, a user'"'"'s favorite player, a user'"'"'s favorite actor, a user'"'"'s favorite television show, a user'"'"'s geographical location, a user demographic, a user'"'"'s viewing history, or a user'"'"'s subscription data.

19. A non-transitory computer-readable storage medium comprising computer-executable instructions for:

receiving a data feed, wherein the data feed comprises data relating to an event associated with a time in a media stream;

receiving a user request based on speech input, wherein the user request is associated with the event; and

responsive to receiving the user request, for causing playback of the media stream to commence at the time in the media stream associated with the event.

20. A system for voice control of media playback, the system comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving a data feed, wherein the data feed comprises data relating to an event associated with a time in a media stream;

receiving a user request based on speech input, wherein the user request is associated with the event; and

responsive to receiving the user request, for causing playback of the media stream to commence at the time in the media stream associated with the event.

21. A method for integrating information into digital assistant knowledge, the method comprising:

at an electronic device;

receiving a data feed, wherein the data feed comprises data relating to an event associated with a time in a media stream;

receiving a user request based on speech input from a user, wherein the user request is associated with the event;

generating a response to the user request based on the data relating to the event; and

causing the response to be delivered.

22. The method of claim 21, wherein generating the response further comprises generating the response based on currently playing media.

23. The method of claim 21, wherein generating the response further comprises generating the response based on a current playback position of currently playing media.

24. The method of claim 21, wherein generating the response further comprises generating the response based on media content previously consumed by the user.

25. The method of claim 21, wherein generating the response further comprises generating the response based on one or more of on-screen actors, on-screen players, a list of game participants, a list of actors in a show, or a team roster.

26. The method of claim 21, further comprising:

in response to the user request comprising a request for information contemporaneous with a current playback position of currently playing media, generating the response based on data contemporaneous with the current playback position, wherein the data contemporaneous with the current playback position excludes data associated with a time after the current playback position; and

in response to the user request comprising a request for live information, generating the response based on live data.

27. The method of claim 21, wherein causing the response to be delivered comprises causing the response to be displayed or played on a playback device other than the electronic device.

28. The method of claim 21, wherein causing the response to be delivered comprises causing the response to be delivered to a playback device other than the electronic device.