Device, method, and graphical user interface for providing audiovisual feedback

• US 10,599,394 B2
• Filed: 11/19/2018
• Issued: 03/24/2020
• Est. Priority Date: 09/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Brown, Matthew I., Cieplinski, Avi E.
• Primary Examiner(s): Titcomb, William D
• Application Number:
  US16/195,737
• Publication Number:
  US 20190138273A1
• Time in Patent Office: 491 Days
• Field of Search: 715716
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

An electronic device provides, to a display, data to present a first video information user interface that includes descriptive information about a first video. The electronic device provides, to an audio system, sound information to provide a first sound output which corresponds to the first video. In response to receiving an input that corresponds to a request to playback the first video, data is provided to the display to replace presentation of the first video information user interface with playback of the first video. In response receiving an input that corresponds to a request to display a second video information user interface about the first video, data is provided to the display to replace the playback of the first video with the second video information user interface about the first video, and sound information is provided to the audio system to provide a second sound output.

Claims

1. A method, comprising:

at an electronic device with one or more processors and memory, wherein the device is in communication with a display and an audio system;

providing, to the display, data to present a first video information user interface that includes descriptive information about a first video; and

providing, to the audio system, sound information to provide a first sound output, which corresponds to the first video, during presentation of the first video information user interface by the display;

providing, to the display, data to replace presentation of the first video information user interface with playback of the first video;

during the playback of the first video, receiving an input that corresponds to a request to display a second video information user interface about the first video; and

,

in response to receiving the input that corresponds to the request to display the second video information user interface about the first video;

providing, to the display, data to replace the playback of the first video with the second video information user interface about the first video, and

providing, to the audio system, sound information to provide a second sound output that corresponds to the first video, during presentation of the second video information user interface by the display.

2. The method of claim 1, wherein the first sound output and/or the second sound output are selected from soundtracks of the first video.

3. The method of claim 1, wherein:

the second sound output is a soundtrack of the first video that corresponds to a position in the first video being played when the input that corresponds to the request to display the second video information user interface is received.

4. The method of claim 1, wherein:

in accordance with a determination that the input that corresponds to the request to display the second video information user interface is received within a predetermined duration from an ending of the first video, an end credits soundtrack of the first video is selected for the second sound output.

5. The method of claim 1, including:

subsequent to initiating the playback of the first video, receiving an input that corresponds to a request to pause the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pausing the playback of the first video at a first playback position in a timeline of the first video;

providing to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

providing, to the audio system, sound information to provide a sound output that corresponds to a soundtrack of the first video at the first playback position.

6. The method of claim 1, including:

subsequent to initiating the playback of the first video, receiving an input that corresponds to a request to pause the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pausing the playback of the first video at a first playback position in a timeline of the first video;

providing to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

providing, to the audio system, sound information to provide a sound output that corresponds to one or more characteristics of the first video at the first playback position.

7. The method of claim 1, wherein:

the first video information user interface includes a plurality of user interface objects;

a first user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a first soundtrack of the first video; and

a second user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a second soundtrack, distinct from the first soundtrack, of the first video.

8. The method of claim 1, wherein the first sound output and/or the second sound output are selected based on one or more characteristics of the first video.

9. The method of claim 1, including:

prior to the display presenting the first video information user interface;

providing, to the display, data to present a video selection user interface that includes representations of a plurality of videos; and

receiving an input that corresponds to a selection of a representation of the first video in the plurality of videos, wherein the first video information user interface for the first video is presented in response to receiving the input that corresponds to the selection of the representation of the first video.

10. An electronic device that is in communication with a display and an audio system, the device comprising:

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

providing, to the display, data to present a first video information user interface that includes descriptive information about a first video;

providing, to the audio system, sound information to provide a first sound output, which corresponds to the first video, during presentation of the first video information user interface by the display;

providing, to the display, data to replace presentation of the first video information user interface with playback of the first video;

during the playback of the first video, receiving an input that corresponds to a request to display a second video information user interface about the first video; and

,

in response to receiving the input that corresponds to the request to display the second video information user interface about the first video;

providing, to the display, data to replace the playback of the first video with the second video information user interface about the first video, and

providing, to the audio system, sound information to provide a second sound output that corresponds to the first video, during presentation of the second video information user interface by the display.

11. The electronic device of claim 10, wherein the first sound output and/or the second sound output are selected from soundtracks of the first video.

12. The electronic device of claim 10, wherein:

the second sound output is a soundtrack of the first video that corresponds to a position in the first video being played when the input that corresponds to the request to display the second video information user interface is received.

13. The electronic device of claim 10, wherein:

an end credits soundtrack of the first video is selected for the second sound output in accordance with a determination that the input that corresponds to the request to display the second video information user interface is received within a predetermined duration from an ending of the first video.

14. The electronic device of claim 10, wherein the one or more programs include instructions for:

receiving an input that corresponds to a request to pause the first video subsequent to initiating the playback of the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pausing the playback of the first video at a first playback position in a timeline of the first video;

providing to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

providing, to the audio system, sound information to provide a sound output that corresponds to a soundtrack of the first video at the first playback position.

15. The electronic device of claim 10, wherein the one or more programs include instructions for:

receiving an input that corresponds to a request to pause the first video subsequent to initiating the playback of the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pausing the playback of the first video at a first playback position in a timeline of the first video;

providing to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

providing, to the audio system, sound information to provide a sound output that corresponds to one or more characteristics of the first video at the first playback position.

16. The electronic device of claim 10, wherein:

the first video information user interface includes a plurality of user interface objects;

a first user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a first soundtrack of the first video; and

a second user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a second soundtrack, distinct from the first soundtrack, of the first video.

17. The electronic device of claim 10, wherein the first sound output and/or the second sound output are selected based on one or more characteristics of the first video.

18. The electronic device of claim 10, wherein the one or more programs include instructions for:

prior to the display presenting the first video information user interface;

providing, to the display, data to present a video selection user interface that includes representations of a plurality of videos; and

receiving an input that corresponds to a selection of a representation of the first video in the plurality of videos, wherein the first video information user interface for the first video is presented in response to receiving the input that corresponds to the selection of the representation of the first video.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device that is in communication with a display and an audio system, cause the device to:

provide, to the display, data to present a first video information user interface that includes descriptive information about a first video;

provide, to the audio system, sound information to provide a first sound output, which corresponds to the first video, during presentation of the first video information user interface by the display;

provide, to the display, data to replace presentation of the first video information user interface with playback of the first video;

during the playback of the first video, receive an input that corresponds to a request to display a second video information user interface about the first video; and

,

in response to receiving the input that corresponds to the request to display the second video information user interface about the first video;

provide, to the display, data to replace the playback of the first video with the second video information user interface about the first video, and

provide, to the audio system, sound information to provide a second sound output that corresponds to the first video, during presentation of the second video information user interface by the display.

20. The non-transitory computer readable storage medium of claim 19, wherein the first sound output and/or the second sound output are selected from soundtracks of the first video.

21. The non-transitory computer readable storage medium of claim 19, wherein:

the second sound output is a soundtrack of the first video that corresponds to a position in the first video being played when the input that corresponds to the request to display the second video information user interface is received.

22. The non-transitory computer readable storage medium of claim 19, wherein:

an end credits soundtrack of the first video is selected for the second sound output in accordance with a determination that the input that corresponds to the request to display the second video information user interface is received within a predetermined duration from an ending of the first video.

23. The non-transitory computer readable storage medium of claim 19, wherein the one or more programs include instructions, which when executed by the electronic device, cause the electronic device to:

receive an input that corresponds to a request to pause the first video subsequent to initiating the playback of the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pause the playback of the first video at a first playback position in a timeline of the first video;

provide to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

provide, to the audio system, sound information to provide a sound output that corresponds to a soundtrack of the first video at the first playback position.

24. The non-transitory computer readable storage medium of claim 19, wherein the one or more programs include instructions, which when executed by the electronic device, cause the electronic device to:

receive an input that corresponds to a request to pause the first video subsequent to initiating the playback of the first video; and

,

in response to receiving the input that corresponds to the request to pause the first video;

pause the playback of the first video at a first playback position in a timeline of the first video;

provide to the display, data to present one or more selected still images from the first video, wherein the one or more selected still images are selected based on the first playback position at which the first video is paused; and

provide, to the audio system, sound information to provide a sound output that corresponds to one or more characteristics of the first video at the first playback position.

25. The non-transitory computer readable storage medium of claim 19, wherein:

the first video information user interface includes a plurality of user interface objects;

a first user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a first soundtrack of the first video; and

a second user interface object of the plurality of user interface objects is configured to, when selected, initiate the electronic device providing, to the audio system, sound information to provide a sound output that corresponds to at least a portion of a second soundtrack, distinct from the first soundtrack, of the first video.

26. The non-transitory computer readable storage medium of claim 19, wherein the first sound output and/or the second sound output are selected based on one or more characteristics of the first video.

27. The non-transitory computer readable storage medium of claim 19, wherein the one or more programs include instructions, which when executed by the electronic device, cause the electronic device to:

prior to the display presenting the first video information user interface;

provide, to the display, data to present a video selection user interface that includes representations of a plurality of videos; and

receive an input that corresponds to a selection of a representation of the first video in the plurality of videos, wherein the first video information user interface for the first video is presented in response to receiving the input that corresponds to the selection of the representation of the first video.