View-Selection Feedback for a Visual Experience

• US 20160054863A1
• Filed: 10/28/2014
• Published: 02/25/2016
• Est. Priority Date: 08/21/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Elmieh, Baback, Pinkava, Jan J., Sweetland, Douglas Paul, Collins, Brian M., Austin, Darren Mark
• Granted Patent: US 10,341,731 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312

Abstract

Techniques and apparatuses for view-selection feedback for a visual experience are described. These techniques and apparatuses enable writers, directors, and other story creators to create or alter visual experiences based on feedback provided by view selections made during visual experiences. This feedback can be analyzed to determine portions of a visual experience that users focused on, wanted to see more of, were not interested in, found difficult to understand, and so forth. With this feedback, visual experiences, such as live-action movies and animated shorts, can be created or improved.

Claims

1. A computer-implemented method comprising:

receiving view selections at a computing device and from multiple mobile media-consumption devices, the view selections made during presentations of a visual experience on the multiple mobile media-consumption devices, the visual experience telling a story having an authored series of events; and

determining, at the computing device and based on the view selections, desirability metrics for one or more of the events shown in the view selections or visual elements shown in the view selections, the desirability metrics usable to create a new visual experience or a new substory for the visual experience.

2. The computer-implemented method as recited in claim 1, wherein the visual experience is a live-action motion picture, the story is a plot, the events are portions or scenes showing parts of the plot, and the visual elements are objects shown in the live-action motion picture, and wherein determining desirability metrics assesses a desirability, across many persons associated with the view selections, of the objects or the parts of the plot shown in the portions or the scenes.

3. The computer-implemented method as recited in claim 1, wherein the view selections select the visual elements, the visual elements being part of context views or story views, the story views presenting at least a portion one of the events of the authored series of events, the context views presenting context of the visual experience, and wherein determining desirability metrics assesses a desirability, across many persons associated with the view selections, of the context shown in the context views or associated with the visual elements or of the events shown in the story views.

4. The computer-implemented method as recited in claim 1, further comprising receiving other view selections made during presentations of other visual experiences telling other stories having other authored series of events and other visual elements, and wherein determining desirability metrics correlates the events or visual elements of the view selections and the other view selections effective to create a correlated desirability metric measuring types of events or types of visual elements.

5. The computer-implemented method as recited in claim 1, wherein determining the desirability metrics is further based on demographic information associated with the view selections and determining the desirability metrics determines multiple desirability metrics tailored to respective demographics of the demographic information.

6. The computer-implemented method as recited in claim 1, further comprising receiving an indication that selection to view the visual experience ceased prior to an intended end of the visual experience, and wherein determining the desirability metrics associates view selections made prior to the intended end as having a negative interest.

7. The computer-implemented method as recited in claim 1, wherein the visual experience is an existing visual experience for which the view selections were made, and further comprising creating, based on the view selections made, the new substory for the visual experience.

8. The computer-implemented method as recited in claim 1, further comprising creating a new visual experience based on the desirability metrics.

9. One or more computer-readable storage devices comprising processor-executable instructions that, responsive to execution by one or more processors, perform operations comprising:

receiving view selections during presentation of a visual experience, the view selections made by a user during the presentation of the visual experience, the visual experience;

capable of telling a story having an authored series of events; and

having story views and context views, the story views presenting at least a portion of an event of the authored series of events, the context views presenting context of the visual experience;

determining, during the presentation of the visual experience and based on the view selections, an alteration to a current or future story view or context view of the visual experience; and

providing the alteration, during the presentation of the visual experience, effective to alter the current or future story view or context view of the visual experience.

10. The computer-readable storage devices as recited in claim 9, wherein the operation of determining the alteration determines the alteration from a set of previously created alterations, the set of previously created alterations created based on previously received view selections by other users of a prior-viewed visual experience, the prior-viewed visual experience being identical to, or a prior version of, the visual experience.

11. The computer-readable storage devices as recited in claim 9, wherein the operation of providing the alteration transmits visual experience updates to a device on which the presentation is currently being made.

12. The computer-readable storage devices as recited in claim 9, wherein the operation of receiving the view selections is performed on a mobile media-consumption device on which the presentation is made, determining the alteration draws from previously determined sets of alterations, and providing the alteration retrieves the alterations from local memory of the mobile media-consumption device.

13. The computer-readable storage devices as recited in claim 9, wherein the view selections include context views during which the story ceases to progress through the authored series of events, the context views indicating context elements of interest to the user.

14. The computer-readable storage devices as recited in claim 13, wherein the context views include a subordinate story, the subordinate story being an authored series of subordinate events, and wherein the alteration to the current or future story view or context view alters the subordinate story to add portions to, or delete portions from, the subordinate story.

15. The computer-readable storage devices as recited in claim 9, wherein the view selections indicate context elements or non-context elements of interest to the user based on an amount of time, multiple view selections showing, or view selections heavily weighted to showing the context elements or non-context elements.

16. The computer-readable storage devices as recited in claim 9, wherein the operation of determining the alteration is further based on user data, the user data including:

a location at which the presentation was made;

an age of the user;

a culture of the user;

an experience in use of prior visual experiences of the user;

a device on which the view selections are made;

a screen size on which the presentation is made;

ambient noise during presentation of the visual experience;

ambient light during presentation of the visual experience;

a geographical location or type of location at which the presentation of the visual experience is made;

or a current activity of the user.

17. The computer-readable storage devices as recited in claim 9, wherein one or more of the view selections indicates a selection repeatedly viewing an event of the authored series of events and further comprising altering the event to present clearer audio during the event or to expand the event to include additional visual elements.

18. The computer-readable storage devices as recited in claim 9, wherein the operations further comprise creating or altering a substory for the visual experience based on a set of view selections including the view selections and multiple other view selections from other users.

19. A mobile media-consumption device comprising:

a display;

a view-selection mechanism;

one or more computer processors; and

one or more computer-readable storage devices comprising processor-executable instructions that, responsive to execution by the one or more computer processors, implement a storytelling module to perform operations including;

presenting, on the display, a visual experience capable of telling a story, the story having an authored series of events;

receiving, from the view-selection mechanism, view selections made during presentation of a visual experience;

responsive to a view selection to present a story view showing one of the events of the authored series of events, presenting on the display portions of the visual experience effective to tell the story by progressing through the authored series of events;

or

responsive to a view selection to present a context view not showing one of the events of the authored series of events, causing the display to cease to progress through the authored series of events;

receiving, from the view-selection mechanism, an alteration to a current or future view of the visual experience, the alteration to the current or future view determined based on one or more of the view selections; and

responsive to receiving the alteration from the view selection mechanism, presenting the visual experience on the display with the alteration to the current or future view.

20. The mobile media-consumption device of claim 19, wherein the processor-executable instructions further implement a feedback module to perform operations including to determine the alteration to the current or future view based on the one or more of the view selections received from the view selection mechanism, and wherein the storytelling module receives the alteration from the feedback module.