Visual Content Modification for Distributed Story Reading

• US 20140192140A1
• Filed: 01/07/2013
• Published: 07/10/2014
• Est. Priority Date: 01/07/2013
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Tang, John C., Gok, Nizamettin, Venolia, Gina Danielle, Quinn, Kori Inkpen, Peevers, Alan W., Khanna, Nitin, Longbottom, Simon Andrew, Thywissen, Kurt A., Oztekin, Koray Can, Chandrasekaran, Vijay
• Application Number:
  US13/735,892
• Publication Number:
  US 20140192140A1
• Time in Patent Office: Days
• US Class Current: 348/14.08
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/61 using advertising information
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: H04N 7/14 Systems for two-way working H04N7/12, H04N7/173 take precedence

Abstract

Various embodiments provide an interactive, shared, story-reading experience in which stories can be experienced from remote locations. Various embodiments enable augmentation or modification of audio and/or video associated with the story-reading experience. This can include augmentation and modification of a reader'"'"'s voice, face, and/or other content associated with the story as the story is read.

Claims

1. A computer-implemented method comprising:

receiving video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;

augmenting the video data to generate at least one new image; and

enabling the one or more remote participants to consume the augmented video data as part of the electronic story.

2. The computer-implemented method of claim 1, wherein receiving the video data further comprises:

displaying at least one visual cue associated with at least one location within the electronic story that can include augmented video data;

enabling selection of the at least one visual cue; and

responsive to selection of the at least one visual cue, receiving the augmented video data.

3. The computer-implemented method of claim 1, wherein augmenting the video data further comprises augmenting the video data by using a spatial filter.

4. The computer-implemented method of claim 1 further comprising:

detecting a face contained within the video data; and

augmenting the video data based, at least in part, upon said detected face.

5. The computer-implemented method of claim 1, wherein said receiving further comprises receiving audio data associated with the video data and further comprising augmenting the audio associated with the video data.

6. The computer-implemented method of claim 1, wherein enabling the one or more remote participants to consume the augmented video data further comprises transmitting the augmented video data to the one or more remote participants over a network.

7. The computer-implemented method of claim 1, wherein augmenting the video data further comprises:

analyzing the video data for movement; and

responsive to said analyzing, mimicking said movement via an image associated with the electronic story.

8. One or more computer readable storage media embodying computer readable instructions which, when executed, implement a method comprising:

receiving video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;

enabling augmentation of the video data to generate at least one new image; and

enabling the one or more remote participants to consume the augmented video data as part of the electronic story.

9. The one or more computer readable storage media of claim 8, wherein the method further comprises receiving the video data from at least one of the remote participants.

10. The one or more computer readable storage media of claim 8, wherein the method further comprises:

determining one or more locations where one or more video augmentation effects can be applied;

visually indicating when the one or more augmentation effects can be applied; and

receiving user input to initiate one or more augmentation effects;

applying the one or more augmentation effects within the electronic story.

11. The one or more computer readable storage media of claim 8, wherein the instructions to augment the video data are further configured to transmit the video data to another computer for augmentation.

12. The one or more computer readable storage media of claim 8, wherein said enabling the one or more remote participants to consume the augmented video data comprises using a peer-to-peer network.

13. The one or more computer readable storage media of claim 8, wherein enabling augmentation of the video data further comprises applying a rotoscoping filter to the video data.

14. The one or more computer readable storage media of claim 8, wherein said enabling the one or more remote participants to consume the augmented video data further comprises:

establishing a communication connection between the reader and the one or more remote participants; and

transferring the augmented video data to the one or more remote participants using the communication connection.

15. A system comprising:

one or more processors;

one or more computer readable storage media; and

at least one augmentation effect module embodied on the one or more computer readable storage media and configured, when executed by the one or more processors, to;

receive video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;

detect one or more facial features contained within the video data;

augment the video data based, at least in part, on said one or more facial features; and

enable the one or more remote participants to consume said augmented video data.

16. The system of claim 15, wherein the at least one augmentation effect module is further configured to:

receive audio data associated with the video data; and

augment the audio data effective to morph a voice contained within the audio data.

17. The system of claim 15, wherein the system is further configured to:

establish a peer-to-peer communication connection between the one or more remote participants over which the electronic story is to be shared; and

share the electronic story over the peer-to-peer communication connection.

18. The system of claim 15, wherein the at least one augmentation effect module is further configured to blend at least one image of said one or more facial features with an image associated with the electronic story.

19. The system of claim 15, wherein the at least one augmentation effect module is further configured to detect the one or more facial features automatically.

20. The system of claim 15, wherein the at least one augmentation effect module is further configured to:

detect at least one gesture contained within the video data; and

animate at least one object associated with the electronic story based, at least in part, on said detected at least one gesture.