Generating an image stream

• US 9,389,765 B2
• Filed: 03/12/2013
• Issued: 07/12/2016
• Est. Priority Date: 03/12/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Amacker, Matthew, Haldar, Malay
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): CHOWDHURY, RAYEEZ R
• Application Number:
  US13/795,583
• Publication Number:
  US 20140282260A1
• Time in Patent Office: 1,218 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for augmenting an interactive session with images. In one aspect, a method includes generating a first linear arrangement of images captured during an interactive session. The images of the first linear arrangement of images can be arranged in order based on a sequence in which the images were captured. The first linear arrangement of images is provided for display. Selection data specifying a selection of an image of the first linear arrangement of images are received. In response to receiving the selection data, a branch point is created at the selected image. The branch point can define a branch from the selected image to a second linear arrangement of images. Additional images captured during the interactive session are received. The second linear arrangement of images is generated that includes the additional images.

Claims

1. A method performed by data processing apparatus, the method comprising:

obtaining images captured by one or more image capture devices during an interactive session involving two or more users communicating with each other;

generating a first linear arrangement of the images, the images of the first linear arrangement of images being arranged in order based on a sequence in which the images were captured, and at least one of the images including content related to the interactive session;

providing the first linear arrangement of images for display;

receiving, during the interactive session, selection data specifying a selection, by one of the two or more users, of an image of the first linear arrangement of images;

in response to receiving the selection data and during the interactive session;

creating a branch point at the selected image, the branch point (i) defining a branch from the selected image to a second linear arrangement of images different than the first linear arrangement of images and (ii) including a visual indicator that illustrates the branch from the first linear arrangement of images to the second linear arrangement of images;

receiving additional images captured by the one or more image capture devices (i) during the interactive session and (ii) subsequent to receipt of the selection data; and

generating the second linear arrangement of images, the second linear arrangement of images including at least a portion of the additional images arranged in order based on a sequence in which the images were captured, including;

detecting a selection of one or more images of the additional images by at least one of the two or more users during the interactive session; and

including, in the second linear arrangement of images, each of the one or more selected images.

2. The method of claim 1, further comprising:

determining that the interactive session has ended; and

in response to determining that the interactive session has ended, storing the first linear arrangement of images and second linear arrangement of images.

3. The method of claim 2, further comprising:

determining that the interactive session has resumed;

providing the first linear arrangement of images and the second arrangement of images for display;

receiving at least one additional image during the resumed interactive session;

determining that the interactive session ended during a portion of the interactive session related to the first linear arrangement of images; and

adding the at least one additional image to the first linear arrangement of images in response to determining that the interactive session ended during a discussion related to the first linear arrangement of images.

4. The method of claim 1, wherein generating a first linear arrangement of images captured during an interactive session comprises:

determining that a particular image captured during the interactive session is sufficiently different than a previously captured image; and

adding the particular image to the first linear arrangement of images in response to determining that the particular image is sufficiently different than a previously captured image.

5. The method of claim 1, wherein generating a first linear arrangement of images captured during an interactive session comprises:

receiving a command to capture an image during the interactive session;

capturing an image in response to receiving the command; and

adding the captured image to the first linear arrangement of images.

6. The method of claim 1, further comprising transmitting the first linear arrangement of images to a device associated with a particular user of the two or more users for display by the device.

7. The method of claim 6, wherein the selection data is received from the device associated with the particular user.

8. The method of claim 6, wherein transmitting the first linear arrangement of images to the device associated with the particular user comprises transmitting the first linear arrangement of images based on an amount of available bandwidth for sending data.

9. The method of claim 1, wherein receiving selection data specifying a selection of an image comprises receiving data specifying that the one user of the two or more users selected the image.

10. The method of claim 1, wherein generating the second linear arrangement of images comprises:

determining that a particular image of the additional images is sufficiently different than a previously captured image of the additional images; and

adding the particular image to the second linear arrangement of images in response to determining that the particular image is sufficiently different than a previously captured image.

21. The method of claim 1, wherein the first linear arrangement of images is generally parallel with the second linear arrangement of images.

22. The method of claim 1, further comprising:

subsequent to receipt of the selection data;

receiving additional selection data specifying a selection of a last image in the first linear arrangement of images;

receiving a given image captured during the interactive sessions and subsequent to receipt of the additional selection data; and

adding the given image to the first linear arrangement of images and adjacent to the last image.

23. The method of claim 1, wherein the first linear arrangement of images relate to a first portion of the interactive sessions and the second linear arrangement of images relate to a second portion of the interactive session different from the first portion.

24. The method of claim 8, wherein transmitting the first linear arrangement of images based on an amount of available bandwidth for sending data comprises:

determining that the amount of available bandwidth is not sufficient to the transmit the first linear arrangement of images and, in response, queuing the first linear arrangement of images for transmission; and

determining that the amount of bandwidth has increased to a sufficient amount of bandwidth and, in response, transmitting the first linear arrangement of images in an order in which the first linear arrangement of images were captured.

11. A system, comprising:

a data processing apparatus; and

a memory storage apparatus in data communication with the data processing apparatus, the memory storage apparatus storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising;

obtaining images captured by one or more image capture devices during an interactive session involving two or more users communicating with each other;

generating a first linear arrangement of the images, the images of the first linear arrangement of images being arranged in order based on a sequence in which the images were captured, and at least one of the images including content related to the interactive session;

providing the first linear arrangement of images for display;

receiving, during the interactive session, selection data specifying a selection, by one of the two or more users, of an image of the first linear arrangement of images;

in response to receiving the selection data and during the interactive session;

creating a branch point at the selected image, the branch point (i) defining a branch from the selected image to a second linear arrangement of images different than the first linear arrangement of images and (ii) including a visual indicator that illustrates the branch from the first linear arrangement of images to the second linear arrangement of images;

receiving additional images captured by the one or more image capture devices (i) during the interactive session and (ii) subsequent to receipt of the selection data; and

generating the second linear arrangement of images, the second linear arrangement of images including at least a portion of the additional images arranged in order based on a sequence in which the images were captured, including;

detecting a selection of one or more images of the additional images by at least one of the two or more users during the interactive session; and

including, in the second linear arrangement of images, each of the one or more selected images.

12. The system of claim 11, wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising:

determining that the interactive session has ended; and

in response to determining that the interactive session has ended, storing the first linear arrangement of images and second linear arrangement of images.

13. The system of claim 12, wherein the instructions upon execution cause the data processing apparatus to perform further operations comprising:

determining that the interactive session has resumed;

providing the first linear arrangement of images and the second arrangement of images for display;

receiving at least one additional image during the resumed interactive session;

determining that the interactive session ended during a portion of the interactive session related to the first linear arrangement of images; and

adding the at least one additional image to the first linear arrangement of images in response to determining that the interactive session ended during a discussion related to the first linear arrangement of images.

14. The system of claim 11, wherein generating a first linear arrangement of images captured during an interactive session comprises:

determining that a particular image captured during the interactive session is sufficiently different than a previously captured image; and

adding the particular image to the first linear arrangement of images in response to determining that the particular image is sufficiently different than a previously captured image.

15. The system of claim 11, wherein generating a first linear arrangement of images captured during an interactive session comprises:

receiving a command to capture an image during the interactive session;

capturing an image in response to receiving the command; and

adding the captured image to the first linear arrangement of images.

16. The system of claim 11, further comprising transmitting the first linear arrangement of images to a device associated with a particular user of the two or more users for display by the device.

17. The system of claim 16, wherein the selection data is received from the device associated with the particular user.

18. The system of claim 16, wherein transmitting the first linear arrangement of images to the device associated with the particular user comprises transmitting the first linear arrangement of images based on an amount of available bandwidth for sending data.

19. The system of claim 11, wherein generating the second linear arrangement of images comprises:

determining that a particular image of the additional images is sufficiently different than a previously captured image of the additional images; and

adding the particular image to the second linear arrangement of images in response to determining that the particular image is sufficiently different than a previously captured image.

20. A non-transitory computer readable medium encoded with a computer program, the program comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising:

obtaining images captured by one or more image capture devices during an interactive session involving two or more users communicating with each other;

generating a first linear arrangement of the images, the images of the first linear arrangement of images being arranged in order based on a sequence in which the images were captured, and at least one of the images including content related to the interactive session;

providing the first linear arrangement of images for display;

receiving, during the interactive session, selection data specifying a selection, by one of the two or more users, of an image of the first linear arrangement of images;

in response to receiving the selection data and during the interactive session;

creating a branch point at the selected image, the branch point (i) defining a branch from the selected image to a second linear arrangement of images different than the first linear arrangement of images and (ii) including a visual indicator that illustrates the branch from the first linear arrangement of images to the second linear arrangement of images;

receiving additional images captured by the one or more image capture devices (i) during the interactive session and (ii) subsequent to receipt of the selection data; and

generating the second linear arrangement of images, the second linear arrangement of images including at least a portion of the additional images arranged in order based on a sequence in which the images were captured, including;

detecting a selection of one or more images of the additional images by at least one of the two or more users during the interactive session; and

including, in the second linear arrangement of images, each of the one or more selected images.