Experience sharing with commenting

• US 9,015,245 B1
• Filed: 12/08/2011
• Issued: 04/21/2015
• Est. Priority Date: 07/20/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lee, Steven John, Mendis, Indika Charles, Braun, Max Benjamin, Chi, Liang-Yu Tom, Rhodes, Bradley James
• Primary Examiner(s): Hwang, Joon H
• Assistant Examiner(s): AGUIAR, JOHNNY B
• Application Number:
  US13/314,176
• Time in Patent Office: 1,230 Days
• Field of Search: 709/203, 709/204, 709/217, 709/218, 709/219, 709/232, 709/235
• US Class Current: 709/204
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0605 Supply or demand aggregation
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/212 using filtering or selective blocking
• CPC Class Codes: H04L 51/214 using selective forwarding
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06

Abstract

Exemplary embodiments involve real-time commenting in experience-sharing sessions. An exemplary method involves: (a) a server system facilitating an experience sharing session between a sharing device and one or more viewing devices, wherein the server system receives media in real-time from the sharing device and transmits the media to the one or more viewing devices in real-time, wherein the media comprises video; (b) during the experience sharing session, the server system receiving one or more comments from one or more of the viewing devices; (d) the server system filtering the received comments in real-time based on filter criteria; and (e) the server system initiating real-time delivery, to the sharing device, of one or more of the received comments that satisfy the filter criteria.

Claims

1. A computer-implemented method comprising:

engaging, by a sharing device, in an experience sharing session between the sharing device and a plurality of viewing devices, wherein the sharing device transmits a share in real-time to the plurality of viewing devices via a server, wherein the sharing device comprises a head-mounted display (HMD), and wherein the share comprises point-of-view video captured at the HMD;

determining, by the sharing device, a context of the sharing device based on one or more context signals, wherein each of the one or more context signals provides information pertaining to a state or an environment of the sharing device;

sending, by the sharing device, to the server, an indication of the context of the sharing device;

during the experience sharing session, receiving, by the sharing device, comments from one or more of the viewing devices, wherein the received comments comprise a first comment and a second comment, wherein the received comments have been pre-filtered by a serving system based on filter criteria, and wherein the filter criteria are determined based at least in part on the context of the sharing device;

filtering, by the sharing device, the received comments in real-time based on display criteria, wherein the display criteria is applied to further filter the pre-filtered comments;

displaying, by the sharing device, in real-time the first comment satisfying the display criteria; and

displaying, by the sharing device, in real-time the second comment, wherein the second comment satisfies an updated version of the display criteria, wherein the updated version of the display criteria is based on a user classification of the first comment.

2. The method of claim 1, wherein one or more of the received comments comprise text, graphics, audio and/or video.

3. The method of claim 1, wherein one or more of the received comments comprise a vote for at least one particular selection from a plurality of possible selections provided in a poll, the method further comprising:

determining, by the sharing device, a total number of votes for each of the possible selections in the poll; and

displaying, by the sharing device, a graphic representation of the poll comprising an indication of the total number of votes for each of the possible selections.

4. The method of claim 1, further comprising:

generating, by the sharing device, a comment summary based on one or more of the received comments meeting the display criteria; and

displaying, by the sharing device, the comment summary.

5. The method of claim 1, further comprising:

using the context of the sharing device as a basis for determining the display criteria upon which the filtering of the received comments is based.

6. The method of claim 5, wherein using the context as a basis for determining the display criteria comprises using the determined context as a basis for determining a ranking for each of one or more of the received comments.

7. The method of claim 1, further comprising storing, by the sharing device, one or more of the received comments not satisfying the display criteria.

8. The method of claim 1, wherein the one or more of the received comments are stored, the method further comprising:

detecting, by the sharing device, a trigger event corresponding to a given one of the stored comments; and

in response to the trigger event, retrieving and displaying, by the sharing device, the given stored comment.

9. The method of claim 1, further comprising:

sending, by the sharing device, a request for comment to one or more of the viewing devices; and

filtering and displaying, by the sharing device, comments, wherein the comments are received in response to the request for comment.

10. A sharing-device system comprising:

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to;

engage in an experience sharing session between the sharing device and a plurality of viewing devices, wherein the sharing device transmits a share in real-time to the plurality of viewing devices via a server, wherein the sharing device comprises a head-mounted display (HMD), and wherein the share comprises point-of-view video captured at the HMD;

determine a context of the sharing device based on one or more context signals, wherein each of the one or more context signals provides information pertaining to a state or an environment of the sharing device;

sending, to the server, an indication of the context of the sharing device;

during the experience sharing session, receive comments from one or more of the viewing devices, wherein the received comments comprise a first comment and a second comment wherein the received comments have been pre-filtered by a serving system based on filter criteria, and wherein the filter criteria are determined based at least in part on the context of the sharing device;

filter the received comments in real-time based on display criteria, wherein the display criteria is applied to further filter the pre-filtered comments;

display in real-time the first comment satisfying the display criteria; and

display in real-time the second comment, wherein the second comment satisfies an updated version of the display criteria, wherein the updated version of the display criteria is based on a user classification of the first comment.

11. The sharing-device system of claim 10, wherein one or more of the received comments comprise text, graphics, audio and/or video.

12. The sharing-device system of claim 10, wherein one or more of the received comments comprise a vote for at least one particular selection from a plurality of possible selections provided in a poll, the system further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

determine a total number of votes for each of the possible selections in the poll; and

display a graphic representation of the poll comprising an indication of the total number of votes for each of the possible selections.

13. The sharing-device system of claim 10, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

generate a comment summary based on one or more of the received comments meeting the display criteria; and

display the comment summary.

14. The sharing-device system of claim 10, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

use the context of the sharing device as a basis to determine the display criteria upon which the filtering of the received comments is based.

15. The sharing-device system of claim 14, wherein the use of the context as a basis to determine the display criteria comprises use of the determined context as a basis to determine a ranking for each of one or more of the received comments.

16. The sharing-device system of claim 10, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to store one or more of the received comments not satisfying the display criteria.

17. The sharing-device system of claim 10, wherein the one or more of the received comments are stored, the system further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

detect a trigger event corresponding to a given one of the stored comments; and

in response to the trigger event, retrieve and display the given stored comment.

18. The sharing-device system of claim 10, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

send a request for comment to one or more of the viewing devices; and

filter and display comments, wherein the comments are received in response to the request for comment.

19. An article of manufacture including a non-transitory computer-readable storage medium having instructions stored thereon, in response to execution by a processor, cause the processor to perform functions, the instructions comprising:

instructions for engaging in an experience sharing session between the sharing device and a plurality of viewing devices, wherein the sharing device transmits a share in real-time to the plurality of viewing devices via a server, wherein the sharing device comprises a head-mounted display (HMD), and wherein the share comprises point-of-view video captured at the HMD;

instructions for determining a context of the sharing device based on one or more context signals, wherein each of the one or more context signals provides information pertaining to a state or an environment of the sharing device;

instructions for sending, to the server, an indication of the context of the sharing device;

instructions for, during the experience sharing session, receiving comments from one or more of the viewing devices, wherein the received comments comprise a first comment and a second comment, wherein the received comments have been pre-filtered by a serving system based on filter criteria, and wherein the filter criteria are determined based at least in part on the context of the sharing device;

instructions for filtering the received comments in real-time based on display criteria wherein the display criteria is applied to further filter the pre-filtered comments;

instructions for displaying in real-time the first comment satisfying the display criteria; and

instructions for displaying in real-time the second comment, wherein the second comment satisfies an updated version of the display criteria, wherein the updated version of the display criteria is based on a user classification of the first comment.

20. The article of manufacture of claim 19, wherein one or more of the received comments comprise text, graphics, audio and/or video.

21. The article of manufacture of claim 19, wherein one or more of the received comments comprise a vote for at least one particular selection from a plurality of possible selections provided in a poll, wherein the instructions further comprise:

instructions for determining a total number of votes for each of the possible selections in the poll; and

instructions for displaying a graphic representation of the poll comprising an indication of the total number of votes for each of the possible selections.

22. The article of manufacture of claim 19, wherein the instructions further comprise:

instructions for generating a comment summary based on one or more of the received comments meeting the display criteria; and

instructions for displaying the comment summary.

23. The article of manufacture of claim 19, further comprising:

instructions for using the context of the sharing device as a basis for determining the display criteria upon which the filtering of the received comments is based.

24. The article of manufacture of claim 23, wherein using the context as a basis for determining the display criteria comprises using the determined context as a basis for determining a ranking for each of one or more of the received comments.

25. The article of manufacture of claim 19, wherein the instructions further comprise instructions for storing one or more of the received comments not satisfying the display criteria.

26. The article of manufacture of claim 19, wherein the one or more of the received comments are stored, and wherein the instructions further comprise:

instructions for detecting a trigger event corresponding to a given one of the stored comments; and

instructions for, in response to the trigger event, the sharing device retrieving and displaying the given stored comment.

27. The article of manufacture of claim 19, wherein the instructions further comprise:

instructions for sending a request for comment to one or more of the viewing devices; and

instructions for filtering and displaying comments, wherein the comments are received in response to the request for comment.