Experience sharing for a registry event

• US 10,083,468 B2
• Filed: 12/21/2015
• Issued: 09/25/2018
• Est. Priority Date: 07/20/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Lee, Steven John, Rhodes, Bradley James, Mendis, Indika Charles, Braun, Max Benjamin
• Primary Examiner(s): Civan, Ethan D
• Assistant Examiner(s): Shui, Ming
• Application Number:
  US14/976,466
• Publication Number:
  US 20160110783A1
• Time in Patent Office: 1,009 Days
• Field of Search: 705 261- 272
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0605 Supply or demand aggregation
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/212 using filtering or selective blocking
• CPC Class Codes: H04L 51/214 using selective forwarding
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06

Abstract

Disclosed herein are methods and corresponding systems for facilitating a live registry event between a shopper and one or more remote viewers. In the live registry event, the shopper, registers for gifts that they would like to receive while sharing their registering experience with the viewers in real-time. When the user registers for an item, a server system allows the viewers to purchase the gift for the shopper.

Claims

1. A method, comprising:

facilitating, by a server system, a registry event comprising an experience-sharing session, wherein the experience-sharing session is between a wearable computing device and one or more viewing devices, and wherein the wearable computing device comprises (a) an audio-capture device arranged to capture audio data when the wearable computing device is worn and (b) a second sensor arranged to capture data indicative of body movement by a wearer of the wearable computing device;

receiving, by the server system, as part of the experience-sharing session, content capturing an experience corresponding to the wearable computing device, wherein the received content comprises at least real-time audio data based on the audio data captured by the audio device and corresponding motion data captured by the second sensor;

detecting, by the server system, based on speech-to-text processing of at least a portion of the real-time audio data, a speech segment comprising an implicit indication of interest in an item of interest, wherein the implicit indication comprises a speech segment identifying the item interest, without a corresponding explicit command to add the item to the registry list;

determining, based on processing of image data of an environment of the wearable computing device, that the item of interest is located at a location in the environment;

detecting, based at least in part on the motion data corresponding to the implicit indication of interest by the speech segment, a body movement referencing the location of the item of interest in the environment;

responsive to at least (a) the detection of the speech segment comprising the implicit indication of interest in the item of interest and (b) the detection of the corresponding body movement referencing the location of the item of interest, adding the item of interest to the registry list;

providing, by the server system, real-time updates of the registry list to the one or more viewing devices, as the one or more items of interest are added to the registry list;

receiving, by the server system, a purchase request from at least one viewing device for a selected item of interest from the registry list; and

in response to receiving the purchase request, the server system initiating a purchase transaction process to bill at least one account associated with the at least one viewing device and to provide the selected item of interest to a user of the wearable computing device.

2. The method of claim 1, further comprising:

receiving, from the wearable computing device, real-time image data comprising the image data of an environment of the wearable computing device; and

enabling the one or more viewing devices to access the received real-time image data as part of the experience-sharing session.

3. The method of claim 2, wherein the image data of the environment comprises at least point-of-view video that is captured by an image-capture device at the wearable computing device.

4. The method of claim 1, wherein providing the real-time updates of the registry list comprises:

presenting the registry list to the one or more viewing devices as part of the experience-sharing session; and

updating the presented registry list in response to receiving, from the wearable computing device, additional indications of additional items of interest.

5. The method of claim 4, wherein providing the real-time updates of the registry list further comprises, in response to initiating the purchase transaction process, updating the presented registry list with a notification that the selected item of interest is purchased.

6. The method of claim 1, further comprising:

upon initiating the purchase transaction process, providing a notification of the purchase transaction process to the wearable computing device, wherein the notification of the purchase transaction process does not identify the at least one viewing device associated with the at least one billed account.

7. The method of claim 1 , further comprising:

in response to initiating the purchase transaction process, adding an entry for the selected item of interest to a list of purchased registry-items, wherein the entry for the selected item of interest identifies the at least one viewing device associated with the at least one billed account; and

at a specified time after the registry event, providing, to the wearable computing device, the list of purchased registry items.

8. The method of claim 1, further comprising, enabling communication between the one or more viewing devices, wherein the communication between the one or more viewing devices is hidden from the wearable computing device.

9. The method of claim 1, wherein the purchase request is received from a plurality of viewing devices, and wherein the purchase transaction process is initiated to bill accounts associated with each of the plurality of viewing devices from which the purchase request is received.

10. The method of claim 1, wherein initiating the purchase transaction process comprises:

determining whether a previous purchase transaction process has been initiated to provide the selected item of interest to the user of the wearable computing device;

if the previous purchase transaction process has been initiated, then refraining from initiating the purchase transaction process; and

if the previous transaction has not been initiated, then initiating the purchase transaction process.

11. The method of claim 1, wherein detecting the body movement referencing the location of the item of interest comprises:

detecting, based on the motion data one of the following body movements;

(a) a finger or other body part pointed at the item of interest, (b) a stare at the item of interest for a threshold period of time, (c) a head gesture towards the item of interest.

12. A server system, comprising:

a non-transitory computer-readable medium;

at least one processor;

program instructions stored on the non-transitory computer-readable medium and executable by the at least one processor to cause the server system to;

(i) facilitate a registry event comprising an experience-sharing session, wherein the experience-sharing session is between a wearable computing device and one or more viewing devices, and wherein the wearable computing device comprises (a) an audio-capture device arranged to capture audio data when the wearable computing device is worn and (b) a second sensor arranged to capture data indicative of body movement by a wearer of the wearable computing device;

(ii) receive, as part of the experience-sharing session, content capturing an experience corresponding to the wearable computing device, wherein the received content comprises at least real-time audio data based on the audio data captured by the audio device and corresponding motion data captured by the second sensor;

(iii) detect, based on speech-to-text processing of at least a portion of the real-time audio data, a speech segment comprising an implicit indication of interest in an item of interest, wherein the implicit indication comprises a speech segment identifying the item interest, without a corresponding explicit command to add the item to the registry list;

(iv) determine, based on processing of image data of an environment of the wearable computing device, that the item of interest is located at a location in the environment;

(v) detect, based at least in part on the motion data corresponding to the implicit indication of interest by the speech segment, a body movement referencing the location of the item of interest in the environment;

(vi) responsive to at least (a) the detection of the speech segment comprising the implicit indication of interest in the item of interest and (b) the detection of the corresponding body movement referencing the location of the item of interest, add the item of interest to the registry list;

(vii) provide real-time updates of the registry list to the one or more viewing devices, as the one or more items of interest are added to the registry list;

(viii) receive a purchase request from at least one viewing device for a selected item of interest from the registry list; and

(ix) in response to receiving the purchase request, initiate a purchase transaction process to bill at least one account associated with the at least one viewing device and to provide the selected item of interest to a user of the wearable computing device.

13. The server system of claim 12, wherein the program instructions are further executable by the at least one processor to:

receive, from the wearable computing device, real-time image data comprising the image data of an environment of wearable computing device; and

enable the one or more viewing devices to access the received real-time image data as part of the experience-sharing session.

14. The server system of claim 12, wherein providing the real-time updates of the registry list comprises:

providing the registry list to the one or more viewing devices as part of the experience-sharing session; and

updating the provided registry list in response to receiving, from the wearable computing device, additional indications of additional items of interest.

15. The server system of claim 14, wherein providing the real-time updates of the registry list further comprises, in response to initiating the purchase transaction process, updating the presented registry list with a notification that the selected item of interest is purchased.

16. The server system of claim 12, wherein the program instructions are further executable by the at least one processor to:

in response to initiating the purchase transaction process, add an entry for the selected item of interest to a list of purchased registry-items, wherein the entry for the selected item of interest identifies the at least one viewing device associated with the at least one billed account; and

at a specified time after the registry event, provide, to the wearable computing device, the list of purchased registry items.

17. The server system of claim 12, wherein the program instructions are further executable by the at least one processor to enable communication between the one or more viewing devices, wherein the communication between the one or more viewing devices is hidden from the wearable computing device.

18. The server system of claim 12, wherein the purchase request is received from a plurality of viewing devices, and wherein the purchase transaction process is initiated to bill accounts associated with each of the plurality of viewing devices from which the purchase request is received.

19. A non-transitory computer-readable medium having stored thereon program instructions executable by a processor to cause a server system to perform functions comprising:

facilitating registry event comprising an experience-sharing session, wherein the experience-sharing session is between a wearable computing device and one or more viewing devices, and wherein the wearable computing device comprises (a) an audio-capture device arranged to capture audio data when the wearable computing device is worn and (b) a second sensor arranged to capture data indicative of body movement by a wearer of the wearable computing device;

receiving, as part of the experience-sharing session, content capturing an experience corresponding to the wearable computing device, wherein the received content comprises at least real-time audio data based on the audio data captured by the audio device and corresponding motion data captured by the second sensor;

detecting, by the server system, based on speech-to-text processing of at least a portion of the real-time audio data, a speech segment comprising an implicit indication of interest in an item of interest, wherein the implicit indication comprises a speech segment identifying the item interest, without a corresponding explicit command to add the item to the registry list;

determining, based on processing of image data of an environment of the wearable computing device, that the item of interest is located at a location in the environment;

detecting, based at least in part on the motion data corresponding to the implicit indication of interest by the speech segment, a body movement referencing the location of the item of interest in the environment; and

responsive to at least (a) the detection of the speech segment comprising the implicit indication of interest in the item of interest and (b) the detection of the corresponding body movement referencing the location of the item of interest, adding the item of interest to the registry list;

providing real-time updates of the registry list to the one or more viewing devices, as the one or more items of interest are added to the registry list;

receiving a purchase request from at least one viewing device for a selected item of interest from the registry list; and

in response to receiving the purchase request, initiating a purchase transaction process to bill at least one account associated with the at least one viewing device and to provide the selected item of interest to a user of the sharing device.