Distributing media to displays

• US 10,354,291 B1
• Filed: 05/03/2016
• Issued: 07/16/2019
• Est. Priority Date: 11/09/2011
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Teller, Eric
• Primary Examiner(s): Wu, Rutao
• Assistant Examiner(s): Cross, Michael
• Application Number:
  US15/145,125
• Time in Patent Office: 1,169 Days
• Field of Search: None
• CPC Class Codes: G06Q 30/0276 Advertisement creation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Methods and systems herein involve a computing system receiving a listing-suggestion request associated with a first account, and responsive to the listing-suggestion request: (a) detecting, in point-of-view (POV) image data received from one or wearable devices, one or more occurrences of a first surface of a real-world object; (b) determining that the first surface of real-world object is associable with the first account; (c) determining that the first surface is not associated with the first account in a database for augmented-reality overlay rights and (d) responsive to determining that the first surface is associated with the first account: (i) using the POV image data as a basis for determining a numeric measure corresponding to overlay of augmented-reality content on the first surface of the real-world object; and (ii) sending a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the determined numeric measure.

Claims

1. A computer-implemented method comprising:

receiving, by a computing system, a listing-suggestion request associated with a first account, wherein the listing-suggestion request indicates an instruction to opt in to a service that provides suggestions of real-world surfaces usable for overlay of augmented-reality content; and

responsive to the listing-suggestion request, the computing system;

(a) detecting, in point-of-view (POV) image data captured by one or more POV cameras of one or wearable devices, one or more occurrences of a first surface of a real-world object;

(b) determining both that;

(i) rights to the real-world object are associated with the first account and, (ii) the real-world object is not yet associated with the first account in a database for augmented-reality overlay rights to real-world surfaces; and

(c) responsive to determining that rights to the real-world object are associated with the first account, but that the real-world object is not yet associated with the first account in an electronic marketplace for augmented-reality overlay rights;

(i) using the POV image data as a basis for determining a numeric measure corresponding to overlay of augmented-reality content on a first surface of the real-world object, wherein the overlay of augmented-reality content on the first surface comprises display of graphical content on a display device, and alignment of the displayed graphical content with the first surface in a wearer field-of-view associated with the display device; and

(ii) sending a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the determined numeric measure.

2. The method of claim 1, wherein using the POV image data as a basis for determining the numeric measure corresponding to overlay of augmented-reality content on the first surface of the real-world object comprises:

using the POV image data to generate wearer-view data for the real-world object;

using the wearer-view data for the real-world object as a basis for determining a value corresponding to overlay of augmented-reality content on the first surface of the real-world object; and

causing the computing device to send a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the value corresponding to overlay of augmented-reality content on the first surface.

3. The method of claim 1, wherein the first surface is a non-display surface of a laptop computer.

4. The method of claim 1, wherein the numeric measure comprises a value corresponding to overlay of augmented-reality content on the first surface of the real-world object.

5. The method of claim 1, wherein the first surface is located on an article of clothing.

6. The method of claim 1, wherein the first surface is located on an automobile.

7. The method of claim 1, further comprising:

after the initial time of the listing, receiving subsequent POV image data from a plurality of wearable computing devices, wherein the subsequent POV image data is indicative of a respective wearer-view associated with each of the wearable computing devices; and

analyzing the subsequent POV image data to detect occurrences of the first surface in the subsequent POV image data;

updating the numeric measure based at least in part on occurrences of the first surface in the subsequent POV image data; and

sending an updated listing-suggestion message to the computing device corresponding to the first account, wherein the updated listing-suggestion message indicates the updated numeric measure.

8. A system for identifying real-world surfaces for overlay of augmented-reality content, the system comprising:

at least one communication interface operable to communicate with one or more client devices;

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to;

(i) receive a listing-suggestion request associated with a first account, wherein the listing-suggestion request indicates an instruction to opt in to a service that provides suggestions of real-world surfaces usable for overlay of augmented-reality content, and (ii) responsive to the listing-suggestion request;

(a) detect, in point-of-view (POV) image data captured by one or more POV cameras of one or wearable devices, one or more occurrences of a first surface of a real-world object;

(b) determine both that;

(i) rights to the real-world object are associated with the first account and, (ii) the real-world object is not yet associated with the first account in a database for augmented-reality overlay rights to real-world surfaces; and

(c) responsive to determining that rights to the real-world object are associated with the first account, but that the real-world object is not yet associated with the first account in an electronic marketplace for augmented-reality overlay rights;

(i) use the POV image data to generate wearer-view data as a basis for determining a numeric measure corresponding to overlay of augmented-reality content on the first surface of the real-world object, wherein the overlay of augmented-reality content on the first surface comprises display of graphical content on a display device, and alignment of the displayed graphical content with the first surface in a wearer field-of-view associated with the display device, and

(ii) send a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the determined numeric measure.

9. A computer-implemented method comprising:

receiving POV image data captured by one or more POV cameras of a plurality of wearable computing devices;

receiving an indication of interest that identifies a real-world object, wherein the real-world object is associated with a first account and the indication of interest is associated with a second account;

determining whether the first account is associated with an optional function that identifies real-world surfaces usable for overlay of augmented-reality content;

when the first account is determined to be associated with an optional service, determining that rights to the real-world object are associated with the first account, but that the real-world object is not yet associated with the first account in an electronic marketplace for augmented-reality overlay rights, and responsively;

(a) analyzing the POV image data from the plurality of wearable computing devices to detect one or more occurrences the real-world object in the POV image data;

(b) determining a numeric measure corresponding to overlay of augmented-reality content on the real-world object;

(c) using the POV image data as a basis for determining a numeric measure corresponding to overlay of augmented-reality content on the real-world object, wherein the overlay of augmented-reality content on the first surface comprises display of graphical content on a display device, and alignment of the displayed graphical content with the first surface in a wearer field-of-view associated with the display device, and

(d) sending a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the determined numeric measure; and

when the first account is not associated with an optional service, refraining from analyzing the POV image data for occurrences of the first surface.

10. The method of claim 9, wherein using the POV image data as a basis for determining the numeric measure corresponding to overlay of augmented-reality content on the real-world object comprises:

using the POV image data to generate wearer-view data for the real-world object;

using the wearer-view data for the real-world object as a basis for determining a value corresponding to overlay of augmented-reality content on the real-world object; and

causing the computing device to send a listing-suggestion message to a computing device corresponding to the first account, wherein the listing-suggestion message indicates the value corresponding to overlay of augmented-reality content on the first surface.

11. The method of claim 9, wherein the real-world object comprises a laptop computer.

12. The method of claim 9, wherein the numeric measure comprises a value corresponding to overlay of augmented-reality content on at least one surface of the real-world object.

13. The method of claim 9, wherein the real-world object is an article of clothing.

14. The method of claim 9, wherein the real-world object takes the form of or is part of an automobile.

15. The method of claim 14, further comprising:

after the initial time of the listing, receiving subsequent POV image data from a plurality of wearable computing devices;

analyzing the subsequent POV image data to detect occurrences of the real-world object in the subsequent POV image data;

updating the numeric measure based at least in part on occurrences of the real-world object in the subsequent POV image data; and

sending an updated listing-suggestion message to the computing device corresponding to the first account, wherein the updated listing-suggestion message indicates the updated numeric measure.