Personal augmented reality advertising

• US 8,644,842 B2
• Filed: 09/04/2007
• Issued: 02/04/2014
• Est. Priority Date: 09/04/2007
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Arrasvuori, Juha, Holm, Jukka Antero, Eronen, Antti Johannes
• Primary Examiner(s): Karikari, Kwasi
• Application Number:
  US11/899,023
• Publication Number:
  US 20090061901A1
• Time in Patent Office: 2,345 Days
• Field of Search: 455/41.2, 455/404.2, 455/414.1, 455/414.2, 455/456.1, 455/456.3, 455/457, 455/459, 455/458, 455/566
• US Class Current: 455/456.1
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04W 4/02 Services making use of location information

Abstract

Personal augmented reality advertising involves detecting a proximity between a participant'"'"'s mobile device and a viewer'"'"'s mobile device. An identifier of the participant'"'"'s mobile device and biometric data that describes the participant have both been made publicly available. The biometric data is obtained in response to detecting the proximity between the participant'"'"'s mobile device and the viewer'"'"'s mobile device. A match is detected between the biometric data of the participant and an image captured from a sensor of the viewer'"'"'s mobile device. In response to detecting the match, the captured image and an advertisement presented with the captured image is presented in the viewer'"'"'s mobile device. The advertisement is associated with the participant.

Claims

1. A method comprising:

causing, at least in part, detection of a proximity between a participant'"'"'s mobile device and a viewer'"'"'s mobile device, wherein an identifier of the participant'"'"'s mobile device and biometric data that describes the participant have been made publicly available, the participant is registered with a promotional service, and the promotional service is independent from the participant and the viewer;

obtaining the biometric data in response to detecting the proximity between the participant'"'"'s mobile device and the viewer'"'"'s mobile device;

causing, at least in part, determination, by the viewer'"'"'s mobile device, of a match between the biometric data of the participant and an image captured by a sensor of the viewer'"'"'s mobile device when in the proximity;

in response to the determination of the match, causing, at least in part, alteration, by the viewer'"'"'s mobile device, of the captured image by superimposing thereinto an advertisement that is associated with the participant by the promotional service; and

causing, at least in part, presentation, at the viewer'"'"'s mobile device, of the captured image superimposed with the advertisement.

2. A method of claim 1, further comprising:

causing, at least in part, registration of the participant with the promotional service using at least one image of the participant and the identifier of the participant'"'"'s mobile device;

determining the biometric data from the at least one image via the promotional service;

associating the advertisement with the biometric data; and

causing, at least in part, transmission of the biometric data, the advertisement, or a combination thereof, from the promotional service to the viewer'"'"'s mobile device in response to detecting the proximity.

3. A method of claim 1, further comprising signaling to the promotional service an indication that the advertisement was presented in the viewer'"'"'s mobile device.

4. A method of claim 3, further comprising causing, at least in part, provision of valuable consideration to the participant in response to the signaling to the promotional service.

5. A method of claim 1, wherein the advertisement is shown in the viewer'"'"'s mobile device as an advertising graphic proximate to a portion of the captured image where the participant is shown.

6. A method of claim 5, wherein the advertising graphic is displayed by overlaying a semitransparent layer over the portion of the captured image where the participant is shown.

7. A method of claim 1, further comprising providing a user selectable link in the captured image in conjunction with presenting the advertisement overlaid on the captured image.

8. A method of claim 7, further comprising facilitating the download of content from the participant'"'"'s mobile device to the viewer'"'"'s mobile device in response to selecting the link.

10. A method of claim 1, further comprising:

determining to scan the captured image for biometric data by performing facial recognition, motion feature analysis, or a combination thereof, on the captured image, wherein the match is made between the biometric data of the participant and the biometric data scanned from the captured image.

11. A method of claim 1, further comprising:

placing the advertisement that matches at least a part of a contour of an image of the participant located within the captured image.

12. A method of claim 1, further comprising:

causing, at least in part, performing a proximity scan for at least one neighboring mobile device;

receiving identification information from the at least one neighboring mobile device; and

causing, at least in part, transmission, to the promotion service, of a request for at least one participant'"'"'s mobile device among the at least one neighboring mobile device and for biometric data that describes the at least one participant.

13. A method of claim 1, further comprising:

detecting, by the viewer'"'"'s mobile device, a contour of an image of the participant presented within the captured image; and

drawing the advertisement as an advertising graphic within the contour.

9. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

cause, at least in part, detection of a proximity between a viewer'"'"'s mobile device and a participant'"'"'s mobile device, wherein an identifier of the participant'"'"'s mobile device and biometric data that describes the participant have been made publicly available, the participant is registered with a promotional service, and the promotional service is independent from the participant and the viewer;

in response to detecting the proximity, acquire the biometric data;

capture an image by using a sensor of the viewer'"'"'s mobile device when in the proximity;

cause, at least in part, determination, by the viewer'"'"'s mobile device, of a match between the biometric data of the participant and the captured image;

in response to the determination of the match, cause, at least in part, alteration, by the viewer'"'"'s mobile device, of the captured image by superimposing thereinto an advertisement that is associated with the participant by the promotional service; and

cause, at least in part, presentation, at the viewer'"'"'s mobile device, of the captured image superimposed with the advertisement.

14. An apparatus of claim 9, wherein the biometric data is acquired from the participant'"'"'s mobile device or a server.

15. An apparatus of claim 14, wherein the proximity is detected via proximity data received from a proximity sensor of the viewer'"'"'s mobile device, or via a network.

16. An apparatus of claim 15, wherein at least one of the biometric data and proximity data is received from the promotional service.

17. An apparatus of claim 9, wherein the advertisement is shown in the viewer'"'"'s mobile device as an advertising graphic proximate to a portion of the captured image where the participant is shown.

18. An apparatus of claim 17, wherein the advertising graphic is displayed by overlaying a semitransparent layer over the portion of the captured image where the participant is shown.

19. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

causing, at least in part, detection of a proximity between a viewer'"'"'s mobile device and a participant'"'"'s mobile device, wherein an identifier of the participant'"'"'s mobile device and biometric data that describes the participant have been made publicly available, the participant is registered with a promotional service, and the promotional service is independent from the participant and the viewer;

in response to detecting the proximity, acquiring the biometric data;

causing, at least in part, determination, by the viewer'"'"'s mobile device, of a match between the biometric data of the participant and an image captured by a sensor of the viewer'"'"'s mobile device when in the proximity;

in response to the determination of the match, causing, at least in part, alteration, by the viewer'"'"'s mobile device, of the captured image by superimposing thereinto an advertisement that is associated with the participant by the promotional service; and

causing, at least in part, presentation, at the viewer'"'"'s mobile device, of the captured image superimposed with the advertisement.

20. A system comprising:

a participant'"'"'s mobile device configured to make biometric data that describes the participant and the participant'"'"'s mobile device publicly available, wherein the participant is registered with a promotional service, and the promotional service is independent from the participant and the viewer;

a viewer'"'"'s mobile device configured to;

detect a proximity between the participant'"'"'s mobile device and the viewer'"'"'s mobile device;

acquire the biometric data in response to detecting the proximity;

capture an image when in the proximity;

determine a match between the biometric data of the participant and the captured image;

in response to the determination of the match, alter the captured image by superimposing thereinto an advertisement that is associated with the participant by the promotional service; and

present the captured image superimposed with the advertisement.