Augmented Reality Personalization

• US 20160086384A1
• Filed: 12/04/2015
• Published: 03/24/2016
• Est. Priority Date: 12/13/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Stroila, Matei
• Granted Patent: US 9,858,723 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H05K 999/99 dummy group

Abstract

A method is provided, such as for mobile augmented reality personalization. A front-facing camera of the mobile device acquires a first view of a user of the mobile device. A personal characteristic of the user of the mobile device is identified from the first view. A location of the mobile device may be determined. A back-facing camera of the mobile device may acquire a second view of a region at the location. Augmented reality information is selected as a function of the personal characteristic. A second view is displayed with the augmented reality information.

Claims

1. (canceled)

2. A method comprising:

receiving a first view of a user from a first camera;

performing an analysis the first view of the user from the first camera;

determining a characteristic of the user from the analysis of the first view;

receiving location data associated with the user;

receiving a second view from a second camera;

querying a database using the location data and the characteristic of the user; and

receiving a point of interest for the location data and the characteristic of the user from the database.

3. The method of claim 2, further comprising:

sending information for the point of interest to a mobile device, wherein the information for the point of interest is combined with the second view from the second camera.

4. The method of claim 2, further comprising:

identifying a face of the user from the first view of the first camera.

5. The method of claim 4, further comprising:

performing feature extraction on the face of the user from the first view of the first camera.

6. The method of claim 2, wherein the analysis determines an identity of the user, wherein the point of interest is associated with the identity of the user.

7. The method of claim 2, wherein the analysis determines a permanent feature of the user, wherein the point of interest is associated with the permanent feature of the user.

8. The method of claim 2, wherein the analysis determines a temporary feature of the user, wherein the point of interest is associated with the temporary feature of the user.

9. The method of claim 2, wherein the location data includes position coordinates and an orientation, wherein the point of interest is selected based on the position coordinates and the orientation.

10. The method of claim 2, wherein querying the database using the location data and the characteristic of the user comprises:

performing a first query for the location that returns a plurality of points of interest; and

performing a second query for the characteristic of the user that selects a subset of the plurality of points of interest.

11. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

identifying a first view of a user collected by a first camera of a mobile device;

performing an analysis the first view of the user from the first camera;

determining a characteristic of the user from the analysis of the first view;

receiving location data associated with the mobile device;

receiving a second view including a point of interest from a second camera of the mobile device;

querying a database using the location data and the characteristic of the user; and

receiving information for the point of interest based on the location data and the characteristic of the user from the database.

12. The apparatus of claim 11, the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

sending the information for the point of interest to the mobile device, wherein the information for the point of interest is combined with the second view from the second camera of the mobile device.

13. The apparatus of claim 11, the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

combining the information for the point of interest with the second view from the second camera of the mobile device.

14. The apparatus of claim 11, the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identifying a face of the user from the first view of the first camera.

15. The apparatus of claim 14, further comprising:

performing feature extraction on the face of the user from the first view of the first camera.

16. The apparatus of claim 11, wherein the analysis determines an identity of the user, wherein the point of interest is associated with the identity of the user.

17. The apparatus of claim 11, wherein the analysis determines a permanent feature of the user, wherein the point of interest is associated with the permanent feature of the user.

18. The apparatus of claim 11, wherein the analysis determines a temporary feature of the user, wherein the point of interest is associated with the temporary feature of the user.

19. The apparatus of claim 11, wherein the location data includes position coordinates and an orientation, wherein the point of interest is selected based on the position coordinates and the orientation.

20. The apparatus of claim 11, wherein querying the database using the location data and the characteristic of the user comprises:

performing a first query for the location that returns a plurality of points of interest; and

performing a second query for the characteristic of the user that selects a subset of the plurality of points of interest.

21. A non-transitory computer readable medium configured to store instructions, executable by the processor to perform:

receiving a first view of a user collected by a first camera of a mobile device;

receiving a second view collected by a second camera of the mobile device;

identifying a characteristic of the user from the first view;

receiving geographic coordinates for the mobile device;

querying a database using the location data and the characteristic of the user; and

receiving a point of interest for the location data and the characteristic of the user from the database.