Augmented reality personalization

• US 10,127,734 B2
• Filed: 11/20/2017
• Issued: 11/13/2018
• Est. Priority Date: 12/13/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Stroila, Matei
• Primary Examiner(s): Tseng, Charles
• Application Number:
  US15/817,375
• Publication Number:
  US 20180082485A1
• Time in Patent Office: 358 Days
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H05K 999/99 dummy group

Abstract

A method is provided, such as for mobile augmented reality personalization. A front-facing camera of the mobile device acquires a first view of a user of the mobile device. A personal characteristic of the user of the mobile device is identified from the first view. A location of the mobile device may be determined. A back-facing camera of the mobile device may acquire a second view of a region at the location. Augmented reality information is selected as a function of the personal characteristic. A second view is displayed with the augmented reality information.

Claims

1. A method comprising:

receiving a first view of a face of a user from a first camera;

determining, by a processor, a facial expression characteristic of the user from an analysis of the face of the user;

receiving, by the processor, a second view from a second camera;

identifying, by the processor, one or more points of interest in the second view;

performing, by the processor, a query for the facial expression characteristic of the user that selects data for the one or more points of interest; and

generating, by the processor, a third view comprising the second view with the data for the one or more points of interest.

2. The method of claim 1, further comprising:

transmitting, by the processor, the third view to a mobile device.

3. The method of claim 1, wherein identifying the one or more points of interest comprises:

extracting, by the processor, the one or more points of interest using an image recognition algorithm.

4. The method of claim 1, wherein identifying the one or more points of interest comprises:

extracting, by the processor, the one or more points of interest using optical character recognition.

5. The method of claim 1, wherein identifying the one or more points of interest comprises:

identifying, by the processor, a template of a building in the second view; and

matching, by the processor, the template to a stored template for a point of interest of the one or more points of interest.

6. The method of claim 1, further comprising:

performing, by the processor, feature extraction on the face of the user.

7. The method of claim 1, wherein the analysis of the face determines an identity of the user, wherein the data for the one or more points of interest is selected based on the identity of the user.

8. The method of claim 1, wherein the analysis of the face determines a permanent feature of the user, wherein the data for the one or more points of interest is selected based on the permanent feature of the user.

9. The method of claim 1, wherein the analysis of the face determines a temporary feature of the user, wherein the data for the one or more points of interest is selected based on the temporary feature of the user.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

identify a first view of a user collected by a first camera of a mobile device;

perform an analysis of the first view of the user from the first camera;

determine a facial expression characteristic of the user from the analysis of the first view;

receive a second view including a point of interest from a second camera of the mobile device;

perform a query for the facial expression characteristic of the user that selects information for the point of interest; and

provide the information with the second view.

11. The apparatus of claim 10, the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identify the point of interest in the second view using optical character recognition.

12. The apparatus of claim 10, the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identify the point of interest in the second view using input from the user.

13. An apparatus comprising:

a first camera, the first camera configured to capture a first view;

a second camera, the second camera configured to capture a second view;

a geographic database, the geographic database configured to store data for a point of interest;

a processor, the processor configured to identify a facial expression characteristic of a user from a face of the user in the first view and configured to identify the point of interest in the second view, the processor configured to select a subset of data of the data for the point of interest based on the facial expression characteristic, the processor further configured to generate a third view comprising the second view and the subset of data; and

a display, the display configured to display the third view to the user.

14. The apparatus of claim 13, wherein the first view, second view, and third view are still images.

15. The apparatus of claim 13, wherein the processor is configured to identify the point of interest using optical character recognition.

16. The apparatus of claim 13, wherein the processor is configured to identify the point of interest using a building template.

17. The apparatus of claim 13, wherein the first camera is a forward facing camera and the second camera is a back facing camera.

18. The apparatus of claim 13, wherein the geographic database is remotely located from the processor.

19. The apparatus of claim 13, wherein the data for the point of interest is advertising data.

20. The apparatus of claim 13, wherein the processor is further configured to identify an age of the user from the face of the user in the first view, wherein the subset of data is further selected based on the age.