Method and apparatus for complementing an instrument panel by utilizing augmented reality

• US 8,712,632 B2
• Filed: 01/30/2013
• Issued: 04/29/2014
• Est. Priority Date: 01/30/2013
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: Navteq B.V.
• Inventors: Tuukkanen, Marko Tapio
• Primary Examiner(s): Black, Thomas
• Assistant Examiner(s): HUYNH, LUAT T
• Application Number:
  US13/754,308
• Publication Number:
  US 20130144482A1
• Time in Patent Office: 454 Days
• Field of Search: 701 291- 299, 701/31.5, 701/32.8, 701/415, 455/41.2, 455/418
• US Class Current: 701/31.5
• CPC Class Codes: B60K 2360/161 Explanation of functions, e.g. instructions
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2360/5899 Internet
• CPC Class Codes: B60K 2360/592 Data transfer involving external databases
• CPC Class Codes: B60K 2370/1529 Head-up displays
• CPC Class Codes: B60K 2370/155 Virtual instruments
• CPC Class Codes: B60K 2370/161 Explanation of functions, e.g. instructions
• CPC Class Codes: B60K 2370/182 Distributing information between displays
• CPC Class Codes: B60K 2370/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2370/5899 Internet
• CPC Class Codes: B60K 2370/592 External database involved
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: G01V 8/12 using one transmitter and one receiver
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 : Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 9/451 : Execution arrangements for user interfaces
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

An approach is provided for complementing various devices and/or instruments by utilizing augmented reality and providing an adaptive user interface to a user at a user device. A user device determines one or more information items associated with at least one instrument panel of at least one vehicle. Then the user device determines one or more representations of the one or more information items and causes, at least in part, a presentation of the one or more information items at the user device, wherein the user device may complement and/or may be substituted for the at least one instrument panel.

Claims

1. A method comprising facilitating a processing of or processing (1) data, (2) information, or (3) at least one signal, the (1) data, (2) information, or (3) at least one signal based, at least in part, on the following:

at least one determination of one or more information items associated with at least one instrument panel of at least one vehicle;

at least one determination of one or more representations of the one or more information items; and

a presentation of the one or more information items at at least one device based, at least in part, on a priority level of the one or more information items,

wherein the at least one device substitutes for the at least one instrument panel, and

wherein the at least one device determines the priority level for the one or more information items based on one or more of a user preference, a user defined threshold value, urgency of the information item, or service provider information.

2. A method of claim 1, wherein the one or more information items are received via one or more communication links to one or more sensors associated with the at least one vehicle, one or more service providers, or a combination thereof.

3. A method of claim 1, wherein the one or more information items are determined via one or more optical sensors, one or more audio sensors, or a combination thereof on the at least one device.

4. A method comprising facilitating a processing of or processing (1) data, (2) information, or (3) at least one signal, the (1) data, (2) information, or (3) at least one signal based, at least in part, on the following:

at least one determination of one or more information items associated with at least one instrument panel of at least one vehicle;

at least one determination of one or more representations of the one or more information items;

a processing of the one or more information items to determine priority information; and

a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel,

wherein the presentation of the one or more information items at the at least one device is based, at least in part, on the priority information, and

wherein the (1) data, (2) information, or (3) at least one signal are further based, at least in part, on the following;

at least one determination of, at the at least one device, one or more inaccuracies in the one or more information items; and

an update to the priority information based, at least in part, on the one or more inaccuracies.

5. A method of claim 4, wherein the (1) data, (2) information, or (3) at least one signal are further based, at least in part, on the following:

at least one determination of one or more sensors associated with the one or more inaccuracies;

a presentation of one or more notifications via a user interface at the at least one device indicative of the one or more inaccuracies;

at least one determination of one or more user inputs via the user interface; and

the update based, at least in part, on the one or more user inputs.

6. A method of comprising facilitating a processing of or processing (1) data, (2) information, or (3) at least one signal, the (1) data, (2) information, or (3) at least one signal based, at least in part, on the following:

at least one determination of one or more information items associated with at least one instrument panel of at least one vehicle;

at least one determination of one or more representations of the one or more information items; and

a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel, and

wherein the (1) data, (2) information, or (3) at least one signal are further based, at least in part, on the following;

the presentation of the one or more information items based, at least in part, on one or more user preferences, one or more user histories, or a combination thereof.

7. A method of claim 6, wherein the (1) data, (2) information, or (3) at least one signal are further based, at least in part, on the following:

a configuration of a display area on the at least one device based, at least in part, on the one or more priorities, one or more information types, the one or more user preferences, the one or more user histories, the one or more inaccuracies, or a combination thereof.

8. A method of claim 7, wherein the configuration of the display area on the at least one device, the presentation of the one or more information items, or a combination thereof is based, at least in part, on a type of the vehicle.

9. A method of claim 7, wherein the (1) data, (2) information, or (3) at least one signal are further based, at least in part, on the following:

a storing of the one or more information items, the configuration of the display area, information of the vehicle, or a combination thereof at the at least one device.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more information items associated with at least one instrument panel of at least one vehicle;

determine one or more representations of the one or more information items; and

cause, at least in part, a presentation of the one or more information items at at least one device based, at least in part, on a priority level of the one or more information items,

wherein the at least one device substitutes for the at least one instrument panel, and

wherein the at least one device determines the priority level for the one or more information items based on one or more of a user preference, a user defined threshold value, urgency of the information item, or service provider information.

11. An apparatus of claim 10, wherein the one or more information items are received via one or more communication links to one or more sensors associated with the at least one vehicle, one or more service providers, or a combination thereof.

12. An apparatus of claim 10, wherein the one or more information items are determined via one or more optical sensors, one or more audio sensors, or a combination thereof on the at least one device.

14. An apparatus of claim 12, wherein the apparatus is further caused to:

determine one or more sensors associated with the one or more inaccuracies;

cause, at least in part, a presentation of one or more notifications via a user interface at the at least one device indicative of the one or more inaccuracies;

determine one or more user inputs via the user interface; and

cause, at least in part, the update based, at least in part, on the one or more user inputs.

13. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more information items associated with at least one instrument panel of at least one vehicle;

determine one or more representations of the one or more information items;

process or facilitate a processing of the one or more information items to determine priority information; and

cause, at least in part, a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel,

wherein the presentation of the one or more information items at the at least one device is based, at least in part, on the priority information, and

wherein the apparatus is further caused to;

determine, at the at least one device, one or more inaccuracies in the one or more information items; and

cause, at least in part, an update to the priority information based, at least in part, on the one or more inaccuracies.

15. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more information items associated with at least one instrument panel of at least one vehicle;

determine one or more representations of the one or more information items; and

cause, at least in part, a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel, and

wherein the apparatus is further caused to;

cause, at least in part, the presentation of the one or more information items based, at least in part, on one or more user preferences, one or more user histories, or a combination thereof.

16. An apparatus of claim 15, wherein the apparatus is further caused to:

cause, at least in part, a configuration of a display area on the at least one device based, at least in part, on the one or more priorities, one or more information types, the one or more user preferences, the one or more user histories, the one or more inaccuracies, or a combination thereof.

17. An apparatus of claim 16, wherein the configuration of the display area on the at least one device, the presentation of the one or more information items, or a combination thereof is based, at least in part, on a type of the vehicle.

18. An apparatus of claim 16, wherein the apparatus is further caused to:

cause, at least in part, a storing of the one or more information items, the configuration of the display area, information of the vehicle, or a combination thereof at the at least one device.