METHOD AND APPARATUS FOR COMPLEMENTING AN INSTRUMENT PANEL BY UTILIZING AUGMENTED REALITY

• US 20130144482A1
• Filed: 01/30/2013
• Published: 06/06/2013
• Est. Priority Date: 01/30/2013
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: Navteq B.V.
• Inventors: TUUKKANEN, Marko Tapio
• Granted Patent: US 8,712,632 B2
• Time in Patent Office: Days
• US Class Current: 701/29.6
• CPC Class Codes: B60K 2360/161 Explanation of functions, e.g. instructions
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/184 Displaying the same information on different displays
• CPC Class Codes: B60K 2360/5899 Internet
• CPC Class Codes: B60K 2360/592 Data transfer involving external databases
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: G01V 8/12 using one transmitter and one receiver
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An approach is provided for complementing various devices and/or instruments by utilizing augmented reality and providing an adaptive user interface to a user at a user device. A user device determines one or more information items associated with at least one instrument panel of at least one vehicle. Then the user device determines one or more representations of the one or more information items and causes, at least in part, a presentation of the one or more information items at the user device, wherein the user device may complement and/or may be substituted for the at least one instrument panel.

Claims

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

at least one determination of one or more information items associated with at least one instrument panel of at least one vehicle;

at least one determination of one or more representations of the one or more information items; and

a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel.

2. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the one or more information items to determine priority information,

wherein the presentation of the one or more information items at the at least one device is based, at least in part, on the priority information.

3. A method of claim 1, wherein the one or more information items are received via one or more communication links to one or more sensors associated with the at least one vehicle, one or more service providers, or a combination thereof.

4. A method of claim 1, wherein the one or more information items are determined via one or more optical sensors, one or more audio sensors, or a combination thereof on the at least one device.

5. A method of claim 2, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of, at the at least one device, one or more inaccuracies in the one or more information items; and

an update to the priority information based, at least in part, on the one or more inaccuracies.

6. A method of claim 5, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of one or more sensors associated with the one or more inaccuracies;

a presentation of one or more notifications via a user interface at the at least one device indicative of the one or more inaccuracies;

at least one determination of one or more user inputs via the user interface; and

the update based, at least in part, on the one or more user inputs.

7. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

the presentation of the one or more information items based, at least in part, on one or more user preferences, one or more user histories, or a combination thereof.

8. A method of claim 7, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a configuration of a display area on the at least one device based, at least in part, on the one or more priorities, one or more information types, the on one or more user preferences, the one or more user histories, the one or more inaccuracies, or a combination thereof.

9. A method of claim 8, wherein the configuration of the display area on the at least one device, the presentation of the one or more information items, or a combination thereof is based, at least in part, on a type of the vehicle.

10. A method of claim 8, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a storing of the one or more information items, the configuration of the display area, information of the vehicle, or a combination thereof at the at least one device.

11. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more information items associated with at least one instrument panel of at least one vehicle;

determine one or more representations of the one or more information items; and

cause, at least in part, a presentation of the one or more information items at at least one device,

wherein the at least one device substitutes for the at least one instrument panel.

12. An apparatus of claim 11, wherein the apparatus is further caused to:

process and/or facilitate a processing of the one or more information items to determine priority information,

wherein the presentation of the one or more information items at the at least one device is based, at least in part, on the priority information.

13. An apparatus of claim 11, wherein the one or more information items are received via one or more communication links to one or more sensors associated with the at least one vehicle, one or more service providers, or a combination thereof.

14. An apparatus of claim 11, wherein the one or more information items are determined via one or more optical sensors, one or more audio sensors, or a combination thereof on the at least one device.

15. An apparatus of claim 12, wherein the apparatus is further caused to:

determine, at the at least one device, one or more inaccuracies in the one or more information items; and

cause, at least in part, an update to the priority information based, at least in part, on the one or more inaccuracies.

16. An apparatus of claim 15, wherein the apparatus is further caused to:

determine one or more sensors associated with the one or more inaccuracies;

cause, at least in part, a presentation of one or more notifications via a user interface at the at least one device indicative of the one or more inaccuracies;

determine one or more user inputs via the user interface; and

cause, at least in part, the update based, at least in part, on the one or more user inputs.

17. An apparatus of claim 11, wherein the apparatus is further caused to:

cause, at least in part, the presentation of the one or more information items based, at least in part, on one or more user preferences, one or more user histories, or a combination thereof.

18. An apparatus of claim 17, wherein the apparatus is further caused to:

cause, at least in part, a configuration of a display area on the at least one device based, at least in part, on the one or more priorities, one or more information types, the on one or more user preferences, the one or more user histories, the one or more inaccuracies, or a combination thereof.

19. An apparatus of claim 18, wherein the configuration of the display area on the at least one device, the presentation of the one or more information items, or a combination thereof is based, at least in part, on a type of the vehicle.

20. An apparatus of claim 18, wherein the apparatus is further caused to:

cause, at least in part, a storing of the one or more information items, the configuration of the display area, information of the vehicle, or a combination thereof at the at least one device.

21-48. -48. (canceled)