User interface controlled by environmental cues

• US 9,766,792 B2
• Filed: 06/08/2015
• Issued: 09/19/2017
• Est. Priority Date: 12/27/2007
• Status: Expired due to Fees

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Inventors: Buecker, Martin, Lobko, Maxim, Hoffmann, Marc, Coersmeier, Edmund
• Primary Examiner(s): PITARO, RYAN F
• Application Number:
  US14/733,910
• Publication Number:
  US 20150268834A1
• Time in Patent Office: 834 Days
• CPC Class Codes: G01C 21/36 Input/output arrangements for on-board computers
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096725 where the received information generates an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096758 where no selection takes place on the transmitted or the received information
• CPC Class Codes: G08G 1/096783 where the origin of the information is a roadside individual element

Abstract

A method comprises receiving a signal containing an environmental cue; correlating the environmental cue to a user interface control element; and generating a user interface control command based on the environmental cue. A device may be controlled by receiving a visual image, processing the image to identify a visual cue, correlating the visual cue with a user interface control, and controlling the device using the user interface control. The visual image may be received from a camera that is part of an automobile, and the user interface control may include a control for a radio to tune to a radio station; a speed control for controlling a speed of the automobile corresponding to a speed sign visual cue; or a navigation system control for controlling a navigation system based on traffic signs. Other variations include an apparatus and computer-readable media including instructions for performing the methods.

Claims

1. A method comprising:

capturing a visual image of a traffic sign by a camera;

receiving a user input for selecting the visual image for correlation;

in response to the user input for selecting the visual image, correlating, by the processor, the visual image to at least one interface control element for operating at least one of a radio device, a telephone device, a web browser device, a speed control device, and a navigation device;

displaying a set of options applicable to the at least one interface control element for the at least one device, the options comprising;

a speed control command for the speed control device when the visual image correlates to a speed limit sign, a detour command for the navigation device when the visual image correlates to a traffic alert, and

a dial command for the telephone device when the visual image correlates to a telephone; and

in response to a user selection of one of the set of options, performing a corresponding command.

2. The method of claim 1, further comprising causing the navigation device to enter a detour mode to plan an alternate route in response to selection of the detour command.

3. The method of claim 1, wherein the options further comprise a web page loading command for the web browser device when the visual image correlates to a website address.

4. The method of claim 1, wherein the options further comprise an update map command for the navigation device when the visual image correlates to traffic routing sign.

5. The method of claim 1, wherein correlating comprises receiving user input regarding a user-selected portion of the visual image corresponding to the received signal.

6. The method of claim 5, wherein correlating further comprises the correlation to the user-selected portion of the visual image.

7. The method of claim 1, wherein correlating comprises matching a visual cue within the captured image to one of a plurality of potentially matching visual cues stored in a database.

8. An apparatus comprising:

a display configured to display a user interface;

a user interface for receiving user inputs;

a camera configured to capture a visual image of a traffic sign; and

a processor configured to;

receive a user input via the user interface for selecting the visual image for correlation,

in response to the user input for selecting the visual image, correlate the visual image to an at least one interface control element for operating at least one of a radio device, a telephone device, a web browser device, a speed control device, and a navigation device

display a set of options applicable to the at least one interface control element for the at least one device, the options comprising;

a speed control command for the speed control device when the visual image correlates to a speed limit sign,

a detour command for the navigation device when the visual image correlates to a traffic alert, and

a dial command for the telephone device when the visual image correlates to a telephone number, and

in response to a user selection of one of the set of options, performing a corresponding command.

9. The apparatus of claim 8, wherein the processor is further configured to cause the navigation device to enter a detour mode to plan an alternate route in response to selection of the detour.

10. The apparatus of claim 9, wherein the options further comprise a web page loading command for the web browser device when the visual image correlates to a website address.

11. The apparatus of claim 9, the options further comprise an update map command for the navigation device when the visual image correlates to traffic routing.

12. The apparatus of claim 9, further comprising a database configured to store visual cue patterns, wherein the processor is further configured to match a visual cue within the captured image to one of a plurality of potentially matching visual cues stored in the database.

13. The apparatus of claim 12, wherein the visual cues are organized by geographic region.

14. A non-transitory computer-readable medium storing executable instructions configured to, when executed, cause a processor to:

receive a visual image of a traffic sign by a camera;

receive a user input via the user interface for selecting the visual image for correlation;

in response to the user input for selecting the visual image, correlate the visual image to at least one interface control element for operating at least one of a radio device, a telephone device, a web browser device, a speed control device, and a navigation device;

display a set of options applicable to the at least one interface control element for the at least one device, the options comprising;

a speed control command for the speed control device when the visual image correlates to a speed limit sign,

a detour command for the navigation device when the visual image correlates to a traffic alert, and

a dial command for the telephone device when the visual image correlates to a telephone number; and

in response to a user selection of one of the set of options, performing a corresponding command.

15. The computer-readable medium of claim 14, wherein the executable instructions configured to, when executed, cause a processor to cause the navigation device to enter a detour mode to plan an alternate route in response to selection of the detour command.

16. The computer-readable medium of claim 15, wherein the options further comprise a web page loading command for the web browser device when the visual image correlates to a website address.

17. The computer-readable medium of claim 15, wherein the options further comprise an update map command for the navigation device when the visual image correlates to traffic routing sign.

18. The computer-readable medium of claim 15, wherein the options further comprise an update map command for the navigation device when the visual image correlates to traffic routing sign.

19. The computer-readable medium of claim 15, wherein the executable instructions configured to, when executed, cause a processor to match a visual cue within a received image to one of a plurality of potentially matching visual cues stored in a database.