Customizable and reconfigurable virtual instrument panel

• US 10,310,627 B2
• Filed: 10/16/2017
• Issued: 06/04/2019
• Est. Priority Date: 04/13/2009
• Status: Active Grant

• Current Assignee: Applied Minds LLC
• Original Assignee: Applied Minds LLC
• Inventors: Ferren, Bran, Hillis, W. Daniel, Yates, Randall Adam, Lichtman, Ira M., Hope, Clinton Blake
• Primary Examiner(s): Nguyen, Tai T
• Application Number:
  US15/785,006
• Publication Number:
  US 20180052526A1
• Time in Patent Office: 596 Days
• Field of Search: 340462, 340 332, 340158, 340971, 345156, 345168, 345173
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/1442 Emulation of input devices
• CPC Class Codes: B60K 2360/145 Instrument input by combination of touch screen and hardware input devices
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/0227 Cooperation and interconnection of the input arrangement with other functional units of a computer G06F3/023 - G06F3/037 take precedence
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

The invention provides an instrument control panel that is easily customized and reconfigured, and yet provides the familiar tactile sensation of physical knobs, sliders, and buttons. The instrument control panel comprises one or more interface components that are removably coupled to an interface display wherein the interface components communicate with one or more control components disposed behind the interface display. The present invention lends itself particularly well to an instrument panel.

Claims

1. A method for controlling a device, comprising:

removably coupling an interface component to a first portion of an interface surface, wherein one or more encoders are coupled to at least a second portion of the interface surface;

detecting, via the one or more encoders, motion of at least one portion of the interface component;

tracking, via the one or more encoders, the motion of the at least one portion of the interface component and forming control input data based on the motion tracking; and

controlling the device using the control input data.

2. The method of claim 1, wherein tracking the motion of the at least one portion of the interface component comprises determining a rotational position of the interface component.

3. The method of claim 2, wherein the interface component includes markings associated with the interface component.

4. The method of claim 3, wherein the markings are reflective.

5. The method of claim 3, wherein the interface component is a knob, and wherein the markings are located on a perimeter surface of the knob.

6. The method of claim 3, wherein the markings are reflective at infrared (IR) wavelengths, and the method for controlling the device further comprises:

illuminating the markings with IR emitters, and

detecting, via one or more encoders, a position of the markings.

7. The method of claim 3, wherein the markings are patterned to uniquely identify the interface component.

8. The method of claim 1, further comprising:

transmitting the control input data to a processor using a wireless signal.

9. The method of claim 1, wherein the interface surface is disposed within a vehicle.

10. The method of claim 9, wherein the interface surface is disposed within any of a dashboard, an instrument panel, a headrest, or a console of the vehicle.

11. The method of claim 10, wherein the vehicle is any of an automobile, a boat, a train, or an airplane.

12. The method of claim 1, further comprising:

determining an association between the interface component and an electronic application of the device; and

manipulating the electronic application upon a processor receiving the control input data.

13. The method of claim 12, wherein determining an association between the interface component and the electronic application comprises:

determining a location where the interface component is coupled to the first portion of the interface surface; and

determining an electronic application, to be manipulated, of the device based on the determined location of the interface component.

14. The method of claim 12, wherein determining an association between the interface component and the electronic application further comprises:

receiving voice input associated with a coupling of the interface component; and

interpreting the voice input to indicate the electronic application of the device to be associated with the interface component.

15. The method of claim 1, wherein the interface surface includes a display.

16. The method of claim 15, wherein the display is a liquid crystal display (LCD) screen.

17. The method of claim 15, wherein the display includes a compact multi-touch panel.

18. The method of claim 15, wherein the one or more encoders comprise an optical sensor, and the optical sensor is integrated into each pixel of the display.

19. The method of claim 1, wherein the interface surface includes a grid having a pattern, and wherein the interface component is coupled to the first portion of the interface surface according to the pattern of the grid.

20. The method of claim 1, wherein the device is a multimedia receiver.

21. The method of claim 20, wherein a function of the multimedia receiver is controlled based on detected motion of at least a portion of the interface component.

22. The method of claim 21, wherein the function is any of volume, terrestrial radio tuning, satellite radio tuning, balance, or frequency response.

23. An apparatus for controlling a device, comprising:

an interface surface having coupled thereto, one or more encoders;

an interface component having a surface associated therewith, wherein the interface component is removably coupled to a first portion of the interface surface upon placement by a user; and

a processor, wherein the processor is operably coupled to the one or more encoders and configured to;

analyze motion of at least a portion of the interface component using the one or more encoders,

form control input data based on the analyzed motion; and

control the device using the control input data.

24. The apparatus of claim 23, wherein the one or more encoders include a plurality of optical scanning elements that define a plurality of positions at which the interface component can be placed.

25. The apparatus of claim 24, wherein the interface surface is further configured to display a status of an attribute.

26. The apparatus of claim 23, wherein the processor is further configured to:

determine an association between the interface component and an electronic application, in response to a placement of the interface component onto the first portion of the interface surface, and

manipulate the electronic application upon analyzing motion of at least a portion of the interface component.

27. The apparatus of claim 26, wherein the interface surface is disposed within a vehicle.

28. The apparatus of claim 27, wherein the interface surface is disposed within any of a dashboard, an instrument panel, a headrest, or a console of the vehicle.

29. The apparatus of claim 28, wherein the vehicle is any of an automobile, a boat, a train, or an airplane.

30. The apparatus of claim 26, wherein the electronic application comprises any of an audiovisual application or a global positioning system application.

31. The apparatus of claim 26, wherein the determining an association between the interface component and the electronic application comprises:

determining a location where the interface component was placed on the first portion of the interface surface; and

determining the electronic application, to be controlled, of the device based on the determined location of the interface component.

32. The apparatus of claim 26, wherein the determining the association between the interface component and the electronic application comprises:

receiving voice input associated with a placement of the interface component on the first portion of the interface surface; and

interpreting the voice input to indicate the electronic application, of the device, to be associated with the interface component.

33. The apparatus of claim 23, wherein the interface surface includes a liquid crystal display (LCD).

34. The apparatus of claim 23, wherein the interface component includes a reflective marking.

35. The apparatus of claim 34, wherein the interface component is a knob, and wherein the reflective marking is located on a perimeter surface of the knob.

36. The apparatus of claim 34, wherein the apparatus for controlling the device further comprises:

one or more IR emitters, wherein the reflective marking is illuminated by the one or more IR emitters, and

analyzing motion of at least a portion of the interface component further comprises analyzing a change in reflective marking position.

37. The apparatus of claim 34, wherein the interface component is a knob, and wherein the marking is patterned to uniquely identify the knob from other knobs on the interface surface.