Multi-functional control and entertainment systems

• US 20050276448A1
• Filed: 07/19/2005
• Published: 12/15/2005
• Est. Priority Date: 07/07/2000
• Status: Active Grant

• Current Assignee: Gesture Technology Partners, LLC
• Original Assignee: Timothy R. Pryor
• Inventors: Pryor, Timothy R.
• Granted Patent: US 7,466,843 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: B60K 2360/122 Instrument input devices with reconfigurable control functions, e.g. reconfigurable menus
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/145 Instrument input by combination of touch screen and hardware input devices
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: G06F 3/0312 for tracking the rotation of a spherical or circular member, e.g. optical rotary encoders used in mice or trackballs using a tracking ball or in mouse scroll wheels tracking relative movement in co-operation with a regularly or irregularly patterned surface, e.g. as in optical mice G06F3/0317; constructional details of scroll or thumb-wheels G06F3/0362; optical rotary encoders G01D5/3473
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

For use in vehicles, it is desirable to have multi-functional (also known as reconfigurable) controls in the center stack portion of the instrument panel in order to best provide electronic and telematic functions to the driver. Disclosed are methods and apparatus to allow reconfiguration of classical controls such as knobs, sliders, and switches most familiar to the vast majority of the motoring public which may, if desired, utilize conventional flat panel displays (e.g., LCD based) and conventional readout electronics and switching. Also disclosed are projection based controls and new forms of rear seat entertainment controls and related apparatus for minivans and other vehicles.

Claims

1. A method for providing control inputs comprising the steps of;

providing a reflective member;

providing a TV camera;

imaging said member with said TV camera;

covering a portion of the member with an object in a position corresponding to a desired control input;

analyzing the output of said TV camera with a computer;

determining, from said analysis, the location of said object on said base member, and;

using said location, determining the control input desired.

2. A method according to claim 1, wherein said object is a finger of a user.

3. A method according to claim 1, wherein said object is a portion of a knob or slider moved by a user.

4. A method according to claim 1, wherein said member is retro-reflective

5. A method according to claim 4, including the further step of illuminating said member with a light source.

6. A method according to claim 1 wherein said member is comprised by a group of discrete members, one of which is blocked by said object.

7. A method according to claim 1, wherein a multiplicity of said members are observed with said camera, and a plurality of inputs are determined using said computer.

8. A method according to claim 1, including the further step of determining the reflection from said base member when not blocked and comparing the result to an instant TV camera image to determine if a portion is blocked.

9. A method for determining the location of at least one member proximate the front surface of an LCD flat panel display, comprising the steps of:

providing an LCD display;

providing an electro-optical sensor in the rear of said display, said sensor having a light source for illuminating said members;

controlling the pixels of said display in those regions where member location is desired, such that light from said light source projected the from rear of said display can substantially pass through said display, and;

using the light reflected by said member in front of the display back to said sensor, determining the location of said member.

10. A method according to claim 9 wherein said member is a finger tip.

11. A method according to claim 9 wherein said member is a reflector on a control device.

12. A method according to claim 9 wherein said control device is a knob.

13. A method according to claim 9 wherein said sensor is a TV camera.

14. A method according to claim 9 wherein the location of said member is chosen to be in a region having defective display pixels.

15. An instrument panel for vehicles or other applications comprising:

a projector for projecting fixed image data onto a rear projection screen and control surface of said instrument panel,

means to sense a user input command on said control surface, and

computer means for determining a control function from said input command.

16. Apparatus according to claim 15 further including an additional fixed image projector.

17. Apparatus according to claim 15 further including a programmable optical image writing device to write information over said projected fixed image.

18. Apparatus according to claim 15 further including a variable display for displaying variable image information.

19. Apparatus according to claim 15 wherein said input command is a finger touch location.

20. Apparatus according to claim 15 wherein said input command is a control detail position.