SYSTEM FOR GENERATING AND CONTROLLING A VARIABLY DISPLAYABLE MOBILE DEVICE KEYPAD/VIRTUAL KEYBOARD

• US 20150121287A1
• Filed: 12/29/2014
• Published: 04/30/2015
• Est. Priority Date: 07/03/2006
• Status: Abandoned Application

• Current Assignee: Yoram Ben-Meir
• Original Assignee: Yoram Ben-Meir
• Inventors: FERMON, Israel
• Application Number:
  US14/584,789
• Publication Number:
  US 20150121287A1
• Time in Patent Office: Days
• US Class Current: 715/773
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A system for generating and controlling a variably displayable virtual keypad includes a mobile device with a screen on which is displayable selected content, holographic projectors, from image generating data retrievable from a memory, a virtual keypad appearing to be free-floating and suspended in mid-air. An input identification unit identifies a virtual key pressing operation performed in conjunction with the generated virtual keypad, determining which key of the virtual keypad has been virtually pressed, and transmitting an input command in response to the virtual key pressing operation by which the displayed content is modifiable. The input identification unit includes a 3D camera capturing gestures of a user hand and transmitting a signal indicative of gesture related data to a microprocessor for translating the gesture related data into the input command by instructions stored in the memory device. The microprocessor generates feedback in response to the virtual key pressing operation to indicate which key has been virtually pressed and to modify a visualization parameter of the generated virtual keypad. The feedback may be in the form of an ultrasonic beam propagatable to the initiating finger.

Claims

1. A system for generating and controlling a variably displayable virtual keypad, comprising a mobile device having a screen on which is displayable selected content and a memory device;

a plurality of holographic projectors housed in said mobile device for generating, from image generating data retrievable from said memory device, a virtual keypad appearing to be free-floating and spaced from said screen; and

an input identification unit for identifying a virtual key pressing operation performed in conjunction with said generated virtual keypad, determining which key of said virtual keypad has been virtually pressed, and transmitting an input command in response to said virtual key pressing operation by which said displayed content is modifiable.

2. The system according to claim 1, wherein the input identification unit comprises a 3D camera for capturing gestures of a user hand and for transmitting a signal which is indicative of gesture related data to a microprocessor for translating said gesture related data into the input command by instructions stored in the memory device.

3. The system according to claim 2, wherein the instructions are retrievable from one or more modules selected from the group of a fingertip tracking module, a gesture recognition module, a coordinate matching module, a look-up table, a distortion correction module, and a key pressing estimation module.

4. The system according to claim 2, wherein the microprocessor is operable to generate feedback in response to the virtual key pressing operation to indicate which key has been virtually pressed.

5. The system according to claim 2, wherein the microprocessor is operable to modify a visualization parameter of the generated virtual keypad in response to performance of one or more user specific gestures.

10. The system according to claim 1, wherein the mobile device is a wearable device selected from the group of Activity trackers, Smartwatches, Smartglasses, GPS watches, Healthcare monitors and pedometers.

11. The system according to claim 10, wherein the wearable device operates is being in communication with a smartphone.

6. A system for generating and controlling a variably displayable virtual user interface, comprising an electronic device having a screen on which is displayable selected content and a memory device;

a plurality of holographic projectors housed in said device for generating, from image generating data retrievable from said memory device, a virtual user interface appearing to be free-floating; and

an input identification unit for identifying a virtual key pressing operation performed in conjunction with said generated virtual user interface, determining which key of said virtual user interface has been virtually pressed, and transmitting an input command in response to said virtual key pressing operation by which said displayed content is modifiable, wherein one of said holographic projectors which were not activated to generate said virtual keypad are activatable in response to said virtual key pressing operation, to display visual feedback independently of said virtual keypad and generally aligned with said virtually pressed key.

7. A system for generating and controlling a variably displayable virtual user interface, comprising an electronic device having a screen on which is displayable selected content and a memory device;

a plurality of holographic projectors housed in said device for generating, from image generating data retrievable from said memory device, a virtual user interface appearing to be free-floating;

an input identification unit for identifying a virtual key pressing operation performed in conjunction with said generated virtual user interface, determining which key of said virtual user interface has been virtually pressed by an initiating finger, and transmitting an input command in response to said virtual key pressing operation by which said displayed content is modifiable; and

a plurality of ultrasonic transducers housed in said device for generating a focused ultrasonic beam propagatable to said initiating finger prior to being separated from said virtually pressed key in response to said virtual key pressing operation, to provide tactile feedback as indication to which key has been virtually pressed.

8. A system for generating and controlling a variably displayable virtual keypad, comprising a mobile device having a screen on which is displayable selected content, a microprocessor, a memory device and a home button;

a plurality of holographic projectors housed in said mobile device for generating, from image generating data retrievable from said memory device, a virtual keypad appearing to be free-floating and spaced from said screen;

a 3D camera housed in said mobile device proximate to said home button for capturing gestures of a user hand and for transmitting a signal which is indicative of gesture related data to said microprocessor; and

an input identification unit for identifying a virtual key pressing operation performed in conjunction with said generated virtual keypad by said gesture related data, determining which key of said virtual keypad has been virtually pressed by instructions stored in said memory device, and transmitting an input command in response to said virtual key pressing operation by which said displayed content is modifiable.

9. A method for performing a virtual key pressing operation, comprising the steps of generating a virtual keypad appearing to be free-floating by retrieving stored image generating data and operating a plurality of holographic projectors housed in a mobile device in accordance with said image generating data;

tracking motion of an initiating finger;

identifying a virtual key pressing operation when said initiating finger substantially coincides temporarily with an image plane of said virtual keypad;

determining which key of said virtual keypad has been virtually pressed by means of instructions stored in a memory device of said mobile device; and

transmitting an input command in response to said virtual key pressing operation.