Secure and custom configurable key, pen or voice based input/output scheme for mobile devices using a local or central server

• US 6,882,859 B1
• Filed: 06/20/2000
• Issued: 04/19/2005
• Est. Priority Date: 12/16/1996
• Status: Expired due to Term

• Current Assignee: Smart Mobile Technologies LLC
• Original Assignee: Raman K. Rao, Sanjay K. Rao, Sunil K. Rao
• Inventors: Rao, Sunil K., Rao, Sanjay K., Rao, Raman K.
• Primary Examiner(s): Urban, Edward F.
• Assistant Examiner(s): CHOW, CHARLES CHIANG
• Application Number:
  US09/597,607
• Time in Patent Office: 1,764 Days
• Field of Search: 455/550.1, 455/575.1, 455/186.1, 455/422.1, 455/556.1, 455/85, 455/154, 455/160, 455/90, 455/344, 455/557, 455/550, 455/575, 455/422, 455/556, 455/346, 455/3.06, 395/146, 341/23, 341/22, 340/539, 340/506, 345/186, 345/179, 345/115, 345/173, 345/168, 709/22, 200/339, 200/5.A, 273/237, 400/90, 379/93, 379/16, 379/17, 379/25, 379/101.02, 379/100.12, 382/187, 382/188, 364/900, 364/709, 364/200
• US Class Current: 455/550.1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/953 Querying, e.g. by the use of web search engines
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0611 Request for offers or quotes
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/30 Writer recognition; Reading and verifying signatures
• CPC Class Codes: G07C 13/00 Voting apparatus
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G09B 19/0092 Nutrition
• CPC Class Codes: H04B 1/0057 using diplexing or multiplexing filters for selecting the desired band
• CPC Class Codes: H04B 10/11 Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
• CPC Class Codes: H04B 7/04 using two or more spaced independent antennas
• CPC Class Codes: H04B 7/0404 the mobile station comprising multiple antennas, e.g. to provide uplink diversity
• CPC Class Codes: H04B 7/0413 : MIMO systems
• CPC Class Codes: H04B 7/15 : Active relay systems
• CPC Class Codes: H04L 12/1827 : Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 : Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 12/2867 : Physical combinations
• CPC Class Codes: H04L 45/00 : Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 5/08 : each combination of signals in different channels being represented by a fixed frequency
• CPC Class Codes: H04L 63/083 : using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04L 63/0861 : using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/12 : Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 67/06 : specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/16 : Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04M 1/0202 : Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets constructional features of telephone transmitters or receivers, e.g. of speakers or microphones H04M1/03
• CPC Class Codes: H04M 1/026 : Details of the structure or mounting of specific components
• CPC Class Codes: H04M 1/724 : User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72409 : by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 : using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72436 : for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72463 : to restrict the functionality of the device
• CPC Class Codes: H04M 1/72466 : with selection means, e.g. keys, having functions defined by the mode or the status of the device
• CPC Class Codes: H04M 2250/58 : including a multilanguage function
• CPC Class Codes: H04M 2250/74 : with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04N 2007/145 : Handheld terminals
• CPC Class Codes: H04N 21/2353 : specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43637 : involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 7/14 : Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04Q 11/0005 : Switch and router aspects
• CPC Class Codes: H04Q 11/0062 : Network aspects
• CPC Class Codes: H04W 12/069 : using certificates or pre-shared keys
• CPC Class Codes: H04W 12/65 : Environment-dependent, e.g. using captured environmental data
• CPC Class Codes: H04W 12/68 : Gesture-dependent or behaviour-dependent
• CPC Class Codes: H04W 16/26 : Cell enhancers or enhancement, e.g. for tunnels, building shadow
• CPC Class Codes: H04W 36/22 : for handling the traffic
• CPC Class Codes: H04W 4/00 : Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 4/16 : Communication-related supplementary services, e.g. call-transfer or call-hold
• CPC Class Codes: H04W 40/02 : Communication route or path selection, e.g. power-based or shortest path routing
• CPC Class Codes: H04W 80/04 : Network layer protocols, e.g. mobile IP [Internet Protocol]
• CPC Class Codes: H04W 84/04 : Large scale networks; Deep hierarchical networks
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/06 : adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 88/10 : adapted for operation in multiple networks, e.g. multi-mode access points
• CPC Class Codes: H04W 92/02 : Inter-networking arrangements

Abstract

A keyboard apparatus for information entry with means for dynamically configuring a legend on a key of the keyboard apparatus. The keyboard apparatus includes means for detecting a selection of the key, and means for associating the selection of the key with the legend on the key. The legend is displayed on a LCD device forming a part of the key or is displayed on a LCD device forming a keyboard. Alternatively, the key may be selected by suing a touch sensitive LCD display.

Claims

1. A multifunction communication device, including a mobile device or cellular telephone, the device comprising

an intelligent keyboard system, the keyboard including central portable compute, command and control means for voice and data information;

the intelligent keyboard including a touch screen display selected functional text and graphics;

a central server;

means for communicating between the server and the mobile device including the intelligent keyboard system;

the mobile device including the intelligent keyboard system providing text, graphics and data from and to the server;

the intelligent keyboard system including a touch screen input;

means for configuring the touch screen input in a stand alone manner;

means for displaying the selected functionality on the touch screen display;

means for actuating the input and output functionality on the touch screen display by touch sensitive means,

means for storing one or more types of full or partial function touch screen enabled keyboard menus in a look up table within the mobile device including the intelligent keyboard and/or the central server; and

means for enabling the functionality of the keyboard menus.

2. The intelligent keyboard system of claim 1 comprising

means for communicating between the intelligent keyboard and the servers by wired or wireless means,

means for configuring the touch screen input using the processing power of the servers.

3. An intelligent keyboard system of claim 1 further comprising

a multi channel multiplexing transmitter/receiver,

the multi channel multiplexing transmitter/receiver enabled with one or more input and output channels for wired or wireless communication of voice, text, graphics and data.

4. An intelligent keyboard system of claim 1 comprising

means for communicating on multiple input and output channels voice, text, graphics and data.

5. An intelligent keyboard system of claim 1 further comprising

means for maintaining, modifying, personalizing, customizing look up tables and databases within the intelligent keyboard or the central server;

means for maintaining one or more menus related to standard keyboard, individual key and/or groups of keys within the intelligent keyboard or the central server

means for dynamically configuring the entire standard keyboard, an individual key and or groups of keys for one or more desired functions.

6. The intelligent keyboard system of claim 1 comprising the functions of

a cellular telephone;

a PDA;

a mobile computer;

an intelligent appliance.

7. An intelligent keyboard system of claim 1 further comprising

means for selecting by audible means, one or more touch screen enabled keyboard menus in one or more languages;

means wherein the audible method is inclusive of voice and sounds;

means wherein the voice and sounds represent one or more discrete or macro functions;

means wherein the audible discrete or macro functions are enabled in one or more selected languages;

means wherein the audible discrete and macro functions are resident in one or more look up tables within the intelligent keyboard or within the local or network server;

means for selecting the discrete and macro functions by audible or touch screen method;

means for enabling the functionality of the discrete and macro functions by audible methods and or;

means for enabling the functionality of the discrete and macro functions by touch screen method;

means wherein standard keystroke and touch screen input are enabled singly or in combination by sound and voice;

means for operating the intelligent keyboard in a stand alone manner and or in conjunction with a local or network server.

8. A intelligent keyboard system of claim 1 comprising

a plurality of communicating devices including intelligent keyboards

a central, local or network server;

means for wired or wireless communication;

means for the individual communication device including the intelligent keyboard to select one or more touch screen or audible keyboard input methods in one or more languages;

means for enabling real time translation between one or more disparate touch screen enabled keyboard input systems;

means for executing said translations within the communication device including intelligent keyboard itself or in conjunction with the local or network server;

means for real time communication between different communication devices including intelligent keyboards and like function devices in the same or different language;

means wherein one or more touch screen enabled keyboard menus are stored, downloaded, uploaded, modified, updated and shared by one or more communication devices including intelligent keyboard systems and like function devices acting collaboratively with each other and/or means for collaboration between communication devices including intelligent keyboard systems in conjunction with a local or network server.

9. An intelligent keyboard system of claim 1 that further comprising means for assigning a unique identifying number to one or more intelligent keyboards and or like function devices;

means for assigning another unique identifying number to one or more local or network servers;

means for secure and intended communication by wired or wireless means with one or more intelligent keyboards and/or local or network servers;

means for initiating, maintaining and terminating communication between selected servers and intelligent appliances and devices;

means for tracking said communication;

means for enabling collaboration in one or more languages, using same or different types of keyboard input methods;

means for collaborating being text based, voice based or sound based;

means for collaborating being enabled utilizing same or different touch screen enabled keyboard menus;

means for enabling collaboration by having the intelligent keyboards, local servers and network servers being in wired or wireless communication;

means for viewing, sharing, annotating, modifying and editing the same document and file in same or different language;

means for collaborating being enabled by utilizing the processing power of the intelligent keyboard itself or the local or network server.

10. The intelligent keyboard system of claim 1 further comprising means for positioning the selected touch screen enabled keyboard menu in one or more locations on the touch screen display as desired by the user;

and/or

means wherein the touch screen enabled keyboard menu is moved from one location to another within the touch screen display window;

means wherein one or more touch screen enabled keyboard menus are open contemporaneously in the same or different display window;

means for sizing one or more keyboard menus as desired by the user in one or more display windows.

11. The intelligent keyboard system of claim 1, comprising

means for maintaining customized and personalized touch screen enabled keyboard menus;

means for selecting a desired touch screen sensitive menu or keyboard menu;

means for associating voice and sounds for each character that comprises the selected keyboard menu;

means for associating voice and sounds for one or more groups of characters that comprises the selected keyboard menu;

means for maintaining the appropriate look up tables that determine the relationship between the individual or groups of characters and the voice and sounds;

means for maintaining said look up tables within the intelligent keyboard or the local or network server;

means for processing the look up tables and related translations in a standalone manner within the intelligent keyboards or in conjunction with a local or network server;

means for activating by touch sensitive method a character and or groups of characters;

means for associating the selected character and or group of characters to the desired voice and or sound from the look up table;

means for generating the desired display, voice and/or sound.

12. The intelligent keyboard system of claim 1 further comprising

means for generating text as each character or group of characters is activated by touch means;

the text being in the desired language for display and further utility;

means for generating real time voice or sound as each character and or group of characters is depressed;

means for enabling such voice and sounds to be transformed into recognizable speech or preset sounds in one or more languages.

13. An intelligent keyboard system comprising

a central server,

a mobile device configured with an intelligent keyboard including a standard full function keyboard or a partial function light enabled keyboard with no characters pre-printed on all or some of the keys;

means for wired or wireless communication between a mobile device and a central server,

means for dynamically selecting a desired individual key or group of keys for a different key function inclusive of different characters, icons and functions,

means for dynamically altering and configuring a selected individual key or a group of keys for a different and altered character, icon and function,

means for dynamically indicating by light the original or altered key functions on the individual light enabled keys and groups of keys;

means for an altered key and a groups of keys to light up with one or more colors, characters and icons to indicate an altered keyboard menu;

means for configuring an intelligent keyboard including a light enabled keyboard for use in one or more languages;

means for storing one or more key functions and keyboard menus related to an individual key, group of keys or the entire keyboard within a mobile device, a central server including a combination of the mobile device and a central server,

means for utilizing the original key functions or altered key functions and keyboard menus using the processing power resident within the mobile device, using the processing power of a central server including a combination of the processing power of the mobile device and a central server,

means for executing desired keyboard actions using a desired keyboard menu at a desired time.

14. An intelligent keyboard system of claim 13 comprising

a mobile device configured with an intelligent keyboard that includes,

a full function standard keyboard with keys that are key stroke sensitive;

means of the full function standard stroke sensitive keys surrounded by touch screen sensitive keys

means of stroke sensitive keys configured within a field of the touch screen display;

means of utilizing the standard stroke sensitive keyboard functionality and/or touch screen sensitive input functionality;

means for configuring the touch screen sensitive keys to be on or off as desired by the user;

means for displaying the desired individual key functionality on the touch screen display;

means for selecting the desired menus for dynamically configuring the keyboard;

means for selecting standard key stroke functionality, touch screen sensitive functionality and/or both means contemporaneously.

15. An intelligent keyboard system of claim 13 comprising

a mobile device configured with an intelligent keyboard that includes;

a separate key stroke sensitive keyboard;

a separate touch screen sensitive keyboard area;

one or more display areas;

means for displaying the altered keyboard functionality in a display window;

means for viewing the desired keyboard functionality in a display window;

means for utilizing the standard key stroke sensitive keyboard input method and/or;

means for utilizing the touch screen sensitive pen or stylus based input method;

means for contemporaneous communication in the same or different languages utilizing a stroke sensitive keyboard, a touch screen keyboard and one or more display areas;

means for processing the different menus and data using the computational and communication capabilities of the intelligent keyboard by itself or in conjunction with a central, local and or network server.

16. A mobile device communication system comprising

one or more mobile devices including intelligent keyboard systems that are touch screen, voice and audio enabled;

a central server, a local server and a network server;

means for enabling the central server as a secure and trusted escrow server,

means for maintaining the control of the central server with an independent and mutually trusted third party;

means for wired or wireless communication;

means for collaborating between the mobile devices including intelligent keyboards and the central server or a local server or a network server;

means for collaborating between and among a plurality of mobile devices including intelligent keyboards.

17. An intelligent keyboard system of claim 16 further comprising means for collaborating in one or more languages in a real time basis between a plurality of mobile devices including intelligent keyboard systems;

means for enabling the mobile devices with intelligent keyboards and like function devices for authentication, trust and permission levels;

means for maintaining the authentication and permission levels by a central server;

means for initiating the collaboration and or escrow procedures for a specific purpose;

means for initiating and conducting the collaboration and/or escrow process for contemporaneous use or for use by one or more parties at a desired time.

18. An intelligent keyboard system of claim 16 further comprising

means for viewing, sharing, annotating, modifying, editing the text document, graphics, image, video, audio, sound and data and or combinations thereof as a collaborative product;

means for defining and working with different types of collaborative product that is inclusive of text, voice, sound, audio, image, video, graphics and data;

means for accessing and using the collaborative product in a contemporaneous manner and/or at a later time by one or more users;

means for maintaining revision control by the central server or a designated intelligent keyboard user;

means for time stamping the access and actions of one or more parties to the collaborative work product in progress;

means for maintaining electronically valid signatures images and authentication files for each user that is party to the said transaction;

means for providing a signature window on a touch screen of the intelligent keyboard or like function device;

means for providing one or more windows for the signature of witnesses if needed in the intelligent keyboard or like function device;

means for acquiring and maintaining relevant data about the keyboard users and witnesses.

19. An intelligent keyboard system of claim 16 that further comprising

means for negotiating the final version of the collaboration product;

means for reaching agreement on the final version of the collaborative product by the relevant parties to the collaboration;

means for indicating agreement by both parties of their willingness to approve and sign off on the particular collaborative product;

means for approving and signing of the collaborative work product in the touch screen signature windows of catch of the mobile devices including the intelligent keyboard, by all parties simultaneously or at designated times by one or more parties;

means for executing said signatures on a touch sensitive screen by pen based, stylus bases or other methods;

means for comparing said signatures to signature images, signature strokes and hand written signatures on file;

means for authenticating the signatures by hand writing recognition software and other means;

means for notifying all parties to the transaction that the collaborative process has been concluded;

means for executing the entire collaborative process by leveraging the wired or wireless communication means and computing capabilities of each of the intelligent keyboards enabled mobile devices and or the central server.

20. An intelligent keyboard system of claim 16 further comprising means for wired or wireless communication and collaboration between stationary devices, mobile devices, intelligent appliances and one or more local, network servers, and or escrow servers;

means for direct collaboration for gaming, entertainment, and educational applications between one or more mobile and stationary device users;

including

means for collaborating for gaming, entertainment and educational and other applications between one or more users in conjunction with a local or network server.

21. An intelligent keyboard system of claim 16 further comprising

means for acquiring a finger print of one or more users by ink and paper, digitizing or other means for baseline line data archiving;

means for digitizing the finger print data

means for maintaining the finger print data in a database and relevant look up tables;

means for acquiring the selected user'"'"'s finger print in a touch screen window by imaging and or digitizing methods;

means for digitizing the finger print acquired by said touch sensitive and or imaging means;

means for time stamping the finger print acquisition process;

means for authenticating the real time finger print process by a witness or trusted escrow agent;

means for comparing the acquired finger print data with the original finger print data in the database maintained by a escrow server;

means for utilizing the wired or wireless communication and computing capabilities of the intelligent keyboard and or the central server or escrow server for authentication and other functions.

22. The intelligent keyboard system of claim 16 further comprising

means for authentication by voice recognition means, including

means for contemporaneous authentication by signature means in a touch screen window, by finger print means in a touch screen window and by voice recognition means;

means wherein the voice liles associated with the specific user are maintained by the central server or escrow server for authentication purposes,

means for authentication by one or more of said selected authentication methods.

23. The intelligent keyboard system of claim 16 further comprising

means for contemporaneous authentication by signature means in a touch screen window,

means for authentication by finger print methods in a touch screen window,

means for authentication by voice recognition methods;

means for maintaining the photographic images of users and objects in a database and look up tables resident on the intelligent keyboard and or the central server;

means for real time photographic image acquisitions;

means for comparing and authenticating real time photographic images in conjunction with the databases resident on the intelligent keyboard and or the trusted central escrow server;

means for authentication by one or more of said selected authentication methods.

24. The intelligent keyboard system of claim 16 further comprising

means for acquiring a retinal scan of a user;

means wherein the retinal scan images files associated with the specific user are maintained in a database and look up tables by the central server for authentication purposes;

including

means for associating voice, finger print, photo and retinal scan data of a user;

means for transmitting and receiving by wired or wireless means by the intelligent keyboard of the data;

means for communicating between the intelligent keyboard and the central server;

means for authenticating of the relevant data in conjunction with a trusted central server,

means for authentication by one or more of said selected authentication methods.

25. The intelligent keyboard system of claim 16 further comprising

means for unique mobile device identification by one or more methods inclusive of mobile IP, static IP and dynamic IP address and or other system identification means;

means for time determination via a time determining server,

means for location determination via a global positioning system and server;

means for providing different levels of security, authentication and control via a local, central and or network server;

means for wired and wireless communication between one or more intelligent keyboards and servers;

means for authenticating the identity including the time and location of a mobile device in conjunction with a trusted central and or escrow server.

26. An intelligent keyboard system comprising

one or more intelligent keyboard devices;

one or more mobile devices,

one or more intelligent appliances;

a central, local or network server;

means for unique identification and addressing of the intelligent devices;

means for configuring an intelligent keyboard as a wired or wireless remote controller;

means for real time selection and installation on the controller, one or more discrete and specific action control icons resident on a database within the intelligent keyboard and or a local or network server;

means for displaying the discrete and macro function action icons on a touch screen input and display;

means for actuating the icons by touch screen input methods that include pen based, stylus based and other touch sensitive methods;

means for maintaining one or more customized icons, macros and touch screen enabled utilities on the intelligent keyboard, a central server or the intelligent appliance;

means for installing said standard or customized icons, macros and utilities on the intelligent appliance and the intelligent keyboard and like function devices;

means for controlling the intelligent appliance via the intelligent keyboard acting in a standalone manner or in conjunction with a central server, a local server or a network server;

means for enhanced processing and communication between the servers, the intelligent appliances and the intelligent keyboard device to execute specific command, control and computational related tasks.