ERGONOMIC MAN-MACHINE INTERFACE INCORPORATING ADAPTIVE PATTERN RECOGNITION BASED CONTROL SYSTEM

• US 20070070038A1
• Filed: 11/13/2006
• Published: 03/29/2007
• Est. Priority Date: 12/23/1991
• Status: Active Grant

• Current Assignee: Hoffberg Family Trust 2
• Original Assignee: Linda Hoffberg-Borghesani, Steven Mark Hoffberg
• Inventors: Hoffberg, Steven, Hoffberg-Borghesani, Linda
• Granted Patent: US 8,046,313 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence. Applications of the interface and system include a VCR, medical device, vehicle control system, audio device, environmental control system, securities trading terminal, and smart house. The system optionally includes an actuator for effecting the environment of operation, allowing closed-loop feedback operation and automated learning.

Claims

1. A method of providing a device input, comprising the steps of:

providing an input for receiving user data and feedback;

storing information relating to the received user data and feedback in a memory;

predicting a subsequent user data input based on the stored information relating to received user data and a status of the device;

presenting the predicted subsequent user data input to the user;

accepting feedback from the user relating to the predicted subsequent user data input;

modifying the predicted subsequent user data input based on at least the feedback; and

employing the modified predicted subsequent user data input as the device input.

2. The method according to claim 1, wherein the input comprises a plurality of manually depressible keys.

3. The method according to claim 1, wherein the input comprises a direct manipulation-type user interface pointing device.

4. The method according to claim 1, wherein the input comprises a plurality of keys having corresponding alphanumeric mapping and a pointing device.

5. The method according to claim 1, wherein the device comprises a microphone for receiving user voice input.

6. The method according to claim 1, wherein the device comprises a microphone and a digital camera.

7. The method according to claim 1, wherein the user data comprises voice input.

8. The method according to claim 1, wherein the predicted subsequent user data input is generated based on at least one prior user input.

9. The method according to claim 1, wherein said device input controls a telecommunication function of a telephone.

10. The method according to claim 1, further comprising a flat panel graphic display for presenting the predicted subsequent user data input to the user.

11. The method according to claim 1, further comprising an LCD flat panel graphic display for presenting the predicted subsequent user data input to the user.

12. The method according to claim 1, wherein the predicted subsequent user data input is presented to the user hierarchally.

13. The method according to claim 1, wherein the user input is received through a keypad and a pointing device.

14. The method according to claim 1, wherein the device input controls communications through a communications network interface.

15. The method according to claim 1, wherein the device input controls communications through a telephone communications network interface.

16. The method according to claim 1, wherein the subsequent user data input is based on a predicted probability of selection by the user.

17. The method according to claim 1, further comprising the step of identifying a user, and storing a user identifier in with said stored information.

18. A tangible computer readable storage medium for storing instructions for controlling a programmable processor to perform the method of step 1.

20. The device according to claim 18, wherein the input comprises a plurality of manually depressible keys.

21. The device according to claim 18, wherein the input comprises a direct manipulation-type user interface pointing device.

22. The device according to claim 18, wherein the input comprises a plurality of keys having corresponding alphanumeric mapping and a pointing device.

23. The device to claim 18, wherein the device comprises a microphone for receiving user voice input.

24. The device according to claim 18, wherein the device comprises a microphone and a digital camera.

25. The device according to claim 18, wherein the user data comprises voice input.

26. The device according to claim 18, wherein the predicted subsequent user data input is generated based on at least one prior user input.

27. The device according to claim 18, wherein said device input controls a telecommunication function of a telephone.

28. The device according to claim 18, further comprising a flat panel graphic display for presenting the predicted subsequent user data input to the user.

29. The device according to claim 18, further comprising an LCD flat panel graphic display for presenting the predicted subsequent user data input to the user.

30. The device according to claim 18, wherein the predicted subsequent user data input is presented to the user hierarchally.

31. The device according to claim 18, wherein the user input is received through a keypad and a pointing device.

32. The device according to claim 18, wherein the device input controls communications through a communications network interface.

33. The device according to claim 18, wherein the device input controls communications through a telephone communications network interface.

34. The device according to claim 18, wherein the subsequent user data input is based on a predicted probability of selection by the user.

35. The device according to claim 18, further comprising a memory location for storing a user identifier.

19. A device having a user interface, comprising:

an input for receiving user data and feedback;

a memory for storing information relating to the received user data and feedback in a memory;

a processor for;

predicting a subsequent user data input based on the stored information relating to received user data and a status of the device;

presenting the predicted subsequent user data input to the user;

accepting feedback from the user relating to the predicted subsequent user data input;

modifying the predicted subsequent user data input based on at least the feedback; and

an output, generating a signal responsive to the modified predicted subsequent user data input.

36. A method for receiving a user input, comprising the steps of:

receiving user data;

predicting a desired user input based on at least the received user data a status of a device;

presenting the predicted desired user input to the user;

receiving feedback from the user relating to the predicted desired user input;

modifying the predicted desired user input based on at least the feedback; and

storing the modified predicted desired user input in a memory.