Human factored interface incorporating adaptive pattern recognition based controller apparatus

• US 5,920,477 A
• Filed: 06/06/1995
• Issued: 07/06/1999
• Est. Priority Date: 12/23/1991
• Status: Expired due to Term

• Current Assignee: Hoffberg Family Trust 2, Blanding Hovenweep LLC (Intellectual Ventures LLC), STEVEN M. HOFFBERG 2004-1 GRAT
• Original Assignee: Linda I. Hoffberg-Borghesani, Steven Mark Hoffberg
• Inventors: Hoffberg, Steven M., Hoffberg-Borghesani, Linda I.
• Primary Examiner(s): Gordon, Paul P.
• Assistant Examiner(s): Brown, Thomas E
• Application Number:
  US08/469,597
• Time in Patent Office: 1,491 Days
• Field of Search: 364/468, 364/468.01, 364/468.02, 382/1, 382/48, 382/56, 382/8, 382/27, 382/30, 382/34, 382/42, 382/181, 382/190, 382/191-193, 382/199, 382/155-159, 358/433, 358/467, 358/84, 358/139, 358/908
• US Class Current: 382/181
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

The need for a more-readily usable interface for programmable devices is widely recognized. The present invention relates to programmable sequencing devices, or, more particularly, the remote controls for consumer electronic devices. The present invention provides an enhanced interface for facilitating human input of a desired control sequence in a programmable device by employing specialized visual feedback. The present invention also relates to a new interface and method of interfacing with a programmable device, which is usable as an interface for a programmable video cassette recorder.

Claims

1. A method of programming a device, comprising the steps of:

providing an input for user commands and feedback;

storing information relating to the user commands and feedback in a memory;

providing a data input for external information;

predicting a subsequent user command based on the stored information relating to user commands and feedback, a status of the device, and external information from the data input;

presenting the predicted user command to the user;

accepting feedback from the user relating to the predicted subsequent user command;

modifying the predicted subsequent user command based on at least the feedback; and

executing the modified predicted user command.

2. The method according to claim 1, further comprising the step of identifying a user and storing an user identifier with said stored information relating to the user commands;

said predicting step predicting a subsequent user command based on the stored information relating to user identifier, commands and feedback, a status of the device, and external information from the data input.

3. An acoustic or image processing system, receiving an acoustic or image data stream, comprising:

a user input;

a memory, storing information relating to acoustic or image data and said user input;

a processor for comparing information of said acoustic or image data stream with said information in said memory, producing an output;

an acoustic or image processor, selectively processing at least a portion of the data stream based on said output.

5. The processing system according to claim 3, wherein said data stream comprises video, and said processor comprises a video recorder.

6. The processing system according to claim 3, wherein said processor for comparing information comprises a semiconductor device selected from the group consisting of an artificial neural network processor, a digital signal processor and an Affine transform processor.

7. The processing system according to claim 3, wherein said memory comprises optical elements.

8. The processing system according to claim 3, wherein said input comprises a graphic user interface.

9. The processing system according to claim 3, wherein said input comprises an adaptive presentation of predicted user actions.

11. The processing system according to claim 3, further comprising

a user biometric input;

said processor comparing information of said acoustic or image data stream with said information in said memory, and said user biometric input.

12. The processing system according to claim 3, further comprising a plurality of user biometric inputs for receiving biometric data relating to a plurality of users.

13. The processing system according to claim 3, wherein said system receives a plurality of acoustic or image data streams, said selective processing comprising selecting one of said data streams.

17. The processing system according to claim 3, wherein said information of said acoustic or image data stream for comparison by said processor is provided with said acoustic or image data stream.

18. The processing system according to claim 17, wherein said information is transmitted in an out-of-band signal.

4. An acoustic or image processing system, receiving an acoustic or image data stream, comprising:

a user input, defining an acoustic or image content related abstract symbolic user preference;

a memory, storing information relating to acoustic or image data and said user input;

a processor for comparing information of said acoustic or image data stream with said information in said memory, said processor classifying said acoustic or image information stream and comparing said classification with said information in said memory, producing an output based on said comparison;

an acoustic or image processor, selectively processing at least a portion of the data stream based on said output,

one of said processor for comparing information and said acoustic or image processor for selectively processing being responsive to said acoustic or image content related abstract symbolic user preference.

10. The processing system according to claim 4, further comprising means for adaptively formulating at least one predicted user action for presentation to the user, based on information stored in said memory.

14. The system according to claim 4, wherein said processor for comparing information is responsive to said acoustic or image content related abstract symbolic user preference.

15. The system according to claim 4, wherein said acoustic or image processor for selectively processing is responsive to said acoustic or image content related abstract symbolic user preference.

16. The system according to claim 4, wherein said user input comprises an identification selected from one or more of the group consisting of a performer, a group of performers, and an entertainment show.

19. The processing system according to claim 4, further comprising:

a user input processing system for determining a viewer preference based on said user input;

a program material processing system for characterizing the program material based on its content;

said processor for comparing comprising a correlator for correlating said characterized content of the program material with said determined viewer preference to produce a correlation index; and

said acoustic or image processor selectively processing said portion of the data stream based on said correlation index.

20. The system according to claim 19, wherein said program material is encrypted, further comprising:

a decryption system for decrypting the program material if it is selected to produce unencrypted program material and optionally an associated decryption event;

a memory for storing data relating to the occurrence of said decryption event; and

a central database for storing data relating to the occurrence of said decryption event in association with data relating to the viewer.

21. The system according to claim 19, wherein:

said user input processing system monitors a pattern of user activity and predicts a viewer preference;

said program material processing system comprises;

a processor for preprocessing the program material to produce a reduced data flow information signal substantially retaining information relating to said abstract information content of the program material and selectively eliminating data not relating to said abstract information content of the program material and for characterizing said information signal based on said abstract information content; and

a comparing system for determining if said correlation index is indicative of a probable high correlation between said characterization of said information signal and said viewer preference and causing said stored program material to be processed by said processing means based on said determination.

22. The system according to claim 19, wherein said processor comprises an image program material storage and retrieval system.

23. The system according to claim 19, further comprising a memory for storing a characterization of the program material;

an input for receiving a feedback signal from the viewer indicating a degree of agreement with said correlation index determination, wherein said feedback signal and said stored characterization are used by said viewer preference predicting means to predict a new viewer preference.