ERGONOMIC MAN-MACHINE INTERFACE INCORPORATING ADAPTIVE PATTERN RECOGNITION BASED CONTROL SYSTEM

• US 20120150651A1
• Filed: 10/24/2011
• Published: 06/14/2012
• Est. Priority Date: 12/23/1991
• Status: Active Grant

• Current Assignee: Hoffberg Family Trust 2, Blanding Hovenweep LLC (Intellectual Ventures LLC), STEVEN M. HOFFBERG 2004-1 GRAT
• Original Assignee: Hoffberg Family Trust 2
• Inventors: Hoffberg, Steven Mark, Hoffberg-Borghesani, Linda Irene
• Granted Patent: US 9,239,951 B2
• Time in Patent Office: Days
• US Class Current: 705/14.58
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

An adaptive interface, predicting a desired user function, based on user history, as well as machine internal status and context. An input is predicted, and the predictive mechanism may be is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein an input is matched to a media stream on a conceptual basis, allowing inferential programming of the device. The system analyzes a data stream for correspondence with a data pattern. The data stream is subjected to adaptive pattern recognition to extract features of interest. Applications of the interface and system include a VCR, medical device, vehicle control system, audio device, environmental control system, securities trading terminal, and smart house. The system optionally includes an actuator for effecting the environment of operation, allowing closed-loop feedback operation and automated learning.

Claims

1. A mobile system, comprising:

at least one receiver configured to receive an extraterrestrial radio frequency signal and to process the extraterrestrial radio frequency signal to provide at least location information;

a terrestrial radio frequency transceiver configured to communicate at least digital data;

a memory configured to store at least an itinerary; and

a controller configured to selectively automatically transmit through the terrestrial transceiver based on at least the location information and the itinerary.

2. The mobile system according to claim 1, wherein the controller interfaces with a vehicular system comprising an engine system, a transmission system, a traction control system, a braking system, a suspension system, a collision avoidance system, a climate control system, an audio system, a steering system and a throttle control system.

3. The mobile system according to claim 1, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to optimize the vehicle control system based on a driver preference.

4. The mobile system according to claim 1, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to optimize the vehicle control system based on a driver action pattern.

5. The mobile system according to claim 1, further comprising a system interface configured to interface with a system, wherein the controller is further configured to optimize the system based on a user preference.

6. The mobile system according to claim 1, further comprising a system interface configured to interface with a system, wherein the controller is further configured to optimize the system based on a user action pattern.

7. The mobile system according to claim 1, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to anticipate voluntary user actions based on implicit inputs from a user.

8. The mobile system according to claim 1, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to anticipate a vehicular encounter with predetermined conditions, and to communicate with the vehicle control system to ready at least one vehicular system prior to the actual encounter with the anticipated predetermined conditions.

9. The mobile system according to claim 1, further comprising a user interface having a set of functional features, wherein the controller is configured to determine a probable required functionality, and to present a subset of the functional features through the user interface in dependence on the determined probable required functionality.

10. The mobile system according to claim 1, further comprising a collision avoidance system.

11. The mobile system according to claim 1, further comprising an imaging sensor, configured to provide an image to the controller.

12. The mobile system according to claim 1, further comprising a light detection and ranging sensor, configured to provide optical object detection and ranging information to the controller.

13. The mobile system according to claim 1, further comprising a movement sensing system, configured to provide movement information to the controller.

14. The mobile system according to claim 1, further comprising a heads up display.

15. The mobile system according to claim 1, wherein the controller is configured to provide a graphic user interface for interaction with a user.

16. The mobile system according to claim 1, wherein the extraterrestrial receiver comprises a global positioning system (GPS) receiver.

17. The mobile system according to claim 1, wherein the terrestrial radio frequency transceiver comprises a cellular radio transceiver.

18. The mobile system according to claim 1, wherein the controller is configured to determine a variance from the itinerary, and to communicate through the terrestrial radio frequency transceiver further in dependence on the variance from the itinerary.

19. The mobile system according to claim 1, wherein the controller is configured to communicate through the terrestrial radio frequency transceiver further in dependence on a deviation from the itinerary.

20. The mobile system according to claim 1, wherein the controller is configured to automatically communicate with at least one traveler service selected from the group consisting of a food service, a fuel service, and a lodging service, in dependence on the location and the itinerary.

21. The mobile system according to claim 1, wherein the controller is configured to automatically negotiate with at least one traveler service selected from the group consisting of a food service, a fuel service, and a lodging service, in dependence on the location and the itinerary, and to renegotiate with the at least one traveler service selected from the group consisting of a food service, a fuel service, and a lodging service, in dependence on a deviation from the itinerary.

22. The mobile system according to claim 1, further comprising an interactive user interface controlled by the controller.

23. The mobile system according to claim 1, wherein the controller is configured to present at least one commercial message to a user, in dependence on at least one of the location and the itinerary.

24. The mobile system according to claim 23, wherein the controller is further configured to present the at least one commercial message to the user in dependence on a user demographic.

25. The mobile system according to claim 23, wherein the mobile system is associated with a cost, and wherein the cost is subsidized by the presentation of the at least one commercial message.

26. The mobile system according to claim 25, wherein an extent of the subsidy is dependent an eventual consummation of a transaction.

27. The mobile system according to claim 1, wherein the terrestrial radio frequency transceiver is selectively configured to automatically communicate emergency information to emergency services and/or police in the event of accident or distress.

28. The mobile system according to claim 1, wherein the terrestrial radio frequency transceiver is selectively configured as an antitheft system.

29. The mobile system according to claim 1, wherein the terrestrial radio frequency transceiver is configured to communicate at least vehicular maintenance and diagnostic information to a remote system.

31. The mobile system according to claim 1, wherein the context comprises a location of the mobile system, the mobile system further comprising at least one receiver configured to receive an extraterrestrial radio frequency signal and to process the extraterrestrial radio frequency signal to provide at least location information.

32. The mobile system according to claim 31, further comprising a memory configured to store at least an itinerary, the controller being further configured to selectively automatically transmit through the terrestrial transceiver in dependence on at least the location information and the itinerary.

33. The mobile system according to claim 32, wherein the controller is further configured to determine a variance from the itinerary.

34. The mobile system according to claim 32, wherein the controller is further configured to communicate through the terrestrial radio frequency transceiver in dependence on the variance from the itinerary.

38. The mobile system according to claim 31, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to anticipate a vehicular encounter with predetermined conditions, and to communicate with the vehicle control system to ready at least one vehicular system prior to the actual encounter with the anticipated predetermined conditions.

44. The mobile system according to claim 31, wherein the extraterrestrial receiver comprises a global positioning system (GPS) receiver.

46. The mobile system according to claim 31, wherein the controller is configured to automatically communicate with at least one service provider which provides a service for a user of the mobile system, in dependence on the location.

47. The mobile system according to claim 31, wherein the controller is configured to automatically negotiate with at least one service provider, in dependence on the location.

48. The mobile system according to claim 31, wherein the controller is configured to present at least one unsolicited commercial message to a user, in dependence on the location.

49. The mobile system according to claim 48, wherein the controller is further configured to present the at least one commercial message to the user in dependence on a user demographic.

50. The mobile system according to claim 48, wherein the mobile system is associated with a cost, and wherein the cost is subsidized by the presentation of the at least one commercial message.

51. The mobile system according to claim 50, wherein an extent of the subsidy is dependent an eventual consummation of a transaction.

52. The mobile system according to claim 31, wherein the terrestrial radio frequency transceiver is selectively configured to automatically communicate emergency information.

53. The mobile system according to claim 31, wherein the terrestrial radio frequency transceiver is selectively configured as an antitheft system.

30. A mobile system, comprising:

a terrestrial radio frequency transceiver configured to communicate at least digital data;

a controller configured to selectively and automatically transmit through the terrestrial transceiver; and

a user interface having a plurality of functional features, wherein the controller is further configured to automatically determine a probable required subset of the functional features based on a determined context, and to control the user interface to interact with the user through the user interface selectively employing the subset of the functional features.

35. The mobile system according to claim 30, wherein the controller interfaces with a vehicular system comprising an engine system, a transmission system, a traction control system, a braking system, a suspension system, a collision avoidance system, a climate control system, an audio system, a steering system and a throttle control system.

36. The mobile system according to claim 30, further comprising a system interface configured to interface with a vehicle control system, wherein the controller is further configured to optimize the vehicle control system based on at least one of a driver preference and a driver action pattern.

37. The mobile system according to claim 30, wherein the controller is further configured to optimize the system based on at least one of a user preference and a user action pattern.

39. The mobile system according to claim 30, wherein the controller is configured to interface with a collision avoidance system.

40. The mobile system according to claim 30, further comprising an imaging sensor, configured to provide an image to the controller.

41. The mobile system according to claim 30, further comprising a light detection and ranging sensor, configured to provide optical object detection and ranging information to the controller.

42. The mobile system according to claim 30, further comprising a movement sensing system, configured to provide movement information to the controller.

43. The mobile system according to claim 30, wherein the controller is configured to provide a graphic user interface for interaction with a user.

45. The mobile system according to claim 30, wherein the terrestrial radio frequency transceiver comprises a cellular radio transceiver.

54. The mobile system according to claim 30, further comprising a system interface configured to interface with a vehicle system, wherein the terrestrial radio frequency transceiver is configured to communicate at least vehicular maintenance and diagnostic information from the vehicle system to a remote system.

55. The mobile system according to claim 30, further comprising a context sensor.

56. A mobile system, comprising:

a cellular radio frequency transceiver configured to communicate at least digital data;

at least one sensor configured to be responsive to a dynamic mechanical input, wherein the at least one sensor has a sensor output;

an optical imaging device having an imaging output;

at least one subsystem configured to determine a location of the cellular radio frequency transceiver, wherein the at least one subsystem has a location output; and

a controller configured to control and to communicate through the cellular radio frequency transceiver, to receive the sensor output, to receive the imaging output, to receive the location output, to generate a user interface employing a subset of a set of functional features, and to provide interaction with at least the cellular radio frequency transceiver, the sensor output, the imaging output, and the location output.

57. The mobile system according to claim 56, wherein the controller comprises a plurality of processing cores.

58. The mobile system according to claim 56, further comprising a graphic information coprocessor configured to selectively process graphical information.

59. The mobile system according to claim 56, wherein the at least one sensor comprises a micromachined sensor.

60. The mobile system according to claim 56, wherein the at least one sensor comprises an accelerometer.

61. The mobile system according to claim 56, wherein the at least one sensor comprises an angular movement sensor.

62. The mobile system according to claim 56, wherein the at least one sensor comprises a gyroscopic sensor.

63. The mobile system according to claim 56, wherein the user interface comprises a graphic user interface.

64. The mobile system according to claim 56, wherein the user interface comprises a speech interface.

65. The mobile system according to claim 61, wherein the controller is configured to perform at least a portion of a speech recognition algorithm.

66. The mobile system according to claim 56, wherein the optical imaging device is configured to capture a machine-readable optical code, and the controller is configured to decode the machine-readable optical code.

67. The mobile system according to claim 56, further comprising a battery configured to functionally power the mobile system.