Control of an electronic apparatus using micro-impulse radar

• US 9,069,067 B2
• Filed: 09/17/2010
• Issued: 06/30/2015
• Est. Priority Date: 09/17/2010
• Status: Active Grant

• Current Assignee: Deep Science LLC (Intellectual Ventures LLC)
• Original Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Inventors: Bangera, Mahalaxmi Gita, Hyde, Roderick A., Ishikawa, Muriel Y., Jung, Edward K. Y., Kare, Jordin T., Leuthardt, Eric C., Myhrvold, Nathan P., Sweeney, Elizabeth A., Tegreene, Clarence T., Tuckerman, David B., Wood, Lowell L. Jr., Wood, Victoria Y. H.
• Primary Examiner(s): Brainard, Timothy A
• Application Number:
  US12/924,036
• Publication Number:
  US 20120068876A1
• Time in Patent Office: 1,747 Days
• Field of Search: 342/175, 705/14.66, 705/14.58, 340/545.3, 340/573.1, 340/573.4, 600/407
• US Class Current: 1/1
• CPC Class Codes: G01S 13/0209 Systems with very large relative bandwidth, i.e. larger than 10 %, e.g. baseband, pulse, carrier-free, ultrawideband
• CPC Class Codes: G01S 13/04 Systems determining presence of a target based on relative movement of target G01S13/56
• CPC Class Codes: G01S 7/415 Identification of targets based on measurements of movement associated with the target
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45

Abstract

A computer or entertainment system is configured to respond to data received from a micro impulse radar configured to detect movement, physiology, posture, presence, and/or absence of a person in one or more regions near the computer or entertainment system.

Claims

1. A computer with micro-impulse radar feedback, comprising:

a display configured to display images to a person located in a first region; and

a micro-impulse radar configured to probe a second region to detect all or a portion of one or more individuals and produce a micro-impulse radar signal;

a processing unit operatively coupled to the micro-impulse radar to receive the micro-impulse radar signal and operatively coupled to the display for controlling the display, the processing unit including processing hardware and an operating system configured to run one or more application programs, the processing unit configured to determine a predicted emotional state of the one or more individuals at least partially from the micro-impulse radar signal; and

wherein at least one of the processing hardware, operating system, or application program is configured to read at least a subset of information associated with the micro-impulse radar signal and to conditionally select content or characteristics of the images displayed on the display responsive to the predicted emotional state, wherein the selected content or characteristics of the images responsive to the predicted emotional state are predicted to produce a target emotional state.

2. The computer with micro-impulse radar feedback of claim 1, wherein the second region is a portion of the first region.

3. The computer with micro-impulse radar feedback of claim 1, wherein the first region and second region are substantially coincident.

4. The computer with micro-impulse radar feedback of claim 1, wherein the first region is a portion of the second region.

5. The computer with micro-impulse radar feedback of claim 1, further comprising:

a signal processor configured to receive signals or data from the micro-impulse radar and to perform signal processing on the signals or data to extract one or more signals corresponding to at least one of human presence, human movement, or human physiological processes.

6. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor is configured as a portion of the processing hardware.

7. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor is embodied as software operable to run on the processing unit.

8. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor includes dedicated hardware and computer executable instructions operable to run on the processing hardware.

9. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor includes Fourier transformation hardware or software.

10. The computer with micro-impulse radar feedback of claim 5, further comprising:

a signal analyzer configured to receive signals or data from the signal processor and to perform signal analysis to determine, from the one or more extracted signals, variable data corresponding to at least one of the human presence, the human movement, or the human physiological processes, the content or characteristics of the images displayed on the display being controlled responsive to the variable data.

11. The computer with micro-impulse radar feedback of claim 10, further comprising:

an interface operatively coupled to the signal analyzer and configured to output micro-impulse radar data including the variable data corresponding to at least one of the human presence, the human movement, or the human physiological processes to the processing unit.

12. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor is integrated into the processing unit.

13. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor is integrated into the micro-impulse radar.

14. The computer with micro-impulse radar feedback of claim 5, wherein the signal processor is configured to output micro-impulse radar data corresponding to the at least one of human presence, human movement, or human physiological processes to one or more memory circuit or storage device locations.

15. The computer with micro-impulse radar feedback of claim 14, wherein the operating system is configured to read at least a subset of the micro-impulse radar data at the one or more memory circuit or storage device locations and responsively adjust one or more operating system parameters.

16. The computer with micro-impulse radar feedback of claim 15, wherein responsive adjustment of one or more operating system parameters includes waking the operating system from a sleep mode responsive to micro-impulse radar data corresponding to human presence in the second region.

17. The computer with micro-impulse radar feedback of claim 15, wherein adjustment of one or more operating system parameters includes selection of terse prompts or fast response responsive to micro-impulse radar data corresponding to human movement or physiological processes characteristic of impatience or urgency.

18. The computer with micro-impulse radar feedback of claim 15, wherein adjustment of one or more operating system parameters includes entering a sleep mode responsive to micro-impulse radar data corresponding to departure of an individual from the second region.

19. The computer with micro-impulse radar feedback of claim 15, wherein adjustment of one or more operating system parameters includes conversion of the micro-impulse radar data into cursor movements.

20. The computer with micro-impulse radar feedback of claim 15, wherein adjustment of one or more operating system parameters includes conversion of the micro-impulse radar data into computer pointer device commands.

21. The computer with micro-impulse radar feedback of claim 14, wherein an application program is configured to read at least a subset of the micro-impulse radar data at the one or more memory circuit or storage device locations and responsively adjust application program parameters.

22. The computer with micro-impulse radar feedback of claim 21, wherein the application program is configured to convert the micro-impulse radar data to program commands.

23. The computer with micro-impulse radar feedback of claim 21, wherein the application program is configured to convert the micro-impulse radar data to one or more preferences selections.

24. The computer with micro-impulse radar feedback of claim 23, wherein the one or more preferences selections includes at least one of automated help, terse response, verbose response, or magnification.

25. The computer with micro-impulse radar feedback of claim 1, wherein the information associated with the micro-impulse radar signal corresponds to a human physiological process.

26. The computer with micro-impulse radar feedback of claim 25, wherein the physiological process includes at least one of heartbeat, perspiration or breathing.

27. The computer with micro-impulse radar feedback of claim 25, wherein the processing unit is configured to correlate the physiological process to the predicted emotional state of an individual.

28. The computer with micro-impulse radar feedback of claim 27, wherein the operating system or application program is configured to conditionally select a program execution path as a function of the predicted emotional state.

29. A method for controlling a computer, comprising:

receiving one or more micro-impulse radar signals from one or more regions;

performing analysis on the one or more micro-impulse radar signals to determine an emotional state of one or more persons in the one or more regions; and

conditionally selecting an operation parameter of the computer predicted to produce a target emotional state of the one or more persons in the one or more regions responsive to the emotional state.

30. The method for controlling a computer of claim 29, wherein performing the analysis on the micro-impulse radar signals includes determining at least one physiological parameter corresponding to the one or more persons.

31. The method for controlling a computer of claim 30, wherein the at least one physiological parameter includes at least one of heart rate, perspiration, or breathing rate.

32. The method for controlling a computer of claim 30, wherein the at least one physiological parameter determines the physiological state of the person.

33. The method for controlling a computer of claim 30, further comprising:

correlating the at least one physiological parameter to the predicted emotional state.

34. The method for controlling a computer of claim 33, wherein correlating the at least one physiological parameter to the predicted emotional state includes:

correlating the physiological parameter to an autonomic nervous system state; and

correlating the autonomic nervous system state to the predicted emotional state.

35. The method for controlling a computer of claim 29, wherein selecting an operation parameter includes conditionally selecting computer program logic.

36. The method for controlling a computer of claim 29, wherein selecting an operation parameter includes waking portions of the computer when the one or more persons enters the one or more regions.

37. The method for controlling a computer of claim 36, wherein the computer is located in one of the regions.

38. The method for controlling a computer of claim 36, further comprising, prior to waking the portions of the computer, performing analysis on a sequence of micro-impulse radar signals to determine a probability that the one or more persons has an intent to use the computer.

39. The method for controlling a computer of claim 38, wherein determining the probability that the one or more persons has an intent to use the computer includes analyzing movements of the one or more persons.

40. The method for controlling a computer of claim 39, wherein the one or more persons is determined to have a high probability of intent to use the computer when the one or more persons enter a computer operating position or approach a chair near the computer.

41. The method for controlling a computer of claim 39, wherein the one or more persons is determined to have a high probability of intent to use the computer when the one or more persons near or reach for a computer keyboard or a computer pointing device or near a computer display.

42. The method for controlling a computer of claim 29, wherein selecting an operation parameter includes putting portions of the computer in a sleep mode when the one or more persons leaves the one or more regions.

43. The method for controlling a computer of claim 29, further comprising:

analyzing movements of the one or more persons; and

wherein selecting an operating parameter includes entering one or more software commands responsive to the movements.

44. The method for controlling a computer of claim 43, wherein the one or more software commands includes commands to operate game software on the computer.

45. The method for controlling a computer of claim 44, wherein the one or more software commands are selected to drive virtual movements of one or more game entities corresponding to the movements of the one or more persons.

46. An entertainment system configured to adapt to personal preferences, comprising:

a media output apparatus configured to present media content according to one or more program options;

a micro-impulse radar configured to probe a region proximate the media output apparatus that includes one or more persons therein and output a micro-impulse radar signal; and

a controller configured to receive the micro-impulse radar signal, determine an emotional state of the one or more persons at least partially based on the micro-impulse radar signal, and select the one or more program options responsive to the determined emotional state corresponding to the one or more persons in the probed region, wherein the one or more program options are predicted to produce a target emotional state in the one or more persons.

47. The entertainment system of claim 46, further comprising:

at least one program source;

wherein selecting one or more program options includes selecting programming from the program source.

48. The entertainment system of claim 46, further comprising:

at least one codec;

wherein selecting one or more program options includes selecting a codec or selecting a codec operating parameter.

49. The entertainment system of claim 46, further comprising:

one or more media output apparatus drivers; and

wherein selecting one or more program options includes selecting a media output apparatus driver or a media output apparatus driver parameter.

50. The entertainment system of claim 49, wherein the one or more media output apparatus drivers include one or more signal amplifiers;

and

wherein selecting a media output apparatus driver parameter includes selecting an amount of amplification.

51. The entertainment system of claim 49, wherein selecting a media output apparatus driver parameter includes selecting between two or more media output apparatuses.

52. The entertainment system of claim 46, wherein selecting one or more program options responsive to presence includes one or more of starting output of media responsive to arrival of one or more persons in the probed region and stopping or suspending output of media responsive to departure of one or more persons from the probed region.

53. The entertainment system of claim 46, wherein selecting one or more program options responsive to movement or a physiological parameter includes selecting one or more program options responsive to detected movement or physiological parameter corresponding to attentiveness to a media output apparatus.

54. The entertainment system of claim 53, wherein selecting one or more program options responsive to detected movement or a physiological parameter corresponding to attentiveness to a media output apparatus includes one or more of increasing audio volume and enabling a video output apparatus.

55. The entertainment system of claim 53, wherein the detected movement corresponding to attentiveness to a media output device includes one or more of the one or more persons approaching a video display, moving to an optimum listening area in an audio sound field, changing orientation relative to a video display, or remaining still in a viewing area of a video display.

56. The entertainment system of claim 53, wherein the movement includes a rhythmic movement of the one or more persons in time with a rhythmic component of a media program.

57. The entertainment system of claim 56, wherein the rhythmic movement includes one or more of dancing, head bobbing, or toe tapping.

58. The entertainment system of claim 53, wherein selecting one or more program options responsive to detected movement or physiological parameter corresponding to attentiveness to a media output apparatus includes selecting additional program content having at least one characteristic similar to program content played during detection of movement corresponding to attentiveness.

59. The entertainment system of claim 46, wherein the micro-impulse radar and the controller are integrated.

60. The entertainment system of claim 46, wherein the media output apparatus includes a portable media player carried by the person.

61. The entertainment system of claim 60, wherein one or more of the micro-impulse radar and the controller are located remotely from the portable media player.

62. The entertainment system of claim 46, wherein the physiological parameter includes a physiological parameter corresponding to a response to the media content.