Sensory enhancement systems and methods in personal electronic devices

• US 7,872,574 B2
• Filed: 02/01/2006
• Issued: 01/18/2011
• Est. Priority Date: 02/01/2006
• Status: Active Grant

• Current Assignee: Innovation Specialists LLC
• Original Assignee: Innovation Specialists LLC
• Inventors: Betts, William L., Betts, Carol
• Primary Examiner(s): GOINS, DAVETTA WOODS
• Application Number:
  US11/345,058
• Publication Number:
  US 20090085873A1
• Time in Patent Office: 1,812 Days
• Field of Search: 340/539.26, 340/539.24, 340/539.11, 340/539.16, 340/539.28, 340/540, 340/601, 381/122, 381/150, 704/226, 704/231, 704/233, 704/258
• US Class Current: 340/539.26
• CPC Class Codes: G01N 33/0075 for multiple spatially distributed sensors, e.g. for environmental monitoring transmission systems for measured values G08C
• CPC Class Codes: G06K 7/10366 the interrogation device being adapted for miscellaneous applications
• CPC Class Codes: G08B 13/1427 with transmitter-receiver for distance detection
• CPC Class Codes: G08B 17/00 Fire alarms; Alarms responsive to explosion
• CPC Class Codes: G08B 21/0263 System arrangements wherein the object is to detect the direction in which child or item is located
• CPC Class Codes: G08B 21/0275 Electronic Article Surveillance [EAS] tag technology used for parent or child unit, e.g. same transmission technology, magnetic tag, RF tag, RFID
• CPC Class Codes: G08B 21/0286 Tampering or removal detection of the child unit from child or article
• CPC Class Codes: G08B 21/0415 detecting absence of activity per se
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0446 worn on the body to detect changes of posture, e.g. a fall, inclination, acceleration, gait
• CPC Class Codes: G08B 21/088 by monitoring a device worn by the person, e.g. a bracelet attached to the swimmer
• CPC Class Codes: G08B 21/12 responsive to undesired emission of substances, e.g. pollution alarms
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: G08B 25/016 Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 29/181 due to failing power supply
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
• CPC Class Codes: H04M 1/026 Details of the structure or mounting of specific components
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/10 : including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 : including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04R 2430/20 : Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 3/005 : for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

Disclosed are personal electronic devices (PEDs) having a sensory enhancement (SE) system for monitoring environmental conditions and detecting environmental events, for example but not limited to, changes in acoustic, thermal, optical, electromagnetic, chemical, dynamic, wireless, atmospheric, or biometric conditions. The detection of such events can be used to invoke a notification, an alert, a corrective action, or some other action, depending upon the implementation to the PED user or another party.

Claims

1. A personal electronic device (PED) that can be transported with a user, comprising:

first means for performing a first electronic based intelligence function; and

second means for performing a second electronic based intelligence function, the second means comprising;

a transducer;

means for detecting an event in an environment to which the PED is exposed via the transducer;

wherein the detecting means further comprises;

means for storing a plurality of reference signatures having frequency domain characteristics;

means for preprocessing a sensed signal by converting the sensed signal to a frequency domain signature; and

means for determining when the sensed signal corresponds with one of the reference signatures by correlating the frequency domain signature with the plurality of reference signatures and

means for producing a notification upon detection of the event.

2. The PED of claim 1, further comprising:

means for receiving an analog sensed signal; and

means for translating the analog sensed signal to one of the reference signatures via fast Fourier transform.

3. A personal electronic device (PED) that can be transported with a user, comprising:

first means for performing a first electronic based intelligence function; and

second means for performing a second electronic based intelligence function, the second means comprising;

a transducer;

means for detecting an event in an environment to which the PED is exposed via the transducer; and

means for producing a notification upon detection of the event;

wherein the event is a moving object in motion and wherein the second means further comprises;

means for determining a Doppler shift associated with the moving object; and

means for determining a proximity and speed of the moving object based upon the Doppler shift.

4. A personal electronic device (PED) that can be transported with a user, comprising:

first means for performing a first electronic based intelligence function; and

second means for performing a second electronic based intelligence function, the second means comprising;

at least two transducers;

means for detecting an event in an environment to which the PED is exposed via the transducers; and

means for producing a notification upon detection of the event; and

means for determining a direction associated with the event based upon signals sensed by the at least two transducers.

5. A personal electronic device (PED) that can be transported with a user, comprising:

first means for performing a first electronic based intelligence function; and

second means for performing a second electronic based intelligence function, the second means comprising;

a transducer;

means for detecting an event in an environment to which the PED is exposed via the transducer; and

means for producing a notification upon detection of the event; and

means for defining a range around the PED, inside of which the event may be detected and outside of which the event cannot be detected.

6. A personal electronic device (PED) that can be transported with a user, comprising:

means for storing identification information relating to a plurality of events; and

means for enabling the user to select an event from the stored identification information relating to the plurality of events;

means for storing reference signatures;

means for detecting the event in an environment associated with the PED, the detecting means comprising;

means for sensing a signal in the environment;

means for correlating the signal with one of the reference signatures; and

means for indicting the detecting of the event based upon the correlating; and

means for producing a notification upon the detecting of the event.

7. A personal electronic device (PED) that can be transported with a user, comprising:

means for storing a reference signature;

means for detecting an event in an environment associated with the PED comprising;

means for sensing a signal in the environment;

means for correlating the signal with the reference signature; and

means for indicting the detecting of the event based upon the correlating; and

means for producing a notification upon the detecting of the event;

wherein the PED has a computer based architecture and further comprising;

a keyboard;

a display; and

user interface software that enables the user of the PED to interact with the PED using the keyboard and the display, the user interface software enabling the user to store the reference signature and enabling the user to associate a picture with the reference signature.

8. A personal electronic device (PED) that can be transported with a user, comprising:

means for storing a reference signature;

means for detecting an event in an environment associated with the PED comprising;

means for sensing a signal in the environment;

means for correlating the signal with the reference signature;

means for indicting the detecting of the event based upon the correlating; and

means for producing a notification upon the detecting of the event;

wherein the PED has a computer based architecture and further comprising;

one or more transducers for measuring environmental characteristics;

a keyboard;

a display; and

user interface software that enables the user of the PED to select which of the one or more transducers are to be operational by providing one or more inputs via the keyboard and receiving one or more outputs via the display.

9. A personal electronic device (PED) that can be transported with a user, comprising:

means for storing a reference signature;

means for detecting an event in an environment associated with the PED comprising;

means for sensing a signal in the environment;

means for correlating the signal with the reference signature;

means for indicting the detecting of the event based upon the correlating; and

means for producing a notification upon the detecting of the event;

wherein the PED has a computer based architecture and further comprising;

a keyboard;

a display; and

user interface software that enables the user of the PED to interact with the PED using the keyboard and the display, the user interface software enabling the user to select a mode of operation, including at least the following;

a first mode that causes the PED to receive and store a reference signature from a remote computer, a second mode that causes the PED to receive and store a reference signature from a local environment associated with the PED, and at least one third mode that causes the PED to attempt to detect occurrence of an event that corresponds with a stored reference signature.

10. The PED of claim 9, wherein the PED comprises two third modes, one mode that causes the PED to identify the reference signature based upon a predefined correlation threshold that has been met and another mode that causes the PED to identify a reference signature that has the highest correlation.

11. A personal electronic device (PED) that can be transported with a user, comprising:

means for storing a reference signature;

means for detecting an event in an environment associated with the PED comprising;

means for sensing a signal in the environment;

means for correlating the signal with the reference signature; and

means for indicating the detecting of the event based upon the correlating;

means for producing a notification upon the detecting of the event; and

means for enabling the PED to communicate with another PED and exchange information relating to detection of the event.

12. The PED of claim 11, further comprising a means for permitting the user to input whether or not the PED will communicate and exchange the information.

13. A system for sensory enhancement, comprising:

a plurality of personal electronic devices (PEDs);

means for communicating among the plurality of PEDs a selection of a reference signature corresponding to an event to be detected;

means for permitting one or more of the PEDs to measure a characteristic of an environment with a transducer associated therewith;

means for detecting the event in one or more of the PEDs; and

means for generating a notification signal in the one or more PEDs indicating detection of the event.

14. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

performing a first electronic based intelligence function; and

performing a second electronic based intelligence function, comprising;

detecting an event in an environment to which the PED is exposed via a transducer by;

storing a plurality of reference signatures having frequency domain characteristics;

preprocessing a sensed signal by converting the sensed signal to a frequency domain signature; and

determining when the sensed signal corresponds with one of the reference signatures by correlating the frequency domain signature with the plurality of reference signatures; and

producing a notification upon detection of the event.

15. The method of claim 14, further comprising the steps of:

receiving an analog sensed signal; and

translating the analog sensed signal to one of the reference signatures via fast Fourier transform.

16. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

performing a first electronic based intelligence function; and

performing a second electronic based intelligence function, comprising;

detecting an event in an environment to which the PED is exposed via a transducer by;

storing a plurality of reference signatures having frequency domain characteristics;

preprocessing a sensed signal by converting the sensed signal to a frequency domain signature; and

determining when the sensed signal corresponds with one of the reference signatures by correlating the frequency domain signature with the plurality of reference signatures; and

producing a notification upon detection of the event

wherein the event is a moving object in motion and further comprising the steps of;

determining a Doppler shift associated with the moving object; and

determining a proximity and speed of the moving object based upon the Doppler shift.

17. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

performing a first electronic based intelligence function; and

performing a second electronic based intelligence function, comprising;

detecting an event in an environment to which the PED is exposed via at least two transducers;

producing a notification upon detection of the event; and

determining a direction associated with the event based upon signals sensed by the at least two transducers.

18. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

performing a first electronic based intelligence function; and

performing a second electronic based intelligence function, comprising;

detecting an event in an environment to which the PED is exposed via a transducer;

producing a notification upon detection of the event; and

defining a range around the PED, inside of which the event may be detected and outside of which the event cannot be detected.

19. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

storing identification information relating to a plurality of events;

enabling the user to select an event from the stored identification information relating to the plurality of events;

storing reference signatures;

detecting the event in an environment associated with the PED by;

sensing a signal in the environment;

correlating the signal with a reference signature; and

indicating the detecting of the event based upon the correlating; and

producing a notification upon the detecting of the event.

20. A method for a personal electronic device (PED) that can be transported with a user, the PED having a computer based architecture with a keyboard, a display, and user interface software that enables the user of the PED to interact with the PED using the keyboard and the display, the method comprising the steps of:

storing a reference signature;

detecting an event in an environment associated with the PED by;

sensing a signal in the environment;

correlating the signal with the reference signature; and

indicating the detecting of the event based upon the correlating;

producing a notification upon the detecting of the event;

enabling the user to store the reference signature with the user interface software; and

enabling the user to associate a picture with the reference signature with the user interface software.

21. A method for a personal electronic device (PED) that can be transported with a user, the PED having a computer based architecture with a keyboard, a display, one or more transducers for measuring environmental characteristics, and user interface software that enables the user of the PED to interact with the PED using the keyboard and the display, the method comprising the steps of:

storing a reference signature;

detecting an event in an environment associated with the PED by;

sensing a signal in the environment;

correlating the signal with the reference signature; and

indicating the detecting of the event based upon the correlating;

producing a notification upon the detecting of the event;

enabling the user to store the reference signature with the user interface software; and

enabling the user of the PED to select with the user interface software which of the one or more transducers are to be operational by providing one or more inputs via the keyboard and receiving one or more outputs via the display.

22. A method for a personal electronic device (PED) that can be transported with a user, the PED having a computer based architecture with a keyboard, a display, and user interface software that enables the user of the PED to interact with the PED using the keyboard and the display, the method comprising the steps of:

storing a reference signature;

detecting an event in an environment associated with the PED by;

sensing a signal in the environment;

correlating the signal with the reference signature; and

indicating the detecting of the event based upon the correlating;

producing a notification upon the detecting of the event;

enabling the user to store the reference signature with the user interface software; and

enabling the user to select with the user interface software a mode of operation, including at least the following;

a first mode that causes the PED to receive and store a reference signature from a remote computer, a second mode that causes the PED to receive and store a reference signature from a local environment associated with the PED, and at least one third mode that causes the PED to attempt to detect occurrence of an event that corresponds with a stored reference signature.

23. The method of claim 22, wherein the PED includes two third modes, one mode that causes the PED to identify the reference signature based upon a predefined correlation threshold that has been met and another mode that causes the PED to identify a reference signature that has the highest correlation.

24. A method for a personal electronic device (PED) that can be transported with a user, comprising the steps of:

storing a reference signature;

detecting an event in an environment associated with the PED by;

sensing a signal in the environment;

correlating the signal with the reference signature; and

indicating the detecting of the event based upon the correlating;

producing a notification upon the detecting of the event; and

enabling the PED to communicate with another PED and exchange information relating to detecting of the event.

25. The method of claim 24, further comprising the step of permitting the user to input whether or not the PED will communicate and exchange the information.

26. A method for a sensory enhancement, comprising the steps of:

providing a plurality of personal electronic devices (PEDs);

enabling communication of a selection of a reference signature corresponding to an event to be detected among the plurality of PEDs;

enabling one or more of the PEDs to measure a characteristic of an environment with a transducer associated therewith;

enabling detection of the event in one or more of the PEDs; and

enabling a notification signal to be generated in the one or more PEDs indicating detection of the event.