Mobile device environment detection using an audio sensor and a reference signal

• US 9,736,782 B2
• Filed: 05/11/2015
• Issued: 08/15/2017
• Est. Priority Date: 04/13/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Nilsson, Jan
• Primary Examiner(s): Poon, King
• Assistant Examiner(s): PEREN, VINCENT ROBERT
• Application Number:
  US14/708,376
• Publication Number:
  US 20160302155A1
• Time in Patent Office: 827 Days
• Field of Search: 455567, 455574, 73587, 73599, 73645, 73646, 367 95
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 52/0254 detecting a user operation or a tactile contact or a motion of the device
• CPC Class Codes: H04W 68/005 Transmission of information for alerting of incoming communication
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

A mobile device configured to modify the mobile device'"'"'s behavior based on the local environment of the mobile device. The mobile device determines the local environment based on a comparison of sound detected by the mobile device'"'"'s audio sensor to sound detected by an exterior audio sensor. In particular, the mobile device determines if it is covered and, if covered, the mobile device determines properties of the covering material.

Claims

1. A mobile device configured to determine a local environment of the mobile device, the mobile device comprising:

a device audio sensor configured to detect sound waves; and

a processor configured to;

determine a variation between the detected sound waves and a reference signal;

determine the local environment of the mobile device based on the determined variation;

detect if the local environment of the mobile device is a covered environment or an uncovered environment;

determine that the mobile device is covered if the variation between the sound frequency profile outside the local environment and the device sound frequency profile is greater than a predetermined threshold variation; and

modify a behavior of the mobile device based on the determined local environment; and

a communication interface configured to receive a sound frequency profile outside the local environment, wherein;

the device audio sensor is configured to output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor and the reference signal comprises the sound frequency profile outside the local environment.

2. A mobile device configured to determine a local environment of the mobile device, the mobile device comprising:

a device audio sensor configured to detect sound waves;

a processor configured to;

determine a variation between the detected sound waves and a reference signal;

determine the local environment of the mobile device based on the determined variation;

detect if the local environment of the mobile device is a covered environment or an uncovered environment; and

modify a behavior of the mobile device based on the determined local environment; and

a communication interface configured to receive a sound frequency profile outside the local environment, wherein;

the device audio sensor is configured to output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor and the reference signal comprises the sound frequency profile outside the local environment;

the sound frequency profile outside the local environment represents sound detected by an environment audio sensor separate from and located at a distance from the mobile device and the environment audio sensor is communicatively coupled to the mobile device via the communication interface in order to communicate the sound frequency profile outside the local environment; and

the processor is configured to determine the variation between the sound frequency profile outside the local environment and the device sound frequency profile based on a calculated damping profile representing a level of attenuation across a range of frequencies of the device sound frequency profile compared to the sound frequency profile outside the local environment.

3. A system comprising:

the mobile device of claim 2; and

the environment audio sensor separate from and located at the distance from the mobile device and the environment audio sensor is communicatively coupled to the mobile device via the communication interface in order to communicate the sound frequency profile outside the local environment, wherein the environment audio sensor is an audio sensor located separate from a user of the mobile device.

4. The mobile device of claim 2, wherein when the processor detects the mobile device to be in a covered environment, the processor is further configured to estimate at least one of a type of the material covering the mobile device, the density of the material covering the mobile device, or a thickness of the material covering the mobile device.

5. The mobile device of claim 2, wherein the processor is configured to determine the variation between the sound frequency profile outside the local environment and the device sound frequency profile by integrating over the mathematical difference between the device sound frequency profile and the sound frequency profile outside the local environment.

6. The mobile device of claim 2, wherein the calculated damping profile comprises a ratio of the sound frequency profile outside the local environment and the device sound frequency profile.

7. The mobile device of claim 2, wherein when the processor determines that the mobile device is covered, the processor is configured to compare the calculated damping profile to stored damping profiles for various materials to determine a stored damping profile that the calculated damping profile is most similar to.

8. The mobile device of claim 2, wherein when the processor determines that the mobile device is covered, the processor is configured to compare the calculated damping profile to stored damping profiles for various materials to determine a set of the stored damping profiles that the calculated damping profile is most similar to.

9. The mobile device of claim 8, wherein the processor is configured to determine the set of the stored damping profiles that the calculated damping profile is most similar to by determining the set of the stored damping profiles that minimizes the following equation:

F(DP_d)=abs(DP_a−

Σ

_i=1^NDP_i),

where abs is the absolute value, DPd is the determined set of stored damping profiles including N of the stored damping profiles where N is an integer greater than or equal to one, DPa is the calculated damping profile, and DPi is the ith calculated damping profile in the determined set of stored damping profiles.

10. The mobile device of claim 8, wherein the processor is configured to determine the set of the stored damping profiles that the calculated damping profile is most similar to by determining the set of the stored damping profiles that minimizes the following equation:

F(DP_d,M_i)=abs(DP_a−

Σ

Σ

_i=1^N*DP_i)

where abs is the absolute value, * represents multiplication, DPd is the determined set of stored damping profiles including N of the stored damping profiles where N is an integer greater than or equal to one, M is a set of multiplicative factors applied to the determined set of stored damping profiles, DPa is the calculated damping profile, DPd,i is an ith damping profile in the determined set of stored damping profiles, and Mi is a ith multiplicative factor applied to the ith damping profile.

11. The mobile device of claim 2, wherein modifying the behavior of the mobile device includes at least one of:

changing a ringer volume of the mobile device;

setting a vibrating mode of the mobile device;

setting a behavior of a display of the mobile device;

setting a behavior of displaying notifications to a user of the mobile device;

turning off a display of the mobile device while the mobile device is determined to be covered;

increasing the ringer volume of the mobile device while the mobile device is determined to be in a bag;

turning off vibrate while the mobile device is determined to be in a bag;

or

reducing the ringer volume of the mobile device while the mobile device is determined to be uncovered.

12. A system comprising:

an ultrasonic device configured to output an ultrasonic signal having a known properly;

a mobile device configured to determine a local environment of the mobile device, the mobile device comprising

a device audio sensor configured to;

output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor, and

detect the ultrasonic signal out by the ultrasonic device; and

a processor configured to;

determine a variation between the detected ultrasonic signal and the known property of the ultrasonic signal;

determine the local environment of the mobile device by determining a sound frequency profile outside the local environment, where the sound frequency profile outside the local environment is determined by;

determining a sound attenuation profile based on the determined variation between the detected ultrasonic signal and the known property of the ultrasonic signal; and

applying an inverse of the sound attenuation profile to the device sound frequency profile, wherein the sound attenuation profile represents an attenuation of frequencies of sound represented in the device sound frequency profile; and

modify a behavior of the mobile device based on the determined local environment.

13. The system of claim 12, wherein the amplitude of the ultrasonic signal is the known property of the ultrasonic signal, the processor configured to:

determine the variation by dividing the amplitude of the detected ultrasonic signal by the amplitude of the ultrasonic signal;

determine the sound attenuation profile by multiplying the determined variation by a conversion factor.

14. The system of claim 13, wherein the conversion factor comprises at least one value representing a differential attenuation of the ultrasonic signal compared to attenuation of the frequencies of sound represented in the device sound frequency profile.