CONTROLLING AN AUDIO AND VISUAL EXPERIENCE BASED ON AN ENVIRONMENT

• US 20110015765A1
• Filed: 07/15/2009
• Published: 01/20/2011
• Est. Priority Date: 07/15/2009
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Haughay, Allen P. JR., Ingrassia, Michael
• Application Number:
  US12/503,741
• Publication Number:
  US 20110015765A1
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Systems and methods for controlling an audio and visual experience based on an environment are provided. A system can monitor an environment while playing back music. The system can then identify a characteristic property of the environment and modify an audio-related or visual-related operation based on the characteristic property. The characteristic property can be any suitable property of the environment or any combination thereof. For example, the characteristic property can be related to an ambient property of the environment (e.g., light or sounds) or the environment'"'"'s occupants (e.g., number of people nearby). The system can then modify its operation in any suitable manner based on the characteristic property. For example, the system can provide a visualization of music based on at least the characteristic property. In another example, the system can select and play back a piece of music based on at least the characteristic property.

Claims

1. A method for controlling an audio and visual display, the method comprising:

playing back music in an environment;

receiving signals representing the environment from a plurality of devices;

identifying a characteristic property of the environment based on the received signals; and

modifying, based on at least the characteristic property, at least one of an audio-related operation and a visual-related operation.

2. The method of claim 1, wherein:

the receiving signals comprises receiving output signals from sensors exposed to the environment; and

two or more of the sensors are provided in different devices.

3. The method of claim 1, wherein:

the receiving signals comprises receiving signals from two or more discoverable devices in the environment; and

the identifying the characteristic property of the environment comprises determining the number of discoverable devices in the environment.

4. The method of claim 1, wherein the characteristic property is related to an ambient property of the environment.

5. The method of claim 1, wherein the characteristic property is related to the environment'"'"'s occupants.

6. The method of claim 1, wherein the characteristic property is related to a physiological metric of one of the environment'"'"'s occupants.

7. The method of claim 1, wherein the characteristic property is related to an amount of movement in the environment.

8. The method of claim 1, wherein the characteristic property is related to a music library stored on one of the plurality of devices.

9. The method of claim 1, wherein identifying a characteristic property of the environment comprises:

removing any portion of the received signals resulting from the playing back of the music in the environment.

10. The method of claim 1, wherein modifying at least one of an audio-related operation and a visual-related operation comprises:

providing an audio and visual experience appropriate for the environment.

11. The method of claim 10, wherein the audio visual experience includes the music played back in the environment.

12. A system for controlling an audio and visual display, the system comprising:

input/output circuitry operative to play back music in an environment;

communications circuitry operative to receive signals representing the environment from a plurality of devices; and

control circuitry coupled with the input/output circuitry and communications circuitry and operative to;

identify a characteristic property of the environment based on the received signals; and

modify, based on at least the characteristic property, at least one of an audio-related operation and a visual-related operation.

13. The system of claim 12, wherein the input/output circuitry comprises a speaker operative to play back music in the environment.

14. The system of claim 12, further comprising:

a sensor coupled with the control circuitry and operative to generate a sensor output, wherein the control circuitry is operative to identify the characteristic property based at least partially on the sensor output.

15. The system of claim 14, wherein the sensor comprises a sensor from the group consisting of:

a camera;

a microphone;

a thermometer;

a hygrometer;

a motion sensing component;

positioning circuitry; and

a physiological sensing component.

16. The system of claim 12, further comprising:

a display coupled with the control circuitry and operative to display a visualization of music, wherein the control circuitry is operative to provide a visualization of the music through the display based on at least the characteristic property.

17. The system of claim 12, further comprising:

storage coupled with the control circuitry and operative to store a music library that includes pieces of music and metadata associated with the pieces of music, wherein the control circuitry is operative to select a piece of music based on the metadata and the characteristic property.

18. A method for providing a visualization of music, the method comprising:

playing back music in an environment;

receiving a signal representing the environment;

identifying a characteristic property of the environment based on the received signal; and

providing a visualization of the music based on at least the characteristic property.

19. The method of claim 18, wherein the providing the visualization comprises:

providing a visualization that includes a plurality of elements, an aspect of one or more of the plurality of elements being based on at least the characteristic property.

20. The method of claim 18, wherein providing the visualization comprises:

providing a visualization that includes one or more colors, the colors being based on at least the characteristic property.

21. A method for selecting a piece of music, the method comprising:

playing back music in an environment;

receiving a signal representing the environment;

identifying a characteristic property of the environment based on the received signal;

selecting a piece of music based on at least the characteristic property; and

playing back the selected piece of music in the environment.

22. The method of claim 21, wherein the selecting the piece of music comprises:

searching a collection of music for pieces of music with metadata appropriate for the characteristic property.

23. The method of claim 21, wherein the selecting the piece of music comprises:

selecting the piece of music based on at least the music played back in the environment.

24. The method of claim 21, wherein:

the receiving the signal comprises receiving a signal that represents a music library of an occupant of the environment; and

the identifying the characteristic property comprises identifying the characteristic property based on the accessed music library.

25. A computer readable medium for an electronic device, the computer readable medium comprising:

a first instruction code for playing back music in an environment;

a second instruction code for receiving signals representing the environment from a plurality of devices;

a third instruction code for identifying a characteristic property of the environment based on the received signals; and

a fourth instruction code for modifying, based on at least the characteristic property, at least one of an audio-related operation and a visual-related operation.