Networked audio/video system

• US 9,191,721 B2
• Filed: 06/15/2010
• Issued: 11/17/2015
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman International Industries Incorporated (Samsung Electronics Co. Ltd.)
• Inventors: Holladay, Adam, Kreifeldt, Richard A., Nelson, Gregory Matthew, George, Spencer Warren
• Primary Examiner(s): ULRICH, NICHOLAS S
• Application Number:
  US12/816,255
• Publication Number:
  US 20100318917A1
• Time in Patent Office: 1,981 Days
• Field of Search: 715/717, 715/734, 715/716, 715/735, 725/78, 709/220
• US Class Current: 1/1
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407

Abstract

A system for configuring an audio/video (AV) system includes a computing device having a processor to enable a user, with a user interface of the computing device, to configure the AV system. The processor may enable the user to draw output zones to create a representation of a geographical layout of a venue in which the AV system is located. The processor may enable the user to place transmitting and receiving AV devices within the output zones that substantially represent physical locations thereof within the venue. The processor may enable the user to logically associate receiving AV device channels of one or more receiving AV devices within an output zone. The processor may also enable the user to select which of a number of source AV signals from transmitting AV devices the user wants to route to the associated output zone. The processor routes the source AV signals from one or more transmitting AV devices over a network to the one or more receiving AV device channels, such that the one or more receiving AV device channels are processed according to the output zone as configured by the user in the user interface.

Claims

1. A method of configuring an audio/video (AV) system, the method executable on a computing device having a processor and memory, the method comprising:

enabling a user, with a user interface of the computing device on which are executed instructions for configuration of the AV system, to configure the AV system by enabling the user to;

draw a plurality of output zones to create a representation of a geographical layout of a venue in which the AV system is located, each output zone being included in a database, the database storing parameters associated with each output zone in relation to that output zone;

place a plurality of transmitting and receiving AV devices within the output zones of the geographical layout that substantially represent physical locations thereof within the venue, where the plurality of receiving AV devices are selected from the group consisting of an audio amplifier, a loudspeaker, a digital signal processing (DSP) device, and an off-ramp AV device;

logically associate one or more receiving AV device channels of one or more receiving AV devices within respective output zones; and

select which of a plurality of source AV signals from transmitting AV devices the user wants to route to the respective associated output zones;

responsive to the user configuring the AV system with the user interface, the computing device automatically, for each of the plurality of output zones configured by the user, assigning relevant parameters for that output zone to the one or more transmitting and receiving AV devices placed in that output zone by the user based on a relationship of the relevant parameters to that output zone as stored in the database, and automatically negotiating settings for the one or more receiving AV devices within that output zone, the settings including latency and at least one of channel count, bit depth, and sample frequency, where automatically negotiating the settings comprises, for each of the plurality of output zones configured by the user, routing the source AV signals from one or more transmitting AV devices over a network to the one or more receiving AV device channels associated with that output zone, such that the one or more receiving AV device channels are processed according to respective output zones as configured by the user;

measuring latencies of signal data paths through the network between the transmitting and receiving AV devices of at least two output zones, including latencies caused by intermediate routing devices within the network;

mapping the signal data paths between the transmitting and receiving AV devices; and

matching a latency of the receiving AV devices and corresponding respective signal data paths that serve the two or more output zones, such that signal data paths for the logically-associated receiving AV device channels for each of the at least two output zones acquires a network latency of a maximum path latency from among all complete signal data paths to the receiving AV devices.

2. The method of claim 1, where the logical association of the one or more receiving AV device channels replicates a physical relationship of at least some of the receiving AV devices with loudspeakers in respective output zones.

3. The method of claim 1, further comprising the computing device:

controlling the one or more transmitting AV devices in response to a grouped association of the one or more receiving AV devices according to output zone, to thereby route the source AV signals to the one or more receiving AV devices.

4. The method of claim 1, where the plurality of transmitting AV devices are selected from the group consisting of a microphone, an audio digital signal processing (DSP) device, and an on-ramp AV device, further comprising the computing device:

enabling the user, through the user interface, to pictorially remove one or more DSP devices from a location in-line with an identified receiving AV device, which dissociates the DSP device from a corresponding output zone;

where, in response to removal of the one or more DSP devices, the computing device dynamically re-routing at least one of the source AV signals to bypass the removed one or more DSP devices before or after receipt by the identified receiving AV device, to remove selected signal processing capabilities from the at least one of the source AV signals.

5. The method of claim 1, where the one or more receiving AV devices of respective output zones comprises one or more loudspeakers, the method further comprising the computing device:

enabling paging a message to the one or more loudspeakers from an AV device other than the one or more transmitting AV devices, where the source AV signal is temporarily disrupted during paging and the paging message is routed to at least a first output zone.

6. The method of claim 5, where the computing device receives a preset for routing the message from the other AV device to a second output zone that includes the first output zone, where the other AV device comprises a public announcement audio source selected from the group consisting of a live announcement and a pre-recorded announcement.

7. The method of claim 1, where the one or more receiving AV device channels comprise audio device channels, the method further comprising the computing device:

enabling the user to combine output zones for simultaneous control by;

enabling the user to select two or more output zones to combine through the user interface;

logically grouping, by the computing device over the network, control of two or more receiving AV devices logically associated with the selected two or more output zones such that they will be controlled as a group; and

enabling the user to control as a group the audio device channels of the receiving AV devices logically associated with the two or more output zones through the user interface of the computing device.

8. The method of claim 7, where for the two or more receiving AV devices, at least one each corresponding to each output zone, the computing device linking AV routing of one or more receiving source AV signal input sources.

9. The method of claim 7, further comprising the computing device:

enabling the user to separate the two or more output zones through the user interface to reverse the simultaneous control of the two or more output zones; and

segregating, by the computing device, the audio device channels of the two or more receiving AV devices such that they will be controlled separately over the network, thereby also segregating the AV routing of one or more receiving source AV signal input sources.

10. The method of claim 7, where the computing device determines which of the two or more output zones is a control master and which is a control slave by determining master and slave relationships among the logically-associated receiving AV devices of the two or more output zones.

11. The method of claim 1, where matching the latencies comprises the computing device:

controlling one or more intermediate network devices of the network to slow down at least one of the signal data paths to one of the at least two output zones.

12. The method of claim 1, where matching a network latency comprises the computing device:

setting an offset delay of a plurality of AV devices such that the latency of a signal data path matches the maximum path latency in any other signal data path.

13. The method of claim 1, further comprising:

enabling a user to place, pictorially within the user interface, a DSP device, where desired, at a location in-line with an identified receiving AV device, to associate the DSP device with the identified receiving AV device in one of the output zones;

where in response to the addition of the DSP device, the computing device dynamically re-routing at least one of the source AV signals through the DSP device before or after receipt by the identified receiving AV device, to add selected digital signal processing capability to the at least one of the source AV signals.

14. The method of claim 13, where the DSP device comprises a freely-configurable DSP device capable of being configured to replicate one or more processing components, where in response to addition of a processing component to the output zone by the user, the method further comprising the computing device:

configuring the DSP device with one or more elements to form the processing component, and re-routing the at least one of the source AV signals through the processing component before being fed to the identified receiving AV device.

15. In a computer system having a processor configured to generate a graphical user interface that receives a pictorial audio/video (AV) configuration screen on a display, a method of providing and selecting from a set of menus on the display, the method comprising:

retrieving a set of menu entries for each menu with the processor, each of the menu entries representing a step in pictorial configuration by a user of an AV system, where the set of menu entries include a venue designer, a hardware device configurator, an output zone associator, and a networked AV router;

displaying the set of menus on the display;

receiving a menu selection signal indicative of a user selection of a menu from the set of menus,

where in response to selection of the venue designer, the processor providing menu entries on the display that are selectable by the user to direct the processor to form a plurality of output zones and to create a representation of a geographical layout of a venue in which the AV system is located;

where in response to selection of the hardware device configurator, the processor providing menu entries on the display that are selectable by the user to direct the processor to place a plurality of transmitting and receiving AV devices within the output zones of the geographical layout that substantially represent physical locations thereof within the venue, where the plurality of receiving AV devices are selected from the group consisting of an audio amplifier, a loud speaker, a DSP device, and an off-ramp AV device;

where in response to selection of the output zone associator, the processor providing menu entries on the display that are selectable by the user to direct the processor to logically associate one or more receiving AV device channels of one or more receiving AV devices within respective output zones, each output zone being included in a database, the database storing parameters associated with each output zone in relation to that output zone;

where in response to selection of the networked AV router, the processor providing menu entries on the display that are selectable by the user to direct the processor to select which of a plurality of source AV signals the user wants to route to the respective associated output zones;

responsive to selection of one or more of the menu entries that are provided on the display in response to selection of the output zone associator, automatically assigning, for each output zone configured by the user, relevant parameters for that output zone to the one or more transmitting and receiving AV devices placed in that output zone by the user based on a relationship of the relevant parameters to that output zone as stored in the database, and automatically negotiating, by the processor and for each of the plurality of output zones configured by the user, settings including latency and at least one of channel count, bit depth, and sample frequency for the one or more receiving AV devices of that output zone by routing, by the processor, the source AV signals from one or more transmitting AV devices in that output zone over a network to the one or more receiving AV device channels associated with that output zone and automatically measuring end-to-end path latencies, such that the one or more receiving AV device channels are processed according to the respective output zones as configured by the user and automatic negotiation of latency is performed based on a configuration of the AV system by the user in the graphical user interface;

measuring, by the processor, latencies of signal data paths through the network between the transmitting and receiving AV devices of at least two output zones, including latencies caused by intermediate routing devices within the network;

mapping, by the processor, the signal data paths between the transmitting and receiving AV devices; and

matching, by the processor, a latency of the receiving AV devices and corresponding respective signal data paths that serve the two or more output zones, such that signal data paths for the logically-associated receiving AV device channels for each of the at least two output zones acquires a network latency of a maximum path latency from among all complete signal data paths to the receiving AV devices.

16. The method of claim 15, further comprising:

storing in data storage of the computer system the one or more receiving AV device channels in relation to the output zone logically associated therewith; and

saving one or more transmitting AV device channels in relation to the associated output zone, the transmitting AV device channels configured to supply the source AV signals.

17. The method of claim 15, where the plurality of transmitting AV devices are selected from the group consisting of a microphone, an audio digital signal processing (DSP) device, and an on-ramp AV device;

where in response to selection of the DSP device configurator, the processor providing menu entries on the display that are selectable by the user to direct the processor to pictorially remove one or more of the DSP devices from a location in-line with the one or more receiving AV devices, which disassociates the one or more DSP devices from a corresponding output zone; and

where, in response to removal of one or more DSP devices, the processor dynamically re-routing at least one of the source AV signals to bypass the removed one or more DSP devices before or after receipt by the receiving AV devices, to remove selected digital signal processing capabilities from the at least one source AV signals.

18. The method of claim 15, where the one or more receiving AV devices of respective output zones comprises one or more loudspeakers, the method further comprising the processor:

enabling paging a message to the one or more loudspeakers from an AV device other than the one or more transmitting AV devices, where the source AV signal is temporarily disrupted during paging and the paging message is routed to at least a first output zone.

19. The method of claim 15, where the one or more receiving AV device channels comprise audio device channels, and the set of menus further comprising an output zone combiner;

where in response to the selection of the output zone combiner, the processor providing menu entries on the display that are selectable by the user to direct the processor to combine output zones for simultaneous control of the audio device channels associated therewith;

where in response to selection of two or more output zones by the user, the processor;

logically grouping the control of two or more receiving AV devices logically associated with the selected two or more output zones such that they will be controlled as a group; and

enabling the user to control as a group the audio device channels of the receiving AV devices logically associated with the two or more output zones through the display.

20. The method of claim 19, where for the two or more receiving AV devices, at least one each corresponding to each output zone, the processor linking the AV routing of one or more receiving source AV signal input sources.

21. The method of claim 19, where in response to selection of two or more combined output zones for segregation of the combined two or more output zones, the processor segregating the audio device channels of the two or more receiving AV devices such that they will be controlled separately over the network, thereby also segregating the AV routing of one or more receiving source AV signal input sources.

22. The method of claim 19, where the processor determining which of the two or more output zones is a control master and which is a control slave by determining master and slave relationships among the logically-associated receiving AV devices of the two or more output zones.

23. The method of claim 15, where matching the latencies comprises the processor:

controlling one or more intermediate network devices of the network to slow down at least one of the signal paths to one of the at least two output zones.

24. The method of claim 15, where matching a network latency comprises the processor:

setting an offset delay of a plurality of AV devices such that the latency of a single data path matches the maximum path latency in any other signal data path.

25. The method of claim 15, where the set of menu entries further includes a digital signal processing (DSP) device configurator, further comprising the processor:

responsive to selection of the DSP device configurator, providing menu entries on the display that are selectable by the user to direct the processor to pictorially add one or more DSP devices to be placed, where desired, in-line with the one or more receiving AV devices, to associate the one or more DSP devices with one of the output zones; and

dynamically re-routing, responsive to the addition of the one or more DSP devices, at least one of the source AV signals through the one or more DSP devices before or after receipt by the one or more receiving AV devices, to add selected digital signal processing capabilities to the at least one of the source AV signals.

26. The method of claim 25, where the one or more DSP devices comprise freely-configurable DSP devices capable of being configured to replicate one or more processing components, where in response to addition of a processing component to the output zone by the user, the method further comprising:

configuring the DSP device with one or more elements to form the processing component, and re-routing the source AV signal through the processing component before being fed to the receiving AV device.

27. A non-transitory computer-readable storage medium comprising a set of instructions for configuring an audio/video (AV) system executable by a computing device having a processor and memory, the computer-readable medium comprising:

instructions to draw a plurality of output zones to create a representation of a geographical layout of a venue in which the AV system is located in response to signals representative of user inputs through a user interface to form the plurality of output zones, a database storing, for each output zone of the plurality of output zones, one or more parameters in relation to that output zone;

instructions to place a plurality of transmitting and receiving AV devices within the output zones of the geographical layout that substantially represent physical locations thereof in the venue in response to signals representative of user inputs through the user interface to insert the plurality of transmitting and receiving AV devices in the output zones, where the transmitting and receiving AV devices include digital signal processing (DSP) devices;

instructions to automatically load the parameters for each output zone according to the database into the one or more transmitting and receiving AV devices within that output zone responsive to placing the one or more transmitting and receiving AV devices within that output zone; and

instructions to generate one or more control interfaces for the output zone based on the loaded parameters, one or more of the control interfaces being pre-determined by real-world operational function associated with the output zone, the control interfaces including interfaces for one or more of array tuning, output zone or room tuning, a wireless system panel, a venue monitor mode for all output zones, and a venue operation interface.

28. The computer-readable storage medium of claim 27, further comprising instructions to direct the processor to route the source AV device signals from one or more transmitting AV devices over a network to the one or more receiving AV device channels associated with the output zone, such that the one or more receiving AV device channels are processed according to the output zone as configured by the user responsive to signals representative of user inputs through the user interface to associate the one or more receiving AV devices channels within respective output zones;

instructions to direct the processor to measure latencies of signal data paths through the network between the transmitting and receiving AV devices of at least two output zones, including latencies caused by intermediate routing devices within the network;

instructions to direct the processor to map the signal data paths between the transmitting and receiving AV devices;

instructions to direct the processor to matching a latency of the receiving AV devices and corresponding respective signal data paths that serve the two or more output zones, such that the signal data paths for the logically-associated receiving AV device channels for each of the at least two output zones acquires a network latency of a maximum path latency from among all complete signal data paths to the receiving AV devices; and

a set of instructions to direct a processor to control the one or more transmitting AV devices in response to the grouped association of the one or more receiving AV devices according to output zone, to thereby route the source AV device signals to the one or more receiving AV devices.

29. The computer-readable storage medium of claim 27, the computer-readable storage medium further comprising:

instructions to add one or more of the DSP devices to be placed in-line with the one or more receiving AV devices of one of the output zones in response to signals representative of user inputs through the user interface to associate the DSP devices with the one or more receiving AV devices of the output zone; and

instructions to dynamically re-route at least one of the source AV device signals through the one or more DSP devices before or after receipt by the one or more receiving AV devices, to add selected digital signal processing capabilities to the at least one of the source AV device signals, in response to the user adding the one or more DSP devices.

30. The computer-readable storage medium of claim 29, where the DSP devices comprise freely-configurable DSP devices capable of being configured to replicate one or more processing components, where in response to the addition of a processing component to the output zone by the user, the computer-readable storage medium further comprising:

instructions to configure a DSP device with the one or more elements to form the processing component; and

instructions to re-route the source AV signal through the processing component before being fed to the receiving AV device.

31. The computer-readable storage medium of claim 27, where the one or more receiving AV devices of respective output zones comprises one or more loudspeakers, the computer-readable storage medium further comprising:

instructions enabling paging a message to the one or more loudspeakers from an AV device other than the one or more transmitting AV devices, where the source AV signal is temporarily disrupted during paging and the paging message is routed to at least a first output zone.

32. The computer-readable storage medium of claim 31, where the processor receives a preset for routing the message from the other AV device to a second output zone that includes the first output zone, where the other AV device comprises a public announcement audio source selected from the group consisting of a live announcement and a pre-recorded announcement.

33. The computer readable storage medium of claim 27, where the one or more receiving AV device channels comprise audio device channels, the computer-readable storage medium further comprising:

instructions to combine output zones for simultaneous control by the user in response to signals representative of user inputs through the user interface to select two or more output zones;

instructions to logically group the control of two or more receiving AV devices logically associated with the selected two or more output zones such that they will be controlled as a group; and

instructions to control as a group the audio device channels of the receiving AV devices logically associated with the two or more output zones through a control interface of the computing device in response to user inputs through the control interface to adjust one or more controllable parameters integrated with the control interface.

34. The computer-readable storage medium of claim 33, where for the two or more receiving AV devices, at least one each corresponding to each output zone, the computing device linking AV routing of one or more receiving source AV signal input sources.

35. The computer-readable storage medium of claim 33, the computer-readable medium further comprising:

instructions to separate the two or more output zones through the user interface to reverse the simultaneous control of the two or more output zones in response to user inputs through the user interface to deselect the two or more output zones; and

instructions to segregate the audio device channels of the two or more receiving AV devices such that they will be controlled separately over the network, thereby also segregating the AV routing of one or more receiving source AV signal input sources.

36. The computer-readable storage medium of claim 27, where matching the latencies comprises:

instructions to direct the processor to control one or more intermediate network devices of the network to slow down at least one of the signal data paths to one of the at least two output zones.

37. The computer-readable storage medium of claim 27, further comprising:

instructions to direct the processor to set an offset delay of a plurality of AV devices such that the latency of a single data path matches the maximum path latency in any other signal data path.

38. The computer-readable storage medium of claim 27, further comprising:

instructions to remove one or more DSP devices from a location in-line with the one or more receiving AV devices of one of the output zones in response to signals representative of user inputs through the user interface to disassociate the one or more DSP devices from the one or more receiving AV devices of the output zone; and

instructions to dynamically re-route at least one of the source AV device signals to bypass the removed one or more DSP devices before or after receipt by at least one of the receiving AV devices, to remove selected digital signal processing capabilities from the at least one of the source AV device signals, in response to removal by the user of the one or more DSP devices from the user interface.