Control system and user interface for network of input devices

• US 7,797,718 B2
• Filed: 05/02/2002
• Issued: 09/14/2010
• Est. Priority Date: 05/03/2001
• Status: Expired due to Fees

• Current Assignee: Mitsubishi Electric US Incorporated (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Digital Electronics America Incorporated (Mitsubishi Electric Corporation)
• Inventors: Houda, Pavel, Palmer, George E., Stecyk, Polly, Pu, Shenta T., Perry, Robert A., Zanfino, Martin, Peterson, Brian, Maxson, Brian D
• Primary Examiner(s): Miller; John W
• Assistant Examiner(s): SMITH, CHENEA
• Application Number:
  US10/138,692
• Publication Number:
  US 20020171763A1
• Time in Patent Office: 3,057 Days
• Field of Search: 725/37, 348/552
• US Class Current: 725/80
• CPC Class Codes: H04L 12/2805 Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 2012/285 Generic home appliances, e.g. refrigerators

Abstract

Apparatus, methods, and systems for centrally and uniformly controlling the operation of a variety of devices, such as communication, consumer electronic, audio-video, analog, digital, 1394, and the like, over a variety of protocols within a network system and, more particularly, a control system and uniform user interface for centrally controlling these devices in a manner that appears seamless and transparent to the user. In a preferred embodiment, a command center or hub of a network system includes a context and connection permutation sensitive control system that enables centralized and seamless integrated control of all types of input devices. The control system preferably includes a versatile icon based graphical user interface that provides a uniform, on-screen centralized control system for the network system. The user interface, which includes a visual recognition system, enables the user to transparently control multiple input devices over a variety of protocols while operating on a single control layer of an input command device. In an alternative embodiment, the control system also enables gated signal pass-through control while avoiding signal jamming.

Claims

1. A television (TV) comprising a display screen, a circuit coupled to the screen,

a command input coupled to the circuit and adapted to receive user input TV specific commands,

a plurality of input and output ports coupled to the circuit, the plurality of ports including enabling the coupling of first and second sets of audio-video (AV) input devices to the circuit,

wherein the plurality of ports include one or more ports enabling communication with the second set of AV input devices over a bidirectional bus and wherein the first set of AV input devices being incapable of communicating over the bidirectional bus, and

a control system operating on the circuit and adapted to translate user input TV specific commands to device specific messages to drive the first set of AV input devices via IR signals and drive the second set of input devices via signals communicated over a bidirectional bus when such devices are coupled to the circuit,

wherein the control system is adapted to generate a graphical user interface (GUI) displayable on the display screen and coupled to a UI module, the GUI including a device selection menu comprising a plurality of icons corresponding to the plurality of internal AV input devices and external AV input devices when such devices are coupled to the television outputs, and

wherein the control system is adapted to direct an audio and/or video signal from a first source device of the plurality of input AV devices to a sink device of the plurality of input AV devices via device specific output messages transmitted from the control system to the plurality of input AV devices while directing a signal from a second source device of the plurality of input AV devices to the television, wherein the first and second source devices and the sink device include one or more analog AV devices selected from the plurality of input AV devices coupled to the circuit.

2. The television of claim 1 wherein the television is a digital television.

3. The television of claim 1 further comprising a down converter adapted to convert digital source signals to analog signals.

4. The television of claim 1 further comprising a plurality of internal audio/video (AV) devices coupled to the circuit.

5. The television of claim 4 wherein the plurality of internal AV devices includes a source signal tuner.

6. The television of claim 1 wherein the user interface (UI) module is adapted to translate user input TV specific commands.

7. The television of claim 6 wherein the control system further comprises first and second control modules coupled to the UI module, the control modules adapted to convert translated user input TV specific commands into device specific output messages to drive the first and second set of AV input devices.

8. The television of claim 7 wherein the control system further comprises a television control module coupled to the UI module, the television control module adapted to convert translated user input TV specific commands into device specific messages to drive internal television AV input devices.

9. The television of claim 7 further comprising a driver module coupled to the second control module, the driver module adapted to communicate device appropriate output messages to the second set of AV input devices through one or more ports of the plurality of input and output ports.

10. The television of claim 9 further comprising

an IR emitter controller coupled to the first control module, and

an IR emitter coupled to the emitter controller.

11. The television of claim 1 wherein the device selection menu comprises a device selection window, a video sink window, and an audio sink window.

12. The television of claim 11 wherein the device selection menu further comprises a connection sink window.

13. The television of claim 1 wherein the GUI further comprises a visual recognition system.

14. The television of claim 13 wherein the visual recognition system comprises three states of visual recognition.

15. The television of claim 14 wherein the three states of visual recognition comprise a disabled state, a current device state, and a selected icon state.

16. The television of claim 13 wherein the visual recognition system comprises five states of visual recognition.

17. The television of claim 16 wherein the five states of visual recognition system comprise a disable state, a selected icon/current device state, a selected icon/not current device state, a not selected icon/not current device state, and a not selected icon/current device state.

18. The television of claim 7 wherein the UI module comprises

a first module adapted to determine a current system state and whether an input command comprises a menu related action or a direct device action,

a second module coupled to the first module, the second module adapted to determine whether a menu related action is a menu display action, a menu navigate action or a menu device action, and

a third module coupled to the first and second modules, the third module adapted to determine what device connections to make and instructing the IR and 1394 control modules as to what device actions to take.

19. The television of claim 1 further comprising a user command input device operably coupled to the command input.

20. The television of claim 19 wherein the user command input device is a remote control.

21. The television of claim 20 wherein the remote control emits IR signals.

22. The television of claim 21 wherein the command input includes an IR signal detector coupled to the circuit.

23. The television of claim 22 further comprising a television control circuit coupled to the IR signal detector and the circuit.

24. The television of claim 22 further comprising an amplifier coupled to the IR signal detector.

25. The television of claim 20 wherein the remote control emits RF signals.

26. The television of claim 1 wherein the command input is a USB port.

27. The television of claim 1 wherein the command input comprises a voice recognition system.

28. The television of claim 1 wherein the command input comprises an Internet connection.

29. A controller for a network system comprising a mix of analog and digital audio-video (AV) input devices, comprising

an input command receiver,

a plurality of input and output ports, and

a control module coupled to the input command receiver and the plurality of input and output ports and adapted to translate user input controller specific commands to device specific output messages to drive analog and digital AV input devices and transmit the device specific output messages to analog AV input devices via IR signals and to the digital AV input devices over a bidirectional bus when such devices are coupled to the plurality of input and output ports, wherein the analog AV devices are incapable of communicating over the bidirectional bus,

wherein the control module is adapted to generate a graphical user interface (GUI) displayable on a screen coupled to the controller, the GUI including a device selection menu comprising a plurality of icons corresponding to analog AV input devices and digital AV input devices when coupled to the controller, and

wherein the control module is adapted to direct an audio and/or video signal from a first source device of the plurality of input AV devices to a sink device of the plurality of input AV devices via device specific output messages transmitted from the control module to the plurality of input AV devices while directing a signal from a second source device of the plurality of input AV devices to the screen coupled to the controller, wherein the first and second source devices and the sink device include one or more analog AV devices selected from the plurality of input AV devices coupled to the controller.

30. The controller of claim 29 further comprising a primary display unit coupled to the control module.

31. The controller of claim 30 wherein the primary display unit comprises a television.

32. The controller of claim 29 further comprising a down converter adapted to convert digital source signals to analog signals.

33. The controller of claim 31 wherein the television is a digital television.

34. The controller of claim 30 wherein the primary display unit comprises a slave monitor.

35. The controller of claim 29, wherein the user interface (UI) module is adapted to translate user input TV specific commands.

36. The controller of claim 35 wherein the control module further comprises a plurality of input device controllers coupled to the UI module and adapted to convert translated user input commands into device specific output messages to drive analog and digital AV input devices and transmit the device specific output messages to analog and digital AV input devices when coupled to the plurality of input and output ports.

37. The controller of claim 36 wherein the plurality of input device controllers include a television controller coupled to the UI module and adapted to convert translated user input controller specific commands into device specific messages to drive internal audio/video (AV) television devices.

38. The controller of claim 36 further comprising a digital driver module coupled to one of the plurality of input device controllers and adapted to communicate device specific output messages to external digital devices.

39. The controller of claim 38 further comprising

an IR emitter controller coupled to one of the plurality of input device controllers, and

an IR emitter coupled to the IR emitter controller.

40. The controller of claim 29 wherein the device selection menu comprises a device selection window, a video sink window, and an audio sink window.

41. The controller of claim 40 wherein the device selection menu further comprises a connection sink window.

42. The controller of claim 29 wherein the GUI further comprises a visual recognition system.

43. The controller of claim 41 wherein the visual recognition system comprises a plurality of visual recognition states.

44. The controller of claim 42 wherein the plurality of visual recognition states comprise a disabled state, a current device state, and a selected icon state.

45. The controller of claim 43 wherein the plurality of visual recognition states comprise a disable state, a selected icon/current device state, a selected icon/not current device state, a not selected icon/not current device state, and a not selected icon/current device state.

46. The controller of claim 36 wherein the UI module comprises

a first module adapted to determiner a current system state and whether an input command comprises a menu related action or a direct device action,

a second module coupled to the first module, the second module adapted to determiner whether a menu related action is a menu display action, a menu navigate action or a menu device action, and

a third module coupled to the first and second modules, the third module adapted to determiner what device connections to make and instruct the plurality of input device controllers as to what device actions to take.

47. The controller of claim 29 further comprising a user command input device operably coupled to the input receiver.

48. The controller of claim 47 wherein the input device is a remote control.

49. The controller of claim 48 wherein the remote control emits IR signals.

50. The controller of claim 49 wherein the input receiver comprises an IR signal detector coupled to the control module.

51. The controller of claim 29 further comprising a decoder coupled to the input command receiver and the control module.

52. The controller of claim 50 further comprising an amplifier coupled to the IR signal detector.

53. The controller of claim 48 wherein the remote control emits RF signals.

54. The controller of claim 29 wherein the input receiver includes a USB port.

55. The controller of claim 29 wherein the input receiver includes a voice recognition system.

56. The controller of claim 29 wherein the input receiver includes an Internet connection.

57. An audio-video (AV) system comprising

a display screen,

a circuit coupled to the screen,

an command input coupled to the circuit and adapted to receive user input commands,

a plurality of input and output ports coupled to the circuit, and

a context sensitive control system adapted to operate on the circuit, the control system having a uniform user interface corresponding to the operation of analog and digital AV input devices and adapted to translate user input commands to device specific messages to drive the analog AV device via IR signals and the digital AV input devices via signals over a bidirectional bus when such devices are coupled to the plurality of input and output ports, wherein the analog AV input devices being incapable of communicating over the bidirectional bus,

wherein the user interface comprises a graphical user interface (GUI) displayable on the display screen and coupled to a user interface (UI) module, the GUI including a device selection menu comprising a plurality of icons corresponding to the plurality of AV input devices to be controlled, and

wherein the control system is adapted to direct an audio and/or video signal from a first source device of the plurality of input AV devices to a sink device of the plurality of input AV devices via device specific output messages transmitted from the control system to the plurality of input AV devices while directing a signal from a second source device of the plurality of input AV devices to the display screen, wherein the first and second source devices and the sink device include one or more analog AV devices selected from the plurality of input AV devices coupled to the system.

58. The AV system of claim 57 wherein the AV system is a digital television.

59. The AV system of claim 57 further comprising a down converter adapted to convert digital source signals to analog signals.

60. The AV system of claim 57 further comprising a plurality of internal audio/video (AV) devices coupled to the circuit.

61. The AV system of claim 60 wherein the plurality of internal AV devices comprises a source signal tuner.

62. The AV system of claim 57 wherein the user interface (UI) module is adapted to translate user input commands.

63. The AV system of claim 62 wherein the control system further comprises first and second AV input device control modules coupled to the UI module, the first and second control modules converting translated user input commands into device specific output messages to drive analog and digital AV input devices when coupled to the plurality of input and output ports.

64. The AV system of claim 63 wherein the control system further comprises an internal device control module converting translated user input commands into device appropriate messages to drive internal AV devices.

65. The AV system of claim 57 wherein the device selection menu comprises a device selection window, a video sink window, and an audio sink window.

66. The AV system of claim 65 wherein the device selection menu further comprises a connection sink window.

67. The AV system of claim 57 wherein the GUI further comprises a visual recognition system.

68. The AV system of claim 67 wherein the visual recognition system comprises a plurality of visual recognition states.

69. The AV system of claim 68 wherein the plurality of visual recognition states comprise a disabled state, a current device state, and a selected icon state.

70. The AV system of claim 68 wherein the plurality of visual recognition states comprise a disable state, a selected icon/current device state, a selected icon/not current device state, a not selected icon/not current device state, and a not selected icon/current device state.

71. The AV system of claim 63 wherein the UI module comprises

a first module determining a current system state and whether an input command comprises a menu related action or a direct device action,

a second module coupled to the first module, the second module determining whether a menu related action is a menu display action, a menu navigate action or a menu device action, and

a third module coupled to the first and second modules, the third module determining what device connections to make and instructing the first and second peripheral device control modules as to what device actions to take.

72. The AV system of claim 57 further comprising a user command input device operably coupled to the command input.

73. The AV system of claim 72 wherein the input device is a remote control.

74. The AV system of claim 73 wherein the remote control emits IR signals.

75. The AV system of claim 74 wherein the command input includes an IR signal detector coupled to the circuit.

76. The AV system of claim 75 further comprising a decoder coupled to the command input and the circuit.

77. The AV system of claim 73 wherein the remote control emits RF signals.

78. The AV system of claim 57 wherein the input is a USB port.

79. The AV system of claim 57 wherein the input comprises a voice recognition system.

80. The AV system of claim 57 wherein the input comprises an Internet connection.

81. A controller for a network of analog and digital audio-video (AV) input devices communicating with the controller over a variety of protocols, comprising

an input command receiver,

a plurality of input and output ports, and

a control module coupled to the input command receiver and plurality of input and output ports, the control module including a context sensitive control system and an uniform user interface generated by the control module and adapted to control first and second sets of AV input devices when coupled to the controller, the control module translating user input controller specific commands to device specific output messages to drive first set of AV input devices via a first communication protocol and the second set of AV input devices via a second communication protocol when coupled to the controller wherein the first set of AV input devices being incapable of communicating via the second communication protocol,

wherein the user interface comprises a graphical user interface (GUI) generated by the control module and displayable on a screen coupled to the controller, the GUI including a device selection menu comprising a plurality of icons corresponding to the devices to be controlled, and

wherein the control module is adapted to direct an audio and/or video signal from a first source device of the plurality of input AV devices to a sink device of the plurality of input AV devices via device specific output messages transmitted from the control module to the plurality of input AV devices while directing a signal from a second source device of the plurality of input AV devices to the screen coupled to the controller, wherein the first and second source devices and the sink device include one or more analog AV devices selected from the plurality of input AV devices coupled to the controller.

82. The controller of claim 81 further comprising a primary display unit coupled to the control module.

83. The controller of claim 82 wherein the primary display unit comprises a television.

84. The controller of claim 81 further comprising a down converter adapted to convert digital source signals to analog signals.

85. The controller of claim 83 wherein the television is a digital television.

86. The controller of claim 82 wherein the primary display unit comprises a slave monitor.

87. The controller of claim 81 wherein the control module comprises a user interface (UI) module translating user input commands.

88. The controller of claim 87 wherein the control module further comprises a plurality of network device controllers coupled to the UI module and adapted to convert translated user input commands into device appropriate output messages to drive analog and digital network devices.

89. The controller of claim 81 wherein the device selection menu comprises a device selection window, a first sink device window, and a second sink device window.

90. The controller of claim 89 wherein the device selection menu further comprises a connection sink window.

91. The controller of claim 81 wherein the GUI further comprises a visual recognition system.

92. The controller of claim 90 wherein the visual recognition system comprises a plurality of visual recognition states.

93. The controller of claim 92 wherein the plurality of visual recognition states comprise a disabled state, a current device state, and a selected icon state.

94. The controller of claim 92 wherein the plurality of visual recognition states comprise a disable state, a selected icon/current device state, a selected icon/not current device state, a not selected icon/not current device state, and a not selected icon/current device state.

95. The controller of claim 88 wherein the UI module comprises

a first module determining a current system state and whether an input command comprises a menu related action or a direct device action,

a second module coupled to the first module, the second module determining whether a menu related action is a menu display action, a menu navigate action or a menu device action, and

a third module coupled to the first and second modules, the third module determining what device connections to make and instructing network device controllers as to what device actions to take.

96. The controller of claim 81 further comprising a user command input device operably coupled to the input receiver.

97. The controller of claim 96 wherein the input device is a remote control.

98. The controller of claim 97 wherein the remote control emits IR signals.

99. The controller of claim 98 wherein the input receiver comprises an IR signal detector coupled to the control module.

100. The controller of claim 99 further comprising a decoder coupled to the input receiver and the control module.

101. The controller of claim 100 further comprising an amplifier coupled to the IR signal detector.

102. The controller of claim 97 wherein the remote control emits RF signals.

103. The controller of claim 81 wherein the input receiver includes a USB port.

104. The controller of claim 81 wherein the input receiver includes a voice recognition system.

105. The controller of claim 81 wherein the input receiver includes an Internet connection.