Display inserts, overlays, and graphical user interfaces for multimedia systems

• US 8,397,264 B2
• Filed: 09/07/2007
• Issued: 03/12/2013
• Est. Priority Date: 12/29/2006
• Status: Active Grant

• Current Assignee: Tyson King
• Original Assignee: Prodea Systems, Inc.
• Inventors: Ansari, Amir, Cowgill, George A., Nicholls, Leon E., Raissyan, Atousa, Ramayya, Jude P., Masina, Ramprakash, McQuarters, Alvin R.
• Primary Examiner(s): Goodarzi, Nasser
• Assistant Examiner(s): PENG, HSIUNGFEI
• Application Number:
  US12/521,760
• Publication Number:
  US 20100231790A1
• Time in Patent Office: 2,013 Days
• Field of Search: None
• US Class Current: 725/74
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 19/042 using digital processors G05B19/05 takes precedence
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2807 Exchanging configuration information on appliance services in a home automation network arrangements for maintenance or administration involving network analysis for automatically determining the actual topology of a network H04L41/12; hardware or software tools for network management using graphical user interfaces H04L41/22; address allocation H04L61/50
• CPC Class Codes: H04L 12/2812 describing content present in a home automation network, e.g. audio video content retrieval from the Internet G06F16/95
• CPC Class Codes: H04L 12/2814 Exchanging control software or macros for controlling appliance services in a home automation network arrangements for maintenance or administration involving configuration of the network and network elements H04L41/08
• CPC Class Codes: H04L 12/2816 Controlling appliance services of a home automation network by calling their functionalities arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 47/80 : Actions related to the user profile or the type of traffic
• CPC Class Codes: H04L 47/83 : based on usage prediction
• CPC Class Codes: H04L 49/25 : Routing or path finding in a switch fabric
• CPC Class Codes: H04L 61/4552 : Lookup mechanisms between a plurality of directories; Synchronisation of directories, e.g. metadirectories
• CPC Class Codes: H04L 63/02 : for separating internal from external traffic, e.g. firewalls
• CPC Class Codes: H04L 63/08 : for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/0876 : based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
• CPC Class Codes: H04L 63/10 : for controlling access to devices or network resources
• CPC Class Codes: H04L 63/20 : for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04L 65/102 : Gateways arrangements for connecting between networks having differing types of switching systems, e.g. gateways, H04L12/66
• CPC Class Codes: H04L 65/1101 : Session protocols
• CPC Class Codes: H04L 65/1108 : Web based protocols, e.g. webRTC
• CPC Class Codes: H04L 67/01 : Protocols
• CPC Class Codes: H04L 67/104 : Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/125 : involving control of end-device applications over a network
• CPC Class Codes: H04L 67/141 : Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04L 67/51 : Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/53 : using third party service providers
• CPC Class Codes: H04L 69/325 : in the network layer [OSI layer 3], e.g. X.25 H04L69/16 takes precedence
• CPC Class Codes: H04N 21/00 : Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/40 : Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04W 12/00 : Security arrangements; Authentication; Protecting privacy or anonymity
• CPC Class Codes: H04W 12/033 : of the user plane, e.g. user's traffic
• CPC Class Codes: H04W 12/0431 : Key distribution or pre-distribution; Key agreement
• CPC Class Codes: H04W 12/06 : Authentication
• CPC Class Codes: H04W 12/065 : Continuous authentication
• CPC Class Codes: H04W 12/08 : Access security
• CPC Class Codes: H04W 12/35 : Protecting application or service provisioning, e.g. securing SIM application provisioning
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: Y10S 370/911 : Bridge, e.g. brouter, bus extender

Abstract

A disclosed digital media device at user premises receives a media signal from a media source for presentation via a television display. The exemplary device also supports bi-directional communications with an application service provider device via user premises data communications network. The provider device, which is independent from the media source, offers an application service from a wide area network via the digital media device and user premises network. The digital media device may form a composite signal from the media signal and application service information, for example, for a composite audio and or video signal for television type presentation to the user. The digital media device may receive a selection signal based on the presentation, for transmission to the application service provider device or to the media source. The media device also offers a GUI presenting a moveable arrangement of icons for selectively accessing application services.

Claims

1. A digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device, comprising:

a first interface configured to receive a media signal from a media source for presentation via the television display;

a second interface configured to enable bi-directional communications between the digital media device and a gateway device via a data communications link in the user premises, wherein the gateway device, which is independent from the media source, is configured to provide an application service and application service information from a service provider over a wide area network to the second interlace of the digital media device via the user premises data communications network, wherein the application service information includes notifications of status regarding applications services managed by the gateway device; and

a processor coupled to the first interface and the second interface, wherein the processor is configured to form a composite signal from the media signal and application service information from the gateway device, wherein the composite signal comprises a composite image on the television display representing media obtained via the first interface and application services provided via the gateway device through the second interface, and wherein the processor enables dynamic addition or removal of graphical icons in cooperation with the gateway device and the service provider as determined by subscriptions to at least one of media applications, services applications and media sources connected to the digital media device;

wherein the digital media device provides graphical interaction simultaneously with media and service distribution systems via a dynamic graphical user interface displayed on the television display and input received in the form of a selection signal from a remote control based on the displayed image, wherein graphical interaction via the dynamic graphical user interlace includes access to an arrangement of graphical icons displayed on the television display and represent identification of media applications, service applications and media that is selectable to generate the selection signal when highlighted, and wherein the selection signal is transmitted via the user premises data communications network to the gateway device or to the media source to enable the execution of programming embodied on the digital media device to provide at least one of;

a service application provided from the gateway device through the second interface via a user premises data communication network and media from a media source connected to the digital media device via the first interface.

2. The digital media device of claim 1, wherein the data communications link in the user premises comprises a user premises data communications network.

3. The digital media device of claim 1, wherein the first interface is configured to receive the media signal from one or more media sources.

4. The digital media device of claim 1, wherein the first interface is configured to receive the media signal from one or more analog video sources or one or more digital video sources.

5. The digital media device of claim 1, wherein the first interface is configured to receive the media signal from a cable television signal source, a satellite television signal source, a television broadcast signal source, an audio signal source, a video playback device, or a game console, or any combination thereof.

6. The digital media device of claim 1, wherein the media signal of the composite signal forms a primary image, and the application service information of the composite signal forms a secondary image, wherein the television display is configured to display the secondary image overlaid on or inserted into the primary image to form the composite image.

7. The digital media device of claim 1, wherein the application service information of the composite signal forms a primary image, and the at least one media signal forms a secondary image, wherein the television display is configured to display the secondary image overlaid on or inserted into the primary image to form the composite image.

8. The digital media device of claim 1, wherein the composite signal further comprises an audio signal from the application service information or the media signal, wherein the audio signal provides audio substantially contemporaneously with the composite image on the television display.

9. The digital media device of claim 8, wherein the processor is configured to form the audio signal as a composite of audio of the media signal and audio information of the application service information from the gateway device.

10. The digital media device of claim 1, further comprising a digital storage device coupled via a data communications link with the processor, wherein the digital storage device is configured to record the media signal received by the first interface, or record the application service received by the second interlace, or record the media signal received by the first interface and the application service received by the second interface.

11. The digital media device of claim 10, wherein the digital media device receives a selection signal, wherein the digital media device records the media signal, the application service, or the media signal and the application service upon receipt of the selection signal.

12. The digital media device of claim 11, wherein the selection signal is a pause media signal or a record signal.

13. The digital media device of claim 1, wherein the processor is configured to synchronize the media signal and the application service information to form the composite signal.

14. The digital media device of claim 1, wherein the processor is configured to filter at least a portion of the media signal, or the application service information, or the media signal and the application service information to form the composite signal.

48. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 1, wherein:

the gateway device is further configured to provide and manage services of one or more endpoint devices including at least one of home automation and security equipment associated with the gateway device;

the second source is further configured to receive status information from endpoint devices connected to and managed by the gateway device for display by the digital media device on the television display and to provide riser selection signals from the digital media device to control tile endpoint devices via the gateway device; and

the processor is further configured to enable graphical interaction including tile arrangement of at least one set of graphical icons displayed on the television display also representing at least one endpoint device managed by the gateway device together with the least one of a media application, a service application, and media that is selectable by a user to generate the selection signal when highlighted via the remote control.

49. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 1, wherein the endpoint device is a security system including video cameras and the gateway device is further configured to provide video from the security system for viewing via the digital media system on the television display.

50. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 49, wherein the endpoint device is a security system including video cameras and the gateway device is further configured to provide video from the security system for viewing via the digital media system on the television display.

15. A media and service distribution system for a user premises having a media source to supply a media signal and a user premises data communications network, comprising:

(a) a gateway device for operation at the user premises, independent of the media source, configured to receive an application service from an application service provider via a wide area network and further configured to provide and manage services to one or more endpoint devices associated with the gateway device; and

(b) a digital media device for operation at the user premises in association with the gateway device, communicatively coupled to a television display and programmed to provide a composite image including graphical interaction enabling user access to media, application services and application service information via a dynamic graphical user interface, comprising;

a first interface configured to receive the media signal from the media source for presentation via the television display;

a second interface configured to enable bi-directional communications between the digital media device and the gateway device coupled to the user premises data communications network, wherein the gateway device is configured to provide the application service and application service information obtained from the wide area network to the second interface of the digital media device via the user premises data communications network, wherein the application service information includes notifications of status regarding applications services managed by the gateway device; and

a processor coupled to the first interface and the second interface, wherein the processor is configured to

(i) form the composite signal from the media signal and application service information supplied from the gateway device, wherein the composite signal comprises a composite image including the dynamic graphical user interface rendered on the television display, wherein the digital media device provides graphical interaction with media and service distribution systems via the dynamic graphical user interface displayed on the television display and input received in the form of a selection signal from a remote control based on the displayed image, wherein graphical interaction includes an arrangement of at least one set of graphical icons displayed on the television display that represent identification of at least one of a media application, a service application, and media that is selectable to generate the selection signal when highlighted, and wherein the selection signal is transmitted via the user premises data communications network to the gateway device or to the media source to enable the execution of programming embodied on the digital media device to provide at least one of;

a service application from the gateway device through the digital media device via a user premises data communication network and a selected media application from a media source connected to the digital media device, and

(ii) dynamically add or remove graphical icons in cooperation with the gateway device and the service provider as determined by subscriptions to at least one of media applications, services applications and media sources connected to the digital media device.

16. The system of claim 15, wherein the gateway device is communicatively coupled to a service management center via the wide area network, and wherein the service management center is configured to provide the application service to the gateway device via the wide area network responsive to a communication from the service management center.

17. The system of claim 15, wherein the first interface is configured to receive the media signal from one or more media sources.

18. The system claim 15, wherein the first interface is configured to receive the media signal from one or more analog video sources or one or more digital video sources.

19. The system of claim 15, wherein the first interface is configured to receive the media signal from a cable television signal source, a satellite television signal source, a television broadcast signal source, an audio signal source, a video playback device, or a game console, or any combination thereof.

20. The system of claim 15, wherein the media signal of the composite signal forms a primary image, and the application service information of the composite signal forms a secondary image, wherein the television display is configured to display the secondary image overlaid on or inserted into the primary image to form the composite image.

21. The system of claim 15, wherein the application service information of the composite signal forms a primary image, and the at least one media signal forms a secondary image, wherein the television display is configured to display the secondary image overlaid on or inserted into the primary image to form the composite image.

22. The system of claim 15, wherein the composite signal further comprises an audio signal from the application service information or the media signal, wherein the audio signal provides audio substantially contemporaneously with the composite image on the television display.

23. The system of claim 22, wherein the processor is configured to form the audio signal as a composite of audio of the media signal and audio information of the application service information from the gateway device.

24. The system of claim 15, wherein the application service information from the gateway device comprises notifications of status with regard to one or more application services managed by the gateway device.

25. The system of claim 24, wherein the processor is configured to receive the notifications of status from the gateway device and transmit a message related to the selection signal to the gateway device, via the user premises data communications network, using a presence and networking protocol.

26. The system of claim 15, further comprising a digital storage device coupled via a data communications link with the processor, wherein the digital storage device is configured to record the media signal received by the first interface, or record the application service received by the second interface, or record the media signal received by the first interface and the application service received by the second interface.

27. The system of claim 26, wherein the digital media device receives a selection signal, wherein the digital media device records the media signal, the application service, or the media signal and the application service upon receipt of the selection signal.

28. The system of claim 27, wherein the selection signal is a pause media signal or a record signal.

29. The system of claim 27, wherein the gateway device further comprises a digital storage device configured to store at least one of media signals, application services, application service information and media signal recorded by the digital media device and communicated to the gateway device from the digital media device via the wide area network.

30. The system of claim 15, wherein the processor is configured to synchronize the media signal, and at least one of the application service and the application service information to form the composite signal.

31. The system of claim 15, wherein the processor is configured to filter at least a portion of the media signal, or the application service information, or the media signal and the application service information to form the composite signal.

32. The system of claim 15, wherein the gateway device comprises:

a first interface for enabling bi-directional network layer communications within the premises, with one or more of the endpoint devices;

a second interface for enabling bi-directional network layer communications for the one or more endpoint devices via a wide area network, and tier enabling at least some bi-directional communications with a service management center external to the premises via the wide area network;

a processor coupled to the interfaces;

storage coupled to the processor; and

programming in the storage for a plurality of application services, wherein, for each application service, execution of the programming by the processor causes the gateway device to provide functions in relation to a respective service for one or more endpoint devices.

33. The system of claim 32, wherein the programming comprises:

logic for a plurality of application services;

logic for interfaces fir the application services, including at least one television interface for implementation on the television display through the digital media device;

logic for a services framework; and

logic for platform management.

51. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 15, wherein:

the gateway device is further configured to provide and manage services of one or more endpoint devices including at least one of home automation and security equipment associated with the gateway device;

the second source is further configured to receive status information from endpoint devices connected to and managed by the gateway device for display by the digital media device on the television display and to provide user selection signals from the digital media device to control the endpoint devices via the gateway device; and

the processor is further configured to enable graphical interaction including the arrangement of at least one set of graphical icons displayed on the viewer also representing at least one endpoint device managed by the gateway device together with the least one of a media application, a service application, and media that is selectable by a user to generate the selection signal when highlighted via the remote control.

52. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 15, wherein the endpoint device is a security system including video cameras and the gateway device is further configured to provide video from the security system for viewing via the digital media system on the television display.

53. The digital media device communicatively coupled to a television display for operation in association with a gateway device at a user premises to provide a dynamic graphical user interface enabling user access to media from at least one media source and application services from the gateway device of claim 52, wherein the endpoint device is a security system including video cameras and the gateway device is further configured to provide video from the security system for viewing via the digital media system on the television display.

34. A digital media device communicatively coupled to an audio-video system for providing a television type output to a viewer at a user premises and collaborating with a gateway device also located at the user premises to provide a dynamic graphical user interface enabling user access to media, application services and application service information, wherein the application service information includes notifications of status regarding applications services managed by the gateway device, the digital media device comprising:

(a) a first interface configured to receive a media signal containing audio and video information, from a media source, for television type presentation via the audio-video system;

(b) a second interface configured to enable bi-directional communications between the digital media device and the gateway device via a user premises data communications network, wherein;

(i) the second interface is configured to receive information for an application service offered from a wide area network from the gateway device via the user premises data communications network, and

(ii) the second interface is configured to send messages related to the application service via the user premises data communications network to the gateway device;

(c) a third interface configured to at least provide output to the audio-video system; and

(d) a processor coupled to the first, second, and third interfaces, wherein;

(i) the processor is configured to form a composite signal containing audio and video information, responsive to the media signal and the received information for the application service, and to supply the composite signal for output via the third interface to the audio-video system for television type presentation;

(ii) the processor is configured to respond to a user selection signal based on the television type presentation of the composite signal to cause the second interface to send a message related to a selection for the application service, via the second interface and the user premises data communications network, to the gateway device; and

(iii) the processor is configured to dynamically add or remove graphical icons from the dynamic graphical user interface as determined by subscriptions to at least one of media applications, services applications and media;

wherein the composite signal includes a graphical user interface displayed on the television display supporting graphical interaction with both media and service distribution systems on the same screen viewing and wherein the graphical user interface further includes an arrangement of at least one set of graphical icons representing media applications, service applications, and media that is selectable via a remote control to generate a user selection signal when highlighted and selected by the remote control.

35. The digital media device of claim 34, wherein the composite signal supplied for output via the third interface to the audio-video system is for audio type presentation, video type television presentation, or audio and video type presentation.

36. A media and service distribution system for a user premises having access to a media source to supply a media signal and a user premises data communications network, comprising:

(a) a gateway device for operation at the user premises and configured to receive an application service from a remote application service provider via a wide area network and further configured to provide and manage services to one or more endpoint devices including home automation and security equipment associated with the gateway device; and

(b) a digital media device communicatively coupled to an audio-video system for providing a television type output to a video screen at a user premises, the digital media device comprising;

(1) a first interface configured to receive a media signal containing audio and video information, from a media source, for television type presentation via the audio-video system;

(2) a second interface configured to enable bi-directional communications between the digital media device and the gateway device via a user premises data communications network, wherein;

(i) the second interface is configured to receive status information from endpoint devices connected to and managed by the gateway device for display by the digital media device on the video screen and to provide user selection signals from the digital media device to control the endpoint devices via the gateway device,

(ii) the second interface is configured to receive information for an application service offered from a remote service application provider via the wide area network and the gateway device via the user premises data communications network, and

(iii) the second interface is configured to send messages related to the application service via the user premises data communications network to the gateway device;

(c) a third interface configured to at least provide output to the audio-video system the audio-video system; and

(d) a processor coupled to the first, second, and third interfaces, wherein;

(1) the processor is configured to form a composite signal containing audio and video information responsive to the media signal and the receive information for the application service and to supply the composite signal for output as a dynamic graphical user interface enabling graphical interaction to a user observing the video screen via the third interface to the audio-video system for television type presentation and to provide user selectable access to media and application services and application service information via remote control, wherein graphical interaction includes an arrangement of at least one set of graphical icons displayed on the video screen and represent at least one of a media application, a service application, an endpoint device managed by the gateway and media that is selectable to generate the selection signal when highlighted via the remote control,

(2) the processor is configured to respond to a user selection signal generated by remote control based on selection of a graphical icon from the television type presentation of the composite signal on the video screen to cause the second interface to send a message related to a selection for the application service, via the second interface and the user premises data communications network, to the gateway device, and

(3) the processor is configured to dynamically add or remove graphical icons for television type presentation by the digital media device as determined by subscriptions to at least one of media applications, services applications and media.

37. The system of claim 36, wherein the composite signal supplied for output via the third interface to the audio-video system is for audio type presentation, video type television presentation, or audio and video type presentation.

38. The system of claim 36, wherein the application service information from the gateway device comprises notifications of status with regard to one or more application services managed by the gateway device.

39. The system of claim 38, wherein the processor is configured to receive the notifications of status from the gateway device and transmit a message related to the selection signal to the gateway device, via the user premises data communications network, using a presence and networking protocol.

40. The system of claim 36, further comprising a digital storage device coupled via a data communications link with the processor, wherein the digital storage device is configured to record the media signal received by the first interface, or record the application service received by the second interface, or record the media signal received by the first interface and the application service received by the second interface.

41. The system of claim 40, wherein the digital media device receives a selection signal, wherein the digital media device records the media signal, the application service, or the media signal and the application service upon receipt of the selection signal.

42. The system of claim 41, wherein the selection signal is a pause media signal or a record signal.

43. The system of claim 41, wherein the gateway device further comprises a digital storage device configured to store media signals, application services, or media signal and application services recorded by the digital media device and communicated to the gateway device from the digital media device via the wide area network.

44. The system of claim 36, wherein the processor is configured to synchronize the media signal and the application service information to form the composite signal.

45. The system of claim 36, wherein the processor is configured to filter at least a portion of the media signal, or the application service information, or the media signal and the application service information to form the composite signal.

46. The system of claim 36, wherein the gateway device comprises:

a first interface for enabling bi-directional network layer communications within the premises, with one or more of the endpoint devices;

a second interlace for enabling bi-directional network layer communications for the one or more endpoint devices via a wide area network, and for enabling at least some bi-directional communications with a service management center external to the premises via the wide area network;

a processor coupled to the interfaces;

storage coupled to the processor; and

programming in the storage for a plurality of application services, wherein, for each application service, execution of the programming by the processor causes the gateway device to provide functions in relation to a respective service for one or more endpoint devices.

47. The system of claim 46, wherein the programming comprises:

logic for a plurality of application services;

logic for interfaces for the application services, including at least one television interface for implementation on the television display through the digital media device;

logic for a services framework; and

logic for platform management.