Network-extensible reconfigurable media appliance

• US 20080163287A1
• Filed: 08/11/2005
• Published: 07/03/2008
• Est. Priority Date: 05/28/2003
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Dennis Fernandez
• Inventors: Fernandez, Dennis S.
• Granted Patent: US 7,599,963 B2
• Time in Patent Office: Days
• US Class Current: 725/31
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/64784 Data processing by the network data processing in packet switching systems H04L12/56; flow control in packet networks H04L47/10; intermediate storage or scheduling H04L49/90; provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: Y10S 707/913 Multimedia
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

Extensible reconfigurable media appliance for security and entertainment captures images digitally for storage. Digital effects and filters are applied to incoming video stream on-the-fly or to video data stored in memory. Digital effects and filters are dynamically stored, modified, updated or deleted, providing extensible reconfigurable effects studio. Digital media appliance communicates wirelessly with other media appliances, computers, security systems, video storage, email, chat, cellular services or PDAs to provide seamless integration of captured video stream.

Claims

1-61. -61. (canceled)

62. Storage medium for digitally storing non-linear media program comprising one or more branching points in such program for wireless mobile digital television or cellular telephone comprising:

a first media portion partitioned in a kernel space in a storage medium; and

a second media portion partitioned in a user space in the storage medium;

wherein a digital television program is produced electronically via a renderer for audio or video presentation using the first and second portions according to a non-linear script, template or storyboard, such that the digital television program presentation branches or flows from the first portion to the second portion according to the non-linear script, template or storyboard, whereby such branching or flowing enables a group of network-extensible media appliances comprising one or more wireless mobile digital television or cellular telephone to collaborate to reconstruct a covered event effectively by synchronizing such branching or flowing audio or video presentations that are collected wirelessly from distributed media appliances, such that the group of one or more wireless mobile digital television or cellular telephone media appliances collaborate or synchronize to provide wirelessly network-extensible non-linear digital television programming.

63. The medium of claim 62 further comprising:

a third media portion partitioned in a trusted space in the storage medium, such that the program presentation branches or flows from the first or second portion to the third portion according to the non-linear script, template or storyboard.

64. On-appliance memory for accessing non-deterministic media programming for wireless mobile digital television or cellular telephone comprising:

a first memory element comprising a pre-produced portion; and

a second memory element comprising a post-produced portion;

wherein a news, sports, movie, game, family or political audio or video digital television program is presented electronically using the pre- and post-produced portions according to a non-deterministic script, template or storyboard, such that the digital television program presentation branches or flows from the first portion to the second portion according to the non-deterministic script, template or storyboard, whereby such branching or flowing enables a group of network-extensible media appliances comprising one or more wireless mobile digital television or cellular telephone to collaborate to reconstrict a covered event effectively by synchronizing such branching or flowing program presentations that are collected wirelessly from distributed media appliances, such that the group of one or more wireless mobile digital television or cellular telephone media appliances collaborate or synchronize to provide wirelessly network-extensible non-deterministic digital television programming.

65. The memory of claim 64 further comprising:

a third memory element comprising a third portion, such that the program presentation branches or flows from the pre- or post-produced portion to the third portion according to the non-deterministric script, template or storyboard.

66. Communication method for network extensible reconfigurable media appliance comprising a media unit, a controller, and a communication unit, the method comprising the steps of:

a sensor generating a video signal;

a controller rendering the video signal according to one or more programmable studio effects comprising color-space conversion, white-balancing, backlight compensation, gain control, motion detection or tracking, gamma correction, multi-frame noise reduction, depth estimation, 2-D bad pixel correction, video compression or stabilization, or digital pan or tilt; and

a communication unit transmitting the rendered signal according to a wireless, cellular or network protocol;

wherein the video signal is provided to a distributed group of network-extensible media appliances, such video signal being provided using programmable protocol translation via real-time or dynamic electronic signal processing to convert a communication format of the provided video signal, at least one of the appliances in the distributed group thereby presenting electronically the video signal via an audio or video renderer, whereby such distributed group of network-extensible media appliances collaborates to reconstruct a covered event effectively by synchronizing video signals that are collected from distributed media appliances, such video signals being synchronized to branch according to a non-linear or non-deterministic script, template or storyboard having multiple branching points or paths.

67. Method of claim 66 wherein:

the controller renders the video signal according to a digital rights management (DRM) rule.

68. Method of claim 66 wherein:

the transmitted signal comprises a tag for synchronizing the video signal with another appliance.

69. Method of claim 66 wherein:

the transmitted signal complies with a pre-defined script for a news or sports event.

70. Network extensible reconfigurable media system comprising:

a first appliance comprising a first media unit;

a first controller; and

a first communication unit; and

a second appliance comprising a second media unit;

a second controller; and

a second communication unit;

wherein the first media unit comprises a first sensor for generating a first video signal, the first controller rendering the first video signal according to one or more programmable studio effects, and the first communication unit transmitting a first rendered signal according to a wireless, cellular or network protocol; and

the second media unit comprises a second sensor for generating a second video signal, the second controller rendering the second video signal according to one or more programmable studio effects, and the second communication unit transmitting a second rendered signal according to a wireless, cellular or network protocol, whereby the first and second appliances couple collaboratively according to a media project;

wherein the first or second video signal is provided to a distributed group of network-extensible media appliances, such video signal being provided using programmable protocol translation via real-time or dynamic electronic signal processing to convert a communication format of the provided video signal, at least one of the appliances in the distributed group thereby presenting electronically such video signal via an audio or video renderer, such presenting appliance comprising an interface or visual prompt for enabling appliance user to access audio or video data according to one or more meta-data tags associated or synchronized with such audio or video data effectively to reconstruct an event sensed by a plurality of appliances in the distributed group, such access to audio or video data being associated or synchronized to enable audio or video branching according to a non-linear or non-deterministic script, template or storyboard having multiple branching points or paths.

71. System of claim 70 wherein:

the first controller renders the first video signal according to a first digital rights management (DRM) rule, and the second controller renders the second video signal according to a second DRM rule.

72. System of claim 70 wherein:

the first transmitted signal comprises a first tag for synchronizing the first video signal with the second appliance, and the second transmitted signal comprises a second tag for synchronizing the second video signal with the first appliance.

73. System of claim 70 wherein:

the first transmitted signal complies with a first pre-defined script for a news or sports event, and the second transmitted signal complies with a second pre-defined script for a news or sports event.

74. Media appliance comprising:

means for sensing to generate an audio or visual (A/V) signal; and

reconfigurable logic or processor for processing the signal adaptively according to automatic recognition of one or more audio or video feature extracted from the processed signal, whereby such extracted feature is usable for image or database query;

wherein the signal is provided to a distributed group of network-extensible media appliances, such signal being provided using programmable protocol translation via real-time or dynamic electronic signal processing to convert a communication format of the provided signal, at least one of the appliances in the distributed group thereby presenting electronically the signal via an audio or video renderer, whereby such distributed group of network-extensible media appliances collaborates to reconstruct a covered event effectively by synchronizing processed A/V signals that are collected from distributed media appliances, such signals being synchronized to flow or branch according to a non-linear or non-deterministic script, template or storyboard.

75. The appliance of claim 74 wherein:

said sensing means encodes the signal according to a video format enabling emotion recognition.

76. The appliance of claim 74 wherein:

said reconfigurable logic or processor enables content, user or device authentication for security intelligence.

77. The appliance of claim 74 wherein:

said reconfigurable logic or processor tags the signal according to a digital rights management (DRM) flag or meta-datastructure.

78. The appliance of claim 74 further comprising:

means for rendering the processed signal using an abstraction layer for presentation according to an ATSC format.

79. The appliance of claim 74 wherein:

said reconfigurable logic or processor enables alternate rendering of the signal according to a non-linear branching-point for a news, sports or movie program.

80. The appliance of claim 74 wherein:

said reconfigurable logic or processor processes the signal synchronously with a delegated A/V stream in an appliance group.

81. Media processing comprising the steps of:

sensing by a sensor to generate an audio or visual (A/V) signal; and

processing the signal adaptively according to pre- or post-production guidance;

wherein the signal is provided to a distributed group of network-extensible media appliances, such signal being provided using programmable protocol translation via real-time or dynamic electronic signal processing to convert a communication format of the provided signal, at least one of the appliances in the distributed group thereby presenting electronically the processed signal via an audio or video renderer, such presenting appliance enabling user access to seam-less stream of audio or video according to one or more metadata or tags for integrating or synchronizing presentation of such audio or video effectively to reconstruct an event sensed by a plurality of appliances in the distributed group, whereby such distributed group of network-extensible media appliances collaborates to reconstruct the event effectively by integrating or synchronizing A/V signals that are collected from distributed media appliances, such A/V signals being integrated or synchronized to flow or branch according to a non-linear or non-deterministic script, template or storyboard.

82. The process of claim 81 wherein:

the signal is encoded according to a video format enabling emotion recognition.

83. The process of claim 81 wherein:

the signal is processed for content, user or device authentication for security intelligence.

84. The process of claim 81 wherein:

the signal is processed using one or more tag according to a digital rights management (DRM) flag or meta-datastructure.

85. The process of claim 81 wherein:

the signal is rendered via an abstraction layer for presentation according to an ATSC format.

86. The process of claim 81 wherein:

the signal is processed for alternate rendering according to a non-linear branching-point for a news, sports or movie program.

87. The process of claim 81 wherein:

the signal is processed synchronously with a delegated A/V stream in an appliance group.