Apparatus and methods for handling interactive applications in broadcast networks

• US 20060125962A1
• Filed: 02/04/2004
• Published: 06/15/2006
• Est. Priority Date: 02/11/2003
• Status: Active Grant

• Current Assignee: Synamedia Limited
• Original Assignee: NDS Limited (Cisco Systems, Inc.)
• Inventors: Ashby, Stuart P, Costello, Michael B, Hall, Nicolas Ashton, Thexton, Nicolas, Dan, Ronnie Israel, Walker, James Geoffrey, Cormican, Neil, Shelton, Ian R
• Granted Patent: US 7,752,648 B2
• Time in Patent Office: Days
• US Class Current: 348/588
• CPC Class Codes: A63F 2300/409 Data transfer via television network
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

An interactive method includes receiving, at a display device, background video including a multiplicity of video frames, at least one of the multiplicity of video frames including a plurality of sub-pictures, each of the plurality of sub-pictures representing an alternative background, and switching, at the display device, between a first sub-picture of the plurality of sub-pictures and a second sub-picture of the plurality of sub-pictures. Related apparatus and methods are also disclosed.

Claims

1-54. -54. (canceled)

55. An interactive method comprising:

receiving, at a display device, background video comprising a multiplicity of video frames, at least one of the multiplicity of video frames comprising a plurality of sub-pictures, each of the plurality of sub-pictures representing an alternative background; and

switching, at the display device, between a first sub-picture of the plurality of sub-pictures and a second sub-picture of the plurality of sub-pictures.

56. The method according to claim 55 and also comprising:

after the switching, upsampling the second sub-picture to a full video frame.

57. The method according to claim 56 and wherein the upsampling comprises upsampling for displaying on a display.

58. The method according to claim 55 and wherein the switching comprises seamlessly switching between the first sub-picture and the second sub-picture.

59. The method according to claim 55 and wherein at least one of the first sub-picture and the second sub-picture comprises a 3-dimensional (3D) scene.

60. The method according to claim 55 and also comprising:

displaying a display effect in response to the switching.

61. The method according to claim 60 and wherein the display effect comprises at least one of the following:

an illusion of an image which is broader than an image displayed before the switching;

an illusion of an image which is higher than the image displayed before the switching;

an illusion of an image which is broader and higher than the image displayed before the switching; and

an illusion of an image which is, with respect to the image displayed before the switching, at least one of the following;

horizontally distorted; and

vertically distorted.

62. The method according to claim 55 and wherein the switching comprises switching between outputs of two audio decoders.

63. The method according to claim 55 and wherein the switching comprises switching between the first sub-picture and the second sub-picture in response to at least one of the following:

timing information;

user input;

an instruction from a headend;

an instruction from a broadcast source; and

an instruction from an interactive application.

64. The method according to claim 55 and wherein the receiving comprises receiving the background video from a broadcast transmission.

65. The method according to claim 55 and wherein the receiving comprises receiving the background video from a storage device of a personal video recorder (PVR).

66. The method according to claim 55 and also comprising, prior to the switching:

receiving object information at the display device, the object information comprising information determining an object; and

overlaying, at the display device, the object over the background video.

67. The method according to claim 66 and wherein the switching comprises switching between the first sub-picture and the second sub-picture in response to the object approaching or entering a border of the first sub-picture.

68. The method according to claim 66 and wherein the object comprises a game object.

69. The method according to claim 66 and wherein the background video and the object information are related to an interactive game application.

70. The method according to claim 66 and wherein the step of receiving background video comprises receiving the background video from a broadcast transmission, and the step of receiving object information comprises receiving the object information from one of the following:

a broadcast transmission; and

a storage device of a PVR.

71. The method according to claim 66 and wherein the step of receiving background video comprises receiving the background video from a storage device of a PVR, and the step of receiving object information comprises receiving the object information from one of the following:

a broadcast transmission; and

the storage device of the PVR.

72. The method according to claim 55 and also comprising:

receiving assistance information at the display device, the assistance information comprising area assistance information related to the background video;

preparing, at the display device, graphics for display at a display location, the preparing being based, at least in part, on at least a portion of the assistance information associated with the display location; and

spatially synchronizing the prepared graphics with the background video.

73. The method according to claim 72 and wherein the at least a portion of the assistance information comprises non-boundary assistance information.

74. The method according to claim 73 and wherein the non-boundary assistance information comprises at least one of the following:

physics information;

lighting information;

at least one alpha mask;

information on at least one target zone;

information on at least one dead zone;

information regarding at least one game specific area;

control information; and

preferred track information.

75. The method according to claim 72 and wherein the preparing also comprises:

temporally synchronizing the prepared graphics with the background video.

76. The method according to claim 72 and also comprising:

displaying the prepared graphics and the background video in a synchronized form.

77. The method according to claim 72 and wherein said preparing also comprises the step of generating, at the display device, audio for rendering in association with the graphics.

78. The method according to claim 77 and wherein said generating comprises preparing the audio for rendering in association with the graphics based, at least in part, on the at least a portion of the assistance information associated with the display location.

79. The method according to claim 78 and wherein the generating also comprises synchronizing the prepared audio with the graphics and the background video.

80. The method according to claim 72 and wherein the step of receiving background video comprises receiving the background video from a broadcast transmission, and the step of receiving assistance information comprises receiving the assistance information from one of the following:

a broadcast transmission; and

a storage device of a PVR.

81. The method according to claim 72 and wherein the step of receiving background video comprises receiving the background video from a storage device of a PVR, and the step of receiving assistance information comprises receiving the assistance information from one of the following:

a broadcast transmission; and

the storage device of the PVR.

82. The method according to claim 72 and wherein the background video, the assistance information, and the graphics are related to an interactive game application.

83. The method according to claim 55 and wherein the first sub-picture corresponds to a first perspective view of a scene and the second sub-picture corresponds to a second perspective view of the scene.

84. The method according to claim 83 and wherein the first perspective view is different from the second perspective view.

85. The method according to claim 66 and also comprising:

receiving, at the display device, distinguishing information distinguishing portions of the background video by at least one characteristic; and

determining, at the display device, whether an action is to be performed on the object based on the distinguishing information.

86. The method according to claim 85 and wherein the determining comprises determining whether the action is to be performed on the object when the object moves from a first one of the portions of the background video towards a second one of the portions of the background video distinguished from the first one of the portions of the background video by the at least one characteristic.

87. The method according to claim 86 and also comprising using the distinguishing information to trigger an audio signal when the object moves from the first one of the portions of the background video towards the second one of the portions of the background video.

88. The method according to claim 85 and wherein the at least one characteristic comprises at least one of the following:

a lighting characteristic;

a physics characteristic;

an alpha mask characteristic;

a target characteristic;

a dead zone characteristic;

a characteristic of a game specific area;

a preferred track characteristic; and

a track-control characteristic.

89. The method according to claim 85 and wherein the distinguishing information comprises at least one of the following:

at least one in-video mask; and

interactive application data.

90. The method according to claim 89 and wherein the at least one in-video mask distinguishes between at least one of the following:

boundary regions in the background video; and

collision regions in the background video.

91. The method according to claim 89 and wherein the at least one in-video mask comprises at least one of the following:

at least one alpha mask;

at least one target;

at least one dead zone;

tracking information; and

control information.

92. The method according to claim 85 and wherein the background video, the object information and the distinguishing information are related to an interactive game application, and the action comprises an action in the interactive game application.

93. The method according to claim 85 and wherein the step of receiving background video comprises receiving the background video from a broadcast transmission, the step of receiving object information comprises receiving the object information from a broadcast transmission, and the step of receiving distinguishing information comprises receiving the distinguishing information from one of the following:

a broadcast transmission; and

a storage device of a PVR.

94. The method according to claim 85 and wherein the step of receiving background video comprises receiving the background video from a storage device of a PVR, the step of receiving object information comprises receiving the object information from the storage device of the PVR, and the step of receiving distinguishing information comprises receiving the distinguishing information from one of the following:

a broadcast transmission; and

the storage device of the PVR.

95. The method according to claim 85 and wherein the step of receiving background video comprises receiving the background video from a broadcast transmission, the step of receiving object information comprises receiving the object information from a storage device of a PVR, and the step of receiving distinguishing information comprises receiving the distinguishing information from a broadcast transmission.

96. The method according to claim 85 and wherein the step of receiving background video comprises receiving the background video from a storage device of a PVR, and the step of receiving object information comprises receiving the object information from a broadcast transmission, and the step of receiving distinguishing information comprises receiving the distinguishing information from the storage device of the PVR.

97. The method according to claim 55 and also comprising:

receiving object information at the display device, the object information comprising information determining an object;

computing, at the display device, an adjustable sliding window display frame around the object;

upsampling a portion of the background video comprised in the adjustable sliding window display frame; and

overlaying, at the display device, the object over the upsampled portion of the background video.

98. An interactive method comprising:

receiving background video at a display device;

receiving object information at the display device, the object information comprising information determining an object;

computing, at the display device, an adjustable sliding window display frame around the object;

upsampling a portion of the background video comprised in the adjustable sliding window display frame; and

overlaying, at the display device, the object over the upsampled portion of the background video.

99. The method according to claim 98 and wherein the object comprises a game object.

100. The method according to claim 98 and wherein the background video, the object information, and the adjustable sliding window display frame around the object are related to an interactive game application.

101. The method according to claim 98 and wherein the computing comprises using the adjustable sliding window display frame around the object for tracking the object.

102. The method according to claim 98 and wherein the computing comprises using the adjustable sliding window display frame around the object for providing an effect of a change of speed of the background video.

103. The method according to claim 98 and wherein the computing comprises using the adjustable sliding window display frame around the object for altering a portion of the background video which is displayed together with the object.

104. The method according to claim 98 and wherein the computing comprises using the adjustable sliding window display frame around the object for providing a shudder effect.

105. The method according to claim 98 and wherein the step of receiving background video comprises receiving the background video from a broadcast transmission, and the step of receiving object information comprises receiving the object information from one of the following:

a broadcast transmission; and

a storage device of a PVR.

106. The method according to claim 98 and wherein the step of receiving background video comprises receiving the background video from a storage device of a PVR, and the step of receiving object information comprises receiving the object information from one of the following:

a broadcast transmission; and

the storage device of the PVR.

107. A display device comprising:

a receiver receiving background video comprising a multiplicity of video frames, at least one of the multiplicity of video frames comprising a plurality of sub-pictures, each of the plurality of sub-pictures representing an alternative background; and

a processor switching between a first sub-picture of the plurality of sub-pictures and a second sub-picture of the plurality of sub-pictures, and rendering the second sub-picture for display.

108. A display device comprising:

a receiver receiving background video, and object information that comprises information determining an object;

a processor computing an adjustable sliding window display frame around the object and upsampling a portion of the background video comprised in the adjustable sliding window display frame; and

an OSD unit overlaying the object over the upsampled portion of the background video.

109. A display device comprising:

means for receiving background video comprising a multiplicity of video frames, at least one of the multiplicity of video frames comprising a plurality of sub-pictures, each of the plurality of sub-pictures representing an alternative background; and

means for switching between a first sub-picture of the plurality of sub-pictures and a second sub-picture of the plurality of sub-pictures, and for rendering the second sub-picture for display.

110. A display device comprising:

means for receiving background video, and object information that comprises information determining an object;

means for computing an adjustable sliding window display frame around the object and for upsampling a portion of the background video comprised in the adjustable sliding window display frame; and

;

means for overlaying the object over the upsampled portion of the background video.