Video display method

• US 9,792,363 B2
• Filed: 02/01/2011
• Issued: 10/17/2017
• Est. Priority Date: 02/01/2011
• Status: Expired due to Fees

• Current Assignee: Silverpush Pte Limited
• Original Assignee: Vdopia, Inc.
• Inventors: McConville, Ryan Patrick, Singh, Bhupendra, Pandey, Prashant, Upadhyay, Chhavi, Kakani, Srikanth
• Primary Examiner(s): HUYNH, AN SON PHI
• Application Number:
  US13/019,210
• Publication Number:
  US 20120194734A1
• Time in Patent Office: 2,450 Days
• Field of Search: 725116, 715723
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image

Abstract

A method for video playback uses only resources universally supported by a browser (“inline playback”) operating in virtually all handheld media devices. In one case, the method first prepares a video sequence for display by a browser by (a) dividing the video sequence into a silent video stream and an audio stream; (b) extracting from the silent video stream a number of still images, the number of still images corresponding to at least one of a desired output frame rate and a desired output resolution; and (c) combining the still images into a composite image. In one embodiment, the composite image having a number of rows, with each row being formed by the still images created from a fixed duration of the silent video stream. Another method plays the still images of the composite image as a video sequence by (a) loading the composite image to be displayed through a viewport defined the size of one of the still images; (b) selecting one of the still images of the composite image; (c) setting the viewport to display the selected still image; and (d) setting a timer for a specified time period based on a frame rate, such that, upon expiration of the specified time period: (i) selecting a next one of the still images to be displayed in the viewport, unless all still images of the composite image have been selected; and (ii) return to step (c) if not all still images have been selected.

Claims

1. A method, comprising:

receiving, by an advertising server, a request from a user device including an identification of content located on the advertising server, the content including a video sequence;

dividing the video sequence into a silent video stream and an audio stream;

extracting from the silent video stream a plurality of still images, the plurality of still images being extracted from the video sequence according to one or more frame rates;

combining the plurality of still images into a composite image for display by a web browser, the composite image including the plurality of still images in a multiple row and multiple column array;

sending the composite image, the audio stream, and playback instructions as separate files to the web browser on the user device in response to the request, the playback instructions including instructions written in a scripting language to cause the web browser, using only resources supported by the web browser and without invoking a native media player on the user device, to;

create a viewport to display a first still image of the plurality of still images, the viewport being embedded in a web page, wherein dimensions of the viewport are equal to dimensions of the first still image;

display the first still image in the viewport by copying the first still image as a bitmap onto a canvas;

start a timer with a duration based on a frame rate between the first still image and a second still image of the plurality of still images to follow the first still image;

in response to the timer timing out, automatically display the second still image in the viewport by copying the second still image as a bitmap onto the canvas;

repeat starting of the timer with the duration based on the one or more frame rates and displaying of the plurality of still images including displaying each of the plurality of still images in the viewport in sequence; and

synchronize and play the audio stream concurrently with the displaying of each of the plurality of still images;

wherein each complete row of the composite image is created from a fixed duration of the silent video stream.

2. The method of claim 1, further comprising applying heuristic algorithms to the composite image to facilitate smooth video playback.

3. The method of claim 2, wherein one heuristic algorithm compiles an index for the still images in the composite image.

4. The method of claim 3, wherein the index is used to calculate a position of each of the plurality of still images within the composite image.

5. The method of claim 1, wherein display of each of the plurality of still images in the viewport in sequence is performed according to an index attached to the composite image, the index indicating a predetermined order in which to display the still images.

6. The method as in claim 5, wherein the index is provided separately from the composite image.

7. The method of claim 1, further comprising compressing the composite image.

8. The method of claim 7, wherein compressing the composite image includes using one or more of JPEG and Huffman-based compression algorithms.

9. The method of claim 1, wherein extracting the plurality of still images comprises decomposing each of the plurality of still images into one or more component layers.

10. The method of claim 9, wherein decomposing each still image of the plurality of still images comprises identifying a base still image from a subset of the plurality of still images, and encoding other still images in the subset each as a combination of component layers representing the base still image and one or more incremental changes from the base still image.

11. The method of claim 1, further comprising separately storing the audio stream into a separate file.

12. The method of claim 1, wherein the user device comprises one of:

a personal computer, a notebook computer, a tablet computer, an personal digital assistance, a media player, a mobile telephone, and an internet-enabled television.

13. The method of claim 1, wherein sending the composite image, the audio stream, and playback instructions further comprises sending a playback module.

14. The method of claim 1, wherein the one or more frame rates are based on a level of motion in the content.

15. A server, comprising:

an interface for receiving into the server a video sequence for processing; and

a processor to;

receive a request from a user device including an identification of content located on an advertising server, the content including a video sequence;

divide the video sequence into a silent video stream and an audio stream;

extract from the silent video stream a plurality of still images, the plurality of still images being extracted from the video sequence according to one or more frame rates; and

combine the plurality of still images into a composite image for display by a web browser, the composite image including the plurality of still images arranged in a multiple row and multiple column array; and

send the composite image, the audio stream, and playback instructions as separate files to the web browser on the user device in response to the request, the playback instructions including instructions written in a scripting language to cause the web browser, using only resources supported by the web browser and without invoking a native media player on the user device, to;

create a viewport to display a first still image of the plurality of still images, the viewport being embedded in a web page, wherein dimensions of the viewport are equal to dimensions of the first still image;

display the first still image in the viewport by copying the first still image as a bitmap onto a canvas;

start a timer with a duration based on a frame rate between the first still image and a second still image of the plurality of still images to follow the first still image;

in response to the timer timing out, automatically display the second still image in the viewport by copying the second still image as a bitmap onto the canvas;

repeat starting of the timer with the duration based on the one or more frame rates and displaying of the plurality of still images including displaying each of the plurality of still images in the viewport in sequence; and

synchronize and play the audio stream concurrently with the displaying of each of the plurality of still images;

wherein each complete row of the composite image is created from a fixed duration of the silent video stream.

16. The server of claim 15, wherein the video sequence comprises a video for advertising.

17. The server of claim 16, wherein the video sequence is received from an advertising server.

18. The server of claim 17, wherein the processor further, when the user device requests the web page from a publisher server, causes the web browser to request the composite image from the advertising server.

19. The server of claim 16, wherein the playback instructions include instructions to display each of the plurality of still images of the composite image at the one or more frame rates in the web browser to provide a video experience to the user device.

20. The server of claim 15, wherein the processor further applies heuristic algorithms to the composite image to facilitate smooth video playback.

21. The server of claim 20, wherein one heuristic algorithm compiles an index for the still images in the composite image.

22. The server of claim 21, wherein the index is used to calculate a position of each of the plurality of still images within the composite image.

23. The server of claim 15, wherein the displaying of each of the plurality of still images in the viewport in sequence is performed according to an index attached to the composite image, the index indicating a predetermined order in which to display the still images.

24. The server as in claim 23, wherein the index is provided separately from the composite image.

25. The server of claim 15, wherein the processor further compresses the composite image.

26. The server of claim 25, wherein the processor further compresses the composite image by using one or more of JPEG and Huffman-based compression algorithms.

27. The server of claim 15, wherein the processor further extracts the plurality of still images by decomposing each still image into one or more component layers.

28. The server of claim 27, wherein decomposing each of the plurality of still images comprises identifying a base still image from a subset of the plurality of still images, and encoding other still images in the subset each as a combination of component layers representing the base still image and one or more incremental change from the base still image.

29. The server of claim 15, further comprising separately storing the audio stream into a separate file.

30. The server of claim 15, wherein the processor further receives and sends over a network.

31. The server of claim 30, wherein the user device comprises one of:

a personal computer, a notebook computer, a tablet computer, an personal digital assistance, a media player, a mobile telephone, and an internet-enabled television.

32. The server of claim 15, wherein the one or more frame rates are based on a level of motion in the content.