Automatic generation of video from structured content

• US 8,340,493 B2
• Filed: 07/05/2007
• Issued: 12/25/2012
• Est. Priority Date: 07/06/2006
• Status: Active Grant

• Current Assignee: Sundaysky Incorporated
• Original Assignee: Sundaysky Incorporated
• Inventors: Axen, Yaniv, Weller, Shmuel
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US12/309,034
• Publication Number:
  US 20100067882A1
• Time in Patent Office: 2,000 Days
• Field of Search: 386/239, 386/232, 386/281, 386/278, 386/284, 386/280
• US Class Current: 386/232
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/17327 with deferred transmission or handling of upstream communications
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

Apparatus for generation of playable media from structured data, comprises a structured data reading unit for reading in of content of a first structure, a transformation unit for transforming said content into a second structure, said transformation comprising incorporating media play instructions, and a rendering unit for rendering content from the second structure using said media play instructions to generate playable media from the content.

Claims

1. Apparatus for generation of playable media from structured data, comprising:

a spatially structured data reading unit for reading in of content comprising a plurality of distinct media elements distributed over a first, spatial, structure,

a spatial to linear transformation unit for transforming said distinct media elements from said spatial structure into a second, linear, structure, said transformation comprising incorporating media play instructions defining a time-line relationship between said spatially distributed distinct media elements, thereby to form said linear structure, and

a rendering unit for rendering said content from said second, linear, structure using said media play instructions to generate playable media from said content.

2. Apparatus according to claim 1, wherein said spatial structure comprises said distinct media elements arranged in at least two dimensions, and said playable media is a linear media, said transformation unit being configured such that said second structure is a linear description of said first structure.

3. Apparatus according to claim 1, wherein said transformation unit is configured for enforcing a linearity on said first structure in order to form said second structure.

4. Apparatus according to claim 1, wherein said playable media is video and said second structure comprises a plurality of scenes.

5. Apparatus according to claim 4, wherein said media play instructions comprise scene change instructions, and said transformation into said second structure further comprises inserting scene change instructions between respective scenes.

6. Apparatus according to claim 5, wherein said transformation is configured to apply to said second structure a timing framework for timing of play of said linear media.

7. Apparatus according to claim 1, wherein said content is at least partly updated dynamically and said structured data reading unit is configured to read data in dynamically and pass to said transformation unit for dynamic transformation.

8. Apparatus according to claim 1, wherein said content comprises data of dynamically generated web pages, and said structured data reading unit is configured to use an API of a content management system managing said dynamically generated web pages to obtain said data.

9. Apparatus according to claim 1, wherein said first structure comprises content fitted within a predetermined format, and said transformation unit comprises a parsing unit for parsing said content based on said predetermined format.

10. Apparatus according to claim 9, wherein said predetermined format comprises content items and wherein said parsing unit is configured to recognize content belonging to said content items.

11. Apparatus according to claim 10, wherein said media play commands comprise at least one enhancement instruction for providing additional play to link between content items.

12. Apparatus according to claim 10, wherein said media play commands comprise at least one enhancement instruction for providing additional play within respective content items.

13. Apparatus according to claim 1, wherein said media play instructions comprise an instruction for generating a graph from tabulated data.

14. Apparatus according to claim 1, wherein said structured data comprises text, and wherein said media play instructions comprise an instruction for conversion of text to speech.

15. Apparatus according to claim 14, wherein said media play instructions comprise an instruction for reading of said speech by an animated character.

16. Apparatus according to claim 15, wherein said media play instructions comprise an instruction for selection between a plurality of alternative animated characters for said reading.

17. Apparatus according to claim 16, wherein said transformation unit is configured to make a selection between said alternative animated characters based on a parsing of a content of said structured data.

18. Apparatus according to claim 1, wherein said structured data comprises at least one image, and wherein said media play instructions comprise an instruction for displaying said image for a predetermined amount of time.

19. Apparatus according to claim 1, wherein said structured data comprises at least one image combined with information and wherein said media play instructions comprise an instruction for displaying said image with said information superimposed thereon.

20. Apparatus according to claim 1, wherein said structured data comprises a plurality of images and wherein said transformation unit is configured with an image selector for selecting a subset of said images for display.

21. Apparatus according to claim 20, wherein said selector is configured to make said selection based on processing of respective images to determine suitability.

22. Apparatus according to claim 1, wherein said structured data comprises a plurality of images and wherein said media play instructions comprise a slideshow instruction for playing said images in succession.

23. Apparatus according to claim 19, wherein said transformation unit comprises an image analysis unit for determining the locations of critical regions within images and wherein said media play instruction for displaying said image with said information superimposed thereon is modifiable to ensure that said information is located so as to avoid obscuring detected critical regions.

24. Apparatus according to claim 1, wherein said transformation unit comprises a parsing unit for parsing content data of said first data structure, and a configuration unit associated with said parsing unit for configuring said parsing unit for said first data structure.

25. Apparatus according to claim 1, wherein said media play instructions comprise camera control instructions for changing a point of view of said media play.

26. Apparatus according to claim 1, wherein said media play instructions comprise scene change instructions.

27. Apparatus according to claim 26, wherein said scene change instructions comprise at least one instruction of the group consisting of cut, fade and merge.

28. Apparatus according to claim 1, wherein said transformation unit comprises a selector for selecting between a plurality of different play possibilities.

29. Apparatus according to claim 28, wherein said selector is configured to initially make said selecting on a substantially random basis, thereby to provide different play versions of the same media for delivery over a network to recipients.

30. Apparatus according to claim 29, further comprising a feedback unit for receiving feedback from recipients indicating levels of interest in the respective versions, said feedback unit being configured to optimize said selector for making selections indicated as preferred from said feedback.

31. Apparatus according to claim 29, further comprising a feedback unit for receiving feedback from recipients indicating levels of interest in the respective versions, said feedback unit being configured to select versions indicated as preferred by said feedback for future sending to recipients.

32. Apparatus according to claim 28, wherein said transformation unit comprises a mapping unit for mapping said structured data from said first structure into a tree, said tree comprising branches, and said selector is configured to select between all of said branches or one or more subsets of said branches for said second structure.

33. Apparatus according to claim 32, wherein said selector is configured to use an importance index based on content of said structured data in order to select between said branches.

34. Apparatus according to claim 33, wherein said importance index comprises importance indices for respective branches.

35. Apparatus according to claim 1, wherein said playable media is video.

36. Apparatus according to claim 1, wherein said playable media is audio.

37. The apparatus of claim 1, further comprising:

a mark up unit for adding media playing instructions to said spatially structured content, as mark up about said content, and

and wherein said rendering unit is configured for converting said content, according to instructions contained in said mark up, into said playable sequence.

38. The linear media generation apparatus of claim 37, configured for distributed playing about said web by locating said rendering unit at a client and transmitting said marked up media to said client.

39. Apparatus according to claim 37, wherein said content comprises data arranged in at least two dimensions, and said playable sequence is a linear media, said markup unit being configured such that said marked up content is a linear description of said content.

40. Apparatus according to claim 39, wherein said mark up is configured to apply to said marked up content a timing framework for timing of play of said linear media.

41. Apparatus according to claim 37, wherein said content is at least partly updated dynamically and said mark up unit is configured to read data in dynamically and mark up said data dynamically.

42. Apparatus according to claim 37, wherein said content comprises data of dynamically generated web pages, and said mark up unit is configured to use an API of a content management system managing said dynamically generated web pages to obtain said content.

43. Apparatus according to claim 37, wherein said content is fitted within a predetermined format, and said mark up unit comprises a parsing unit for parsing said content based on said predetermined format.

44. Apparatus according to claim 43, wherein said predetermined format comprises content items and wherein said parsing unit is configured to recognize content belonging to said content items.

45. Apparatus according to claim 44, wherein said media play commands comprise at least one enhancement instruction for providing additional play to link between content items.

46. Apparatus according to claim 44, wherein said media play commands comprise at least one enhancement instruction for providing additional play within respective content items.

47. Apparatus according to claim 37, wherein said media play instructions comprise an instruction for generating a graph from tabulated data.

48. Apparatus according to claim 37, wherein said content comprises text, and wherein said media play instructions comprise an instruction for conversion of text to speech.

49. Apparatus according to claim 48, wherein said media play instructions comprise an instruction for reading of said speech by an animated character.

50. Apparatus according to claim 49, wherein said media play , instructions comprise an instruction for selection between a plurality of alternative animated characters for said reading.

51. Apparatus according to claim 50, wherein said transformation unit is configured to make a selection between said alternative animated characters based on a parsing of a content of said structured data.

52. Apparatus according to claim 37, wherein said structured data comprises at least one image, and wherein said media play instructions comprise an instruction for displaying said image for a predetermined amount of time.

53. Apparatus according to claim 37, wherein said structured data comprises at least one image combined with information and wherein said media play instructions comprise an instruction for displaying said image with said information superimposed thereon.

54. Apparatus according to claim 37, wherein said structured data comprises a plurality of images and wherein said transformation unit is configured with an image selector for selecting a subset of said images for display.

55. Apparatus according to claim 54, wherein said selector is configured to make said selection based on processing of respective images to determine suitability.

56. Apparatus according to claim 37, wherein said content comprises a plurality of images and wherein said media play instructions comprise a slideshow instruction for playing said images in succession.

57. Apparatus according to claim 53, wherein said transformation unit comprises an image analysis unit for determining the locations of critical regions within images and wherein said media play instruction for displaying said image with said information superimposed thereon is modifiable to ensure that said information is located so as to avoid obscuring detected critical regions.

58. Apparatus according to claim 37, wherein said transformation unit comprises a parsing unit for parsing content of different data structures, and a configuration unit associated with said parsing unit for configuring said parsing unit for respectively different data structures.

59. Apparatus according to claim 37, wherein said media play instructions comprise camera control instructions for changing a point of view of said media play.

60. Apparatus according to claim 37, wherein said media play instructions comprise scene change instructions.

61. Apparatus according to claim 60, wherein said scene change instructions comprise at least one instruction of the group consisting of cut, fade and merge.

62. Apparatus according to claim 37, wherein said transformation unit comprises a selector for selecting between a plurality of different play possibilities.

63. Apparatus according to claim 62, wherein said selector is configured to initially make said selecting on a substantially random basis, thereby to provide different play versions of the same media for delivery over a network to recipients.

64. Apparatus according to claim 63, further comprising a feedback unit for receiving feedback from recipients indicating levels of interest in the respective versions, said feedback unit being configured to optimize said selector for making selections indicated as preferred from said feedback.

65. Apparatus according to claim 63, further comprising a feedback unit for receiving feedback from recipients indicating levels of interest in the respective versions, said feedback unit being configured to select versions indicated as preferred by said feedback for future sending to recipients.

66. Apparatus according to claim 62, wherein said transformation unit comprises a mapping unit for mapping said content into a tree, said tree comprising branches, and said selector is configured to select between all of said branches or one or more subsets of said branches for said second structure.

67. Apparatus according to claim 66, wherein said selector is configured to use an importance index based on content of said structured data in order to select between said branches.

68. Apparatus according to claim 67, wherein said importance index comprises importance indices for respective branches.

69. Apparatus according to claim 37, wherein said playable sequence is video.

70. Apparatus according to claim 37, wherein said playable sequence is audio.

71. Apparatus according to claim 37, further comprising a combiner for combining separate sequences into a channel.

72. A storage system for storing media content in play ready fashion comprising:

an input unit for input of content comprising a plurality of distinct media elements in a spatial structure, and

a markup unit for marking up said content with media play instructions, said media play instructions including a timing schedule to provide a linear relationship between said elements, to render said spatial structure into a linear structure for sequential play.

73. A method for generation of playable media from structured data, comprising:

reading in of content data comprising a plurality of distinct elements spatially distributed in a first, spatial, structure,

transforming said content data into a second, linear, structure, said transforming comprising incorporating media play instructions for sequential play of said elements, and

rendering said structured data from said second structure using said media play instructions to generate playable media from said content data.