System for creating and rendering synchronized audio and visual programming defined by a markup language text file

• US 20080005130A1
• Filed: 08/02/2007
• Published: 01/03/2008
• Est. Priority Date: 10/02/1996
• Status: Abandoned Application

• Current Assignee: Personal Audio, LLC
• Original Assignee: Personal Audio, LLC
• Inventors: Logan, James, Call, Charles, Goessling, Daniel
• Application Number:
  US11/888,864
• Publication Number:
  US 20080005130A1
• Time in Patent Office: Days
• US Class Current: 707/10
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: H04H 60/46 for recognising users' preferences
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

An audio program and message distribution system in which a host system organizes and transmits program segments to client subscriber locations. The host organizes the program segments by subject matter and creates scheduled programming in accordance with preferences associated with each subscriber. Program segments are associated with descriptive subject matter segments, and the subject matter segments may be used to generate both text and audio cataloging presentations to enable the user to more easily identify and select desirable programming. A playback unit at the subscriber location reproduces the program segments received from the host and includes mechanisms for interactively navigating among the program segments. A usage log is compiled to record the subscriber'"'"'s use of the provided program materials, to return data to the host for billing, to adaptively modify the subscriber'"'"'s preferences based on actual usage, and to send subscriber-generated comments and requests to the host for processing. Voice input and control mechanisms included in the player allow the user to perform hands-free navigation of the program materials and to dictate comments and messages which are returned to the host for retransmission to other subscribers. The program segments sent to each subscriber may include advertising materials which the user can selectively play to obtain credits against the subscriber fee. Parallel audio and text transcript files for at least selected programming enable subject matter searching and synchronization of the audio and text files. Speech synthesis may be used to convert transcript files into audio format. Image files may also be transmitted from the server for synchronized playback with the audio programming.

Claims

1. A system for reproducing audible and visible program segments to a user comprising, in combination:

a program storage unit for storing an electronically readable markup file of text characters expressed in a standard markup language, said markup file including a plurality of markup tags each of which includes a predetermined distinctive string of characters identifying the meaning of said tag,

an audio player responsive to the content of said markup file for reproducing an audible program segment having audio content specified by said markup file, and

a display device for displaying the content of an image file specified by said markup file concurrently with the reproduction of said audio content.

2. A system for reproducing audible and visible program segments to a user as set forth in claim 1 wherein one of said plurality of markup tags includes an image tag that identifies said image file.

3. A system for reproducing audible and visible program segments to a user as set forth in claim 2 wherein said image tag specifies the filename of said image file.

4. A system for reproducing audible and visible program segments to a user as set forth in claim 3 wherein said image tag specifies the time at which said display device displays said image file relative to the audio play time when said audio player reproduces said audible program segment.

5. A system for reproducing audible and visible program segments to a user as set forth in claim 3 wherein the relative position of said image tag within said markup file specifies the time at which said image file is displayed to said user relative to said audio play time.

6. A system for reproducing audible and visible program segments to a user as set forth in claim 3 wherein at least some of said audible and visible program segments are retrieved by said system via the Internet from one or more remote storage servers prior to being reproduced to said user.

7. A system for reproducing audible and visible program segments to a user. as set forth in claim 1 wherein said plurality of markup tags includes at least one hypertext link tag that specifies anchor content and linked content and wherein said system includes:

means for accepting a jump command from said user when said anchor content is being reproduced for said user, and

means responsive to said jump command for initiating the reproduction of said linked content for said user.

8. A media player for reproducing an audiovisual program defined by a markup file, said media player comprising, in combination:

one or more storage devices for storing at least one digitally recorded audio program file, at least one image file, and a text markup file including one or more imbedded markup tags establishing the relative times at which said audio program file is scheduled to be reproduced and said image file is scheduled to be displayed, and

processing means responsive to said text markup file for reproducing said digitally recorded audio program file in a form audible to said user at an audio playback time and for displaying said image file in a form visible to said user at a time relative to said playback time specified by said text markup file.

9. A media player for reproducing an audiovisual program defined by a markup file as set forth in claim 8 wherein said text markup file is expressed in a standard markup language which defines a set of markup tags of different types, each markup tag including a unique character string that indicates its meaning, said text markup file including an image tag that includes a filename identifying said image file.

10. A media player for reproducing an audiovisual program defined by a markup file as set forth in claim 9 wherein said time relative to said audio playback time is specified by the position of said image tag in said text markup file.

11. A media player for reproducing an audiovisual program defined by a markup file as set forth in claim 8 wherein said text markup file includes a first markup tag indicating when the display of said image file begins relative to said audio playback time and a second markup tag indicating when the display of said image file ends relative to said audio playback time.

12. A media player for reproducing an audiovisual program defined by a markup file as set forth in claim 8 wherein said imbedded markup tags include at least one hypertext link tag specifying the combination of anchor content and linked content within said audiovisual content and wherein said processing means initiates the presentation of said linked content to said user in response to receiving a hypertext jump command from said user while said anchor content is being presented to said user.

13. The system for storing and rendering a synchronized audio and visual presentation comprising, in combination:

means for storing a markup language text file expressed in a standard markup language, said text file including a plurality of imbedded tag elements each of which comprises a predetermined string of characters having a predefined meaning in said markup language and including;

(a) a specification of an audio program segment,

(b) an identification of an image file containing visual content, and

(c) a specification of the relative times at which said audio program segment and said visual content are to be presented to a user, and

a playback system responsive to said text file of characters for presenting said audio program segment and said visual content to a user at said relative times specified by said text file.

14. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 13 wherein said identification of an image file comprises the combination of one of said tag elements and a string of characters identifying said image file by name.

15. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 14 wherein said specification of the relative times at which said audio and said visual content are to be presented to a user comprises a timing specification specified by one or more of said markup tags.

16. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 15 wherein said timing specification specifies the time at which the display of said visual content begins relative to the time or times at which said audio program segment is reproduced by said playback unit.

17. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 15 said timing specification specifies the time at which the display of said visual content ends relative to the time or times at which said audio program segment is reproduced by said playback unit.

18. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 15 wherein said timing specification specifies the time at which the display of said visual content begins and ends relative to the time or times at which said audio program segment is reproduced by said playback unit.

19. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 15 wherein said timing specification is specified by the position of one or more of said markup tags within said markup language text file.

20. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 15 wherein said timing specification is specified by the position within said markup language text file of a markup tag that identifies said image file.

21. The system for storing and rendering a synchronized audio and visual presentation as set forth in claim 14 wherein said imbedded tag elements include at least one hypertext link tag element specifying the combination of anchor content and linked content within said audio and visual presentation and wherein said playback system includes means for initiating the rendering of said linked content to said user in response to receiving a hypertext jump command from said user while said anchor content is being rendered to said user.