Method and apparatus to prepare listener-interest-filtered works

• US 6,374,225 B1
• Filed: 10/09/1998
• Issued: 04/16/2002
• Est. Priority Date: 10/09/1998
• Status: Expired due to Term

• Current Assignee: Virentem Ventures LLC
• Original Assignee: Enounce Incorporated
• Inventors: Hejna, Jr., Donald J.
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): ARMSTRONG, ANGELA A
• Application Number:
  US09/169,031
• Time in Patent Office: 1,285 Days
• Field of Search: 704/270, 704/503, 704/500, 704/207, 704/208, 704/200, 704/211, 434/156, 434/157, 434/185, 434/307.R, 434/350, 434/362
• US Class Current: 704/270
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G10L 21/04 Time compression or expansion
• CPC Class Codes: G10L 21/043 by changing speed
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783

Abstract

An embodiment of the present invention is a method for generating a listener-interest-filled work for an audio or audio-visual work, which method comprises the steps of: (a) generating one or more average speed contours for one or more audio or audio-visual works for one or more categories of users; (b) converting the one or more average speed contours to one or more conceptual speed association data structures; and (c) forming a listener-interest-filtered conceptual speed association data structure from the one or more conceptual speed association data structures. This embodiment further includes the step of using the listener-interest-filtered conceptual speed association data structure to create a listener-interest-filtered audio or audio-visual work; or the step of converting the listener-interest-filtered conceptual speed association data structure to a listener-interest-filtered speed contour; or the step of using the listener-interest-filtered speed contour to create a listener-interest-filtered audio or audio-visual work.

Claims

1. An apparatus for generating a speed contour which includes an affinity information used to obtain a time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the TSM rate, which apparatus comprises:

a user input apparatus that receives user information and directs input of a portion of the audio or audio-visual work;

a time-scale modification system, responsive to an identifier of the portion, the portion, and the TSM rate, that generates a time-scale modified portion;

a time-scale modification monitor, responsive to at least a portion of the user information, the identifier of the portion, and the portion, that generates the TSM rate and the identifier of a portion associated with the TSM rate; and

a speed contour generator, responsive to the TSM rate and the identifier of the associated portion, that generates the speed contour.

2. The apparatus of claim 1 which further comprises a storage device, responsive to the speed contour, that stores the speed contour.

3. The apparatus of claim 2 wherein the speed contour is stored with user identification contained within the user information.

4. The apparatus of claim 3 wherein the speed contour generator generates a speed contour which is a function of several speed contours generated for a particular user.

5. The apparatus of claim 3 wherein the speed contour generator generates a speed contour which is a function of several speed contours generated for different users.

6. The apparatus of claim 1 wherein the time-scale modification monitor, responsive to predetermined user information, generates one or more particular TSM rates and wherein the time-scale modification system, responsive to the one or more particular TSM rates, does not generate the time-scale modified portion.

7. The apparatus of claim 1 which further comprises display apparatus, responsive to the speed contour, which displays the speed contour.

8. The apparatus of claim 1 which further comprises playback apparatus, responsive to the time-scale modified portion, that plays the time-scale modified portion.

9. The apparatus of claim 8 which further comprises a storage device, responsive to the time-scale modified portion, that stores the time-scale modified portion.

10. The apparatus of claim 9 which further transmits the time-scale modified portion to another apparatus.

11. The apparatus of claim 1 wherein the affinity information comprises a measure of user interest in the portion.

12. The apparatus of claim 1 wherein the affinity information comprises a derivative of the TSM rate.

13. The apparatus of claim 12 wherein the derivative is a first derivative.

14. The apparatus of claim 1 which further transmits the speed contour to another apparatus.

15. The apparatus of claim 1 which further transmits the speed contour to another apparatus along with user identification.

16. A method for generating a speed contour which includes an affinity information used to obtain a time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the TSM rate, which method comprises steps of:

obtaining user information and directing input of a portion of the audio or audio-visual visual work;

generating a time-scale modified portion responsive to an identifier of the portion, the portion, and the TSM rate;

generating the TSM rate and the identifier of a portion associated with the TSM rate responsive to the user information, the identifier of the portion, and the portion; and

generating the speed contour responsive to the TSM rate and the identifier of the associated portion.

17. An apparatus for generating a conceptual speed association data structure which includes an affinity information used to obtain a time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the TSM rate, which apparatus comprises:

a user input apparatus that receives user information and directs input of a portion of the audio or audio-visual work;

a time-scale modification system, responsive to an identifier of the portion, the portion, and the TSM rate, that generates a time-scale modified portion;

a concept decoder, responsive to the identifier of the portion and the portion, that generates one or more concepts for the portion;

a time-scale modification concept monitor, responsive to the user information and the one or more concepts, that generates the TSM rate and a concept identifier associated with the TSM rate; and

a conceptual speed association data structure generator, responsive to the TSM rate and the associated concept identifier, that generates the conceptual speed association data structure.

18. The apparatus of claim 17 which further comprises a storage device, responsive to the conceptual speed association data structure, which stores the conceptual speed association data structure.

19. The apparatus of claim 18 wherein the conceptual speed association data structure is stored with user identification contained within the user information.

20. The apparatus of claim 19 wherein the conceptual speed association data structure generator generates a conceptual speed association data structure which is a function of several conceptual speed association data structures generated for a particular user.

21. The apparatus of claim 19 wherein the conceptual speed association data structure generator generates a conceptual speed association data structure which is a function of several conceptual speed association data structures generated for a number of different users.

22. The apparatus of claim 17 wherein the time-scale modification concept monitor, responsive to predetermined user information, generates one or particular TSM rates and wherein the time-scale modification system, responsive to the one or more particular TSM rates, does not generate the time-scale modified portion.

23. The apparatus of claim 17 which further comprises display apparatus, responsive to the conceptual speed association data structure, which displays the conceptual speed association data structure.

24. The apparatus of claim 17 which further comprises playback apparatus, responsive to the time-scale modified portion, that plays the time-scale modified portion.

25. The apparatus of claim 24 which further comprises a storage device, responsive to the time-scale modification portion, that stores the time-scale modified portion.

26. The apparatus of claim 17 wherein the concept decoder includes an algorithm for recognizing categories of concepts.

27. The apparatus of claim 26 wherein one of the categories include numbers.

28. The apparatus of claim 17 wherein the concept decoder comprises a concept determiner that provides output to a concept information decoder, which concept determiner inputs closed-captioning data or textual annotation stored with the portion of the audio or audio-visual work.

29. The apparatus of claim 17 wherein the concept decoder comprises a concept determiner that provides output to a concept information decoder, which concept determiner includes speech recognition apparatus.

30. The apparatus of claim 17 wherein the time-scale modification concept monitor creates a single TSM rate for a concept by performing a mathematical function of the TSM rates over the interval of the input audio or audio-visual work associated with that single concept.

31. The apparatus of claim 30 wherein the mathematical function comprises forming a mathematical average.

32. The apparatus of claim 30 wherein the mathematical function comprises forming a weighted average which emphasizes most recent TSM values obtained during the interval in which a particular concept was present at the input to the time-scale modification concept monitor.

33. The apparatus of claim 17 which further transmits the time-scale modified portion to another apparatus.

34. The apparatus of claim 17 wherein the time-scale modification concept monitor generates the TSM rate associated with a particular concept as a function of the number of times the particular concept has appeared in the work.

35. The apparatus of claim 17 wherein the time-scale modification concept monitor creates a multiplicity of TSM rates for a concept.

36. The apparatus of claim 35 wherein the multiplicity of TSM rates cause the TSM rate to increase as the concept is repeated throughout the audio or audio-visual work.

37. The apparatus of claim 17 wherein the affinity information comprises a derivative of the TSM rate.

38. The apparatus of claim 37 wherein the derivative is a first derivative.

39. The apparatus of claim 17 which further transmits the conceptual speed association data structure to another apparatus.

40. The apparatus of claim 17 which further transmits the conceptual speed association data structure to another apparatus along with user identification.

41. A method for generating a conceptual speed association data structure which includes an affinity information used to obtain a time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the TSM rate, which method comprises steps of:

obtaining user information and directing input of a portion of the audio or audio-visual work;

generating a time-scale modified version of the portion responsive to an identifier of the portion, the portion, and the TSM rate;

generating one or more concepts for the portion responsive to the identifier of the portion and the portion;

generating the TSM rate and a concept associated with the TSM rate responsive to the user information and the one or more concepts; and

generating the conceptual speed association data structure responsive to the TSM rate and the associated concept.

42. An apparatus which plays an audio or audio-visual work in conjunction with a speed contour which includes an affinity information used to obtain a first time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the first TSM rate, which apparatus comprises:

an input apparatus that directs input of a portion of the audio or audio-visual work, wherein the input apparatus further comprises a user input apparatus that receives user information;

a time-scale modification system, responsive to an identifier of the portion, the portion, and a TSM rate, that generates a time-scale modified portion;

playback apparatus, responsive to the time-scale modified portion, that plays the time-scale modified portion; and

a time-scale modification rate determiner, responsive to the speed contour, to the information, and to the identifier of the portion, that generates the TSM rate.

43. The apparatus of claim 42 wherein the user information includes an offset and wherein the time-scale modification rate determiner generates the TSM rate using the offset.

44. The apparatus of claim 42 wherein the user information includes a user specified quantization step to a TSM rate and the time-scale modification rate determiner generates the TSM rate using the user specified quantization step.

45. A method for playing an audio or audio-visual work in conjunction with a speed contour which includes an affinity information used to obtain a first time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the first TSM rate, which method comprises steps of:

directing input of a portion of the audio or audio-visual work, and receiving user information;

generating a time-scale modified portion responsive to an identifier of the portion, the portion, and a TSM rate;

playing the time-scale modified portion; and

generating the TSM rate responsive to the speed contour, the user information, and the identifier of the portion.

46. An apparatus which plays an audio or audio-visual work in conjunction with a conceptual speed association data structure which includes an affinity information used to obtain a first time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the first TSM rate, which apparatus comprises:

an input apparatus that directs input of a portion of the audio or audio-visual work;

a time-scale modification system, responsive to an identifier of the portion, the portion, and a TSM rate, that generates a time-scale modified portion;

playback apparatus, responsive to the time-scale modified portion, that plays the time-scale modified portion;

a concept decoder, responsive to the identifier of the portion and the portion, that generates one or more concepts for the portion; and

a time-scale modification concept look-up system, responsive to the one or more concepts and the conceptual speed association data structure, that generates the TSM rate.

47. The apparatus of claim 46 wherein the input apparatus further comprises a user input apparatus that receives user information and wherein the time-scale modification concept look-up system is also responsive to the user information to generate the TSM rate.

48. The apparatus of claim 47 wherein the user information includes an offset and wherein the time-scale modification concept look-up system generates the TSM rate using the offset.

49. The apparatus of claim 47 wherein the user information includes a user specified quantization step to a TSM rate and the time-scale modification concept look-up system generates the TSM rate using the user specified quantization step.

50. The apparatus of claim 47 wherein the user information includes a concept and a TSM rate for that concept and the time-scale modification concept look-up system generates the TSM rate using the user specified concept and TSM rate.

51. The apparatus of claim 46 wherein the time-scale modification concept look-up system searches the conceptual speed association data structure for concept entries within a range of the one or more concepts.

52. The apparatus of claim 51 wherein, if no concept entries are within the range, the previously obtained TSM rate is used.

53. The apparatus of claim 46 wherein the time-scale modification concept look-up system generates the TSM rate associated with a particular concept as a function of the number of times the particular concept has appeared in the work.

54. A method for playing an audio or audio-visual work in conjunction with a conceptual speed association data structure which includes an affinity information used to obtain a first time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the first TSM rate, which method comprises steps of:

directing input of a portion of the audio or audio-visual work;

generating a time-scale modified portion responsive to an identifier of the portion, the portion, and a TSM rate;

playing the time-scale modified portion;

generating a concept for the portion responsive to the identifier of the portion and the portion; and

generating the TSM rate responsive to the concept, and the conceptual speed association data structure.

55. The method of claim 54 wherein the step of generating the TSM rate comprises searching the conceptual speed association data structure for concept entries within a range of the one or more concepts.

56. The method of claim 55 wherein, if no concept entries are within the range, the previously obtained TSM rate is used.

57. The method of claim 54 wherein the step of generating the TSM rate includes generating the TSM rate associated with a particular concept as a function of the number of times the particular concept has appeared in the work.

58. An apparatus for converting a speed contour which includes an affinity information used to obtain a time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the TSM rate into a conceptual speed association data structure which includes an affinity information used to obtain a time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the TSM rate, which apparatus comprises:

an input apparatus, responsive to the speed contour, that determines a TSM rate for a portion and an identifier of the portion and directs input of the portion of the audio or audio-visual work;

a concept decoder, responsive to an identifier of the portion and the portion, that generates one or more concepts for the portion;

a time-scale modification concept monitor, responsive to the one or more concepts and the TSM rate, that associates a concept identifier with the TSM rate; and

a conceptual speed association data structure generator, responsive to the TSM rate and the associated concept identifier, that generates the conceptual speed association data structure.

59. An apparatus for converting a conceptual speed association data structure which includes an affinity information used to obtain a time-scale modification (TSM) rate and a concept information used to obtain a concept identifier for a portion of an audio or audio-visual work associated with the TSM rate into a speed contour which includes an affinity information used to obtain a time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the TSM rate, which apparatus comprises:

an input apparatus that directs input of a portion of the audio or audio-visual work and determines an identifier of the portion;

a concept decoder, responsive to the identifier of the portion and the portion, that generates one or more concepts for the portion;

a time-scale modification concept look-up, responsive to the one or more concepts and the conceptual speed association data structure, that generates the TSM rate; and

a speed contour generator, responsive to the TSM rate and the associated identifier of the portion, that generates the speed contour.

60. An apparatus for generating a speed contour which includes an affinity information used to obtain a time-scale modification (TSM) rate and an identifier information used to obtain an identifier of a portion of an audio or audio-visual work associated with the TSM rate, which apparatus comprises:

a user input apparatus that receives user information and directs input of a portion of the audio or audio-visual work;

a display apparatus, responsive to an identifier of the portion, that displays a representation of the input portion and the TSM rate associated with the portion;

an editor, in response to the user information, that provides an identifier for a user selected portion of the display and a user specified TSM rate for the user selected portion; and

a speed contour generator, responsive to the user specified TSM rate, the associated TSM rate, and the identifier of the user selected portion, that generates the speed contour.

61. The apparatus of claim 60 wherein the display apparatus display comprises text material from close captioning material which is associated with the input portion.

62. The apparatus of claim 60 wherein the display apparatus display comprises text material that is determined by speech recognition of the input portion.