VIDEO AND AUDIO CONTENT SYSTEM

• US 20120014673A1
• Filed: 09/24/2009
• Published: 01/19/2012
• Est. Priority Date: 09/25/2008
• Status: Abandoned Application

• Current Assignee: IGRUUV Pty., Ltd.
• Original Assignee: IGRUUV Pty., Ltd.
• Inventors: O'Dwyer, Sean Patrick
• Application Number:
  US13/121,047
• Publication Number:
  US 20120014673A1
• Time in Patent Office: Days
• US Class Current: 386/282
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection tempo display G10H2220/081; tempo control G10H2210/375
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings synchronised lyrics, e.g. for karaoke G10H2220/011
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A method for use in editing video content and audio content, wherein the method includes, in a processing system, determining a video part using video information, the video information being indicative of the video content, and the video part being indicative of a video content part, determining an audio part using first audio information, the first audio information being indicative of a number of events and representing the audio content, and the audio part being indicative of an audio content part including an audio event and editing, at least in part using the audio event, at least one of the video content part and the audio content part using second audio information indicative of the audio content.

Claims

1. ) A method for use in editing video content and audio content, wherein the method includes, in a processing system:

a) determining a video part using video information, the video information being indicative of the video content, and the video part being indicative of a video content part;

b) determining an audio part using first audio information, the first audio information being indicative of a number of events and representing the audio content, and the audio part being indicative of an audio content part including an audio event; and

,

c) editing, at least in part using the audio event, at least one of;

i) the video content part; and

ii) the audio content part using second audio information indicative of the audio content.

2. ) A method according to claim 1, wherein the second audio information includes a waveform of the audio content.

3. ) A method according to claim 1, wherein the method includes, in the processing system, at least one of:

a) aligning the video content part and the audio content part using the audio event;

b) modifying the video content part; and

c) modifying the audio content part.

4. ) A method according to claim 1, wherein the method includes, in the processing system, determining the audio content part from the second audio information using the first audio information.

5. ) A method according to claim 1, wherein the method includes, in the processing system, determining at least one of the video part and the audio part based on an association between the video part and the audio part.

6. ) A method according to claim 1, wherein the method includes, in the processing system, defining an association between the video part and the audio part.

7. ) A method according to claim 1, wherein the method includes, in the processing system, storing the video content and the audio content by storing each video content part together with an associated audio content part.

8. ) A method according to claim 7, wherein the method includes, in the processing system, storing the video content parts and associated audio content parts as a file.

9. ) A method according to claim 8, wherein the method includes, in the processing system, storing the first information in the file.

10. ) A method according to claim 1, wherein the method includes, in the processing system, causing the video and audio content to be presented by presenting:

a) each video content part using the video information; and

b) each audio content part using second audio information.

11. ) A method according to claim 1, wherein the method includes, in the processing system, determining at least one of the audio part and the video part in accordance with user input commands.

12. ) A method according to claim 11, wherein the method includes, in the processing system:

a) displaying to the user;

i) indications of a number of events; and

ii) indications of a number of parts of video content; and

b) allowing the user to select at least one event and at least one video part using the indications.

13. ) A method according to claim 12, wherein the method includes, in the processing system:

a) determining a user selection of at least one event;

b) presenting audio content including the at least one event using second audio information includes waveform data representing the audio content.

14. ) A method according to claim 1, wherein the method includes, in the processing system:

a) determining an event type for the event; and

b) modifying at least one of the audio content and the video content in accordance with the event type.

15. ) A method according to claim 1, wherein the first information includes, at least one of:

a) note data;

b) timing data;

c) marking data; and

d) instrument data.

16. ) A method according to claim 1, wherein the video content includes a sequence of a number of frames, and wherein the video part includes at least one frame.

17. ) A method according to claim 1, wherein the first audio information includes midi data.

18. ) A method according to claim 1, wherein the first audio information includes a time grid, the events being positioned on the time grid to thereby indicate the respective position of the event within the audio content.

19. ) A method according to claim 18, wherein the time grid includes an associated tempo representing the tempo of the audio content.

20. ) A method according to claim 1, wherein the method includes, in the processing system:

a) determining at least one video event using first video information, the first video information being indicative of a number of video events within the video content; and

b) editing at least one of the video content and the audio content at least in part using the video event.

21. ) A method according to claim 20, wherein the first video information includes a time grid, the video events being position on the time grid to thereby indicate the respective position of the event within the video content.

22. ) A method according to claim 21, wherein the time grid includes an associated tempo representing a video tempo assigned to the video content.

23. ) A method according to claim 22, wherein the method includes, in the processing system, editing at least one of the video and the audio content at least in part using the video tempo.

24. ) A method according to claim 23, wherein the method includes, in the processing system, combining audio content with video content, the audio content being selected at least partially in accordance with the video tempo and a tempo of the audio content.

25. ) A method according to claim 1, wherein the first video information forms part of the first audio information.

26. ) A method according to claim 1, wherein the method includes, in the processing system:

a) determining at least one video event using the first audio information, the first audio information being indicative of a number of video events within video content associated with the audio content; and

b) editing at least one of the video content and the audio content at least in part using the video event.

27. ) A method for use in generating video and audio content, the method including:

a) determining an event using first audio information, the first audio information being indicative of a number of events and representing the audio content;

b) generating a video part indicative of a video content part; and

,

c) causing the video content part to be presented to the user with an audio content part including the event, the audio content part being presented using second audio information indicative of a waveform of the audio content.

28. ) A method for use in presenting video and audio content, the method including, in a processing system:

a) presenting video and audio content to the user;

b) determining an event within the audio content using first information, the first audio information being indicative of a number of events and representing the audio content;

c) causing at least one of;

i) modifying at least one of the video content part and the associated audio content part;

ii) allowing interaction with at least one of the video content part and the associated audio content part; and

,

iii) triggering an external event.

29. ) A method for use in editing video content and audio content, wherein the method includes, in a processing system:

a) determining at least one video event using first video information, the first video information being indicative of a number of video events within the video content, the first video events being aligned on a time grid defining a tempo; and

,

b) editing at least one of video content and audio content at least in part using the at least one video event.

30. ) A method for use in presenting audio content, wherein the method includes, in a processing system:

a) determining an audio part using first audio information, the first audio information being indicative of a number of events and representing the audio content, and the audio part being indicative of an audio content part including an audio event; and

,

b) modifying the audio content part; and

,

c) presenting audio content including the modified audio content part.

31. ) A method according to claim 30, wherein the audio content part is at least one of:

a) a instrument or vocal solo; and

,

b) an audio content component part.

32. ) A method according to claim 31, wherein the component part includes a drum beat.

33. ) A method according to claim 30, wherein the method includes, in the processing system, presenting the audio content using second audio information indicative of the audio content, the second audio information includes a waveform of the audio content.

34. ) A method according to claim 33, wherein the method includes, in the processing system, presenting the audio content by:

a) determining the waveform part representing the audio content part;

b) modifying the waveform part; and

,

c) presenting the second audio content using the modified waveform part.

35. ) Apparatus for use in editing video content and audio content, wherein the apparatus includes a processing system for:

a) determining a video part using video information, the video information being indicative of the video content, and the video part being indicative of a video content part;

b) determining an audio part using first audio information, the first audio information being indicative of a number of events and representing the audio content, and the audio part being indicative of an audio content part including an audio event; and

,

c) editing, at least in part using the audio event, at least one of;

i) the video content part; and

ii) the audio content part using second audio information indicative of the audio content.

36. ) Apparatus for use in presenting video and audio content, the apparatus including a processing system for:

a) presenting video and audio content to the user;

b) determining an event within the audio content using first information, the first audio information being indicative of a number of events and representing the audio content;

c) causing at least one of;

i) modifying at least one of the video content part and the associated audio content part;

ii) allowing interaction with at least one of the video content part and the associated audio content part; and

,

iii) triggering an external event.

37. ) Apparatus for use in editing video content and audio content, wherein the apparatus includes a processing system for:

a) determining at least one video event using first video information, the first video information being indicative of a number of video events within the video content, the first video events being aligned on a time grid defining a tempo; and

,

b) editing at least one of video content and audio content at least in part using the at least one video event.

38. ) Apparatus for use in presenting audio content, wherein the apparatus includes a processing system for:

a) determining an audio part using first audio information, the first audio information being indicative of a number of events and representing the audio content, and the audio part being indicative of an audio content part including an audio event; and

,

b) modifying the audio content part; and

,

c) presenting audio content including the modified audio content part.

39. ) A machine readable file including:

a) video information, the video information being indicative of the video content;

b) first audio information, the first audio information being indicative of a number of events and representing the audio content; and

,

c) second audio information indicative of the audio content. the second audio information includes a waveform of the audio content.

40. ) A file according to claim 39, wherein the file includes first video information, the first video information being indicative of a number of video events within the video content.

41. ) A file according to claim 39, wherein the first audio information is indicative of a number of video events within the video content.

42. ) A method for use in presenting audio content, wherein the method includes, in a processing system:

a) generating video content using first audio information representing the audio content, the first audio information being indicative of audio events and including at least one audio component, the video content including at least one video component representing the at least one audio component and including video events based on corresponding audio events;

b) causing the video content and audio content to be presented to a user, the audio content being presented at least in part using second audio information, the second audio information including a waveform of the audio content, the video and audio content being presented so that the video events are presented synchronously with corresponding audio events;

c) determining at least one input command representing user interaction with the at least one video component; and

,

d) modifying the presentation of the audio content in accordance with the user input command.

43. ) A method according to claim 42, wherein the at least one video component is at least partially indicative of a parameter value associated with the audio component.

44. ) A method according to claim 43, wherein the method includes, in the processing system:

a) determining a user input command indicative of user interaction with the video component; and

,

b) modifying the parameter value for the audio component in accordance with the user input command.

45. ) A method according to claim 42, wherein the method includes, in the processing system:

a) determining at least one parameter associated with the audio component; and

b) generating the video component using the at least one parameter.

46. ) A method according to claim 42, wherein the video component includes an indicator at least partially indicative of at least one of:

a) a parameter value; and

b) an audio event.

47. ) A method according to claim 46, wherein an indicator position of the indicator is indicative of the parameter value.

48. ) A method according to claim 47, wherein the method includes:

a) determining a modified indicator position in accordance with the input command; and

,

b) determining a modified parameter value in accordance with the modified indicator position.

49. ) A method according to claim 46, wherein the method includes, in the processing system, determining a user input command indicative of user interaction with the indicator.

50. ) A method according to claim 42, wherein the at least one video component is a visualisation.

51. ) A method according to claim 50, wherein the video events include changes in at least one of:

a) a video component color;

b) a video component shape;

c) a video component size; and

d) video component movements.

52. ) A method according to claim 42, wherein the video content includes a plurality of video components, each video component being indicative of a respective audio component.

53. ) A method according to claim 52, wherein the audio content includes a plurality of audio components presented simultaneously.

54. ) A method according to claim 42, wherein the events include at least one of:

a) musical notes;

b) drum beats; and

c) vocal rendition indications.

55. ) A method according to claim 42, wherein the first information includes, at least one of:

a) note data;

b) timing data;

c) marking data; and

d) instrument data.

56. ) A method according to claim 42, wherein the first audio information includes midi data.

57. ) A method according to claim 42, wherein the first audio information includes a time grid, the events being positioned on the time grid to thereby indicate the respective position of the event within the audio content.

58. ) A method according to claim 57, wherein the time grid includes an associated tempo representing the tempo of the audio content.

59. ) A method according to claim 42, wherein the method includes, in a processing system, modifying the presentation of the audio content by modifying at least part of the audio waveform.

60. ) A method according to claim 42, wherein the audio component is at least one of:

a) an instrument track; and

b) a vocal track.

61. ) A method according to claim 42, wherein the method includes, in the processing system, modifying the presentation of the audio content by:

a) determining a part of the waveform representing the audio content to be modified;

b) modifying the waveform part; and

c) presenting the second audio content using the modified waveform part.

62. ) A method according to claim 61, wherein the method includes, in the processing system, modifying the waveform part by at least one of:

a) performing waveform manipulation techniques;

b) replacing the waveform part with another waveform part from the audio content; and

c) replacing the waveform part with a waveform part generated using the first information.

63. ) A method according to claim 42, wherein the method includes:

a) rendering a video component in accordance with midi data associated with a waveform; and

b) presenting the rendered video component and the audio content, the audio content being presented at least in part using the waveform.

64. ) Apparatus for use in presenting audio content, wherein the apparatus includes a processing system for:

a) generating video content using first audio information representing the audio content, the first audio information being indicative of audio events and including at least one audio component, the video content including at least one video component representing the at least one audio component and including video events based on corresponding audio events;

b) causing the video content and audio content to be presented to a user, the audio content being presented at least in part using second audio information, the second audio information including a waveform of the audio content, the video and audio content being presented so that the video events are presented synchronously with corresponding audio events;

c) determining at least one input command representing user interaction with the at least one video component; and

,

d) modifying the presentation of the audio content in accordance with the user input command.

65. ) Apparatus according to claim 64, wherein the apparatus includes a display for displaying the video content.

66. ) Apparatus according to claim 65, wherein the display is a touch screen display for providing user input commands

67. ) Apparatus according to claim 64, wherein the apparatus includes an audio output for presenting the audio content.