Audio/video reproducing apparatus and method

• US 6,772,125 B2
• Filed: 12/04/2001
• Issued: 08/03/2004
• Est. Priority Date: 04/05/2000
• Status: Expired

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: David, Morgan William, Williams, Michael, Turner, Alan, Harradine, Vincent Carl, McGrath, Mark John, Kydd, Andrew, Thorpe, Jonathan
• Primary Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US10/005,603
• Publication Number:
  US 20020152082A1
• Time in Patent Office: 973 Days
• Field of Search: 704/235, 704/251, 704/257, 704/275, 704/278, 382/236, 386/46, 386/55, 386/66, 386/69
• US Class Current: 704/278
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/61 wherein solid state memory is used for storing A/V content storing computer data in solid state memories G06F
• CPC Class Codes: G11B 2220/655 Memory in cassette [MIC]
• CPC Class Codes: G11B 2220/657 Memory in disc [MID]
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/107 of operating tapes
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/323 Time code signal, e.g. on a cue track as SMPTE- or EBU-time code
• CPC Class Codes: G11B 27/326 used signal is a video-frame or a video-field (P.I.P.)
• CPC Class Codes: G11B 27/328 on a tape [TTOC]
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/9201 involving the multiplexing of an additional signal and the video signal
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

An audio/video reproducing apparatus is connectable to a communications network for selectively reproducing items of audio/video material from a recording medium in response to a request received via the communications network. The audio/video reproducing apparatus may comprise a control processor operable in use to receive data representing the request for the audio/video material item via the communications network. A reproducing processor is operable in response to signals identifying the audio/video material items from the control processor to reproduce the audio/video material items. The data identifying the audio/video material items includes meta data indicative of the audio/video material items. The meta data may be one of UMID, tape ID and time codes, and a Unique Material Identifier the material items. To facilitate the identification and selection of the audio and/or video material, an audio and/or video processing apparatus is provided for processing audio and/or video signals representing sound and/or images. The processing apparatus comprises an activity detector operable to generate an activity signal indicative of an amount of activity within the sound/images represented by the audio/video signal, and a meta data generator coupled to the activity detector which is operable to generate sample images at temporal positions within the audio/video signal, which temporal positions are determined from the activity signal. The processing apparatus thereby provides a facility for automatically generating meta data from received audio/video signals. The meta data can be used to select the audio/video material.

Claims

1. An audio/video reproducing apparatus connectable to a communications network for selectively reproducing items of audio/video material from a recording medium, the reproducing apparatus comprising:

a control processor which is arranged in use to receive data representing a request for a selected audio/video material item via a first network interface connectable to a first communications network, the data representing the request including metadata indicative of the selected audio/video material item; and

a reproducing processor coupled to the control processor and arranged in response to signals identifying said selected audio/video material items from said control processor to reproduce said audio/video material item, the audio/video material item being communicated via a second network interface connectable to a second communications network for communicating said items of audio/video material, said second communications network having a higher bandwidth than said first communications network.

2. An audio/video reproducing apparatus as claimed in claim 1, wherein said first network interface is arranged to operate in accordance with a data communications network standard selected from the Ethernet, RS 322 and RS 422 standards.

3. An audio/video reproducing apparatus as claimed in claim 1, wherein said second network interface is arranged to operate in accordance with the Serial Digital Interface (SDI) or the Serial Digital Transport Interface (SDTI).

4. An audio/video reproducing apparatus as claimed in claim 1, wherein said metadata is at least one of UMID, tape ID and time codes, and a Unique Material Reference Number, identifying the material items.

5. An audio/video reproducing apparatus as claimed in claim 1, wherein said reproducing apparatus comprises a plurality of audio/video recording/reproducing apparatus each of which is coupled to said control processor via a local data bus.

6. An audio/video reproducing apparatus as claimed in claim 5, wherein said local bus includes a control communications channel for communicating control data to and/or from said control processor, and a video data communications channel for communicating said items of audio/video material from said plurality of audio/video recording/reproducing apparatus to said communications network.

7. An audio/video reproducing apparatus as claimed in claim 1, further comprising a display device which is arranged in operation to display images representative of said audio/video material items present on said recording medium.

8.n An audio/video reproducing apparatus as claimed in claim 7, wherein said display device is a touch screen coupled to said control processor, and arrange in use to receive touch commands from a user for selecting said items of audio/video material.

8. An audio/video reproducing apparatus as claimed in claim 1, wherein said control processor is arranged to generate data representing a material identifier for each of said audio/video material items, from data recorded with said audio/video material items on said recording medium.

10. A computer program providing computer executable instructions, which when loaded onto a data processor configures the data processor to operate as an audio/video reproducing apparatus according to claim 1.

12. A signal representing audio and/or video material produced by an audio/video reproducing apparatus according to claim 1.

13. A data carrier on which is recorded data representing audio and/or video material produced by an audio/video reproducing apparatus according to claim 1.

9. An audio/video reproducing apparatus as claimed in claim 9, wherein said material identifier is a UMID.

11. A computer program product having a computer readable medium recorded thereon information signals representative of the computer program claimed in claim 11.

14. A method of reproducing items of audio/video material from a recording medium, comprising the steps of:

communicating metadata identifying a selected item of audio/video material via a first communications network;

receiving said identifying metadata at an audio/video reproducing apparatus in which said recording medium is loaded;

selectively reproducing said selected item of audio/video material from said recording medium in accordance with said identifying metadata; and

communicating said selected item of audio/video material via a second communications network in response to said identifying metadata, said second communications network having a higher bandwidth than said first communications network.

15. A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 15.

16. A video processing apparatus for processing video signals representing images, said apparatus comprising:

an activity detector which is arranged in operation to receive said video signals and to generate an activity signal indicative of an amount of activity within the images represented by the video signal; and

an image generator coupled to the activity detector which is arranged in operation to receive said video signal and said activity signal and to generate sample images at temporal positions within said video signal, which temporal positions are determined from said activity signal, wherein said activity signal is representative of a relative amount of activity within the images represented by said video signal and said image detector is arranged in operation to produce more of said sample images during periods of greater activity indicated by said activity signal.

17. A video processing apparatus as claimed in claim 17, wherein said sample images are represented by a substantially reduced amount of data in comparison to said images represented by said video signal.

18. A video processing apparatus as claimed in claim 17, comprising

a reproduction processor which is arranged in operation to receive a recording medium on which said video signals are recorded and to reproduce said video signals from said recording medium.

20. A video processing apparatus as claimed in claim 17, comprising a display device for displaying said sample images.

21. A video processing apparatus as claimed in claim 17, wherein said display device is arranged to display said sample images at locations on said display device which are representative of the location on said recording medium at which said sample images are recorded.

22. A video processing apparatus as claimed in claim 17, wherein said activity detector generates said activity signal by forming a histogram of colour components of said video image and determining a rate of change of said colour components.

23. A video processing apparatus as claimed in claim 17, wherein said activity detector generates said activity signal from motion vectors of image components of said video image signal.

24. An editing system having a database connected to a communications channel and a video processor as claimed in claim 17, wherein the video processor includes a communications device for communicating the sample images to said database via the communications channel, said sample images being stored in said data base.

19. A video processing apparatus as claimed in claim 19, wherein said image generator is arranged in operation to generate, for each of said sample images a material identification representative of a location on said recording medium where the video signal corresponding to said sample images are recorded.

25. An audio/video processing apparatus for processing video signals which include associated audio signals representative of sound including speech, said apparatus comprising:

a speech analysis processor which is arranged in operation to generate data identifying speech detected within said audio signals;

an activity processor coupled to said speech analysis processor and arranged in operation to generate an activity signal in accordance with the data identifying speech present in said audio signal;

a video processing apparatus operable to generate sample images from a video signal in response to said activity signal; and

a content information generator coupled to said activity processor, said speech analysis processor and said video processing apparatus and arranged in operation to generate data representing the content of said speech at temporal positions within said audio signal determined by said activity signal, wherein sample images are generated at the temporal positions indicated by said activity signal with said speech content data.

26. An audio/video processing apparatus as claimed in claim 26, wherein said activity signal is indicative of the start of a speech sentence, said speech content data representing text data being generated at the start of the sentence.

27. An audio/video processing apparatus as claimed in claim 26, wherein said activity signal is indicative of a first time a person included in the content of said video signal speaks, said speech content data representing text data generated for the first speech of the person.

28. An audio/video processing apparatus as claimed in claim 26, comprising a reproduction processor which is arranged in operation to receive a recording medium on which said video and said associated audio signals are recorded and to reproduce said audio signals from said recording medium.

33. An audio/video processing apparatus as claimed in claim 26, comprising a communications processor which is arranged in operation to communicate said speech content data.

34. An editing system having a database connected to a communications channel and an audio/video processor as claimed in claim 26, wherein the audio/video processor includes a communications device for communicating the sample images and said speech content data to said database via the communications channel, said sample images being stored in said data base with the speech data.

35. An audio/video processing apparatus as claimed in claim 26, wherein the video processing apparatus comprises:

an image activity detector which is arranged in operation to receive said video signals and to generate an image activity signal indicative of an amount of activity within the images represented by the video signal; and

an image generator coupled to the image activity detector which is arranged in operation to receive said video signal and said image activity signal and to generate sample images at temporal positions within said video signal, which temporal positions are determined from said image activity signal, wherein said image activity signal is representative of a relative amount of activity within the images represented by said video signal and said image detector is arranged in operation to produce more of said sample images during periods of greater activity indicated by said activity signal.

29. An audio/video processing apparatus as claimed in claim 29, wherein said content information generator is arranged in operation to generate, for each of said sample images a material identification representative of a location on said recording medium where the audio signals corresponding to said speech content data are recorded.

30. An audio/video processing apparatus as claimed in claim 30, wherein said speech content data is representative of text corresponding to the content of the speech.

31. An audio/video processing apparatus as claimed in claim 31, comprising a display device for displaying said text.

32. An audio/video processing apparatus as claimed in claim 32, wherein said display device is arranged to display said text with respect to a location on said display device which is representative of a location on said recording medium at which said text is recorded.

36. A method of processing video signals, comprising the steps of:

receiving video signals;

generating an activity signal indicative of an amount of activity within the images represented by the video signal;

generating sample images at temporal positions within said video signal, which temporal positions are determined from said activity signal, wherein said activity signal is representative of a relative amount of activity within the images represented by said video signal, and said generating the sample images comprises;

producing more of said sample images during periods of greater activity indicated by said activity signal.

37. A method of processing video signals which include associated audio signals representative of sound including speech, said method comprising the steps of generating speech data identifying speech detected within said audio signals, generating an activity signal in response to said speech data, and generating sample images from a video signal in response to said activity signal, wherein said generating said speech data comprises generating data representing the content of said speech at temporal positions within said audio signal determined by said activity signal, wherein sample images are generated at the temporal positions indicated by said activity signal with said speech data.

38. A system for editing audio/video productions, comprising:

an ingestion processor having means for receiving a recording medium and being arranged in use to reproduce selectively audio/video material items from said recording medium in response to meta data identifying the selected audio/video material items;

a database operable to receive and to store content meta data describing the contents of said audio/video material items on said recording medium in association with meta data identifying the audio/video material items; and

an editing processor coupled to said ingestion processor and said database, said editing processor having a graphical user interface for displaying a representation of said content meta data stored in said data base and for selecting said audio/video material items from said displayed representation of said content meta data, said editing processor being arranged to combine user selected items of audio/video material, which are selectively reproduced by said ingestion processor in response to the identifying meta data corresponding to said selected items of audio/video material being communicated to said ingestion processor by said editing processor.

39. A system as claimed in claim 39, wherein said editing processor is coupled to said database and said audio/video reproducing apparatus via a data communications network.

43. A system as claimed in claim 39, wherein said identifying meta data includes at least one of UMID, tape ID and time codes, and a Unique Material Reference Number, identifying the material items.

44. A system as claimed in claim 39, wherein said content meta data includes sample images representing the content of the audio/video material items at sample temporal positions within said audio/video material items.

45. A system as claimed in claim 39, wherein said recording medium includes said content metadata describing the content of the audio/video material items recorded on to said recording medium, and said ingestion processor is arranged in operation to reproduce said content meta data and to communicate said content meta data via said network to said database, said database operating to receive and to store said content metadata.

40. A system as claimed in claim 40, wherein said data communications network comprises:

a first communications channel coupled to said editing station, said database and said ingestion processor for communicating said identifying metadata; and

a second communications channel coupled to said editing station, said database and said ingestion processor for communicating said items of audio/video material.

41. A system as claimed in claim 41, wherein said first network interface is arranged to operate in accordance with a data communications network standard selected from the Ethernet, RS 322 and RS 422 standards.

42. A system as claimed in claim 41, wherein said second network interface is arranged to operate in accordance with the Serial Digital Interface (SDI) or the Serial Digital Transport Interface (SDTI).

46. A method of generating an audio/video production by selecting and combining items of content meta data, said method comprising the steps of:

loading a recording medium on which items of audio/video material are recorded into an ingestion processor;

reviewing content meta data describing the content of the audio/video material items on said recording medium; and

consequent upon said review, selecting content meta data corresponding to a desired selection of audio/video material items,

selectively retrieving items of audio/video material from said recording medium to form said audio/video production, in accordance with meta data identifying the selected audio/video material items associated with the content meta data.

47. A method as claimed in claim 47, further comprising the step of loading content metadata describing the content of the audio/video material items into a database;

wherein the step of reviewing the metadata comprises the step of interrogating said database.

48. A method as claimed in claim 48, wherein said content metadata and said identifying metadata are present on said recording medium with said items of audio/video material, and said method comprises the steps of:

ingesting said content meta data and said identifying metadata using said ingestion processor;

communicating said content meta data and said identifying meta data to said database; and

storing said content meta data in association with said identifying meta data in said database.