Multimedia information retrieval system and method including format conversion system and method

• US 6,463,445 B1
• Filed: 09/30/1999
• Issued: 10/08/2002
• Est. Priority Date: 08/27/1999
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Regents of the University of California (University of California)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Suzuki, Teruhiko, Yagasaki, Yoichi
• Primary Examiner(s): Trammell, James P.
• Assistant Examiner(s): CHEUNG, MARY DA ZHI WANG
• Application Number:
  US09/410,185
• Time in Patent Office: 1,104 Days
• Field of Search: 707/200, 707/203, 375/240.01, 375/240-3-2, 375/240-8-2
• US Class Current: 1/1
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/64784 Data processing by the network data processing in packet switching systems H04L12/56; flow control in packet networks H04L47/10; intermediate storage or scheduling H04L49/90; provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A multimedia information retrieval system and method including a method and system for automatic format conversion. The invention includes a data structure that is associated with each multimedia bitstream. The data structure identifies the encoding format, e.g., compression technique, used in the multimedia bitstream which is originated by a contents server. An automatic format conversion process then queries information from the client system (requester) and also receives the data structure identifying the encoding format. The client information identifies the decoding format. The automatic format conversion determines the transcoding process required for converting the bitstream from its encoded format to the format recognized by the client system. The format conversion process of the present invention also determines whether or not decoding is required before transcoding is performed thereby saving processing time and computer resources in those cases where decoding is not required. Moreover, the format conversion process also automatically determines the computer memory size required to perform the transcoding process thereby saving computer memory resources. The format converter can be implemented in software as an application and can also be integrated within a data access server. The data access server can be integrated within the client system or within the contents server. The format converter of the invention is particularly useful for electronic devices coupled in a communication network where the encoding format of the sender may not be compatible with the decoding format of the receiver, thereby requiring transcoding between the formats.

Claims

1. A method for processing multimedia information comprising the steps of:

a) responsive to a request signal from a client, accessing a portion of encoded multimedia information from a database storing encoded multimedia information;

b) accessing contents information describing an encoding format of said portion of encoded multimedia information and accessing client information describing a decoding format of said client; and

c) automatically transcoding said portion of encoded multimedia information to generate transcoded multimedia information based on said contents and client information, wherein said transcoded multimedia information is compatible with said decoding format of said client.

2. A method as described in claim 1 wherein said step c) comprises the steps of:

c1) based on said contents and client information, automatically determining whether or not decoding is required of said portion of encoded multimedia information;

c2) provided decoding is required, automatically determining memory resources required to decode said portion of encoded multimedia information;

c3) provided decoding is required, decoding said portion of encoded multimedia information to produce decoded multimedia information; and

c4) based on said contents and client information, transcoding said decoded multimedia information to provide said transcoded multimedia information.

3. A method as described in claim 1 wherein said step c) comprises the steps of:

c1) based on said contents and client information, automatically determining that decoding is not required of said portion of encoded multimedia information; and

c2) based on said contents and client information, transcoding said encoded multimedia information to provide said transcoded multimedia information.

4. A method as described in claim 1 further comprising the step of d) transmitting said transcoded multimedia information to said client.

5. A method as described in claim 1 wherein said step a) comprises the step of receiving said client information from said client and wherein said portion of encoded multimedia information is a digital bitstream.

6. A method as described in claim 1 wherein said contents information comprises picture type information indicative of encoded picture types within said portion of encoded multimedia information.

7. A method as described in claim 6 wherein said picture type information comprises a flag for I-pictures, a flag for P-pictures and a flag for B-pictures.

8. A method as described in claim 6 wherein said contents information further comprises picture structure information indicative of a type of structure used in said portion of encoded multimedia information.

9. A method as described in claim 6 wherein said contents information further comprises motion compensation information indicative of a type of motion compensation used in said portion of encoded multimedia information.

10. A method as described in claim 9 wherein said motion compensation information comprises frame and field motion compensation flags.

11. A method as described in claim 6 wherein said contents information further comprises discrete cosine transform (DCT) information indicative of a type of DCT coefficients used in said portion of encoded multimedia information.

12. A method as described in claim 11 wherein said DCT information comprises frame and field DCT flags.

13. An electronic system comprising:

a processor coupled to a bus; and

a memory coupled to said bus, wherein said memory comprises instructions stored thereon that implement a method for processing multimedia information comprising the steps of;

a) responsive to a request signal from a client, accessing a portion of encoded multimedia information from a database storing encoded multimedia information;

b) accessing contents information describing an encoding format of said portion of encoded multimedia information and accessing client information describing a decoding format of said client; and

c) automatically transcoding said portion of encoded multimedia information to generate transcoded multimedia information based on said contents and client information, wherein said transcoded multimedia information is compatible with said decoding format of said client.

14. An electronic system as described in claim 13 wherein said step c) comprises the steps of:

c1) based on said contents and client information, automatically determining whether or not decoding is required of said portion of encoded multimedia information;

c2) provided decoding is required, automatically determining memory resources required to decode said portion of encoded multimedia information;

c3) provided decoding is required, decoding said portion of encoded multimedia information to produce decoded multimedia information; and

c4) based on said contents and client information, transcoding said decoded multimedia information to provide said transcoded multimedia information.

15. An electronic system as described in claim 13 wherein said step c) comprises the steps of:

c1) based on said contents and client information, automatically determining that decoding is not required of said portion of encoded multimedia information; and

c2) based on said contents and client information, transcoding said encoded multimedia information to provide said transcoded multimedia information.

16. An electronic system as described in claim 13 wherein said method further comprises the step of d) transmitting said transcoded multimedia information to said client.

17. An electronic system as described in claim 13 wherein said step a) comprises the step of receiving said client information from said client and wherein said portion of encoded multimedia information is a digital bitstream.

18. An electronic system as described in claim 13 wherein said contents information comprises picture type information indicative of encoded picture types within said portion of encoded multimedia information.

19. An electronic system as described in claim 18 wherein said picture type information comprises a flag for I-pictures, a flag for P-pictures and a flag for B-pictures.

20. An electronic system as described in claim 18 wherein said contents information further comprises picture structure information indicative of a type of structure used in said portion of encoded multimedia information.

21. An electronic system as described in claim 18 wherein said contents information further comprises motion compensation information indicative of a type of motion compensation used in said portion of encoded multimedia information.

22. An electronic system as described in claim 21 wherein said motion compensation information comprises frame and field motion compensation flags.

23. An electronic system as described in claim 18 wherein said contents information further comprises discrete cosine transform (DCT) information indicative of a type of DCT coefficients used in said portion of encoded multimedia information.

24. An electronic system as described in claim 23 wherein said DCT information comprises frame and field DCT flags.

25. A multimedia system comprising:

a client system;

a multimedia contents server containing encoded multimedia information and contents information describing said multimedia information; and

a data access server coupled to said client system and to said multimedia contents server and responsive to a request signal from said client system for accessing a portion of encoded multimedia information from said multimedia contents server and for accessing contents information describing an encoding format of said portion of encoded multimedia information and accessing client information describing a decoding format of said client system, said data access server also for automatically transcoding said portion of encoded multimedia information to generate transcoded multimedia information based on said contents and client information wherein said transcoded multimedia information is compatible with said decoding format of said client system.

26. A system as described in claim 25 wherein said data access server comprises:

a transcoding manager that, based on said contents and client information, automatically determines whether or not decoding is required of said portion of encoded multimedia information and, provided decoding is required, automatically determines memory resources required to decode said portion of encoded multimedia information; and

a transcoder that, provided decoding is required, decodes said portion of encoded multimedia information to produce decoded multimedia information and based on said contents and client information and further transcodes said decoded multimedia information to provide said transcoded multimedia information.

27. A multimedia system as described in claim 25 wherein said contents information comprises picture type information indicative of encoded picture types within said portion of encoded multimedia information.

28. A multimedia system as described in claim 27 wherein said contents information further comprises picture structure information indicative of a type of structure used in said portion of encoded multimedia information.

29. A multimedia system as described in claim 28 wherein said contents information further comprises motion compensation information indicative of a type of motion compensation used in said portion of encoded multimedia information.