Multimedia data pre-processing on idle core by detecting multimedia data in application

• US 9,372,720 B2
• Filed: 12/06/2011
• Issued: 06/21/2016
• Est. Priority Date: 01/18/2011
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd., Seoul National University R&DB Foundation (Seoul National University)
• Original Assignee: Samsung Electronics Co. Ltd., Seoul National University R&DB Foundation (Seoul National University)
• Inventors: Jung, Dong-Heon, Moon, Soo-Mook, Sihn, Kue-Hwan
• Primary Examiner(s): GHAFFARI, ABU Z
• Application Number:
  US13/311,670
• Publication Number:
  US 20120185869A1
• Time in Patent Office: 1,659 Days
• Field of Search: 718/104, 718/105, 370/468, 379/265.09, 379/908, 348/5, 348/8, 707/913, 707/E17.009, 707/999.107
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3404 for parallel or distributed programming
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 9/3818 Decoding for concurrent execution
• CPC Class Codes: G06F 9/3822 Parallel decoding, e.g. parallel decode units
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06V 40/1347 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/382 Preprocessing; Feature extraction

Abstract

A multimedia data preprocessing apparatus for a virtual machine is provided. The multimedia data preprocessing apparatus includes a detection unit configured to detect multimedia data included in an application, a generation unit configured to generate a thread for processing the detected multimedia data, and an allocation unit configured to allocate the generated thread to an idle core.

Claims

1. A multimedia data preprocessing apparatus comprising:

a multicore device comprising a first processing core and a second processing core, the first processing core being configured to execute an application; and

at least one processor configured to implement

a detector configured to detect multimedia data included in the application, to detect a multimedia data attribute from either a metadata or a code of the application based on the detected multimedia data, and to acquire the multimedia data included in the application corresponding to the detected multimedia data attribute,

a generator configured to generate a thread configured to process the detected multimedia data, and

an allocator configured to allocate the generated thread to the second processing core during the execution of the application in response to the second processing core becoming idle so that the thread is executed by the second processing core in advance of the application using the detected multimedia data,

wherein the generated thread is configured to determine if the multimedia data requires preprocessing, and the generated thread returns the preprocessed multimedia data to the application.

2. The multimedia data preprocessing apparatus of claim 1, wherein the generated thread decodes the detected multimedia data into code that would be processed by the application.

3. The multimedia data preprocessing apparatus of claim 1, wherein the generated thread loads multimedia data corresponding to the detected multimedia data attribute and decodes the loaded multimedia data into the code that would be processed by the application.

4. The multimedia data preprocessing apparatus of claim 1, further comprising a data store configured to store processed multimedia data obtained by processing the detected multimedia data based on the generated thread.

5. The multimedia data preprocessing apparatus of claim 4, wherein the data store is configured to store the processed multimedia data in a data structure that would be used in the application.

6. The multimedia data preprocessing apparatus of claim 4, wherein in response to an execution of the application being complete, the data store is configured to delete the stored multimedia data.

7. The multimedia data preprocessing apparatus of claim 1, wherein the detected multimedia data comprises at least one of video data, audio data, image data, and text data.

8. The multimedia data preprocessing apparatus of claim 1, wherein in response to an execution of the application being complete, the allocator is configured to remove the thread allocated to the idle core.

9. A multimedia data preprocessing method comprising:

executing an application in a first processing core of a multicore device;

detecting multimedia data included in the application, to detect a multimedia data attribute from either a metadata or a code of the application based on the detected multimedia data, and to acquire the multimedia data included in the application corresponding to the detected multimedia data attribute;

generating a thread configured to process the detected multimedia data; and

allocating the generated thread to a second processing core of the multicore device during the execution of the application in response to the second processing core becoming idle so that the thread is executed by the second processing core in advance of the application using the detected multimedia data,

wherein the generated thread is configured to determine if the multimedia data requires preprocessing, and the generated thread returns the preprocessed multimedia data to the application.

10. The multimedia data preprocessing method of claim 9, further comprising determining whether the detected multimedia data is decoded.

11. The multimedia data preprocessing method of claim 9, wherein the generated thread loads multimedia data corresponding to the detected multimedia data attribute and decodes the loaded multimedia data into the code that would be processed by the application.

12. The multimedia data processing method of claim 9, further comprising storing processed multimedia data obtained by processing the detected multimedia data using the generated thread.

13. The multimedia data preprocessing method of claim 9, wherein the detected multimedia data comprises at least one of video data, audio data, image data, and text data.

14. A multimedia data preprocessing method comprising:

executing an application in a first processing core of a multicore device;

detecting multimedia data included in the application, to detect a multimedia data attribute from either a metadata or a code of the application based on the detected multimedia data, and to acquire the multimedia data included in the application corresponding to the detected multimedia data attribute;

generating a thread to decode the detected multimedia data;

allocating the generated thread to a second processing core of the multicore device during the execution of the application in response to the second processing core becoming idle so that the thread is executed by the second processing core in advance of the application using the detected multimedia data;

receiving a call for decoded multimedia data from the application;

determining whether the multimedia data is decoded; and

in response to the multimedia data being decoded, returning the decoded multimedia data to the first processing core,

wherein the generated thread is configured to determine if the multimedia data requires preprocessing, and the generated thread returns the preprocessed multimedia data to the application.

15. A multimedia data preprocessing apparatus comprising:

a multicore device comprising a first processing core and a second processing core, the first processing core being configured to execute an application; and

at least one processor configured to implement

a generator configured to generate a thread configured to process multimedia data included in the application,

an allocator configured to allocate the generated thread to the second processing core during the execution of the application in response to the second processing core becoming idle so that the thread is executed by the second processing core in advance of the application using the multimedia data included in the application, and

a detector configured to detect the multimedia data included in the application from the generated thread, to detect a multimedia data attribute from either a metadata or a code of the application based on the detected multimedia data, and to acquire the multimedia data included in the application corresponding to the detected multimedia data attribute,

wherein the generated thread is configured to determine if the multimedia data requires preprocessing, and the generated thread returns the preprocessed multimedia data to the application.