MULTIMEDIA DATA PROCESSING DEVICE WHICH CAN EASILY PREPARE MULTIMEDIA CONTENTS

• US 20090222489A1
• Filed: 05/08/2009
• Published: 09/03/2009
• Est. Priority Date: 12/12/2002
• Status: Active Grant

• Current Assignee: Junsei Sato, Ryota Yagi, Tatsuo Sudoh
• Original Assignee: Junsei Sato, Ryota Yagi, Tatsuo Sudoh
• Inventors: Sudoh, Tatsuo, Yagi, Ryota, Sato, Junsei
• Granted Patent: US 8,650,477 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/489 using time information

Abstract

A multimedia processing device implements a script having a data structure that is formed of a drawing information describing portion where media data is chronologically described, and a user navigation information describing portion where correspondence between events and actions and implementation conditions are chronologically described. The multimedia processing device implements this script, and thereby, media data is chronologically reproduced, and at the same time, a user interface showing operations that can be chronologically carried out is outputted. Then, a predetermined process, such as an insertion of media data, can be implemented by carrying out the operations following the user interface according to predetermined timing.

Claims

1. A multimedia data processing device, comprising:

a script implementing unit for reproducing data that is referred from a script that is included in a template in accordance with said script;

a user changeable data determining unit for determining a portion changeable by a user among said data that is referred from said script;

a data changing unit for changing said portion changeable; and

a script and data outputting unit for outputting at least either said script or said data changed.

12. The multimedia data processing device according to claim 1 or 2, wherein transition information of the state of reproduction of the media data is described in said template, and said script implementing unit manages the transition of said state of reproduction of said media data.

13. The multimedia data processing device according to claim 12, wherein said script implementing unit carries out said transition of the state of reproduction of media data in accordance with said transition information of the state of reproduction of media data that is described in said template when said action determining unit acquires an event by using said function selected.

14. The multimedia data processing device according to claim 13, wherein said event is a time event that includes at least one of arrival at a predetermined time or running out of a timer.

15. The multimedia data processing device according to claim 1 or 2, wherein transition information of the state of reproduction of media data is described in said template together with time restriction, and said script implementing unit chronologically manages said transition of the state of reproduction of the media data.

16. The multimedia data processing device according to claim 1 or 2, wherein

transition information of the state of reproduction of media data is described in said template, and

said multimedia data processing device further comprises:

a thumbnail generating unit for generating a thumbnail of media data that is included in said template; and

a preview unit for displaying said thumbnail generated on the basis of said transition information.

17. The multimedia data processing device according to claim 1 or 2, further comprising:

a template acquiring unit for acquiring said template that includes said script;

a selecting unit for selecting a desired template from said template acquired; and

a data change confirming unit for confirming said changing in said data.

18. The multimedia data processing device according to claim 17, wherein said template acquiring unit acquires a template that has been stored in a memory device within said multimedia data processing device.

19. The multimedia data processing device according to claim 17, wherein said template acquiring unit acquires a template from another device via a network.

20. The multimedia data processing device according to claim 17, wherein said template acquiring unit acquires a template from a message that has been received via a network.

21. The multimedia data processing device according to claim 1 or 2, further comprising a control unit for controlling said changing in said data in accordance with said script.

22. The multimedia data processing device according to claim 1 or 2, further comprising:

a sequence managing unit for managing a sequence that is described in said script; and

a changeable data proposing unit for showing changeable data in response to said sequence.

23. The multimedia data processing device according to claim 1 or 2, further comprising:

a sequence managing unit for managing the sequence that is described in said script; and

an operation guidance proposing unit for proposing an operation guidance for carrying out data change in response to said sequence.

24. The multimedia data processing device according to claim 23, wherein said script implementing unit further comprises a reproduction time controlling unit for controlling reproduction time of said data changed in accordance with a predetermined rule in the case where an operation of said data change is carried out.

25. The multimedia data processing device according to claim 1 or 2, wherein

said script implementing unit further comprises a media time selecting unit for determining and selecting a portion from said data that is referred from said script where implementation or termination can be carried out, and

said script implementing unit pauses at said portion when implementing said selected portion from among said data.

26. The multimedia data processing device according to claim 25, wherein said portion that is selected by said media time selecting unit is a portion where changeable media data switches.

27. The multimedia data processing device according to claim 26, wherein

said script implementing unit further comprises a sequence changing point determining unit for determining the changing point of the sequence that is the closest in the future from this time, and

said script implementing unit skips the reproduction of said data to said sequence changing point determined next.

28. The multimedia data processing device according to claim 26, wherein

said script implementing unit further comprises a sequence changing point determining unit for determining the changing point of the sequence that is the closest in the future from this time, and

said script implementing unit skips the reproduction of said data to said sequence changing point determined closest past.

29. The multimedia data processing device according to claim 1 or 2, wherein the start portion or the end portion of a changed section of said data is added to a predetermined portion of said data in the case where the operation of said data change is carried out.

30. The multimedia data processing device according to claim 1 or 2, wherein the script and data outputting unit deletes at least a portion of one of said script that is included in said template and said data that is referred from said script before outputting.

31. The multimedia data processing device according to claim 30, wherein at least one of said script that is included in said template and said data that is referred from said script is written in XML (Extensible Markup Language), and said script and data outputting unit deletes said data that is referred from said script in response to the description of a predetermined tag.

32. The multimedia data processing device according to claim 1 or 2, wherein said script and data outputting unit outputs at least one of said script and said data changed to a memory device inside said multimedia data processing device.

33. The multimedia data processing device according to claim 1 or 2, wherein said script and data outputting unit outputs at least one of said script and said data changed to another device via a network.

34. The multimedia data processing device according to claim 33, which outputs at least one of said script and said data changed.

35. The multimedia data processing device according to claim 33, wherein said script and data outputting unit outputs at least one of said script and said data changed to said other device by using MMS (Multimedia Messaging Service).

2. A multimedia data processing device, comprising:

a script implementing unit for reproducing data that is referred from a script that is included in a template in accordance with said script;

a function selecting unit for selecting a function of said multimedia data processing device in accordance with said script that is included in said template;

an action determining unit for determining which process is to be carried out on the data that is referred from said script by using said function selected in accordance with said script that is included in said template;

an action implementing unit for implementing said process determined;

a data changing unit for changing said data that is referred from said script; and

a script and data outputting unit for outputting at least either said script or said data changed.

3. The multimedia data processing device according to claim 2, wherein time restriction for determining an action that is carried out on said data that is referred from said script is described in said template, and said action implementing unit carries out said process determined in accordance with said time restriction.

4. The multimedia data processing device according to claim 2, wherein said action determining unit acquires data that includes any pieces of data from among still image data, animated image data, sound data and position information data that is acquired by means of a GPS (global positioning system) or the like by using said function selected, and determines which process is to be carried out on said data that is referred from said script by using said data acquired.

5. The multimedia data processing device according to claim 2, wherein said action determining unit acquires data via a network by using said function selected, and determines whish process is to be carried out on said data that is referred from said script by using said data acquired.

6. The multimedia data processing device according to claim 2, wherein said determined process that is carried out in said action implementing unit is a process for accessing a predetermined WEB page.

7. The multimedia data processing device according to claim 2, wherein said process determined that is carried out in said action implementing unit is a process for calling a predetermined telephone number.

8. The multimedia data processing device according to claim 2, wherein

said action implementing unit is characterized by acquiring data by using said function selected and by carrying out a conversion process on said data acquired in accordance with environmental information that includes any of specifications and conditions of said function selected, said template, and data that has been acquired by using said function selected, and

said conversion process in accordance with said environmental information includes deletion of an amount of data in accordance with the restriction of memory capacity and conversion of the screen size, reduction in the number of colors or coordination of data formats in accordance with the display device or the results of analysis of said multimedia data.

9. The multimedia data processing device according to claim 2, wherein

said action implementing unit is characterized by acquiring data by using said function selected and by carrying out a conversion process on said data acquired in accordance with environmental information that includes any of specifications and conditions of said function selected, said template, and data that has been acquired by using said function selected, and

said conversion process in accordance with said environmental information is a process for converting said data acquired to predetermined alternative data.

10. The multimedia data processing device according to claim 2, wherein said action implementing unit acquires data by using said function selected and determines whether or not the usage of said data acquired is required in accordance with environmental information that includes any of specifications and conditions of said function selected, said template, and data that has been acquired by using said function selected.

11. The multimedia data processing device according to claim 2, wherein said action implementing unit carries any of carrying out said process after noticing that said process is to be carried out via a user interface, accepting confirmation that said process is to be carried out, and accepting selection whether or not said process is to be carried out immediately before said process determined is carried out.

36. A multimedia data processing device, comprising:

a template list acquiring unit for acquiring a list of templates that have been formed so as to include scripts where a predetermined action that requires to be carried out by another device on the receiving side and time information for when said action is required are described;

a template list displaying unit for displaying said list of templates;

a template selecting unit for selecting one or more desired template from said list of displayed templates; and

a message transmitting unit for transmitting said template selected to said another device as a message.

37. The multimedia data processing device according to claim 36, wherein said script is characterized by including at least one of reference information to reproduced data, a method for reproducing said data, and action information for specifying the function that is to be carried out in the terminal for reproducing said data.

38. The multimedia data processing device according to claim 37, wherein said action information specifies at least one function from among a video or still image taking function, a function of acquiring text information inputted by a user, a sound recording function, a function of acquiring position information, and a function of acquiring data.

39. The multimedia data processing device according to claim 36, further comprising a script implementing unit for reproducing said data that is referred from a script in accordance with said script.

40. The multimedia data processing device according to claim 36, further comprising a communication interlocutor function acquiring unit for acquiring the function of a communication interlocutor apparatus, wherein

said template list acquiring unit acquires a list of templates that can be implemented using said function that is included in said function acquired of said communication interlocutor apparatus.

41. The multimedia data processing device according to claim 36, further comprising a communication interlocutor function acquiring unit for acquiring the function of a communication interlocutor apparatus, wherein

said template list displaying unit displays a list of templates that can be implemented using said function that is included in said function acquired of said communication interlocutor apparatus.

42. A multimedia data processing device, comprising:

a template acquiring unit for acquiring a template that has been formed so as to include a script;

a program acquiring unit for acquiring a program from a broadcasting station;

a contents acquiring unit for acquiring internet contents which are provided via the internet; and

a script implementing unit for reproducing at least one of data that is referred from said script, said program that has been acquired by said program acquiring unit, and said internet contents that have been acquired by said contents acquiring unit in accordance with said script that is included in said template in a position on the screen and according to timing which are designated by said script.

43. The multimedia data processing device according to claim 42, wherein

said template includes program list information,

said multimedia data processing device further comprises a reproduction data selecting unit for selecting one or more program or internet contents on the basis of said program list information, and

said script implementing unit reproduces said program or said internet contents selected.

44. A multimedia data processing program product for allowing a computer to carry out the process of a template that has been formed so as to include a script, which allows the computer to carry out:

the script implementing step of reproducing data that is referred from said script that is included in said template in accordance with said script;

the user changeable data determining step of determining a portion that can be changed by a user from among said data that is referred from said script;

the data changing step of changing said portion changeable by using a function of a multimedia data processing device; and

the script and data outputting step of outputting at least one of said script and said data changed.

47. The multimedia data processing program product according to claim 44 or 45, wherein transition information of the state of reproduction of media data is described in said template, and said transition of the state of reproduction of media data is managed in said script implementing step.

48. The multimedia data processing program product according to claim 44 or 45, wherein transition information of the state of reproduction of media data is described in said template together with time restriction, and said transition of the state of reproduction of media data is chronologically managed in said script implementing step.

49. The multimedia data processing program product according to claim 44 or 45, wherein

transition information of the state of reproduction of media data is described in said template, and

the multimedia data processing program further allows the computer to carry out:

the thumbnail generating step of generating a thumbnail of media data that is included in said template; and

the preview step of displaying said thumbnail generated on the basis of said transition information.

50. The multimedia data processing program product according to claim 44 or 45, which further allows the computer to carry out:

the template acquiring step of acquiring said template that includes said script;

the selecting step of selecting a desired template from said acquired template; and

the data change confirming step of confirming said changing in said data.

51. The multimedia data processing program product according to claim 44 or 45, which further allows the computer to carry out the restricting step of restricting said changing in said data in accordance with said script.

52. The multimedia data processing program product according to claim 44 or 45, which further allows the computer to carry out:

the sequence managing step of managing a sequence that is described in said script; and

the changeable data proposing step of proposing changeable data in response to said sequence.

53. The multimedia data processing program product according to claim 44 or 45, which further allows the computer to carry out:

the sequence managing step of managing a sequence that is described in said script; and

the operation guidance proposing step of proposing an operation guidance for carrying out data change in response to said sequence.

54. The multimedia data processing program product according to claim 53, which further allows the computer to carry out the reproduction time controlling step of controlling the reproduction time of said data changed in accordance with a predetermined rule in said script implementing step in the case where an operation of said data change is carried out.

55. The multimedia data processing program product according to claim 44 or 45, which further allows the computer to carry out:

the media time selecting step of determining and selecting a portion of said data that is referred from said script where implementation or termination can be carried out in said script implementing step; and

said portion is paused when implementing said portion selected of said data in said script implementing step.

56. The multimedia data processing program product according to claim 55, wherein said portion that is selected in said media time selecting step is a portion where changeable media data switches.

57. The multimedia data processing program product according to claim 56, which further allows the computer to carry out:

the sequence change selecting step of determining a sequence changing point that is the closest in the future from this time in said script implementing step; and

the reproduction of said data is skipped to said sequence changing point determined next in said script implementing step.

58. The multimedia data processing program product according to claim 56, which further allows the computer to carry out:

the sequence change selecting step of determining a sequence changing point that is the closest in the past from this time in said script implementing step; and

the reproduction of said data is skipped to said sequence changing point determined closest past in said script implementing step.

59. The multimedia data processing program product according to claim 44 or 45, wherein the start portion or the end portion of the changed section of said data is added to a predetermined portion of said data in the case where an operation of said data change is carried out.

45. A multimedia data processing program product for allowing a computer to carry out the process of a template that has been formed so as to include a script, which allows the computer to carry out:

the script implementing step of reproducing data that is referred from said script that is included in said template in accordance with said script;

the terminal function selecting step of selecting a function of a multimedia data processing device in accordance with said script that is included in said template;

the action determining step of determining which process is to be carried out for said data that is referred from said script by using said function selected;

the action implementing step of implementing said process determined;

the data changing step of changing said data that is referred from said script; and

the script and data outputting step of outputting at least one of said script and said data changed.

46. The multimedia data processing program product according to claim 45, wherein time restriction for determining an action that is carried out on said data that is referred from said script is described in said template, and said action implementing unit carries out said determined process in accordance with said time restriction.