Multimedia personal historical information system and method

• US 9,742,753 B2
• Filed: 07/14/2014
• Issued: 08/22/2017
• Est. Priority Date: 07/12/2013
• Status: Expired due to Fees

• Current Assignee: HJ Holdings LLC (Nippon Television Holdings, Inc.)
• Original Assignee: HJ Holdings LLC (Nippon Television Holdings, Inc.)
• Inventors: Talley, Patrick L.
• Primary Examiner(s): Holmes, Michael B
• Application Number:
  US14/331,209
• Publication Number:
  US 20150020170A1
• Time in Patent Office: 1,135 Days
• Field of Search: 706 14
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/306 User profiles

Abstract

Disclosed is a mobile and web-based personal history capture-store-retrieval process and system intended to be used by individuals or groups (including companies and educational institutions) to record personal historical information in multimedia file format from any source, such as the individual'"'"'s smartphone, tablet, or personal computer. The system will assist individuals in the recording and storage and retrieval of the individual'"'"'s (or group'"'"'s) personal histories. The system employs an artificial intelligence engine to analyze user content (e.g., information, data, metadata, and historical content associated with such user) and design prompts to the user to input additional information. The system also provides a method for creating an e-book from the content, either by a single user or by collaboration among multiple users. Disclosed also is a computer implemented method and system and related computer program product for capturing, storing, retrieving and disseminating personal and/or group legacy and history information.

Claims

1. A multimedia method of capturing, storing, retrieving and disseminating personal and/or group legacy and history information comprising the steps of:

a. providing a secure technology-based platform for access by authorized users over a network;

b. providing a mobile and web-based or mobile-app-based graphical user interface, whereby an individual and/or group user(s), via multiple media (video, audio, photographic, text or combinations thereof), can record, store, retrieve and/or disseminate content in an ad hoc or prompted manner via a mobile and web-based or mobile-app-based multimedia computer device;

c. providing server or cloud-based storage to store such content;

d. providing multiple options to such user(s) for retrieving such content, including, email, direct download, DVD, e-book reader, or mailed storage media;

e. providing audio/video-to-text transcription of such recorded content; and

f. providing the user with the option to authorize dissemination of such content to authorized designees via email, direct download, DVD, e-book reader, mailed storage media and/or social media platforms;

wherein said graphical user interface further comprises

a log-in process module for accessing a secure computer technology-based software platform for use by one or more authorized users over a computer network using one or more of the multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

an auto question prompt module for prompting the user with a series of questions, one or more visual content images, audio files, music files, and/or one or more visual content videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content;

a tell a story process module for creating a recorded audio visual story capable of being played back by the one or more users by permitting the one or more users to access previously existing multimedia content available to the one or more computer devices, to review the new or previously existing content from the one or more computer devices from within the platform, to edit the new or previously existing content from the one or more computer devices from within the platform, and/or to delete the new or previously existing content from the one or more computer devices;

wherein the step of editing the preexisting one or more visual content images and/or one or more visual content videos comprises selecting the desired visual content for display within the audio visual story, recording any desired audio content to accompany any of such selected visual content, such audio content being tied to such respective visual content so that such audio content becomes audible when such selected visual content is displayed during the playback of the recorded story;

a save a story process module for permitting the one or more users to store the recorded content on the one or more computer devices, a platform server or a platform cloud-based storage system; and

a share a story process module for permitting the one or more users to share the recorded content with others.

2. The method of claim 1 wherein the user content comprises information, data, metadata, and historical content associated with such user.

3. The method of claim 2 wherein the user is prompted by the platform to provide content.

4. The method of claim 3 wherein the platform prompts the user with a series of questions, images, audio files, music files, narratives or videos pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content.

5. The method of claim 2 further comprising the step of providing an artificial intelligence engine to analyze the specific user content.

6. The method of claim 5 wherein the artificial intelligence engine analyzes specific user content, data and metadata, to design prompts to the user, the method further comprising the step of prompting the user with such designed prompts.

29. The method of claim 1 wherein the audio editing comprises voice narration or commentary, singing a song or music.

30. The method of claim 1 wherein the recorded audio visual story is recorded as a slide show presentation wherein the presentation may be played on a presentation device where the presentation of slides proceeds from one slide to another slide manually or automatically.

7. A multimedia system for capturing, storing, retrieving and disseminating personal and/or group legacy and history information comprising:

a. a secure technology-based platform for access by authorized users;

b. a mobile and web-based or mobile-app-based graphical user interface, whereby an individual and/or group user(s), via multiple media (video, audio, photographic, text or combinations thereof), can record, store, retrieve and/or disseminate content in an ad hoc or prompted manner via a mobile and web-based or mobile-app-based multimedia computer device;

c. server or cloud-based storage to store such content;

d. interfaces to provide multiple options to such user(s) for retrieving such content, including, email, direct download, DVD, e-book reader, or mailed storage media;

e. audio/video-to-text transcription engine for converting audio in such recorded content to text;

f. sharing protocol to provide the user with the option to authorize dissemination of such content to authorized designees via email, direct download, DVD, e-book reader, mailed storage media and/or social media platforms; and

g. an artificial intelligence engine for analyzing the specific user content;

wherein said graphical user interface further comprises

a log-in process module for accessing a secure computer technology-based software platform for use by one or more authorized users over a computer network using one or more of the multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

an auto question prompt module for prompting the user with a series of questions, one or more visual content images, audio files, music files, and/or one or more visual content videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content;

a tell a story process module for creating a recorded audio visual story capable of being played back by the one or more users by permitting the one or more users to access previously existing multimedia content available to the one or more computer devices, to review the new or previously existing content from the one or more computer devices from within the platform, to edit the new or previously existing content from the one or more computer devices from within the platform, and/or to delete the new or previously existing content from the one or more computer devices;

wherein the step of editing the preexisting one or more visual content images and/or one or more visual content videos comprises selecting the desired visual content for display within the audio visual story, recording any desired audio content to accompany any of such selected visual content, such audio content being tied to such respective visual content so that such audio content becomes audible when such selected visual content is displayed during the playback of the recorded story;

a save a story process module for permitting the one or more users to store the recorded content on the one or more computer devices, a platform server or a platform cloud-based storage system; and

a share a story process module for permitting the one or more users to share the recorded content with others.

31. The multimedia system of claim 7 wherein the audio editing comprises voice narration or commentary, singing a song or music.

32. The multimedia system of claim 7 wherein the recorded audio visual story is recorded as a slide show presentation wherein the presentation may be played on a presentation device where the presentation of slides proceeds from one slide to another slide manually or automatically.

8. A computer implemented multimedia method of capturing, storing, retrieving and disseminating personal and/or group legacy and history information comprising the steps of:

a. providing a secure computer technology-based software platform for access by one or more authorized users over a computer network using one or more multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

b. providing a graphical user interface for use by the one or more users with the one or more multimedia computer devices for interfacing with the platform over the network;

c. interfacing the one or more computer devices with the platform;

d. providing the ability within the platform for the one or more users to record new multimedia content from the one or more computer devices;

e. providing the ability within the platform for the one or more users to access previously existing multimedia content available to the one or more computer devices;

f. providing the ability for the one or more users to review or play back the new or previously existing content from the one or more computer devices from within the platform;

g. providing the ability for the one or more users to edit the new or previously existing content from the one or more computer devices from within the platform;

h. providing the ability for the one or more users to delete the new or previously existing content from the one or more computer devices;

i. providing a platform server or platform cloud-based storage system for use by the one or more users for storing the recorded content within the platform;

j. storing the recorded content onto the platform server or platform cloud-based storage; and

k. providing the one or more users with the ability to retrieve the stored content from the platform server or platform cloud-based storage;

wherein said graphical user interface further comprises

a log-in process module for accessing a secure computer technology-based software platform for use by one or more authorized users over a computer network using one or more multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

an auto question prompt module for prompting the user with a series of questions, one or more visual content images, audio files, music files, and/or one or more visual content videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content;

a tell a story process module for creating a recorded audio visual story capable of being played back by the one or more users by permitting the one or more users to access previously existing multimedia content available to the one or more computer devices, to review the new or previously existing content from the one or more computer devices from within the platform, to edit the new or previously existing content from the one or more computer devices from within the platform, and/or to delete the new or previously existing content from the one or more computer devices;

wherein the step of editing the preexisting one or more visual content images and/or one or more visual content videos comprises selecting the desired visual content for display within the audio visual story, recording any desired audio content to accompany any of such selected visual content, such audio content being tied to such respective visual content so that such audio content becomes audible when such selected visual content is displayed during the playback of the recorded story;

a save a story process module for permitting the one or more users to store the recorded content on the one or more computer devices, a platform server or a platform cloud-based storage system; and

a share a story process module for permitting the one or more users to share the recorded content with others.

9. The method of claim 8 wherein the platform prompts the user with a series of questions, images, audio files, music files, and/or videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content.

10. The method of claim 9 wherein the prompt is generated automatically by the system.

11. The method of claim 9 wherein the system provides the user with the ability to request the prompt.

12. The method of claim 9 wherein the questions, images, audio files, music files and/or videos are randomly selected by the platform.

13. The method of claim 9 wherein the questions, images, audio files, music files and/or videos are submitted by other platform users.

14. The method of claim 9 further comprising the step of providing an artificial intelligence engine to analyze the specific user content, wherein the artificial intelligence engine analyzes specific user content, user data and user metadata, to design prompts to the user, the method further comprising the step of prompting the user with such designed prompts.

15. The method of claim 8 wherein the users retrieve the stored content from the platform storage via direct interface with the platform, by email, by direct download, by DVD, by e-book reader, or by mailed storage media.

16. The method of claim 8 further comprising the step of providing the user with the ability to authorize dissemination of the stored recorded content to authorized designees via email, direct download, DVD, e-book reader, mailed storage media and/or social media platforms.

17. The method of claim 8 further comprising the step of providing audio/video-to-text transcription of such recorded content.

18. The method of claim 8 further comprising the step of further providing an e-book creation system;

and an e-book creation system interface to permit the one or more users to import recorded content from the platform into the e-book creation system for use in creating an e-book.

19. The method of claim 18 comprising the further steps of:

sharing the e-book creation system with other permitted users;

permitting the other permitted users to collaborate in creating a jointly created e-book using recorded content from within the platform or recorded content that the other permitted users import into the platform;

editing the jointly created e-book as desired;

saving the jointly created e-book; and

sharing the jointly created e-book.

20. The method of claim 8 wherein the multimedia computer devices are selected from the group consisting of smartphones, tablets, personal computers, and laptops.

21. The method of claim 8 wherein the graphical user interface is mobile-based and web-based or mobile-app-based.

33. The computer implemented multimedia method of claim 8 wherein the audio editing comprises voice narration or commentary, singing a song or music.

34. The computer implemented multimedia method of claim 8 wherein the recorded audio visual story is recorded as a slide show presentation wherein the presentation may be played on a presentation device where the presentation of slides proceeds from one slide to another slide manually or automatically.

22. A computer implemented multimedia system for capturing, storing, retrieving and disseminating personal and/or group legacy and history information comprising:

a. a processor and memory;

b. a secure computer technology-based software platform embodied on one or more computer-readable medium for access by authorized users using one or more multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

c. a graphical user interface embodied on one or more computer-readable medium for use by the one or more users with the one or more multimedia computer devices for interfacing with the platform over the network;

d. an interface embodied on the one or more computer-readable medium for the one or more users to record new multimedia content from the one or more computer devices;

e. an interface embodied on the one or more computer-readable medium for the one or more users to access previously existing multimedia content available to the one or more computer devices;

f. an interface embodied on the one or more computer-readable medium for the one or more users to review the new or previously existing content from the one or more computer devices from within the platform;

g. an interface embodied on the one or more computer-readable medium for the one or more users to edit the new or previously existing content from the one or more computer devices from within the platform;

h. an interface embodied on the one or more computer-readable medium for the one or more users to delete the new or previously existing content from the one or more computer devices;

i. a platform server or platform cloud-based storage system embodied on one or more computer-readable medium for use by the one or more users for storing the recorded content within the platform; and

j. an interface embodied on the one or more computer-readable medium providing the one or more users with the ability to retrieve the stored content from the platform server or platform cloud-based storage;

wherein said graphical user interface further comprises

a log-in process module for accessing a secure computer technology-based software platform for use by one or more authorized users over a computer network using one or more multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

an auto question prompt module for prompting the user with a series of questions, one or more visual content images, audio files, music files, and/or one or more visual content videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content;

a tell a story process module for creating a recorded audio visual story capable of being played back by the one or more users by permitting the one or more users to access previously existing multimedia content available to the one or more computer devices, to review the new or previously existing content from the one or more computer devices from within the platform, to edit the new or previously existing content from the one or more computer devices from within the platform, and/or to delete the new or previously existing content from the one or more computer devices;

wherein the step of editing the preexisting one or more visual content images and/or one or more visual content videos comprises selecting the desired visual content for display within the audio visual story, recording any desired audio content to accompany any of such selected visual content, such audio content being tied to such respective visual content so that such audio content becomes audible when such selected visual content is displayed during the playback of the recorded story;

a save a story process module for permitting the one or more users to store the recorded content on the one or more computer devices, a platform server or a platform cloud-based storage system; and

a share a story process module for permitting the one or more users to share the recorded content with others.

23. The system of claim 22 further comprising an artificial intelligence engine embodied on the one or more computer-readable medium for analyzing the specific user content within the platform.

35. The computer implemented multimedia system of claim 22 wherein the audio editing comprises voice narration or commentary, singing a song or music.

36. The computer implemented multimedia system of claim 22 wherein the recorded audio visual story is recorded as a slide show presentation wherein the presentation may be played on a presentation device where the presentation of slides proceeds from one slide to another slide manually or automatically.

24. A computer program product embodied on one or more non-transitory computer-readable media, said computer program product adapted to be executed to implement a method of capturing, storing, retrieving and disseminating personal and/or group legacy and history information, said method comprising providing a computer-implemented system, wherein the computer implemented system comprises distinct software modules on the one or more computer-readable medium, and wherein the distinct software modules comprise:

a. a log-in process module for accessing a secure computer technology-based software platform for use by one or more authorized users over a computer network using one or more multimedia computer devices, the one or more computer devices capable of recording content in audio, video, photographic, and/or text format and/or combinations thereof;

b. an auto question prompt module for prompting the user with a series of questions, one or more visual content images, audio files, music files, and/or one or more visual content videos stored within the system pertaining to topics of interest to prompt the user to provide answers to such questions to form part of the content;

c. a tell a story process module for creating a recorded audio visual story capable of being played back by the one or more users by permitting the one or more users to access previously existing multimedia content available to the one or more computer devices, to review the new or previously existing content from the one or more computer devices from within the platform, to edit the new or previously existing content from the one or more computer devices from within the platform, and/or to delete the new or previously existing content from the one or more computer devices;

wherein the step of editing the preexisting one or more visual content images and/or one or more visual content videos comprises selecting the desired visual content for display within the audio visual story, recording any desired audio content to accompany any of such selected visual content, such audio content being tied to such respective visual content so that such audio content becomes audible when such selected visual content is displayed during the playback of the recorded story;

d. a save a story process module for permitting the one or more users to store the recorded content on the one or more computer devices, a platform server or a platform cloud-based storage system; and

e. a share a story process module for permitting the one or more users to share the recorded content with others.

25. The computer program product of claim 24 further comprising an e-book process module for permitting the one or more users to import recorded content into an e-book creation system.

26. The computer program product of claim 25 wherein the e-book process module further permits one or more users to collaborate in creating a jointly created e-book using recorded content from within the platform or recorded content that the other permitted users import into the platform;

editing the jointly created e-book as desired;

saving the jointly created e-book; and

sharing the jointly created e-book.

27. The computer program product of claim 24 wherein the audio editing comprises voice narration or commentary, singing a song or music.

28. The computer program product of claim 24 wherein the recorded audio visual story is recorded as a slide show presentation wherein the presentation may be played on a presentation device where the presentation of slides proceeds from one slide to another slide manually or automatically.