Event archiving, systems and methods

• US 10,540,319 B2
• Filed: 11/02/2018
• Issued: 01/21/2020
• Est. Priority Date: 05/24/2012
• Status: Active Grant

• Current Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Original Assignee: Nant Holdings IP, LLC (NantWorks, LLC)
• Inventors: Soon-Shiong, Patrick
• Primary Examiner(s): Hutton, Nan
• Application Number:
  US16/179,821
• Publication Number:
  US 20190073369A1
• Time in Patent Office: 445 Days
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Method of retrieving event information is presented. Memento objects can be recognized by an archive engine. Based on the recognition, the archive engine obtains information related to the memento object, possibly one or more recognizable features, and uses the information to search for events associated with a timeline that have corresponding tags. The archive engine can then return the event information as a result set to a user.

Claims

1. A computer implemented method of retrieving item information comprising:

configuring a computing device to operate as an archiving engine;

receiving from a first user an item object by the archiving engine, the item object representative of an occurrence in time;

binding the item object, by the archiving engine, to at least one timeline associated with an entity of the first user where the timeline comprises a plurality of item objects organized according to time;

displaying on a user device of a second user, an item object from item objects bound to the timeline;

generating indexing information based on a set of recognizable features related to an image object, wherein the set of recognizable features comprises a vector of information corresponding to a digital representation of the image object, and wherein each member of the vector represents a different modality and includes (1) one or more relevant features for a corresponding modality, and (2) recognition criteria comprising a recognition threshold corresponding to the one or more relevant features;

upon selection by the first user of at least one recognizable feature, registering, by the archiving engine, the generated indexing information in the timeline with the selected item object; and

retrieving, by the archiving engine, at least a portion of the vector of information corresponding to the image object upon selection by the second user of the selected item object, wherein the portion includes one or more recommendations related to the item object, displayed on the user device of the second user.

2. The method of claim 1, wherein the step of configuring the device to operate as the archiving engine includes accessing at least one of the following:

an application program interface, a search engine interface, a social network interface, a cell phone interface, a browser interface, and a sensor interface.

3. The method of claim 1, wherein the step of receiving the item object includes at least one of the following:

pushing the item object, pulling the item object, automatically receiving the item object, and receiving the item object over a network.

4. The method of claim 1, wherein the item object comprises a media object.

5. The method of claim 1, wherein the item object comprises a multi-media object.

6. The method of claim 1, wherein the item object comprises at least one of the following types of data:

audio data, video data, image data, motion data, acceleration data, temperature data, location data, time data, metadata, identification data, preference data, game data, sensor data, links to external content, other types of content data and security data.

7. The method of claim 1, wherein the entity comprises at least one of the following:

a person, an animal, a company, an organization, a group, a family, a school, a yearbook, a brand, a building, and a vehicle.

8. The method of claim 1, wherein the item object is representative of at least one of the following:

a party, a concert, a sporting event, a catalog, a convention, a conference, a celebration, a fashion show, and a festival.

9. The method of claim 1, wherein the timeline comprises at least one of the following:

a life stage, a life time, a year, a month, a week, and a day.

10. The method of claim 1, wherein selection by the second user of the selected item object includes searching for the item object.

11. The method of claim 1, wherein selection by the second user of the selected item object includes tapping on the selected item object.

12. The method of claim 1, wherein selection by the second user includes selecting the selected item object from item objects within a specified time span on the timeline.

13. The method of claim 1, wherein the step of registering the set of recognizable features includes indexing the selected item object according to the set of recognizable features.

14. The method of claim 1, wherein the step of retrieving the selected item object includes searching for item objects having registered recognizable features corresponding to the associated feature.

15. The method of claim 1, wherein the set of recognizable features include at least one of the following:

audio data characteristics, image data characteristics, color, shape, dimension of relevance, make, model, encoded data, non-encoded information, attributes, and texture.

16. The method of claim 1, wherein the associated feature set includes at least one of the following:

audio data characteristics, image data characteristics, color, shape, dimension of relevance, make, model, encoded data, non-encoded information, attributes, and texture.

17. The method of claim 1, wherein the image object comprises at least a substantially two-dimensional object.

18. The method of claim 17, wherein the image object comprises at least a three-dimensional object.

19. The method of claim 18, wherein the image object comprises at least a four-dimensional object.

20. The method of claim 1, wherein the set of recognizable features relevant to the image object comprises attributes based on past item objects associated with the one or more timelines.

21. The method of claim 1, wherein the image object comprises one of the following:

an image, a sound, a brand, a device, and a video.

22. The method of claim 1, wherein selection by the second user of the selected item object includes selecting the selected item object based on a second, different timeline.

23. The method of claim 1, wherein the step of binding the item object to the timeline includes binding the item object to multiple timelines.

24. The method of claim 1, wherein the step of binding the item object includes recognizing objects within the item object.

25. A non-transitory computer readable medium comprising one or more instructions for retrieving item information, wherein one or more instructions, upon execution by a processor, perform:

configuring a computing device to operate as an archiving engine;

receiving from a first user an item object by the archiving engine, the item object representative of an occurrence in time;

binding the item object, by the archiving engine, to at least one timeline associated with an entity of the first user where the timeline comprises a plurality of item objects organized according to time;

displaying on a user device of a second user, an item object from item objects bound to the timeline;

generating indexing information based on a set of recognizable features related to an image object, wherein the set of recognizable features comprises a vector of information corresponding to a digital representation of the image object, and wherein each member of the vector represents a different modality and includes (1) one or more relevant features for a corresponding modality, and (2) recognition criteria comprising a recognition threshold corresponding to the one or more relevant features;

upon selection by the first user of at least one recognizable feature, registering, by the archiving engine, the generated indexing information in the timeline with the selected item object; and

retrieving, by the archiving engine, at least a portion of the vector of information corresponding to the image object upon selection by the second user of the selected item object, wherein the portion includes one or more recommendations related to the item object displayed on the user device of the second user.

26. A system for retrieving item information comprising:

an archiving engine configured for;

receiving from a first user an item object, the item object representative of an occurrence in time;

binding the item object to at least one timeline associated with an entity of the first user where the timeline comprises a plurality of item objects organized according to time;

generating indexing information based on a set of recognizable features related to an image object, wherein the set of recognizable features comprises a vector of information corresponding to a digital representation of the image object, and wherein each member of the vector represents a different modality and includes (1) one or more relevant features for a corresponding modality, and (2) recognition criteria comprising a recognition threshold corresponding to the one or more relevant features;

upon selection by the first user of at least one recognizable feature, registering the generated indexing information in the timeline with the selected item object;

displaying on a user device of a second user, an item object from item objects bound to the timeline; and

retrieving at least a portion of the vector of information corresponding to the image object upon selection by the second user of the selected item object, wherein the portion includes one or more recommendations related to the item object displayed on the user device of the second user;

an item database operably connected to the archiving engine and configured to store one or more item objects; and

a timeline database operably connected to the archiving engine and configured to store the at least one timeline.