State extrapolation for automated and semi-automated crawling architecture

• US 10,387,379 B2
• Filed: 09/29/2015
• Issued: 08/20/2019
• Est. Priority Date: 05/13/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Desineni, Kalyan, Sankaranarasimhan, Manikandan, Sarpasayanam, Vasanthakumar
• Primary Examiner(s): Lewis, Cheryl
• Application Number:
  US14/869,127
• Publication Number:
  US 20160335356A1
• Time in Patent Office: 1,421 Days
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 16/9558 Details of hyperlinks; Management of linked annotations
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

A system for automated acquisition of content from an application includes a link extraction controller that receives an identification of a target state of the application directly reachable from an intermediate state and a specification of a user interface element of the intermediate state actuated by a user to arrive at the target state. After navigating to the intermediate state in an executing instance of the application and extracting a tree of user interface widgets, the link extraction controller identifies widget sub-trees that have at least a threshold level of commonality with a reference widget sub-tree that includes the specified user interface element. The link extraction controller adds states, including the target state, reachable by user actuation of the identified widget sub-trees to a state list. A scraper module extracts text and metadata from each of the states in the state list for storage in a data store.

Claims

1. An apparatus comprising:

a memory; and

at least one processor configured to;

receive an identification of a target state of an application reachable from an intermediate state of the application;

access, by using the identification of the target state, the intermediate state in an executing instance of the application, wherein the intermediate state is a state prior to the target state;

identify a plurality of states which are reachable from the intermediate state by using information indicating linking relation between states in the application;

identify at least one state which has at least a threshold level of commonality with the target state; and

add identified at least one state and the target state to a state list,

wherein the at least one processor is configured to extract text and metadata from each of the identified at least one state and the target state in the state list,

wherein information based on the extracted text and metadata is stored in the memory, and

wherein the at least one processor is further configured to receive a query from a user device and transmit a search result corresponding to the query which is identified at least based on the information based on the extracted text and metadata.

2. The apparatus of claim 1, wherein the at least one processor is further configured to, for each of the identified at least one state and the target state, (i) access to the each of the identified at least one state and the target state and (ii) omit a state being a duplicate of the each of the identified at least one state and the target state already in the state list.

3. The apparatus of claim 1, wherein the at least one processor is further configured to:

determine a candidate target state from the plurality of states which are reachable from the intermediate state, wherein the candidate target state is directly linked to the intermediate state; and

in response to identifying no state having the threshold level of commonality with the target state, determine a new candidate target state from the plurality of states which are reachable from the intermediate state, wherein the new candidate target state is hierarchically linked to the intermediate state.

4. The apparatus of claim 1, wherein the threshold level of commonality between the identified at least one state and the target state is determined by a comparison of metadata of the identified at least one state to metadata of the target state, irrespective of content conveyed by the identified at least one state and the target state.

5. The apparatus of claim 4, wherein the at least one processor is further configured to determine that commonality between the identified at least one state and the target state exceed the threshold level of commonality in response to resource identifiers of the identified at least one state and the target state matching.

6. The apparatus of claim 4, wherein the at least one processor is further configured to determine that commonality between the identified at least one state and the target state exceed the threshold level of commonality in response to type of data included in identified at least one state and type of data included in the target state.

7. The apparatus of claim 6, wherein:

the identified at least one state is described by a resource identifier;

the target state is described by a resource identifier; and

the at least one processor is further configured to calculate a difference metric based on a comparison of a number of states having a common resource identifier from the identified at least one state.

8. The apparatus of claim 7, wherein the at least one processor is further configured to calculate the difference metric further based on a number of states having no resource identifier but a common type of data between type of data included in identified at least one state and type of data included in the target state.

9. The apparatus of claim 7, wherein the at least one processor is further configured to:

calculate the difference metric by;

calculating, for each resource identifier in the target state, a percent difference between a count of states having the resource identifier in the identified at least one state with respect to a count of states having the resource identifier in the target state, and

calculating an average based on absolute values of the percent differences; and

determine that commonality between the identified at least one state and the target state exceed the threshold level of commonality in response to the average being below a predetermined threshold value.

10. The apparatus of claim 1, wherein the at least one processor is configured to perform guide tracking by monitoring interaction of an operator with the executing instance of the application and record a first guide,

wherein the first guide includes a recorded sequence of user interface interactions concluding at an ultimate state of the application,

wherein the ultimate state is provided to the at least one processor as the target state, and

wherein a user interface element actuated by a final user interface interaction of the recorded sequence of user interface interactions is provided to the at least one processor as the specified user interface element.

11. The apparatus of claim 1, wherein the application is executing within an emulator.

12. The apparatus of claim 11, wherein the at least one processor is further configured to execute the application within a second emulator.

13. The apparatus of claim 1, wherein the at least one processor is further configured to, for each entry in the state list, (i) access to the identified at least one state in the executing instance of the application and (ii) extract the text and metadata from the identified at least one state.

14. The apparatus of claim 1, wherein the at least one processor is configured to perform set generation, by selecting records from the memory to form a consideration set of records in response to the query from the user device;

wherein the at least one processor performs set processing, by assigning a score to each record of the consideration set of records, and

wherein the at least one processor performs results generation by responding to the user device with a subset of the consideration set of records as the search result, wherein the subset is selected based on the assigned scores.

15. A method comprising:

receiving, using at least one processor of an apparatus, an identification of a target state of an application reachable from an intermediate state of the application;

accessing, by using the identification of the target state, the intermediate state in an executing instance of the application, wherein the intermediate state is a state prior to the target state;

identifying, using the at least one processor, a plurality of states which are reachable from the intermediate state by using information indicating linking relation between states in the application;

identifying, using the at least one processor, at least one state which has at least a threshold level of commonality with the target state;

adding, using the at least one processor, identified at least one state to a state list;

extracting text and metadata from each of the identified at least one state and the target state in the state list; and

storing, using the at least one processor, information based on the extracted text and metadata in a memory,

wherein the at least one processor is further configured to receive a query from a user device and transmit a search result corresponding to the query which is identified at least based on the information based on the extracted text and metadata.

16. The method of claim 15, further comprising, for each of the identified at least one state and the target state, (i) accessing to the each of the identified at least one state and the target state and (ii) omitting a state being a duplicate of the each of the identified at least one state and the target state already in the state list.

17. The method of claim 15, further comprising:

determining a candidate target state from the plurality of states which are reachable from the intermediate state, wherein the candidate target state is directly linked to the intermediate state; and

in response to identifying no state having the threshold level of commonality with the candidate target state, determining a new candidate target state from the plurality of states which are reachable from the intermediate state, wherein the new candidate target state is hierarchically linked to the intermediate state.

18. The method of claim 15, wherein the threshold level of commonality between the identified at least one state and the target state is determined by a comparison of metadata of the identified at least one state to metadata of the target state, irrespective of content conveyed by the identified at least one state and the target state.

19. The method of claim 18, further comprising determining that commonality between the identified at least one state and the target state exceed the threshold level of commonality in response to resource identifiers of the identified at least one state and the target state matching.

20. The method of claim 18, further comprising determining that commonality between the identified at least one state and the target state exceed the threshold level of commonality in response to type of data included in identified at least one state and type of data included in the target state matching.

21. The method of claim 20, wherein:

the identified at least one state is described by a resource identifier;

the target state is described by a resource identifier; and

the method further comprises calculating a difference metric based on a comparison of a number of states having a common resource identifier from the identified at least one state.

22. The method of claim 21, further comprising calculating the difference metric further based on a number of states having no resource identifier but a common type of data between type of data included in identified at least one state and type of data included in the target state.

23. The method of claim 21, further comprising calculating the difference metric by:

calculating, for each resource identifier in the target state, a percent difference between a count of states having the resource identifier in the identified at least one state with respect to a count of states having the resource identifier in the target state; and

calculating an average based on absolute values of the percent differences,

wherein commonality between the identified at least one state and the target state is determined to exceed the threshold level of commonality in response to the average being below a predetermined threshold value.

24. The method of claim 15, further comprising:

monitoring interaction of an operator with the executing instance of the application; and

recording a first guide based on the monitored interaction, wherein the first guide includes a recorded sequence of user interface interactions concluding at an ultimate state of the application,

wherein the ultimate state is used as the target state, and

wherein a user interface element actuated by a final user interface interaction of the recorded sequence of user interface interactions is used as the specified user interface element of the intermediate state.

25. The method of claim 15, wherein the extracting text and metadata includes, for each entry in the state list, (i) accessing to the identified at least one state in the executing instance of the application and (ii) extracting the text and metadata from the identified at least one state.

26. The method of claim 15, further comprising:

in response to the query from the user device, selecting records from the memory to form a consideration set of records;

assigning a score to each record of the consideration set of records; and

responding to the user device with a subset of the consideration set of records as the search result, wherein the subset is selected based on the assigned scores.