Methods and software for visualizing data by applying physics-based tools to data objectifications

• US 9,761,036 B2
• Filed: 04/24/2015
• Issued: 09/12/2017
• Est. Priority Date: 04/24/2014
• Status: Active Grant

• Current Assignee: Carnegie Mellon University
• Original Assignee: Carnegie Mellon University
• Inventors: Rzeszotarski, Jeffrey M., Kittur, Aniket D.
• Primary Examiner(s): McCulley, Ryan D
• Application Number:
  US14/696,053
• Publication Number:
  US 20150310643A1
• Time in Patent Office: 872 Days
• Field of Search: None
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

Methods and corresponding software for allowing a user to manipulate and interactively explore data intuitively by objectifying the data and allowing the user to apply any one or more simulated physical tools to the objectified data. The data can be any suitable type of data, including multivariate data and graph (network) data. In some embodiments, the method displays user-selected charts, such as histograms, scattergrams, and network graphs, in which objectified data points, or simulated physical objects, are attracted to their proper charted locations. In some embodiments, the user can apply one or more simulated physical tools and/or other tools, such as physical-barrier-type filter tools (e.g., sieves) and/or optical filter lens tools, to the simulated physical objects to filter the data. In some embodiments, the user can apply multiple tools, with each tool leaving a visual trace that allows the user to easily retrace their data manipulations.

Claims

1. A method of enabling a user to visualize a data set on a graphical display of a computing system, wherein the data set contains a plurality of records each having a plurality of attributes common to the plurality of records, the method comprising:

displaying, by the computing system, a physics-based sandbox on the graphical display, wherein the physics-based sandbox contains a chart having at least one axis representing a corresponding attribute of the plurality of attributes;

objectifying, by the computing system, each of the plurality of records to create a corresponding plurality of simulated physical objects, wherein each of the simulated physical objects defines a peripheral boundary that simulates an exterior surface of a real-world physical object, wherein each of the simulated physical objects has a corresponding plot location on the chart based on the attribute of the at least one axis;

displaying the simulated physical objects in the physics-based sandbox, wherein said displaying includes;

applying an attraction algorithm to attract each simulated physical object toward the corresponding plot location by simulating electromagnetic attraction between each simulated physical object and the corresponding plot location; and

when ones of the simulated physical objects are attracted to identical or proximate plot locations, applying a collision algorithm in conjunction with the attraction algorithm to cause the ones of the simulated physical objects to collide with one another and cluster together with corresponding respective peripheral boundaries abutting one another;

receiving, by the computing system, a user selection of a physics-based data-manipulation tool, wherein the physics-based data-manipulation tool invokes a physics-based interaction with one or more of the plurality of simulated physical objects, wherein the physics-based interaction is modeled by one or more physics-based modeling algorithms;

displaying a graphical representation of the physics-based data-manipulation tool in the physics-based sandbox;

determining, by the computing system, which one or more of the plurality of simulated physical objects experiences the physics-based interaction;

applying, by the computing system, the one or more physics modeling algorithms to each of the plurality of simulated physical objects determined to experience the physics-based interaction so as to determine at least one updated graphical representation for each of the one or more of the plurality of physical objects experiencing the physics-based interaction; and

rendering each of the at least one updated graphical representation in the physics-based sandbox.

2. A method according to claim 1, wherein

the chart is a histogram;

and

said displaying a graphical representation of the data-manipulation tool includes displaying a histogram axis for the histogram in the physics-based sandbox.

3. A method according to claim 1, wherein:

the chart is a scattergram and

said displaying a graphical representation of the data-manipulation tool includes displaying scattergram axes for the scattergram in the physics-based sandbox, the scattergram axes having first and second axes orthogonal to one another and representing, respectively, first and second attributes of the plurality of attributes, wherein each of the simulated physical objects has a corresponding plot location based on the first and second attributes.

4. A method according to claim 1, wherein said applying an attraction algorithm includes applying an algorithm in which a force of attraction diminishes with increasing distance between each simulated physical object and the corresponding plot location.

5. A method according to claim 1,

wherein said receiving a user selection of a physics-based data-manipulation tool includes receiving a user selection of a physical barrier filter designed and configured to allow passage therethrough of each of the plurality of simulated physical objects satisfying one or more filtering parameters;

displaying the physical barrier filter at a location in the physics-based sandbox wherein the physical barrier filter can filter ones of the plurality of simulated physical objects during attraction of the plurality of simulated physical objects to the corresponding respective plot locations on the chart; and

filtering, by the physical barrier filter, the ones of the plurality of simulated physical objects based on the one or more filtering parameters so as to block each of the plurality of simulated physical objects not satisfying the one or more filter parameters from reaching the corresponding plot location and to allow each of the plurality of simulated physical objects satisfying the one or more filter parameters to pass through the physical barrier filter so as to reach the corresponding plot location.

6. A method according to claim 5, further comprising applying a binary filtering algorithm to the simulated physical objects based on the one or more filtering parameters so as to designate which of the plurality of simulated physical objects are permitted to pass through the physical barrier filter.

7. A method according to claim 1,

wherein:

said receiving a user selection of a data-manipulation tool includes receiving a selection of a simulated physical tool;

said displaying a graphical representation of the data-manipulation tool includes displaying the simulated physical tool in the physics-based sandbox; and

said applying the one or more physics modeling algorithms includes applying the one or more physics modeling algorithms with the plurality of physical objects initially in the plot locations.

8. A method according to claim 7, wherein said receiving a user selection of a simulated physical tool includes receiving a user selection of a filter designed and configured to filter the plurality of simulated physical objects based on values of at least one of the plurality of attributes based on one or more filtering parameters.

9. A method according to claim 8, wherein said receiving a user selection of a filter includes receiving a user selection of a first optical lens filter designed and configured to visually highlight each of the plurality of simulated physical objects satisfying the one or more optical filtering parameters while still displaying in a non-visually-highlighted manner each of the plurality of simulated physical objects not satisfying the one or more optical filtering parameters.

10. A method according to claim 9, further comprising receiving a user selection of at least one second optical lens filter and graphically overlaying the at least one second optical lens filter with the first optical lens filter.

11. A method according to claim 8, wherein said receiving a user selection of a filter includes receiving a user selection of a physical barrier filter designed and configured to allow passage therethrough of each of the plurality of simulated physical objects satisfying the one or more filtering parameters such that, when a user moves the physical barrier filter, the physical barrier filter pushes any of the plurality of simulated physical objects satisfying the one or more filtering parameters away from the corresponding plot location.

12. A method according to claim 11, further comprising applying a binary filtering algorithm to the simulated physical objects based on the one or more filtering parameters so as to designate which of the plurality of simulated physical objects are permitted to pass through the physical barrier filter and which of the plurality of simulated physical objects are to be pushed by the physical barrier filter.

13. A method according to claim 11, further comprising receiving user input that moves the physical barrier filter across at least some of the plot locations, whereby filtering occurs during movement of the physical barrier.

14. A method according to claim 7, wherein said receiving a selection of a simulated physical tool includes receiving a selection of an attraction-repulsion tool designed and configured to move one or more of the plurality of simulated physical objects away from the corresponding plot location(s) based on an electromagnetic force mapped to a selected value of one of the plurality of attributes, the method further comprising receiving a user input designating a location in the physics-based sandbox for the attraction-repulsion tool.

15. A method according to claim 1, further comprising:

receiving a user selection of a subset of the plurality of simulated physical objects;

objectifying the subset of the plurality of simulated physical objects as a group representation having a boundary representing an exterior surface of a physical object; and

applying the one or more physics modeling algorithms to the group representation.

16. A method according to claim 15, further comprising applying the one or more physics modeling algorithms to the group representation based on a function applied to one or more of the plurality of attributes for the subset.

17. A method according to claim 1, further comprising:

assigning differing ones of the plurality of simulated physical objects to a plurality of differing layers so as to control collisions during movement of the differing ones of the plurality of simulated physical objects; and

executing a selected physics-based modeling algorithm for each of the plurality of differing layers.

18. A method according to claim 17, further comprising, when said executing is done, collapsing the plurality of differing layers into a single layer.

19. A method according to claim 17, further comprising, when said executing is done, collapsing the plurality of differing layers into more than one layer.

20. A method according to claim 1, further comprising:

receiving a user selection of a subset of the plurality of simulated physical objects;

receiving user changes to values of at least one attribute for the subset of the plurality of simulated physical objects to create modified values; and

applying the one or more physics modeling algorithms to the simulated physical objects in the subset based on the modified values.

21. A method according to claim 1, wherein said receiving a user selection of a data-manipulation tool includes receiving a selection of a barrier-wall filter having one or more filter parameters, that, in response to user activation, surrounds a region of plot locations and holds each simulated physical object not satisfying the one or more filter parameters in spaced relation to the corresponding plot location against the electromagnetic attraction between the simulated physical object and the corresponding plot location.

22. A machine-readable storage medium containing machine-executable instructions for performing a method of enabling a user to visualize a data set on a graphical display of a computing system, wherein the data set contains a plurality of records each having a plurality of attributes common to the plurality of records, said machine-executable instructions comprising:

a first set of machine-executable instructions for displaying, by the computing system, a physics-based sandbox on the graphical display, wherein the physics-based sandbox contains a chart having at least one axis representing a corresponding attribute of the plurality of attributes;

a second set of machine-executable instructions for objectifying, by the computing system, each of the plurality of records to create a corresponding plurality of simulated physical objects, wherein each of the simulated physical objects defines a peripheral boundary that simulates an exterior surface of a real-world physical object, wherein each of the simulated physical objects has a corresponding plot location on the chart based on the attribute of the at least one axis;

a third set of machine-executable instructions for displaying the simulated physical objects in the physics-based sandbox, wherein said displaying includes;

applying an attraction algorithm to attract each simulated physical object toward the corresponding plot location by simulating electromagnetic attraction between each simulated physical object and the corresponding plot location; and

when ones of the simulated physical objects are attracted to identical or proximate plot locations, applying a collision algorithm in conjunction with the attraction algorithm to cause the ones of the simulated physical objects to collide with one another and cluster together with corresponding respective peripheral boundaries abutting one another;

a fourth set of machine-executable instructions for receiving, by the computing system, a user selection of a physics-based data-manipulation tool, wherein the physics-based data-manipulation tool invokes a physics-based interaction with one or more of the plurality of simulated physical objects, wherein the physics-based interaction is modeled by one or more physics-based modeling algorithms;

a fifth set of machine-executable instructions for displaying a graphical representation of the physics-based data-manipulation tool in the physics-based sandbox;

a sixth set of machine-executable instructions for determining, by the computing system, which one or more of the plurality of simulated physical objects experiences the physics-based interaction;

a seventh set of machine-executable instructions for applying, by the computing system, the one or more physics modeling algorithms to each of the plurality of simulated physical objects determined to experience the physics-based interaction so as to determine at least one updated graphical representation for each of the one or more of the plurality of physical objects experiencing the physics-based interaction; and

an eighth set of machine-executable instructions for rendering each of the at least one updated graphical representation in the physics-based sandbox.

23. A machine-readable storage medium according to claim 22, wherein

the chart is a histogram and

said fifth set of machine-executable instructions includes machine-executable instructions for displaying a histogram axis for the histogram in the physics-based sandbox.

24. A machine-readable storage medium according to claim 22, wherein

the chart is a scattergram and

said fifth set of machine-executable instructions includes machine-executable instructions for displaying scattergram axes for the scattergram in the physics-based sandbox, the scattergram axes having first and second axes orthogonal to one another and representing, respectively, first and second attributes of the plurality of attributes, wherein each of the simulated physical objects has a corresponding plot location based on the first and second attributes.

25. A machine-readable storage medium according to claim 22, wherein said machine-executable instructions for applying an attraction algorithm include machine-executable instructions for applying an algorithm in which a force of attraction diminishes with increasing distance between each simulated physical object and the corresponding plot location.

26. A machine-readable storage medium according to claim 22, further comprising:

a ninth set of machine-executable instructions for receiving a user selection of a physical barrier filter designed and configured to allow passage therethrough of each of the plurality of simulated physical objects satisfying one or more filtering parameters;

a tenth set of machine-executable instructions for displaying the physical barrier filter at a location in the physics-based sandbox wherein the physical barrier filter can filter ones of the plurality of simulated physical objects during attraction of the plurality of simulated physical objects to the corresponding respective locations on the chart; and

an eleventh set of machine-executable instructions for filtering, by the physical barrier filter, the ones of the plurality of simulated physical objects based on the one or more filtering parameters so as to block each of the plurality of simulated physical objects not satisfying the one or more filter parameters from reaching the corresponding plot location and to allow each of the plurality of simulated physical objects satisfying the one or more filter parameters to pass through the physical barrier filter so as to reach the corresponding plot location.

27. A machine-readable storage medium according to claim 26, further comprising a twelfth set of machine-executable instructions for applying a binary filtering algorithm to the simulated physical objects based on the one or more filtering parameters so as to designate which of the plurality of simulated physical objects are permitted to pass through the physical barrier filter.

28. A machine-readable storage medium according to claim 22,

wherein:

said fourth set of machine-executable instructions includes machine-executable instructions for receiving a selection of a simulated physical tool;

said fifth set of machine-executable instructions includes machine-executable instructions for displaying the simulated physical tool in the physics-based sandbox; and

said seventh set of machine-executable instructions includes machine-executable instructions for applying the one or more physics modeling algorithms with the plurality of physical objects initially in the plotted locations.

29. A machine-readable storage medium according to claim 28, wherein said fourth set of machine-executable instructions includes machine-executable instructions for receiving a user selection of a filter designed and configured to filter the plurality of simulated physical objects based on values of at least one of the plurality of attributes based on one or more filtering parameters.

30. A machine-readable storage medium according to claim 29, wherein said machine-executable instructions for receiving a user selection of a filter includes machine-executable instructions for receiving a user selection of a first optical lens filter designed and configured to visually highlight each of the plurality of simulated physical objects satisfying the one or more optical filtering parameters while still displaying in a non-visually-highlighted manner each of the plurality of simulated physical objects not satisfying the one or more optical filtering parameters.

31. A machine-readable storage medium according to claim 30, further comprising an eleventh set of machine-executable instructions for receiving a user selection of at least one second optical lens filter and graphically overlaying the at least one second optical lens filter with the first optical lens filter.

32. A machine-readable storage medium according to claim 29, wherein said machine-executable instructions for receiving a user selection of a filter includes receiving a user selection of a physical barrier filter designed and configured to allow passage therethrough of each of the plurality of simulated physical objects satisfying the one or more filtering parameters such that, when a user moves the physical barrier filter, the physical barrier filter pushes any of the plurality of simulated physical objects satisfying the one or more filtering parameters away from the corresponding plot location.

33. A machine-readable storage medium according to claim 32, further comprising an eleventh set of machine-executable instructions for applying a binary filtering algorithm to the simulated physical objects based on the one or more filtering parameters so as to designate which of the plurality of simulated physical objects are permitted to pass through the physical barrier filter and which of the plurality of simulated physical objects are to be pushed by the physical barrier filter.

34. A machine-readable storage medium according to claim 32, further comprising an eleventh set of machine-executable instructions for receiving user input that moves the physical barrier filter across at least some of the plot locations, whereby filtering occurs during movement of the physical barrier.

35. A machine-readable storage medium according to claim 28, wherein said machine-executable instructions for receiving a selection of a simulated physical tool includes machine-executable instructions for receiving a selection of an attraction-repulsion tool designed and configured to move one or more of the plurality of simulated physical objects away from the corresponding plot location(s) based on an electromagnetic force mapped to a selected value of one of the plurality of attributes, the machine-readable storage medium further comprising an eleventh set of machine-executable instructions for receiving a user input designating a location in the physics-based sandbox for the attraction-repulsion tool.

36. A machine-readable storage medium according to claim 22, further comprising:

a ninth set of machine-executable instructions for receiving a user selection of a subset of the plurality of simulated physical objects;

a tenth set of machine-executable instructions for objectifying the subset of the plurality of simulated physical objects as a group representation having a boundary representing an exterior surface of a physical object; and

an eleventh set of machine-executable instructions for applying the one or more physics modeling algorithms to the group representation.

37. A machine-readable storage medium according to claim 36, further comprising a twelfth set of machine-executable instructions for applying the one or more physics modeling algorithms to the group representation based on a function applied to one or more of the plurality of attributes for the subset.

38. A machine-readable storage medium according to claim 22, further comprising:

a ninth set of machine-executable instructions for assigning differing ones of the plurality of simulated physical objects to a plurality of differing layers so as to control collisions during movement of the differing ones of the plurality of simulated physical objects; and

a tenth set of machine-executable instructions for executing a selected physics-based modeling algorithm for each of the plurality of differing layers.

39. A machine-readable storage medium according to claim 38, further comprising an eleventh set of machine-executable instructions for, when said executing is done, collapsing the plurality of differing layers into a single layer.

40. A machine-readable storage medium according to claim 38, further comprising an eleventh set of machine-executable instructions for, when said executing is done, collapsing the plurality of differing layers into more than one layer.

41. A machine-readable storage medium according to claim 22, further comprising:

a ninth set of machine-executable instructions for receiving a user selection of a subset of the plurality of simulated physical objects;

a tenth set of machine-executable instructions for receiving user changes to values of at least one attribute for the subset of the plurality of simulated physical objects to create modified values; and

an eleventh set of machine-executable instructions for applying the one or more physics modeling algorithms to the simulated physical objects in the subset based on the modified values.

42. A machine-readable storage medium according to claim 22, wherein said fourth set of machine-executable instructions includes machine-executable instructions for receiving a selection of a barrier-wall filter having one or more filter parameters, that, in response to user activation, surrounds a region of plot locations and holds each simulated physical object not satisfying the one or more filter parameters in spaced relation to the corresponding plot location against the electromagnetic attraction between the simulated physical object and the corresponding plot location.

43. A method of enabling a user to visualize a data set on a graphical display of a computing system, wherein the data set contains a plurality of records each having a plurality of attributes common to the plurality of records, the method comprising:

displaying, by the computing system, a physics-based sandbox on the graphical display;

objectifying, by the computing system, each of the records to create a corresponding plurality of simulated physical objects, wherein each of the simulated physical objects defines a peripheral boundary that simulates an exterior surface of a real-world physical object;

displaying, by the computing system, the simulated physical objects in the physics-based sandbox on the graphical display;

receiving, by the computing system, a user selection of a physical-barrier-filter tool designed and configured to allow passage therethrough of each of the simulated physical objects that satisfies one or more filtering parameters applied to the physical barrier filter and to block passage therethrough of each of the simulated physical objects that does not satisfy the one or more filtering parameters;

displaying, by the computing system, a graphical representation of the physical-barrier-filter tool in the physics-based sandbox on the graphical display;

assigning, by the computing system, differing ones of the simulated physical objects to a plurality of differing layers so as to control collisions during movement of the differing ones of the simulated physical objects; and

filtering, by the computing system and based on the differing layers, the simulated physical objects so as to block each of the simulated physical objects not satisfying the one or more filter parameters from passing through the graphical representation of the physical barrier filter and so as to allow each of the plurality of simulated physical objects satisfying the one or more filter parameters to pass through the graphical representation of the physical barrier filter.

44. A method according to claim 43, wherein assigning differing ones of the simulated physical objects to differing layers includes separating onto differing layers ones of the simulated physical objects that will pass through the physical-barrier-filter tool and ones of the simulated physical objects that will be blocked by the physical-barrier-filter tool so as to avoid ones of the simulated physical objects that will pass through the physical-barrier-filter tool from colliding with ones of the simulated physical objects that will be blocked by the physical-barrier-filter tool.

45. A method according to claim 44, wherein assigning differing ones of the simulated physical objects to differing layers includes assigning a first binary value to each of the simulated physical objects that will pass through the physical-barrier-filter tool and assigning a second binary value, differing from the first binary value, to each of the simulated physical objects that will be blocked by the physical-barrier-filter tool.

46. A method according to claim 45, further comprising controlling on-screen movement of the simulated physical objects based on the first and second binary values.

47. A method according to claim 43, further comprising, following said filtering, collapsing the differing layers into one or more layers.

48. A method according to claim 47, wherein said collapsing includes collapsing the differing layers into a single layer.

49. A method according to claim 47, wherein the physical-barrier-filter tool comprises a continuous semipermeable physical-barrier-tool wall forming a closed shape that surrounds at least some of the plotted locations.

50. A method according to claim 49, wherein the closed shape has an as-displayed size in the physics-based sandbox and the method further comprises receiving user input that expands the as-displayed size of the closed shape and expanding the as-displayed size of the closed shape in response to the user input.

51. A method according to claim 50, wherein said filtering occurs in realtime as the size of the closed shape is expanded.

52. A method according to claim 43, wherein prior to said filtering each of the simulated physical objects has a charted location on a chart and following said filtering ones of the simulated physical objects satisfying the one or more filter parameters are located at their charted locations on the chart and ones of the simulated physical objects not satisfying the one or more filter parameters are held by the graphical representation of the physical-barrier-filter tool in spaced relation to their charted locations on the chart against magnetic attraction between the held ones of the simulated physical objects and the charted locations of the held ones of the simulated physical objects.

53. A method according to claim 52, wherein the physical barrier filter comprises a semipermeable physical-barrier-tool razor.

54. A method according to claim 53, wherein the semipermeable physical-barrier-tool razor has a first location in the physics-based sandbox and the method further comprises:

receiving user input for moving the graphical representation of the semipermeable physical-barrier-tool razor from the first location to a second location in the physics-based sandbox that causes the graphical representation of the semipermeable physical-barrier-tool razor to encounter at least some of the simulated physical objects;

moving, on the graphical display, the graphical representation of the semipermeable physical-barrier-tool razor from the first location to the second location based on the user input; and

filtering encountered ones of the simulated physical objects as the graphical representation of the semipermeable physical-barrier-tool razor is moving.

55. A machine-readable storage medium containing machine-executable instructions for performing a method of enabling a user to visualize a data set on a graphical display of a computing system, wherein the data set contains a plurality of records each having a plurality of attributes common to the plurality of records, said machine-executable instructions comprising:

a first set of machine-executable instructions for displaying, by the computing system, a physics-based sandbox on the graphical display;

a second set of machine-executable instructions for objectifying, by the computing system, each of the records to create a corresponding plurality of simulated physical objects, wherein each of the simulated physical objects defines a peripheral boundary that simulates an exterior surface of a real-world physical object;

a third set of machine-executable instructions for displaying, by the computing system, the simulated physical objects in the physics-based sandbox on the graphical display;

a fourth set of machine-executable instructions for receiving, by the computing system, a user selection of a physical-barrier-filter tool designed and configured to allow passage therethrough of each of the simulated physical objects that satisfies one or more filtering parameters applied to the physical barrier filter and to block passage therethrough of each of the simulated physical objects that does not satisfy the one or more filtering parameters;

a fifth set of machine-executable instructions for displaying, by the computing system, a graphical representation of the physical-barrier-filter tool in the physics-based sandbox on the graphical display;

a sixth set of machine-executable instructions for assigning, by the computing system, differing ones of the simulated physical objects to a plurality of differing layers so as to control collisions during movement of the differing ones of the simulated physical objects; and

a seventh set of machine-executable instructions for filtering, by the computing system and based on the differing layers, the simulated physical objects so as to block each of the simulated physical objects not satisfying the one or more filter parameters from passing through the graphical representation of the physical barrier filter and so as to allow each of the plurality of simulated physical objects satisfying the one or more filter parameters to pass through the graphical representation of the physical barrier filter.

56. A machine-readable storage medium according to claim 55, wherein said sixth set of machine-executable instructions includes machine-executable instructions for separating onto differing layers ones of the simulated physical objects that will pass through the physical-barrier-filter tool and ones of the simulated physical objects that will be blocked by the physical-barrier-filter tool so as to avoid ones of the simulated physical objects that will pass through the physical-barrier-filter tool from colliding with ones of the simulated physical objects that will be blocked by the physical-barrier-filter tool.

57. A machine-readable storage medium according to claim 56, wherein said sixth set of machine-executable instructions includes machine-executable instructions for assigning a first binary value to each of the simulated physical objects that will pass through the physical-barrier-filter tool and assigning a second binary value, differing from the first binary value, to each of the simulated physical objects that will be blocked by the physical-barrier-filter tool.

58. A machine-readable storage medium according to claim 57, further comprising a set of machine-executable instructions for controlling on-screen movement of the simulated physical objects based on the first and second binary values.

59. A machine-readable storage medium according to claim 55, further comprising, machine-executable instructions for, following said filtering, collapsing the differing layers into one or more layers.

60. A machine-readable storage medium according to claim 59, wherein said machine-executable instructions for collapsing includes machine-executable instructions for collapsing the differing layers into a single layer.

61. A machine-readable storage medium according to claim 59, wherein the physical-barrier-filter tool comprises a continuous semipermeable physical-barrier-tool wall forming a closed shape that surrounds at least some of the plotted locations.

62. A machine-readable storage medium according to claim 61, wherein the closed shape has an as-displayed size in the physics-based sandbox and said machine-executable instructions further comprise machine-executable instructions for receiving user input that expands the as-displayed size of the closed shape and expanding the as-displayed size of the closed shape in response to the user input.

63. A machine-readable storage medium according to claim 62, wherein said seventh set of machine-executable instructions includes machine-executable instructions allowing the filtering to occur in realtime as the size of the closed shape is expanded.

64. A machine-readable storage medium according to claim 55, wherein prior to said filtering each of the simulated physical objects has a charted location on a chart and following said filtering ones of the simulated physical objects satisfying the one or more filter parameters are located at their charted locations on the chart and ones of the simulated physical objects not satisfying the one or more filter parameters are held by the graphical representation of the physical-barrier-filter tool in spaced relation to their charted locations on the chart against magnetic attraction between the held ones of the simulated physical objects and the charted locations of the held ones of the simulated physical objects.

65. A machine-readable storage medium according to claim 64, wherein the physical barrier filter comprises a semipermeable physical-barrier-tool razor.

66. A machine-readable storage medium according to claim 65, wherein the semipermeable physical-barrier-tool razor has a first location in the physics-based sandbox and said machine-executable instructions further comprise:

machine-executable instructions for receiving user input for moving the graphical representation of the semipermeable physical-barrier-tool razor from the first location to a second location in the physics-based sandbox that causes the graphical representation of the semipermeable physical-barrier-tool razor to encounter at least some of the simulated physical objects;

machine-executable instructions for moving, on the graphical display, the graphical representation of the semipermeable physical-barrier-tool razor from the first location to the second location based on the user input; and

machine-executable instructions for filtering encountered ones of the simulated physical objects as the graphical representation of the semipermeable physical-barrier-tool razor is moving.