System for displaying a status of an object of interest

• US 10,216,359 B2
• Filed: 05/12/2015
• Issued: 02/26/2019
• Est. Priority Date: 09/07/2007
• Status: Active Grant

• Current Assignee: Visualcue Technologies, LLC
• Original Assignee: Visualcue Technologies, LLC
• Inventors: Gilger, Kerry, Bushnell, Irving, Slesinger, Steven, Gandhi, Aashish
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US14/710,044
• Publication Number:
  US 20150248214A1
• Time in Patent Office: 1,386 Days
• Field of Search: 345419
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06Q 10/0833 Tracking
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

A system and method for creating a visual perspective of operational information that facilitates rapid decision making. The system and method merges existing data sources from any number of computer-fed external data sources through an applications server to display data set in easily recognizable, repeatable images (tiles) uniquely designed for a user'"'"'s application. The system and method create visual perspectives of data that accelerate decision-making and problem solving processes by displaying repeatable images (tiles) that display performance results verses expected performance criteria in high-volume, intuitive displays.

Claims

1. A method of displaying a status of an object of interest in an augmented reality environment comprising:

receiving a live video feed including an object of interest, wherein said live video feed is generated by a video camera;

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible;

combining the live video feed and the display tile into a combined live video feed representative of the status of the object of interest; and

displaying the combined live video feed on a display.

2. The method of claim 1, further comprising:

determining the identification of the object of interest in the live video feed.

3. The method of claim 2, wherein the identification of the object of interest in the live video feed is determined using video analysis.

4. The method of claim 2, wherein the identification of the object of interest in the live video feed is determined using facial recognition.

5. The method of claim 2, wherein the identification of the object of interest in the live video feed is determined using position coordinates.

6. The method of claim 1, wherein combining the live video feed and the display tile into the combined live video feed comprises overlaying the display tile on the live video feed.

7. The method of claim 1, further comprising:

updating a given icon display characteristic based upon a change in received data.

8. The method of claim 1, further comprising:

updating a given icon display characteristic based upon the value exceeding a threshold.

9. The method of claim 1, wherein the icon display characteristic comprises an icon display color.

10. The method of claim 1, wherein the icon display characteristic comprises an icon display size.

11. The method of claim 1, wherein the icon display characteristic comprises an icon display shape.

12. The method of claim 1, wherein the icon display characteristic comprises an icon display position.

13. The method of claim 1, wherein the received data comprises data received in real-time.

14. The method of claim 1, wherein the received data comprises data received from multiple sources.

15. A method of displaying a status of an object of interest in an augmented reality environment comprising:

receiving a live video feed including an object of interest, wherein said live video feed is generated by a video camera;

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a plurality of virtual image layers, each virtual image layer associated with a respective determined icon display characteristic;

generating a display tile for the object of interest by combining the plurality of virtual image layers;

combining the live video feed and the display tile into a combined live video feed representative of the status of the object of interest; and

displaying the combined live video feed on a display.

16. The method of claim 15, further comprising:

determining the identification of the object of interest in the live video feed.

17. The method of claim 15, wherein the identification of the object of interest in the live video feed is determined using video analysis.

18. The method of claim 15, wherein the identification of the object of interest in the live video feed is determined using facial recognition.

19. The method of claim 15, wherein the identification of the object of interest in the live video feed is determined using position coordinates.

20. The method of claim 15, wherein combining the live video feed and the display tile into the combined live video feed comprises overlaying the display tile on the live video feed.

21. The method of claim 15, further comprising:

updating a given icon display characteristic based upon a change in received data.

22. The method of claim 15, further comprising:

updating a given icon display characteristic based upon the value exceeding a threshold.

23. The method of claim 15, wherein the icon display characteristic comprises an icon display color.

24. The method of claim 15, wherein the icon display characteristic comprises an icon display size.

25. The method of claim 15, wherein the icon display characteristic comprises an icon display shape.

26. The method of claim 15, wherein the icon display characteristic comprises an icon display position.

27. The method of claim 15, wherein the received data comprises received in real-time.

28. The method of claim 15, wherein the received data comprises data received from multiple sources.

29. A system for displaying a status of an object of interest in an augmented reality environment comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving a live video feed including an object of interest, wherein said live video feed is generated by a video camera,

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the live video feed and the display tile into a combined live video feed representative of the status of the object of interest, and

displaying the combined live video feed on a display.

30. The system of claim 29, wherein the computer readable instructions further cause the system to perform the operation of determining the identification of the object of interest in the live video feed.

31. The system of claim 29, further comprising:

updating a given icon display characteristic based upon a change in received data.

32. A system for displaying a status of an object of interest comprising in an augmented reality environment:

an electronic device having a display, a camera, and a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving a live video feed from the camera including an object of interest, wherein said live video feed is generated by a video camera,

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the live video feed and the display tile into a combined live video feed representative of the status of the object of interest, and

displaying the combined live video feed on the display.

33. The system of claim 32, wherein the computer readable instructions further cause the system to perform the operation of determining the identification of the object of interest in the live video feed.

34. The system of claim 32, further comprising:

updating a given icon display characteristic based upon a change in received data.

35. A system for displaying a status of an object of interest comprising in an augmented reality environment:

a server having a processor in electric communication with a memory comprising computer readable non-transitory memory comprising computer readable instructions for execution by the processor;

a camera in communication with the server;

a display in communication with the server; and

wherein the computer readable instructions cause the system to perform the operations of

receiving a live video feed from the camera including an object of interest,

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the live video feed and the display tile into a combined live video feed representative of the status of the object of interest, and

displaying the combined live video feed on the display.

36. The system of claim 35, wherein the computer readable instructions further cause the system to perform the operation of determining the identification of the object of interest in the live video feed.

37. The system of claim 35, further comprising:

updating a given icon display characteristic based upon a change in received data.

38. A method of displaying a status of an object of interest comprising:

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible;

displaying the display tile on a display;

receiving a user selection of one of the icons;

generating a secondary display tile based upon the user-selected icon by combining a plurality of secondary icons associated with the status attribute of the user-selected icon; and

displaying the secondary display tile on the display.

39. A system for displaying a status of an object of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

displaying the display tile on a display,

receiving a user selection of one of the icons,

generating a secondary display tile based upon the user-selected icon by combining a plurality of secondary icons associated with the status attribute of the user-selected icon, and

displaying the secondary display tile on the display.

40. A method of displaying a status of an object of interest comprising:

receiving a position of an object of interest;

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible;

combining the display tile and a geographic depiction of an area comprising the position, wherein the display tile is positioned on the geographic depiction at a location representative of the position; and

displaying the combined display tile and geographic depiction on a display.

41. The method of claim 40, wherein each icon may be a segment of a composite icon.

42. The method of claim 41, wherein the composite icon may graphically represent the object of interest.

43. The method of claim 40, wherein the geographic depiction is a map.

44. The method of claim 40, wherein the geographic depiction is a floorplan.

45. A system for displaying a status of an object of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving a position of an object of interest,

receiving data related to a plurality of status attributes for the object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the display tile and a geographic depiction of an area comprising the position, wherein the display tile is positioned on the geographic depiction at a location representative of the position, and

displaying the combined display tile and geographic depiction on a display.

46. The system of claim 45, wherein each icon may be a segment of a composite icon.

47. The system of claim 46, wherein the composite icon may graphically represent the object of interest.

48. The system of claim 45, wherein the geographic depiction is a map.

49. The system of claim 45, wherein the geographic depiction is a floorplan.

50. A method of displaying a status of an object of interest comprising:

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible, wherein the display tile has a timestamp associated therewith;

generating a timeline mosaic comprising a timeline comprising the time reflected in the timestamp and the display tile, wherein the display tile is positioned along the timeline at a location representative of the time reflected in the timestamp; and

displaying the timeline mosaic on a display.

51. A system for displaying a status of an object of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible, wherein the display tile has a timestamp associated therewith,

generating a timeline mosaic comprising a timeline comprising the time reflected in the timestamp and the display tile, wherein the display tile is positioned along the timeline at a location representative of the time reflected in the timestamp, and

displaying the timeline mosaic on a display.

52. A method of displaying a status of an object of interest comprising:

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible, wherein the display tile has a date associated therewith;

generating a calendar mosaic comprising a calendar comprising the date and the display tile, wherein the display tile is positioned on the calendar at a location corresponding to the date; and

displaying the calendar mosaic on a display.

53. A system for displaying a status of an object of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes for an object of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a display tile for the object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible, wherein the display tile has a date associated therewith,

generating a calendar mosaic comprising a calendar comprising the date and the display tile, wherein the display tile is positioned on the calendar at a location corresponding to the date, and

displaying the calendar mosaic on a display.

54. A method of displaying a status of a process of interest comprising:

receiving data related to a plurality of status attributes of a process of interest, each status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the process of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a process display tile for the process of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible; and

displaying the process display tile on a display.

55. The method of claim 54, wherein a portion of the icons are tab icons.

56. A system for displaying a status of a process of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes of a process of interest, each status attribute having an icon

associated therewith conveying meaning through a pictorial resemblance of the process of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a process display tile for the process of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible, and

displaying the process display tile on a display.

57. The system of claim 56, wherein a portion of the icons are tab icons.

58. A method of displaying a system status for a plurality of objects of interest:

receiving data related to a plurality of status attributes for each of a plurality of objects of interest, each of the plurality of status attributes having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a respective display tile for each object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible;

combining the display tiles in overlapped and stacked relation;

and

displaying the combined display tiles on a display.

59. A system for displaying a system status for a plurality of objects of interest:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes

for each of a plurality of objects of interest, each of the plurality of status attributes having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a respective display tile for each object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the display tiles in overlapped and stacked relation, and

displaying the combined display tiles on a display.

60. A method of displaying a system status for a plurality of objects of interest:

receiving data related to a plurality of status attributes for each of a plurality of objects of interest, each of the plurality of status attributes having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute;

generating a respective display tile for each object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible;

combining the display tiles;

generating a composite indicator representing the combined display tiles; and

displaying the composite indicator on a display.

61. A system for displaying a system status for a plurality of objects of interest:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving data related to a plurality of status attributes for each of a plurality of objects of interest, each of the plurality of status attributes having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

determining an icon display characteristic for each icon based upon the received data and indicative of a value of the associated status attribute,

generating a respective display tile for each object of interest by combining the icons so that at least a portion of each icon with its icon display characteristic remains visible,

combining the display tiles,

generating a composite indicator representing the combined display tiles, and

displaying the composite indicator on a display.

62. A method of displaying a status of an object of interest comprising:

receiving a set of data related to a status attribute for an object of interest, the status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest;

generating a diagram of the distribution of the set of data for the status attributes;

combining the diagram and at least one slideable manipulation slider;

displaying the combined diagram and the slideable manipulation slider on a display;

receiving input from a user comprising the placement of the manipulation slider in relation to the diagram;

determining a threshold for a first icon display characteristic and a second icon display characteristic for the icon based upon the placement of the manipulation slider;

receiving additional data related to the status attribute; and

displaying at least a portion of the icon on the display, wherein the first icon display characteristic is visible on the icon when the additional data is below the threshold and the second icon display characteristic is visible on the icon when the additional data is above the threshold.

63. A system for displaying a status of an object of interest comprising:

a processor in electrical communication with a memory, wherein the memory comprises computer readable non-transitory memory comprising computer readable instructions for execution by the processor that cause the system to perform the operations of

receiving a set of data related to a status attribute for an object of interest, the status attribute having an icon associated therewith conveying meaning through a pictorial resemblance of the object of interest,

generating a diagram of the distribution of the set of data for the status attributes,

combining the diagram and at least one slideable manipulation slider,

displaying the combined diagram and the at least one slideable manipulation slider on a display,

receiving input from a user comprising the placement of the manipulation slider in relation to the diagram,

determining a threshold for a first icon display characteristic and a second icon display characteristic for the icon based upon the placement of the manipulation slider,

receiving additional data related to the status attribute,

and

displaying at least a portion of the icon on the display, wherein the first icon display characteristic is visible on the icon when the additional data is below the threshold and the second icon display characteristic is visible on the icon when the additional data is above the threshold.