System and method for item self-assessment as being extant or displaced

• US 10,354,505 B2
• Filed: 09/10/2017
• Issued: 07/16/2019
• Est. Priority Date: 01/08/2012
• Status: Active Grant

• Current Assignee: ImagiStar LLC
• Original Assignee: ImagiStar LLC
• Inventors: Oppenheimer, Steven Charles
• Primary Examiner(s): Chai, Longbit
• Application Number:
  US15/330,988
• Publication Number:
  US 20190035245A1
• Time in Patent Office: 674 Days
• Field of Search: 726 35
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 21/50 Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
• CPC Class Codes: G06F 21/88 Detecting or preventing theft or loss
• CPC Class Codes: G06F 2221/2101 Auditing as a secondary aspect
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06K 19/022 Processes or apparatus therefor
• CPC Class Codes: G06K 19/041 Constructional details G06K19/06 takes precedence
• CPC Class Codes: G06K 19/0723 the record carrier comprising an arrangement for non-contact communication, e.g. wireless communication circuits on transponder cards, non-contact smart cards or RFIDs
• CPC Class Codes: G06K 2007/10504 Data fields affixed to objects or articles
• CPC Class Codes: G06K 7/10009 sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves
• CPC Class Codes: G06K 7/10099 the directional field being used for pinpointing the location of the record carrier, e.g. for finding or locating an RFID tag amongst a plurality of RFID tags, each RFID tag being associated with an object, e.g. for physically locating the RFID tagged object in a warehouse
• CPC Class Codes: G06K 7/10326 the antenna being of the very-near field type, e.g. capacitive
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G08B 13/1436 with motion detection
• CPC Class Codes: G08B 13/2428 Tag details
• CPC Class Codes: G08B 21/0275 Electronic Article Surveillance [EAS] tag technology used for parent or child unit, e.g. same transmission technology, magnetic tag, RF tag, RFID
• CPC Class Codes: G08B 21/24 : Reminder alarms, e.g. anti-loss alarms
• CPC Class Codes: H04L 25/0226 : sounding signals per se
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services
• CPC Class Codes: H04W 4/33 : for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/38 : for collecting sensor information
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A portable item reporting device is configured to be attached to and in substantial collocation with a portable item, or to be integrated into a portable item. The device includes an environmental sensor to monitor two or more real-time environmental factors, such as item location, item movement, ambient light, ambient sounds, ambient temperature, etc. The device is configured to store usage expectation data indicative of historical and/or expected item usage and environments when the item is in normal use/storage associated with an authorized user. The device monitors current environmental conditions surrounding and pertaining to the item. The device compares the expected environment with the current environment, and/or with the recent historical environment. If the current/recent historical environment is inconsistent with expected conditions for the two or more environmental factors, the device assesses that the item is displaced, meaning either that the item is in abnormal use or abnormal storage, or is under the control of an unauthorized user who is other than the authorized user. Based on the assessment of displacement, the device initiates a signal or message to an authorized user of the item or to a recipient designated by the authorized user, indicating that the item usage/storage is displaced or otherwise anomalous.

Claims

1. An electronic device configured to be operated while in collocation with a portable item, and configured to assess a state of the collocated portable item, the electronic device comprising:

a hardware processor;

a memory ; and

an environmental sensor configured to detect a location of the portable item and a personal motion of the portable item, said personal motion comprising at least one of;

(i) a local movement of the portable item caused by movement of a person who possesses said portable item, and (ii) a lack of motion of said portable item wherein the portable item is stationary;

wherein;

the hardware processor is configured to store locally at the portable item in the memory;

(i) an expected time interval of portable item use (TimeInt_PI_Use), as designated by an authorized user of the portable item, comprising at least one of (A) a specified usage date and (B) a specified usage time range starting at a first designated time and ending at a later second designated time falling within a specified day or within a specified plurality of consecutive days, wherein;

said specified usage date or said specified usage time range pertain to a use of the portable item by the authorized user or a storage of the portable item as designated by the authorized user; and

said authorized user is an owner of the portable item or a person to whom portable item control has been delegated by the portable item'"'"'s owner; and

(ii) a portable item usage expectation which is associated in the memory with the TimeInt_PI_Use, wherein the portable item usage expectation comprises expectations for location data and for personal motion data, for the portable item during the TimeInt_PI_Use, in consequence of at least one of;

an anticipated use of the portable item during the TimeInt_PI_Use by the authorized user, and

an anticipated storage of the portable item during the TimeInt_PI_Use as designated by the authorized user;

wherein the expected location data, the expected personal motion data, and the at least one of the specified usage date and specified usage time range are locally stored at the portable item;

the memory is configured to provide storage for a communications address of a remote processing device which is designated to receive an item displacement alert message on behalf of the authorized user;

upon determining by the hardware processor that at least one of the current date and the current time fall within said specified usage date or said specified usage time range of the designated TimeInt_PI_Use,

(a) the environmental sensor is configured to monitor a real-time usage data for the portable item during the TimeInt_PI_Use, the real-time usage data comprising the location of the portable item and the personal motion of the portable item during the TimeInt_PI_Use; and

(b) the hardware processor of the electronic device is further configured to;

compare locally at the portable item the real-time usage data comprising the location of the portable item and the personal motion of the portable item within said specified usage date or said specified usage time range of the designated TimeInt_PI_Use, with the stored item usage expectation comprising the expectations for the location and for personal motion of the portable item during the TimeInt_PI_Use; and

determine locally at the portable item, via the comparison, and based on a combined assessment of the real-time location data and the real-time personal motion data, whether the portable item is one of;

extant, wherein the real-time usage data for the portable item detected by the environmental sensor which is configured to detect the location and the personal motion of the portable item is in conformance with the item usage expectation during the TimeInt_PI_Use;

or

displaced, wherein the real-time usage data for the portable item detected by the environmental sensor which is configured to detect the location and the personal motion of the portable item is not in conformance with the item usage expectation during the TimeInt_PI_Use; and

upon determining that the portable item is displaced, the hardware processor is configured to transmit the item displacement alert message, which is indicative of the portable item'"'"'s state of displacement, to the communications address of the remote processing device;

wherein at least one of said authorized user and a party designated by said authorized user may be automatically alerted, via the designated remote processing device, to the displacement of the portable item.

2. The electronic device of claim 1, wherein the determining by the hardware processor of whether the portable item is extant or displaced based on the combined assessment of the real-time location data and the real-time personal motion data comprises:

storing a logic table comprising at least one of a truth table, a fuzzy logic table, and a heuristic, said logic table further comprising;

(i) a first logical variable based on the real-time location data and a second logical variable based on the real-time personal motion data, wherein;

the first and second logical variables provide input to the logic table; and

at least one of a truth value for each logical variable and a probability value for each logical variable is determined based on a comparison of;

(1) at least one of the real-time location data and the real-time personal motion with (2) the usage expectation for the portable item; and

(ii) a plurality of logical results based on the first and second logical variables;

evaluating in real-time a first value of the first logic variable and a second value of the second logic variable, in conformance with the item usage expectation and the real-time usage data, wherein a logical result of the logic table is determined in real-time in accordance with all of the logic table, the item usage expectation, and at least one of the real-time usage data for the location and the real-time usage data for the personal motion; and

determining via the hardware processor whether the portable item is extant or displaced based on the real-time logical result of the logic table.

3. The electronic device of claim 2, wherein the hardware processor is configured to make the determination of the state of being extant and at least one of:

the state of being displaced, and

a plurality of subsidiary states of being displaced;

based on at least one of;

any of the logic tables of FIG. 1L, FIG. 1M, FIG. 5B, FIG. 5C, FIG. 5F, FIG. 5H, and FIG. 9A; and

any of the flow charts of FIG. 1K, FIG. 4A, FIG. 5A, FIG. 5D, FIG. 5E, FIG. 5G, FIG. 10E, FIG. 10G, and FIG. 10J.

4. The electronic device of claim 1, wherein the hardware processor is further configured to distinguish a plurality of subsidiary states of being displaced, wherein said plurality of subsidiary states of being displaced comprises at least two of a lost state, a misplaced state, a misappropriated state, a stolen state, a borrowed state, and a state of wandering.

5. The electronic device of claim 4, wherein the hardware processor is further configured to distinguish the plurality of subsidiary states of being displaced based on at least one of:

any of the logic tables of FIG. 1L, FIG. 1M, FIG. 5B, FIG. 5C, FIG. 5F, FIG. 5H, and FIG. 9A; and

any of the flow charts of FIG. 1K, FIG. 4A, FIG. 5A, FIG. 5D, FIG. 5E, FIG. 5G, FIG. 10E, FIG. 10G, and FIG. 10J.

6. The electronic device of claim 1, further comprising a local output communications interface configured to communicate with a person in immediate proximity to the portable item, wherein:

the memory is configured to provide long-term, static storage for a personal identity data descriptive of at least one of the authorized user and of a third-party associated with the authorized user, wherein said personal identity data is sufficient to enable to at least one of;

(i) communicating with, identifying, or locating the authorized user, and

(ii) communicating with, identifying, or locating the third-party; and

in response to the assessment that the item is displaced, the hardware processor is configured to present an item displacement local alert, wherein;

said item displacement local alert is presented by the electronic device via the local output communications interface of the electronic device; and

said item displacement local alert comprises the personal identity data.

7. The electronic device of claim 1, wherein the hardware processor is configured to:

(A) assess, for at least one of the real-time location data and the real-time personal motion data, a degree to which the real-time usage data for the portable item during the TimeInt_PI_Use is not in conformance with the associated item usage expectation; and

(B) based on the assessment of the degree of non-conformance in step (A), to further assess a probability that the portable item is extant or that the portable item is displaced.

8. The electronic device of claim 1, wherein:

the hardware processor is further configured to cause the memory to store;

a calendar comprising a plurality of events scheduled for the authorized user of the portable item, each respective event comprising a respective TimeInt_PI_Use; and

a plurality of respective item usage expectations for the portable item, wherein each respective item usage expectation of the plurality is associated in the memory with a respective use of the portable item by the authorized user during the respective TimeInt_PI_Use for a respective event, or with a storage of the portable item, as designated by the authorized user, during the respective TimeInt_PI_Use for the respective event;

the environmental sensor is configured to obtain real-time usage data for the real-time location and real-time motion of the portable item resulting from the use or change of use of the portable item for each event of the plurality of events comprising the calendar;

the hardware processor is further configured to compare the real-time usage data for each event with the respective item usage expectation for each event; and

the hardware processor is configured to assess, via the comparison and according to the respective item usage expectation, whether the item is extant or displaced for each of the plurality of events of the calendar.

9. The electronic device of claim 1, wherein:

the hardware processor is further configured to receive from the authorized user, and to cause the memory to store, a home base, wherein the home base comprises;

an identification of a location which is designated, by the authorized user, as a location of anticipated recurring occupation or anticipated recurring activity by the authorized user, and

a home base TimeInt_PI_Use, designated by the authorized user, comprising at least one of;

a plurality of time intervals of the anticipated recurring occupation of the home base location or anticipated recurring activity in the home base location by the authorized user of the home base location; and

time intervals when the authorized use anticipates maintaining the portable item at the home base location, such maintenance being at least one of on-person of the authorized user, in storage in substantial proximity to the authorized user, or in storage when the authorized user is not present at the home base;

the memory is further configured to store a home base usage expectation associated with the home base and comprising;

an expectation that the portable will be at the location of the home base during the home base TimeInt_PI_Use; and

an anticipated use or storage of the portable item at the home base;

during each time interval of the home base TimeInt_PI_Use, the processor is configured to determine if the portable item is in use or in storage according to the home base usage expectation; and

the hardware processor is further configured to determine whether the portable item is extant or displaced during the TimeInt_PI_Use based on a comparison between (i) the home base usage expectation and (ii) a real-time detection of the actual location of the portable item during the TimeInt_PI_Use and a usage or storage of the portable item during the TimeInt_PI_Use.

10. The electronic device of claim 9, wherein the memory is further configured to store a plurality of distinct item usage expectations for a single home base, each respective distinct item usage expectation being associated with one or more respective time intervals of the home base TimeInt_PI_Use, wherein different portions of time at a home base may be assigned different respective anticipated uses and storages of the portable item.

11. The electronic device of claim 1, wherein the processor is further configured to:

assess, based on the personal motion of a person in possession of the portable item, if the person in possession of the portable item is the authorized user of the portable item; and

determine, based on a combined assessment of (i) the real-time location data, (ii) the real-time personal motion data, and (iii) the assessment of whether the portable item is in possession of the authorized user or is not in possession of the authorized user, whether the portable item extant or displaced.

12. A computer-readable, non-transitory storage medium storing instructions that, when executed by a hardware processor of an electronic device, causes the hardware processor to execute a method for assessing the state of a portable item, the electronic device configured to be operated while in collocation with the portable item, the electronic device comprising the hardware processor, a memory, and an environmental sensor configured to detect at least a location of the portable item and a personal motion of the portable item, the method comprising:

storing locally at the portable item in the memory;

(i) an expected time interval of portable item use (TimeInt_PI_Use), as designated by an authorized user of the portable item, comprising at least one of (A) a specified usage date and (B) a specified usage time range starting at a first designated time and ending at a later second designated time falling within a specified day or within a specified plurality of consecutive days, wherein;

said specified usage date or said specified usage time range pertain to a use of the portable item by the authorized user or a storage of the portable item as designated by the authorized user; and

said authorized user is an owner of the portable item or a person to whom portable item control has been delegated by the portable item'"'"'s owner; and

(ii) a portable item usage expectation which is associated in the memory with the TimeInt_PI_Use, wherein the portable item usage expectation comprises expectations for location data and for personal motion data, for the portable item during the TimeInt_PI_Use, in consequence of at least one of;

an anticipated use of the portable item during the TimeInt_PI_Use by the authorized user, and

an anticipated storage of the portable item during the TimeInt_PI_Use as designated by the authorized user,

wherein the expected location data, the expected personal motion data, and the at least one of the specified usage date and specified usage time range are locally stored at the portable item;

wherein said personal motion comprises at least one of;

(i) local movement of the portable item caused by movement by a person who possesses said portable item on their person, and (ii) a lack of motion of said portable item wherein the portable item is stationary;

storing in the memory a communications address of a remote processing device which is designated to receive an item displacement alert message on behalf of the authorized user;

upon determining that at least one of the current date and the current time fall within said specified usage date or said specified usage time range of the designated TimeInt_PI_Use;

(a) monitoring, via the environmental sensor, a real-time usage data for the portable item during the TimeInt_PI_Use, the real-time usage data comprising the location of the portable item and the personal motion of the portable item during the TimeInt_PI_Use; and

(b) comparing locally at the portable item the real-time usage data of the portable item, within the TimeInt_PI_Use, with the stored item usage expectation which is associated with the TimeInt_PI_Use; and

determining locally at the portable item by the hardware processor of the electronic device, via the comparison, and based on a combined assessment of the real-time location data and the real-time personal motion data, whether the portable item is one of;

extant, wherein the real-time usage data the portable item detected by the environmental sensor which is configured to detect the location and the personal motion of the portable item is in conformance with the item usage expectation during the TimeInt_PI_Use;

or

displaced, wherein the real-time usage data for the portable item detected by the environmental sensor which is configured to detect the location and the personal motion of the portable item is not in conformance with the item usage expectation during the TimeInt_PI_Use; and

upon determining that the portable item is displaced, transmitting the item displacement alert message, which is indicative of the portable item'"'"'s state of displacement, to the communications address of the remote processing device;

wherein at least one of said authorized user and a party designated by said authorized user may be automatically and remotely alerted, via the designated remote processing device, to the displacement of the portable item.

13. The computer-readable, non-transitory storage medium of claim 12, wherein the method further comprises:

storing in the electronic device a logic table comprising at least one of a truth table, a fuzzy logic table, and a heuristic, said logic table further comprising;

(i) a first logical variable based on the real-time location data and a second logical variable based on the real-time personal motion data, wherein;

the first and second logical variables provide input to the logic table; and

at least one of a truth value for each logical variable and a probability value for each logical variable is determined based on a comparison of (1) at least one of the real-time location data and the real-time personal motion with (2) the usage expectation for the portable item; and

(ii) a plurality of logical results based on the first and second logical variables;

evaluating in real-time a first value of the first logic variable and a second value of the second logic variable, in conformance with the item usage expectation and the real-time usage data, wherein a logical result of the logic table is determined in real-time in accordance with all of the logic table, the item usage expectation, and the real-time usage data for the location and the real-time usage data for the personal motion; and

determining via the hardware processor whether the portable item is extant or displaced based on a logical result of the logic table.

14. The computer-readable, non-transitory storage medium of claim 13, wherein the method further comprises:

making the determination of the state of being extant and at least one of;

the state of being displaced, and

a plurality of subsidiary states of being displaced;

based on at least one of;

any of the logic tables of FIG. 1L, FIG. 1M, FIG. 5B, FIG. 5C, FIG. 5F, FIG. 5H, and FIG. 9A; and

any of the flow charts of FIG. 1K, FIG. 4A, FIG. 5A, FIG. 5D, FIG. 5E, FIG. 5G, FIG. 10E, FIG. 10G, and FIG. 10J.

15. The computer-readable, non-transitory storage medium of claim 12, wherein the method step of determining the state of being displaced further comprises:

distinguishing a plurality of subsidiary states of being displaced, wherein said plurality of subsidiary states of being displaced comprises at least two of a lost state, a misplaced state, a misappropriated state, a stolen state, a borrowed state, and a state of wandering.

16. The computer-readable, non-transitory storage medium of claim 15, wherein the method further comprises distinguishing the plurality of subsidiary states of being displaced based on at least one of:

any of the logic tables of FIG. 1L, FIG. 1M, FIG. 5B, FIG. 5C, FIG. 5F, FIG. 5H, and FIG. 9A; and

any of the flow charts of FIG. 1K, FIG. 4A, FIG. 5A, FIG. 5D, FIG. 5E, FIG. 5G, FIG. 10E, FIG. 10G, and FIG. 10J.

17. The computer-readable, non-transitory storage medium of claim 12, wherein the electronic device further comprises a local output communications interface configured to communicate with a person in immediate proximity to the portable item, and the method further comprises:

providing via the memory a long-term, static storage for a personal identity data descriptive of at least one of the authorized user and of a third-party associated with the authorized user, wherein;

said personal identity data is sufficient to enable to at least one of;

(i) communicating with, identifying, or locating the authorized user, and

(ii) communicating with, identifying, or locating the third-party; and

in response to the assessment that the item is displaced, presenting via the local output communications interface an item displacement local alert, wherein said item displacement local alert comprises the personal identity data.

18. The computer-readable, non-transitory storage medium of claim 12, wherein the method further comprises:

(A) assessing, for at least one of the real-time location data and the real-time personal motion data, a degree to which the real-time usage data for the portable item during the TimeInt_PI_Use is not in conformance with the associated item usage expectation; and

(B) based on the assessment of the degree of non-conformance in step (A), further assessing a probability that the portable item is extant or that the portable item is displaced.

19. The computer-readable, non-transitory storage medium of claim 12, wherein the method further comprises:

storing in the memory;

a calendar comprising a plurality of events scheduled for the authorized user of the portable item, each respective event comprising a respective TimeInt_PI_Use; and

a plurality of respective item usage expectations for the portable item, wherein each respective item usage expectation of the plurality is associated in the memory with a respective use of the portable item by the authorized user during the respective TimeInt_PI_Use for a respective event, or with a storage of the portable item, as designated by the authorized user, during the respective TimeInt_PI_Use for the respective event; and

obtaining, in real-time via the environmental sensor, usage data for the real-time location and real-time motion of the portable item resulting from the use or change of use of the portable item for each event of the plurality of events comprising the calendar;

comparing, via the hardware processor, the real-time usage data for each event with the respective item usage expectation for each event; and

assessing, via the comparison and according to the respective item usage expectation, whether the item is extant or displaced for each of the plurality of events of the calendar.

20. The computer-readable, non-transitory storage medium of claim 12, wherein the method further comprises:

storing in the memory a home base, wherein the home base comprises;

an identification of a location which is designated, by the authorized user, as a location of anticipated recurring occupation or anticipated recurring activity by the authorized user, and

a home base TimeInt_PI_Use, designated by the authorized user, comprising at least one of;

a plurality of time intervals of the anticipated recurring occupation of the home base location or anticipated recurring activity at the home base location by the authorized user of the home base location; and

a plurality of time intervals when the authorized use anticipates maintaining the portable item at the home base location, such maintenance being at least one of on-person of the authorized user, in storage in substantial proximity to the authorized user, or in storage when the authorized user is not present at the home base;

further storing in the memory a home base usage expectation associated in the memory with the home base and comprising;

an expectation that the portable will be at the location of the home base during the home base TimeInt_PI_Use; and

an anticipated use or storage of the portable item at the home base;

during each time interval of the home base Timelnt_PI_Use, determining via the hardware processor if the portable item is in use or in storage according to the home base usage expectation; and

further determining via the hardware processor whether the portable item is extant or displaced during the TimeInt_PI_Use based on a comparison between (i) the home base usage expectation and (ii) a real-time detection of the actual location of the portable item during the TimeInt_PI_use home base time intervals and a usage or storage of the portable item during the TimeInt_PI_use.

21. The computer-readable, non-transitory storage medium of claim 20, wherein the method further comprises:

storing in the memory a plurality of distinct usage expectations for the home base, each respective distinct item usage expectation being associated with one or more respective home base item TimeInt_PI_Use, wherein different portions of time at a home base may be assigned different respective anticipated uses or storages of the portable item.

22. The computer-readable, non-transitory storage medium of claim 12, wherein the method further comprises at least one of:

assessing, based on the personal motion of a person in possession of the portable item, if the person in possession of the portable item is the authorized user of the portable item; and

determining, based on a combined assessment of (i) the real-time location data, (ii) the real-time personal motion data, and (iii) the assessment of whether the portable item is in possession of the authorized user or is not in possession of the authorized user, whether the portable item extant or displaced.