SYSTEM AND METHOD FOR ACTIVITY MONITORING

• US 20140244344A1
• Filed: 02/26/2013
• Published: 08/28/2014
• Est. Priority Date: 02/26/2013
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Bilet, Maxime Jean Jerome, Hyde, Roderick A., Ishikawa, Muriel Y., Kare, Jordin T., Myhrvold, Nathan P., Pan, Tony S., Peterson, Nels R., Tegreene, Clarence T., Wood, Lowell L. Jr., Wood, Victoria Y.H., Young, Christopher Charles
• Granted Patent: US 9,449,219 B2
• Time in Patent Office: Days
• US Class Current: 705/7.28
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06Q 10/0635 Risk analysis of enterprise or organisation activities
• CPC Class Codes: G06Q 30/018 Certifying business or products
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A system for activity monitoring includes a tracking component, an activity identification component, a procedural component, and a notification component. The tracking component tracks an individual and one or more objects in a work area using a three-dimensional tracking system. The activity identification component identifies an activity of the individual and any of the one or more objects that are affected by the activity. The procedural component determines whether the activity violates one or more procedural rules pertaining to one or more of the individual, the work area, and the one or more objects. The notification component provides a notification of a violation.

Claims

1. A computer-readable storage medium comprising program code for causing one or more processors to perform a method for activity monitoring, the method comprising:

tracking an individual and one or more objects in a work area using a three-dimensional tracking system;

identifying, using the three-dimensional tracking system, an activity of the individual and any of the one or more objects that are affected by the activity;

determining whether the activity violates one or more procedural rules pertaining to one or more of the individual, the work area, and the one or more objects; and

providing a notification of a violation.

15. The computer-readable storage medium of claim 1, wherein tracking the one or more objects comprises tracking a food item.

16. The computer-readable storage medium of claim 1, wherein tracking the one or more objects comprises tracking tableware.

27. The computer-readable storage medium of claim 1, wherein tracking the one or more objects comprises tracking a cleaning implement.

28. The computer-readable storage medium of claim 1, wherein tracking an individual and one or more objects in a work area comprises tracking the individual and the one or more objects in a kitchen.

44. The computer-readable storage medium of claim 1, wherein tracking comprises tracking an individual and one or more objects in a work area logically divided into two or more logical areas.

45. The computer-readable storage medium of claim 44, wherein the two or more logical areas comprise a raw meat area.

52. The computer-readable storage medium of claim 44, wherein the two or more logical areas comprise a hand washing area.

76. The computer-readable storage medium of claim 1, wherein the identified activity comprises contact between the individual and an object of the one or more objects.

77. The computer-readable storage medium of claim 1, wherein the identified activity comprises contact between an individual and a surface of the work area.

83. The computer-readable storage medium of claim 1, wherein the identified activity comprises contact between an object of the one or more objects and a surface of the work area.

95. The computer-readable storage medium of claim 1, wherein the identified activity comprises an activity having a risk of contaminating an object of the one or more objects.

96. The computer-readable storage medium of claim 1, wherein the identified activity comprises an activity having a risk of contaminating at least a portion of the work area.

125. The computer-readable storage medium of claim 1, wherein a procedural rule of the one or more procedural rules defines violation of a food handling procedure and determining comprises determining whether the activity violates the food handling procedure.

152. The computer-readable storage medium of claim 1, wherein the procedural rule defines a combination of one or more work area conditions that comprise a violation and wherein determining whether the activity violates the procedural rule comprises comparing current work area conditions to the defined combination of work area conditions.

166. The computer-readable storage medium of claim 1, wherein providing a notification comprises indicating in the work area an occurrence of a violation in response to determining that the activity violates a procedural rule of the one or more procedural rules.

167. The computer-readable storage medium of claim 166, wherein indicating comprises visually indicating the occurrence of the violation.

171. The computer-readable storage medium of claim 167, wherein visually indicating comprises spotlighting one or more of an object of the one or more objects, the individual, and a portion of the work area using a spotlight.

173. The computer-readable storage medium of claim 167, wherein visually indicating comprises displaying on a display a diagram of the work area indicating the occurrence of the violation.

174. The computer-readable storage medium of claim 166, wherein indicating comprises audibly playing a sound indicating the occurrence of the violation.

225. The computer-readable storage medium of claim 1, the method further comprising maintaining a history for the one or more objects, the individual, and portions of the work area.

226. The computer-readable storage medium of claim 225, wherein determining whether the activity violates a procedural rule is based on the history.

227. The computer-readable storage medium of claim 225, the method further comprising determining a contamination status of one or more of an object of the one or more objects, a portion of the work area, and the individual based on the history.

231. The computer-readable storage medium of claim 1, the method further comprising maintaining a database of violating activities and one or more work area conditions associated with each violating activity.

232. The computer-readable storage medium of claim 231, the method further comprising analyzing the database to identify a combination of the associated workplace conditions having a correlation to a violating activity.

233. The computer-readable storage medium of claim 231, the method further comprising analyzing the database to identify a procedure having a high correlation to a violating activity.

234. The computer-readable storage medium of claim 231, the method further comprising analyzing the database to identify a physical layout feature having a high correlation to a violating activity.

235. The computer-readable storage medium of claim 231, the method further comprising analyzing the database to identify an individual having a high correlation to a violating activity.

238. The computer-readable storage medium of claim 231, the method further comprising detecting a combination of the associated workplace conditions having a correlation to a violating activity and providing a warning.

2-14. -14. (canceled)

17-26. -26. (canceled)

29-43. -43. (canceled)

46-51. -51. (canceled)

53-75. -75. (canceled)

78-82. -82. (canceled)

84-94. -94. (canceled)

97-124. -124. (canceled)

126-151. -151. (canceled)

153-165. -165. (canceled)

168-170. -170. (canceled)

172. (canceled)

175-224. -224. (canceled)

228-230. -230. (canceled)

236-237. -237. (canceled)

239-298. -298. (canceled)

299. A system for activity monitoring, the system comprising:

a tracking component to track an individual and one or more objects in a work area using a three-dimensional tracking system;

an activity identification component to identify, using the three-dimensional tracking system, an activity of the individual and any of the one or more objects that are affected by the activity;

a procedural component to determine whether the activity violates one or more procedural rules pertaining to one or more of the individual, the work area, and the one or more objects; and

a notification component to provide a notification of a violation.

567. The system of claim 299, further comprising a tracking storage component to store information regarding tracking of the individual and the one or more objects in the work area.

568. The system of claim 567, wherein the tracking storage component stores video footage of the work area.

573. The system of claim 568, wherein the tracking storage component stores video footage comprising video footage corresponding to a violation.

577. The system of claim 567, wherein the tracking storage component stores abstracted information regarding one or more of the work area, the activity of the individual, and the one or more objects.

581. The system of claim 299, wherein the three-dimensional tracking system comprises a tracer detection component to detect a tracer material, the tracer material comprising a material that transfers to a contacting surface in response to contact with the tracer material.

587. The system of claim 581, wherein the three-dimensional tracking system comprises a tracer trigger component to trigger detectability of the tracer material.

593. The system of claim 299, wherein the notification component provides the notification by automatically issuing a citation in response to the procedural component determining that the activity violates the one or more procedural rules.

594. The system of claim 593, wherein the citation indicates violation of a health violation.

300-566. -566. (canceled)

569-572. -572. (canceled)

574-576. -576. (canceled)

578-580. -580. (canceled)

582-586. -586. (canceled)

588-591. -591. (canceled)

592. (canceled)

595-603. -603. (canceled)

604. A method for activity monitoring, the method comprising:

tracking an individual and one or more objects in a work area using a three-dimensional tracking system;

identifying, using the three-dimensional tracking system, an activity of the individual and any of the one or more objects that are affected by the activity;

determining whether the activity violates one or more procedural rules pertaining to one or more of the individual, the work area, and the one or more objects; and

providing a notification of a violation.