CENTRALIZED VIDEO SURVEILLANCE DATA IN HEAD MOUNTED DEVICE

• US 20150146004A1
• Filed: 11/27/2013
• Published: 05/28/2015
• Est. Priority Date: 11/27/2013
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Kritt, Barry Alan, Rakshit, Sarbajit Kumar
• Granted Patent: US 9,569,669 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An apparatus includes a security location module that tracks a location of a user. The user has a heads-up display with a display that allows viewing by the user of items along with electronic display images. An object identification module identifies an object for tracking using cameras. A selection module selects the identified object for tracking, an object location module identifies a location and direction information of the selected object and an alert module sends the location and the direction information of the selected object to the heads-up display. A display module identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display, or provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

Claims

1. An apparatus comprising:

a security location module that tracks a location of a user, the user having a heads-up display, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;

an object identification module that identifies an object for tracking, the object identified using one or more cameras of a video surveillance system;

a selection module that selects the identified object for tracking;

an object location module that identifies a location and direction information of the selected object;

an alert module that sends the location and the direction information of the selected object to the heads-up display; and

an display module that one of

identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display; and

provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display,

wherein the security location module, the object identification module, the selection module, the object location module, the alert module, and the display module comprise one or more of hardware and executable code, the executable code stored on one or more computer readable storage media.

2. The apparatus of claim 1, wherein the display module identifies the selected object in the heads-up display by locating a symbol on one or more of

an image of the selected object visible in the heads-up display;

and

a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to an obstruction between the selected object and the heads-up display.

3. The apparatus of claim 2, wherein the display module identifies the selected object in the heads-up display as a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to other obstructions between the selected object and the heads-up display and tracks the selected object until the selected object is in view of the user through the heads-up display.

4. The apparatus of claim 1, wherein the display module identifies the selected object in the heads-up display by one or more of an icon, a symbol, and a color change.

5. The apparatus of claim 1, wherein the display module further comprises an object information module that displays information about the selected object along with identification of the selected object by the display module.

6. The apparatus of claim 5, wherein the information about the selected object comprises one or more of

a description of the selected object;

an indication of direction of the selected object; and

an indication of speed of the selected object.

7. The apparatus of claim 5, wherein the object comprises a person and further comprising a recognition module that uses an image of the person acquired by the one or more cameras to determine an identity of the person, wherein the object information module displays identity information in the heads-up display in addition to identifying the selected object in the heads-up display.

8. The apparatus of claim 7, wherein the identify information comprises one or more of a picture of the person, a name of the person, and a description of the person.

9. The apparatus of claim 1, wherein the one or more cameras of the video surveillance system comprises cameras each mounted at a fixed location with a camera display, from each camera, located in a central location.

10. The apparatus of claim 1, wherein the selection module selects the identified object for tracking by receiving input from a user to select the identified object.

11. The apparatus of claim 1, wherein the one or more cameras of the video surveillance system comprise one or more cameras mounted on the heads-up display of one or more users different than the heads-up display where the alert module sends the location and direction information of the selected object.

12. The apparatus of claim 1, wherein the display module tracks movement of the selected object and adjusts one or more of

identification of the selected object in the heads-up display to continually track the selected object;

and

updates instruction of the heads-up display to direct the user regarding movement of the heads-up display so the selected object is in the field of view of the heads-up display.

13. The apparatus of claim 1, wherein the alert module sends the location and direction information of the selected object to two or more heads-up displays.

14. The apparatus of claim 1, wherein the heads-up display comprises one or more of:

a transparent display that allows viewing by the user of the items in the field of view of the user through the transparent display along with electronic images in the field of view of the user on the transparent display; and

an electronic display that combines images of the items in the field of view of the user with electronic display images in the field of view of the user.

15. A method comprising:

tracking a location of a user, the user having a heads-up display, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;

identifying an object for tracking, the object identified using one or more cameras of a video surveillance system;

selecting the identified object for tracking;

identifying a location and direction information of the selected object;

sending the location and the direction information of the selected object to the heads-up display; and

one of identifying the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display, and providing instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

16. The method of claim 15, further comprising displaying information about the selected object along with identification of the selected object.

17. The method of claim 15, wherein the object comprises a person and further comprising using an image of the person acquired by the one or more cameras to determine an identity of the person, wherein the identity information is displayed in the heads-up display in addition to identifying the selected object in the heads-up display.

18. The method of claim 15, wherein identifying the selected object in the heads-up display comprises locating a symbol in the heads-up display on one or more of

an image of the selected object visible in the heads-up display;

and

a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to other obstructions between the selected object and the heads-up display.

19. A system comprising:

one or more cameras;

a heads-up display on a user, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;

a security location module that tracks a location of the user;

an object identification module that identifies an object for tracking, the object identified using the one or more cameras;

a selection module that selects the identified object for tracking;

an object location module that identifies a location and direction information of the selected object;

an alert module that sends the location and the direction information of the selected object to the heads-up display; and

a display module that one of

identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display; and

provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

20. The system of claim 19, further comprising one or more of

electronic displays that display images captured by the one or more cameras;

a server that communicates with the one or more cameras and the heads-up display; and

a wireless network in communication with the heads-up display.