Displaying location-based rules on augmented reality glasses

• US 9,858,676 B2
• Filed: 01/08/2015
• Issued: 01/02/2018
• Est. Priority Date: 01/08/2015
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, Jr., John M., Rakshit, Sarbajit K., Trim, Craig M.
• Primary Examiner(s): Demeter, Hilina K
• Application Number:
  US14/592,333
• Publication Number:
  US 20160203639A1
• Time in Patent Office: 1,090 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

Augmented reality glasses include: a wearable frame; a lens attached to the wearable frame; a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses; a rule retrieval device that retrieves one or more rules that pertain to the physical location and field of view of the user; a graphical information generator that generates graphical information that delineates an area in the field of view and describes a rule that is related to an environment of the delineated area; and a display coupled to the wearable frame, where the display overlays the graphical information onto the lens of the wearable frame according to the field of view of the user.

Claims

1. Augmented reality glasses comprising:

a wearable frame;

a lens attached to the wearable frame;

a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses;

a rule retrieval device, wherein the rule retrieval device retrieves one or more rules that pertain to the physical location and the field of view of the user, wherein the one or more rules identify one or more interests that have been identified by the user;

a receiver for receiving the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited from being performed by the user at the physical location of the field of view, and wherein a graphical information generator generates icon representations describing the prohibited activities;

a display coupled to the wearable frame, wherein the display displays one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

a user input device for receiving a user input that defines the one or more rules, wherein the user input is from the user generating a signal that removes one or more of the icon representations from the display coupled to the wearable frame; and

one or more processors for;

determining that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “

no photography”

icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

2. The augmented reality glasses of claim 1, wherein the positioning device comprises a 3-axis positioning device and a geographical positioning device.

3. The augmented reality glasses of claim 1, wherein the user input is from the user selecting the one or more rules from a list of rules on a user interface of a smart phone.

4. The augmented reality glasses of claim 1, further comprising:

a receiver for receiving the one or more rules from a weather service, wherein the weather service identifies current real-time weather conditions beyond the physical location of the field of view.

5. The augmented reality glasses of claim 1, further comprising:

a receiver for receiving the one or more rules from a social media service, wherein the social media service provides a recommendation review of facilities within the physical location of the field of view.

6. The augmented reality glasses of claim 1, wherein the activities that are prohibited are from a group consisting of photography, smoking, and pet accompaniment.

7. The augmented reality glasses of claim 1, wherein the rule retrieval device retrieves the one or more rules from a smart phone being carried by the user.

8. A method for alerting a user of wearable augmented reality eyeglasses of rules pertaining to an environment within a prescribed field of view, the method comprising:

determining, by a positioning device, a physical location of a user;

determining, by the positioning device, a field of view for the user at the physical location;

retrieving, by a rule retrieval device, one or more rules pertaining to one or more environments within the field of view, wherein the one or more rules identify one or more interests that have been identified by the user;

receiving, by a receiver associated with a computing device, the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited at the physical location of the field of view, and wherein the graphical information generator generates icon representations describing the prohibited activities;

displaying, by a display on wearable augmented reality eyeglasses, one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

receiving, by a user input device, a user input that defines the one or more rules, wherein the user input is from the user generating a signal on the display that removes one or more of the icon representations from the display coupled to the wearable frame;

determining, by one or more processors, that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, by one or more processors, and based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “

no photography”

icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

9. The method of claim 8, wherein the display is a projector, and wherein the projector overlays the images on the lens.

10. The method of claim 8, wherein the display is a video screen, wherein the images are overlaid directly onto the video screen.

11. The method of claim 8, further comprising:

receiving, by a rules receiving device, a user input that defines the one or more rules.

12. The method of claim 8, further comprising:

receiving, by the rules receiving device, the one or more rules from a mapping service, wherein the mapping service identifies which activities are allowed at the physical location of the field of view.

13. The method of claim 8, further comprising:

receiving, by the rules receiving device, the one or more rules from a weather service, wherein the weather service identifies current real-time weather conditions beyond the physical location of the field of view.

14. The method of claim 8, further comprising:

determining, by an integration web application server, that the user has low vision; and

in response to determining that the user has low vision, magnifying the images of the one or more environments that are of interest to the user that has low vision.

15. The method of claim 8, wherein an image presented on the lens of the wearable augmented reality eyeglasses is a retail establishment, and wherein the method further comprises:

receiving, by the receiver on the wearable augmented reality glasses, a plurality of favorable reports about the retail establishment, wherein the plurality of favorable reports are from a social media service; and

in response to receiving the plurality of favorable reports about the retail establishment, overlaying a “

favorable icon”

over an image of the retail establishment as presented on the lens of the wearable augmented reality eyeglasses.

16. A system comprising:

an integration web application server, wherein the integration web application server has access to rules related to fields of view; and

one or more augmented reality glasses, wherein each of the one or more augmented reality glasses comprises;

a wearable frame;

a lens attached to the wearable frame;

a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses;

a rule retrieval device, wherein the rule retrieval device retrieves one or more rules that pertain to the physical location and the field of view of the user, wherein the one or more rules identify one or more interests that have been identified by the user;

a receiver for receiving the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited at the physical location of the field of view, and wherein a graphical information generator generates icons describing the prohibited activities;

a display coupled to the wearable frame, wherein the display displays one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

a user input device for receiving a user input that defines the one or more rules, wherein the user input is from the user generating a signal on the display that removes one or more of the icon representations from the display coupled to the wearable frame; and

one or more processors for;

determining that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “

no photography”

icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

17. The system of claim 16, wherein at least one of the one or more augmented reality glasses further comprises:

a user input device for receiving a user input that defines the one or more rules.

18. The system of claim 16, further comprising:

a services server, wherein the services server provides a mapping service to at least one of the one or more augmented reality glasses, and wherein the mapping service identifies which activities are allowed and which activities are prohibited at the physical location of the field of view.