PERSONAL HOLOGRAPHIC BILLBOARD

• US 20140306994A1
• Filed: 04/12/2013
• Published: 10/16/2014
• Est. Priority Date: 04/12/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Brown, Cameron G., Mount, Brian J., McCulloch, Daniel J., Scavezze, Michael J., Hastings, Ryan L., Bevis, John, Lee, Abby, Thomas, Mike, Amador-Leon, Ron
• Granted Patent: US 9,390,561 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 1/00347 with another still picture apparatus, e.g. hybrid still picture apparatus circuits or arrangements for control or supervision between image input and image output device H04N1/32
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information

Abstract

Methods for generating and displaying personalized virtual billboards within an augmented reality environment are described. The personalized virtual billboards may facilitate the sharing of personalized information between persons within an environment who have varying degrees of acquaintance (e.g., ranging from close familial relationships to strangers). In some embodiments, a head-mounted display device (HMD) may detect a mobile device associated with a particular person within an environment, acquire a personalized information set corresponding with the particular person, generate a virtual billboard based on the personalized information set, and display the virtual billboard on the HMD. The personalized information set may include information associated with the particular person such as shopping lists and classified advertisements. The HMD may share personalized information associated with an end user of the HMD with the mobile device based on whether the particular person is a friend or unknown to the end user.

Claims

1. An electronic device for generating and displaying personalized virtual billboards within an augmented reality environment, comprising:

one or more processors, the one or more processors detect a first mobile device within a distance of the electronic device, the one or more processors determine a classification level for a first person associated with the first mobile device, the one or more processors generate one or more searching criteria based on the classification level, the one or more processors acquire a set of personalized information associated with a virtual billboard from the first mobile device, the one or more processors determine whether the set of personalized information satisfies the one or more searching criteria, the one or more processors generate the virtual billboard based on the set of personalized information in response to determining that the set of personalized information satisfies the one or more searching criteria, the one or more processors render one or more images corresponding with the virtual billboard; and

a display in communication with the one or more processors, the display displays the one or more images such that the virtual billboard is perceived to exist within the augmented reality environment.

2. The electronic device of claim 1, wherein:

the one or more processors acquire a set of formatting information associated with the virtual billboard from the first mobile device, the one or more processors generate the virtual billboard based on the set of personalized information and the set of formatting information.

3. The electronic device of claim 1, wherein:

the one or more processors determine a position for the virtual billboard within a field of view of the electronic device based on a location of the first person within the field of view, the one or more processors render the one or more images such that the virtual billboard is perceived to exist at the position within the field of view of the electronic device.

4. The electronic device of claim 1, wherein:

the one or more processors determine a position for the virtual billboard within a field of view of the electronic device based on a location of a second person within the field of view, the one or more processors render the one or more images such that the virtual billboard does not obstruct a view of the second person within the field of view.

5. The electronic device of claim 1, wherein:

the one or more processors determine whether the set of personalized information satisfies the one or more searching criteria by determining whether the set of personalized information includes a listing associated with an online classified advertisement.

6. The electronic device of claim 1, wherein:

the one or more processors determine whether the set of personalized information satisfies the one or more searching criteria by determining whether the set of personalized information includes one or more personal characteristics.

7. The electronic device of claim 1, wherein:

the electronic device comprises an HMD; and

the set of personalized information includes at least one of a relationship status of the first person or a blood type of the first person.

8. A method for generating and displaying personalized virtual billboards within an augmented reality environment, comprising:

detecting a first mobile device within a distance of an origin device;

identifying a classification level of a first person associated with the first mobile device;

generating one or more searching criteria based on the classification level;

acquiring a set of personalized information associated with a virtual billboard from the first mobile device, the set of personalized information is associated with the first person;

determining whether the set of personalized information satisfies the one or more searching criteria;

generating the virtual billboard based on the set of personalized information in response to determining that the set of personalized information satisfies the one or more searching criteria; and

rendering one or more images corresponding with the virtual billboard.

9. The method of claim 8, further comprising:

acquiring a set of formatting information associated with the virtual billboard from the first mobile device, the generating the virtual billboard includes generating the virtual billboard based on the set of personalized information and the set of formatting information; and

displaying the one or more images on the origin device.

10. The method of claim 8, further comprising:

determining a position for the virtual billboard within a field of view of the origin device based on a location of the first person within the field of view, the rendering one or more images includes rendering the one or more images such that the virtual billboard is perceived to exist at the position within the field of view of the origin device.

11. The method of claim 8, further comprising:

determining a position for the virtual billboard within a field of view of the origin device based on a location of a second person within the field of view, the rendering one or more images includes rendering the one or more images such that the virtual billboard does not obstruct a view of the second person within the field of view.

12. The method of claim 8, wherein:

the determining whether the set of personalized information satisfies the one or more searching criteria includes determining whether the set of personalized information includes a listing associated with an online classified advertisement.

13. The method of claim 8, wherein:

the determining whether the set of personalized information satisfies the one or more searching criteria includes determining whether the set of personalized information includes one or more personal characteristics.

14. The method of claim 8, wherein:

the detecting a first mobile device within a distance of an origin device includes identifying the first person within a field of view of the origin device and determining that the first person is within the distance of the origin device.

15. The method of claim 8, wherein:

the origin device comprises an HMD.

16. One or more storage devices containing processor readable code for programming one or more processors to perform a method for generating and displaying personalized virtual billboards within an augmented reality environment comprising the steps of:

detecting one or more computing devices within an environment, the one or more computing devices include a first mobile device;

determining a classification level for a first person associated with the first mobile device;

generating one or more searching criteria based on the classification level;

acquiring a second set of personalized information associated with a second virtual billboard from the first mobile device, the second set of personalized information is associated with the first person;

acquiring a second set of formatting information associated with the second virtual billboard from the first mobile device;

determining whether the second set of personalized information satisfies the one or more searching criteria;

generating the second virtual billboard based on the second set of personalized information and the second set of formatting information in response to determining that the second set of personalized information satisfies the one or more searching criteria; and

rendering one or more images corresponding with the second virtual billboard.

17. The one or more storage devices of claim 16, further comprising:

determining a position for the second virtual billboard within a field of view of the origin device based on a location of the first person within the field of view, the rendering one or more images includes rendering the one or more images such that the second virtual billboard is perceived to exist at the position within the field of view of the origin device; and

displaying the one or more images on an origin device.

18. The one or more storage devices of claim 16, further comprising:

determining a position for the second virtual billboard within a field of view of the origin device based on a location of a second person within the field of view, the rendering one or more images includes rendering the one or more images such that the second virtual billboard does not obstruct a view of the second person within the field of view.

19. The one or more storage devices of claim 16, wherein:

the determining whether the second set of personalized information satisfies the one or more searching criteria includes determining whether the second set of personalized information includes a listing associated with an online classified advertisement.

20. The one or more storage devices of claim 16, wherein:

the determining whether the second set of personalized information satisfies the one or more searching criteria includes determining whether the second set of personalized information includes one or more personal characteristics.