Personal holographic billboard

• US 9,390,561 B2
• Filed: 04/12/2013
• Issued: 07/12/2016
• Est. Priority Date: 04/12/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Brown, Cameron G., Lee, Abby, Mount, Brian J., McCulloch, Daniel J., Scavezze, Michael J., Hastings, Ryan L., Bevis, John, Thomas, Mike, Amador-Leon, Ron
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): HICKEY, DIANA S
• Application Number:
  US13/862,349
• Publication Number:
  US 20140306994A1
• Time in Patent Office: 1,187 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 1/00347 with another still picture apparatus, e.g. hybrid still picture apparatus circuits or arrangements for control or supervision between image input and image output device H04N1/32
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information

Abstract

Methods for generating and displaying personalized virtual billboards within an augmented reality environment are described. The personalized virtual billboards may facilitate the sharing of personalized information between persons within an environment who have varying degrees of acquaintance (e.g., ranging from close familial relationships to strangers). In some embodiments, a head-mounted display device (HMD) may detect a mobile device associated with a particular person within an environment, acquire a personalized information set corresponding with the particular person, generate a virtual billboard based on the personalized information set, and display the virtual billboard on the HMD. The personalized information set may include information associated with the particular person such as shopping lists and classified advertisements. The HMD may share personalized information associated with an end user of the HMD with the mobile device based on whether the particular person is a friend or unknown to the end user.

Claims

1. A head-mounted display device for generating and displaying personalized virtual billboards within an augmented reality environment, comprising:

one or more processors configured to detect that a first mobile device is within a distance of the head-mounted display device and determine a classification level for a first person associated with the first mobile device in response to detecting that the first mobile device is within the distance of the head-mounted display device, the classification level corresponds with whether the first person is classified as a friend of an end user of the head-mounted display device or is classified as being unknown to the end user of the head-mounted display device, the one or more processors configured to generate one or more searching criteria based on the classification level and determine whether a set of personalized information acquired from the first mobile device satisfies the one or more searching criteria, the one or more processors configured to generate a virtual billboard based on the set of personalized information in response to determining that the set of personalized information satisfies the one or more searching criteria, the one or more processors configured to detect that a second person different from the first person is within a field of view of the head-mounted display device and determine a position for the virtual billboard within a field of view of the head-mounted display device such that the virtual billboard does not obstruct a view of a portion of the second person within the field of view, the one or more processors configured to render one or more images corresponding with the virtual billboard located at the position within the field of view; and

a display in communication with the one or more processors, the display configured to display the one or more images such that the virtual billboard is perceived to exist within the augmented reality environment.

2. The head-mounted display device of claim 1, wherein:

the one or more processors configured to acquire a set of formatting information associated with the virtual billboard from the first mobile device and generate the virtual billboard based on the set of personalized information and the set of formatting information.

3. The head-mounted display device of claim 1, wherein:

the one or more processors configured to determine whether the set of personalized information satisfies the one or more searching criteria by determining whether the set of personalized information includes a listing associated with an online classified advertisement.

4. The head-mounted display device of claim 1, wherein:

the one or more processors configured to determine whether the set of personalized information satisfies the one or more searching criteria by determining whether the set of personalized information includes one or more personal characteristics.

5. The head-mounted display device of claim 1, wherein:

the set of personalized information includes at least one of a relationship status of the first person or a blood type of the first person.

6. The head-mounted display device of claim 1, wherein:

the portion of the second person comprises a face of the second person.

7. A method for generating and displaying personalized virtual billboards within an augmented reality environment, comprising:

detecting that a first mobile device is within a distance of an origin device, the origin device comprises a head-mounted display device;

determining a classification level of a first person associated with the first mobile device, the classification level corresponds with whether the first person is classified as a friend of an end user of the origin device or is classified as being unknown to the end user of the origin device;

generating one or more searching criteria based on the classification level;

acquiring a set of personalized information associated with a virtual billboard from the first mobile device;

detecting that the set of personalized information satisfies the one or more searching criteria;

generating the virtual billboard based on the set of personalized information in response to detecting that the set of personalized information satisfies the one or more searching criteria;

detecting that a second person different from the first person is within a field of view of the origin device;

determining a position for the virtual billboard within a field of view of the origin device such that the virtual billboard does not obstruct a view of a portion of the second person within the field of view;

rendering one or more images corresponding with the virtual billboard located at the position within the field of view using the origin device; and

displaying the one or more images using the origin device.

8. The method of claim 7, further comprising:

acquiring a set of formatting information associated with the virtual billboard from the first mobile device, the generating the virtual billboard includes generating the virtual billboard based on the set of personalized information and the set of formatting information.

9. The method of claim 7, wherein:

the detecting that the set of personalized information satisfies the one or more searching criteria includes determining whether the set of personalized information includes a listing associated with an online classified advertisement.

10. The method of claim 7, wherein:

the detecting that the set of personalized information satisfies the one or more searching criteria includes determining whether the set of personalized information includes one or more personal characteristics.

11. The method of claim 7, wherein:

the detecting that the first mobile device is within a distance of an origin device includes identifying the first person within a field of view of the origin device and determining that the first person is within the distance of the origin device.

12. The method of claim 7, wherein:

the set of personalized information includes at least one of a relationship status of the first person or a blood type of the first person.

13. The method of claim 7, wherein:

the portion of the second person comprises a face of the second person.

14. One or more processor readable storage devices containing processor readable code for programming one or more processors to perform a method for generating and displaying personalized virtual billboards within an augmented reality environment comprising the steps of:

acquiring a GPS location associated with a first mobile device;

detecting that the first mobile device is within a distance of a head-mounted display device based on the GPS location of the first mobile device;

determining a classification level for a first person associated with the first mobile device in response to detecting that the first mobile device is within the distance of the head-mounted display device, the classification level corresponds with whether the first person is classified as a friend of an end user of the head-mounted display device or is classified as being unknown to the end user of the head-mounted display device;

generating one or more searching criteria based on the classification level;

acquiring a second set of personalized information associated with a second virtual billboard from the first mobile device, the second set of personalized information is associated with the first person;

acquiring a second set of formatting information associated with the second virtual billboard from the first mobile device, the second set of formatting information dictates how the second virtual billboard is displayed on the head-mounted display device;

determining whether the second set of personalized information satisfies the one or more searching criteria;

generating the second virtual billboard based on the second set of personalized information and the second set of formatting information in response to determining that the second set of personalized information satisfies the one or more searching criteria;

detecting that a second person different from the first person is within a field of view of the head-mounted display device;

determining a position for the second virtual billboard within a field of view of the head-mounted display device such that the second virtual billboard does not obstruct a view of either a portion of the second person within the field of view or a portion of the first person within the field of view;

rendering one or more images corresponding with the second virtual billboard located at the position within the field of view; and

displaying the one or more images using the head-mounted display device.

15. The one or more processor readable storage devices of claim 14, wherein:

the determining whether the second set of personalized information satisfies the one or more searching criteria includes determining whether the second set of personalized information includes a listing associated with an online classified advertisement.

16. The one or more processor readable storage devices of claim 14, wherein:

the determining whether the second set of personalized information satisfies the one or more searching criteria includes determining whether the second set of personalized information includes one or more personal characteristics.

17. The one or more processor readable storage devices of claim 14, wherein:

the second set of personalized information includes at least one of a relationship status of the first person or a blood type of the first person.

18. The one or more processor readable storage devices of claim 14, wherein:

the portion of the second person comprises a face of the second person.