Methods and systems for making the use of head-mounted displays less obvious to non-users

• US 9,310,611 B2
• Filed: 01/03/2013
• Issued: 04/12/2016
• Est. Priority Date: 09/18/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Forutanpour, Babak, Baker, Daniel S., Yamakawa, Devender A.
• Primary Examiner(s): Chauhan, Ulka
• Assistant Examiner(s): Yoon, Sae Won
• Application Number:
  US13/733,758
• Publication Number:
  US 20140078175A1
• Time in Patent Office: 1,195 Days
• Field of Search: 345 7- 8, 345/633
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Various arrangements are presented for positioning virtual objects displayed by a head-mounted display. A location of a person within a real-world scene may be determined. A virtual object may be displayed to a user such that the virtual object is superimposed over the face of the person.

Claims

1. A method for positioning virtual objects displayed by a head-mounted display, comprising:

receiving a set of person rankings for a plurality of persons;

receiving a set of virtual object rankings from the user for a plurality of virtual objects;

determining a location of a face of a person within a real-world scene;

determining a unique identity of the person;

determining a relative ranking of the person within the real-world scene based on the unique identity of the person and the set of person rankings, the relative ranking being relative to other persons within the real-world scene;

selecting a virtual object from among the plurality of virtual objects based on both the relative ranking of the person and the set of virtual object rankings, wherein the rank of the selected virtual object correlates to the relative ranking of the person; and

displaying, via the head-mounted display, the virtual object such that the virtual object is superimposed over the face of the person.

2. The method for positioning virtual objects displayed by the head-mounted display of claim 1, wherein content of the virtual object is unrelated to the person.

3. The method for positioning virtual objects displayed by the head-mounted display of claim 1, further comprising:

after displaying the virtual object such that the virtual object is superimposed over the face of the person, relocating the virtual object to being superimposed over a second face of a second person after a threshold period of time.

4. The method for positioning virtual objects displayed by the head-mounted display of claim 1, further comprising:

after displaying the virtual object such that the virtual object is superimposed over the face of the person, determining a user is looking up at greater than a threshold angle; and

in response to determining the user is looking up at greater than the threshold angle, relocating the virtual object such that the virtual object is not superimposed over the face of the person.

5. The method for positioning virtual objects displayed by the head-mounted display of claim 1, wherein the virtual object is presented by the head-mounted display such that the virtual object is visible only to a user of the head-mounted display.

6. The method for positioning virtual objects displayed by the head-mounted display of claim 1, wherein the virtual object is transparent such that the face of the person and the virtual object are simultaneously visible to a user of the head-mounted display.

7. The method for positioning virtual objects displayed by the head-mounted display of claim 1, further comprising:

determining an amount of motion by the person; and

after displaying the virtual object such that the virtual object is superimposed over the face of the person, displaying, via the head-mounted display, the virtual object such that the virtual object is superimposed over the face of a second person due to the determined amount of motion by the person.

8. The method for positioning virtual objects displayed by the head-mounted display of claim 1, further comprising:

before displaying the virtual object such that the virtual object is superimposed over the face of the person, selecting the person from a second plurality of persons using brightness levels of each person of the second plurality of persons.

33. The method for positioning virtual objects displayed by the head-mounted display of claim 1, further comprising modifying the set of person rankings based on a number of times the person appears within the user'"'"'s field of view.

9. A system for presenting virtual objects, comprising:

an image capture device;

a head-mounted display;

a processor; and

a memory communicatively coupled with and readable by the processor and having stored therein processor-readable instructions which, when executed by the processor, cause the processor to;

receive a set of person rankings for a plurality of persons;

receive a set of virtual object rankings from the user for a plurality of virtual objects;

determine a location of a face of a person within a real-world scene using an image captured by the image capture device;

determine a unique identity of the person;

determine a relative ranking of the person within the real-world scene based on the unique identity of the person and the set of person rankings, the relative ranking being relative to other persons within the real-world scene;

select a virtual object from among the plurality of virtual objects based on both the relative ranking of the person and the set of virtual object rankings, wherein the rank of the selected virtual object correlates to the relative ranking of the person; and

cause, via the head-mounted display, the virtual object to be displayed such that the virtual object is superimposed over the face of the person.

10. The system for presenting virtual objects of claim 9, wherein content of the virtual object is unrelated to the person.

11. The system for presenting virtual objects of claim 9, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, relocate the virtual object to being superimposed over a second face of a second person after a threshold period of time.

12. The system for presenting virtual objects of claim 9, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, determine a user of the head-mounted display is looking up at greater than a threshold angle; and

in response to determining the user is looking up at greater than the threshold angle, cause display of the virtual object to be relocated such that the virtual object is not superimposed over the face of the person.

13. The system for presenting virtual objects of claim 9, wherein the virtual object is presented by the head-mounted display such that the virtual object is visible only to a user of the head-mounted display.

14. The system for presenting virtual objects of claim 9, wherein the virtual object is transparent such that the face of the person and the virtual object are simultaneously visible to a user of the head-mounted display.

15. The system for presenting virtual objects of claim 9, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

determine an amount of motion by the person; and

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, causing the virtual object to be displayed such that the virtual object is superimposed over the face of a second person due to the determined amount of motion by the person.

16. The system for presenting virtual objects of claim 9, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

before causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, select the person from a second plurality of persons using brightness levels of each person of the second plurality of persons.

17. A computer program product residing on a non-transitory processor-readable medium for positioning virtual objects displayed by a head-mounted display, the computer program product comprising processor-readable instructions configured to cause a processor to:

receive a set of person rankings for a plurality of persons;

receive a set of virtual object rankings from the user for a plurality of virtual objects;

determine a location of a face of a person within a real-world scene;

determine a unique identity of the person;

determine a relative ranking of the person within the real-world scene based on the unique identity of the person and the set of person rankings, the relative ranking being relative to other persons within the real-world scene;

select a virtual object from among the plurality of virtual objects based on both the relative ranking of the person and the set of virtual object rankings, wherein the rank of the selected virtual object correlates to the relative ranking of the person; and

cause, via the head-mounted display, the virtual object to be displayed such that the virtual object is superimposed over the face of the person.

18. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein content of the virtual object is unrelated to the person.

19. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, relocate the virtual object to being superimposed over a second face of a second person after a threshold period of time.

20. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, determine a user of the head-mounted display is looking up at greater than a threshold angle; and

in response to determining the user is looking up at greater than the threshold angle, cause display of the virtual object to be relocated such that the virtual object is not superimposed over the face of the person.

21. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the virtual object is presented by the head-mounted display such that the virtual object is visible only to a user of the head-mounted display.

22. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the virtual object is transparent such that the face of the person and the virtual object are simultaneously visible to a user of the head-mounted display.

23. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

determine an amount of motion by the person; and

after causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, causing the virtual object to be displayed such that the virtual object is superimposed over the face of a second person due to the determined amount of motion by the person.

24. The computer program product for positioning virtual objects displayed by the head-mounted display of claim 17, wherein the processor-readable instructions further comprise processor-readable instructions which, when executed by the processor, cause the processor to:

before causing the virtual object to be displayed such that the virtual object is superimposed over the face of the person, select the person from a second plurality of persons using brightness levels of each person of the second plurality of persons.

25. An apparatus for positioning displayed virtual objects, comprising:

means for receiving a set of person rankings for a plurality of persons;

means for receiving a set of virtual object rankings from the user for a plurality of virtual objects;

means for determining a location of a face of a person within a real-world scene;

means for determining a unique identity of the person;

means for determining a relative ranking of the person within the real-world scene based on the unique identity of the person and the set of person rankings, the relative ranking being relative to other persons within the real-world scene;

means for selecting a virtual object from among the plurality of virtual objects based on both the relative ranking of the person and the set of virtual object rankings, wherein the rank of the selected virtual object correlates to the relative ranking of the person; and

means for displaying the virtual object such that the virtual object is superimposed over the face of the person.

26. The apparatus for positioning displayed virtual objects of claim 25, wherein content of the virtual object is unrelated to the person.

27. The apparatus for positioning displayed virtual objects of claim 25, further comprising:

means for relocating the virtual object to being superimposed over a second face of a second person after a threshold period of time, wherein relocating occurs after displaying the virtual object such that the virtual object is superimposed over the face of the person.

28. The apparatus for positioning displayed virtual objects of claim 25, further comprising:

means for determining a user is looking up at greater than a threshold angle, wherein determining occurs after displaying the virtual object such that the virtual object is superimposed over the face of the person; and

means for relocating the virtual object such that the virtual object is not superimposed over the face of the person, wherein relocating occurs in response to determining the user is looking up at greater than the threshold angle.

29. The apparatus for positioning displayed virtual objects of claim 25, wherein the virtual object is presented such that the virtual object is visible only to a user of the apparatus.

30. The apparatus for positioning displayed virtual objects of claim 25, wherein the virtual object is transparent such that the face of the person and the virtual object are simultaneously visible to a user of the apparatus.

31. The apparatus for positioning displayed virtual objects of claim 25, further comprising:

means for determining an amount of motion by the person; and

means for displaying the virtual object such that the virtual object is superimposed over the face of a second person due to the determined amount of motion by the person.

32. The apparatus for positioning displayed virtual objects of claim 25, further comprising:

means for selecting the person from a second plurality of persons using brightness levels of each person of the second plurality of persons prior to displaying the virtual object such that the virtual object is superimposed over the face of the person.