Modifying virtual object display properties to increase power performance of augmented reality devices

• US 9,727,996 B2
• Filed: 09/09/2016
• Issued: 08/08/2017
• Est. Priority Date: 11/13/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Pandey, Umesh, Srinivasan, Chandrasekar, Forutanpour, Babak
• Primary Examiner(s): FARAGALLA, MICHAEL A
• Application Number:
  US15/260,633
• Publication Number:
  US 20160379396A1
• Time in Patent Office: 333 Days
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

A display device may be provided and may be configured to present a virtual field of view comprising a virtual object superimposed on a real-world scene. A controller may be provided and configured to modify display of the virtual object by the display device based on a first color of a real-world object in the real-world scene. The virtual object in the virtual field of view may be superimposed over the real-world object. A lumen output of the display device for displaying the virtual object may be decreased.

Claims

1. An apparatus comprising:

a display device, configured to present a virtual field of view comprising a virtual object superimposed on a real-world scene; and

a controller, configured to;

modify a display of the virtual object using a second color to display the virtual object via the display device, wherein the second color contrasts with and is selected based on a first color of a real-world object in the real-world scene, wherein the virtual object in the virtual field of view is superimposed over the real-world object; and

decrease a lumen output of the display device for displaying the virtual object based on an amount of contrast between the first color of the real-world object in the real-world scene and the second color.

2. The apparatus of claim 1, wherein the display device comprises a head-mounted display.

3. The apparatus of claim 1, wherein the second color has at least a predefined amount of color contrast with the first color of the real-world object.

4. The apparatus of claim 1, wherein the predefined amount of color contrast is determined based on a minimum distance between the first color and the second color in the Lab color space.

5. The apparatus of claim 1, the system further comprising:

a battery, wherein the controller is further configured to modify the display of the virtual object if a charge level of the battery is below a predefined threshold.

6. The apparatus of claim 1, wherein power consumption of the display device is decreased by decreasing the lumen output of the display device for displaying the virtual object.

7. The apparatus of claim 1, wherein the controller is further configured to:

modify the display of the virtual object by moving the virtual object to be displayed, via the display device, from a first location to a second location within the virtual field of view of the display device.

8. The apparatus of claim 1, wherein the controller is further configured to:

wait a predefined period of time before moving the virtual object from the first location to the second location within the virtual field of view of the display device.

9. The apparatus of claim 1, the system further comprising:

a camera, configured to monitor a focus of a user'"'"'s eyes, wherein

the controller is further configured to decrease a brightness level of the virtual object when the user'"'"'s eyes are focused away from the virtual object.

10. The apparatus of claim 1 wherein the controller comprises a processor.

11. A method comprising:

presenting, by a display device, a virtual field of view comprising a virtual object superimposed on a real-world scene;

modifying a display of the virtual object using a second color that contrasts with and is selected based on a first color of a real-world object in the real-world scene, wherein the virtual object in the virtual field of view is superimposed over the real-world object; and

decreasing a lumen output of the display device for displaying the virtual object based on an amount of contrast between the first color of the real-world object in the real-world scene and the second color.

12. The method of claim 11, wherein the display device comprises a head-mounted display.

13. The method of claim 11, wherein the second color has at least a predefined amount of color contrast with the first color of the real-world object.

14. The method of claim 11, further comprising:

determining the predefined amount of color contrast based on a minimum distance between the first color and the second color in the Lab color space.

15. The method of claim 11, further comprising:

modifying the display of the virtual object if a charge level of a battery coupled with the augmented reality display is below a predefined threshold.

16. The method of claim 11, further comprising:

decreasing power consumption of the display device by decreasing the lumen output of the display device for displaying the virtual object.

17. The method of claim 11, further comprising:

modifying the display of the virtual object by moving the virtual object from a first location to a second location within the virtual field of view of the display device.

18. The method of claim 11, further comprising:

waiting a predefined period of time before moving the virtual object from the first location to the second location within the virtual field of view of the display device.

19. The method of claim 11, further comprising:

monitoring a focus of a user'"'"'s eyes; and

decreasing a brightness level of the virtual object when the user'"'"'s eyes are focused in a direction away from the virtual object.

20. An apparatus comprising:

means for presenting a virtual field of view comprising a virtual object superimposed on a real-world scene;

means for modifying a display of the virtual object using a second color that contrasts with and is selected based on a first color of a real-world object in the real-world scene, wherein the virtual object in the virtual field of view is superimposed over the real-world object; and

means for decreasing a lumen output of the display device for displaying the virtual object based on an amount of contrast between the first color of the real-world object in the real-world scene and the second color.

21. The apparatus of claim 20, wherein the second color has at least a predefined amount of color contrast with the first color of the real-world object.

22. The apparatus of claim 20, further comprising:

means for determining the predefined amount of color contrast based on a minimum distance between the first color and the second color in the Lab color space.

23. The apparatus of claim 20, further comprising:

means for modifying the display of the virtual object if a charge level of a battery coupled with the augmented reality display is below a predefined threshold.

24. A computer program product residing on a non-transitory processor-readable medium, the computer program product comprising processor-readable instructions configured to cause a processor to:

cause, via a display device, a virtual field of view to be displayed comprising a virtual object superimposed on a real-world scene;

modify a display of the virtual object using a second color that contrasts with and is selected based on a first color of a real-world object in the real-world scene, wherein the virtual object in the virtual field of view is superimposed over the real-world object; and

decrease a lumen output of the display device for displaying the virtual object based on an amount of contrast between the first color of the real-world object in the real-world scene and the second color.

25. The computer program product residing on the non-transitory processor-readable medium for controlling an augmented reality display of claim 24, wherein the second color has at least a predefined amount of color contrast with the first color of the real-world object.