Systems and methods for managing content presentation involving a head mounted display and a presentation device

• US 9,933,985 B2
• Filed: 01/20/2015
• Issued: 04/03/2018
• Est. Priority Date: 01/20/2015
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Forutanpour, Babak, Baker, Daniel S., Menendez, Jose R., Kimberly, William E., Ganesh, Shriram, Rajagopalan, Ramachandran
• Primary Examiner(s): Tryder, Gregory J
• Assistant Examiner(s): Patel, Jitesh
• Application Number:
  US14/601,094
• Publication Number:
  US 20160210097A1
• Time in Patent Office: 1,169 Days
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens

Abstract

Various arrangements are presented to facilitate the handoff of presentation of content between a head mounted display (HMD) and another presentation device, such as a television. For example, based upon separate events, video and audio being presented to a user via a presentation device may be handed off to an HMD that the user is wearing for continued presentation. In response to a first reference event occurring, the HMD may initiate continued presentation of the video content that was being viewed by the user on the presentation device. At a later time, in response to a second reference event, the HMD may initiate continued presentation of the audio content.

Claims

1. A method for managing content presentation involving a head mounted display (HMD), wherein the HMD is configured to permit a field of view of at least a portion of a surrounding environment, the method comprising:

determining, by the HMD, that video content output of a presentation device separate from the HMD is within the field of view, wherein the presentation device outputs the video content and audio content;

detecting, by the HMD, a first reference event indicating that the video content output of the presentation device is no longer within the field of view, wherein detecting the first reference event comprises;

measuring, by the HMD, a first color temperature of at least a portion of the field of view;

comparing the measured first color temperature with a first reference color temperature; and

based on comparing the measured first color temperature with the first reference color temperature, determining that the first reference event has occurred;

in response to the first reference event, initiating, by the HMD, continued presentation of the video content via the HMD.

2. The method of claim 1, further comprising:

after the first reference event, detecting, by the HMD, a second reference event; and

in response to the second reference event, initiating, by the HMD, continued presentation of the audio content via the HMD, wherein the HMD initiates continued presentation of the audio content at a later time than when the HMD initiates the continued presentation of the video content.

3. The method for managing content presentation involving the HMD of claim 1, wherein determining that the video content output of the presentation device is within the field of view comprises:

measuring, by the HMD, a second color temperature of at least a portion of the field of view, wherein measuring the second color temperature occurs before or after the measuring of the first color temperature;

comparing the measured second color temperature with a second threshold color temperature, the second threshold color temperature being the same or different than the first reference color temperature; and

based on the comparison, determining that the video content output of the presentation device is within the field of view.

4. The method for managing content presentation involving the HMD of claim 2, wherein detecting the second reference event comprises:

determining a first location of the HMD;

calculating a distance from the first location to a second location of the presentation device;

comparing the distance to a threshold distance; and

based upon comparing the distance to the threshold distance, determining that the second reference event has occurred.

5. The method for managing content presentation involving the HMD of claim 2, wherein detecting the second reference event comprises:

measuring, via a microphone of the HMD, a signal-to-noise ratio of the audio content output by the presentation device;

comparing the measured signal-to-noise ratio of the audio content to a threshold signal-to-noise ratio; and

based upon comparing the measured signal-to-noise ratio of the audio content to the threshold signal-to-noise ratio, determining that the second reference event has occurred.

6. The method for managing content presentation involving the HMD of claim 2, wherein at least five seconds elapse between the first reference event and the second reference event.

7. The method for managing content presentation involving the HMD of claim 2, wherein initiating the continued presentation of the audio content via the HMD comprises fading in the audio content from a first volume to a second, louder volume.

8. The method for managing content presentation involving the HMD of claim 1, wherein initiating the continued presentation of the video content via the HMD comprises fading in a brightness of the video content to be presented via the HMD.

9. A system for managing content presentation via a head mounted display (HMD), wherein the HMD is configured to permit a field of view of at least a portion of a surrounding environment, the system comprising:

memory; and

one or more processors coupled to the memory and configured to;

determine that video content output of a presentation device separate from the HMD is within the field of view, wherein the presentation device outputs the video content and audio content;

detect a first reference event indicating that the video content output of the presentation device is no longer within the field of view, wherein detecting the first reference event comprises;

measuring a first color temperature of at least a portion of the field of view;

comparing the measured first color temperature with a first reference color temperature; and

based on comparing the measured first color temperature with the first reference color temperature, determining that the first reference event has occurred;

in response to the first reference event, initiate continued presentation of the video content via the HMD.

10. The system of claim 9, wherein the one or more processors are further configured to:

after the first reference event, detect a second reference event; and

in response to the second reference event, initiate continued presentation of the audio content via the HMD, wherein the HMD initiates continued presentation of the audio content at a later time than when the HMD initiates the continued presentation of the video content.

11. The system of claim 9, wherein the one or more processors are further configured to:

measure a second color temperature of at least a portion of the field of view, wherein measuring the second color temperature occurs before or after the measuring of the first color temperature;

compare the measured second color temperature with a second threshold color temperature, the second threshold color temperature being the same or different than the first reference color temperature; and

based on the comparison, determine that the video content output of the presentation device is within the field of view.

12. The system of claim 10, wherein the one or more processors are further configured to:

determine a first location of the HMD;

calculate a distance from the first location to a second location of the presentation device;

compare the distance to a threshold distance; and

based upon comparing the distance to the threshold distance, determine that the second reference event has occurred.

13. The system of claim 10, wherein the one or more processors are further configured to:

measure, via a microphone of the HMD, a signal-to-noise ratio of the audio content output by the presentation device;

compare the measured signal-to-noise ratio of the audio content to a threshold signal-to-noise ratio; and

based upon comparing the measured signal-to-noise ratio of the audio content to the threshold signal-to-noise ratio, determine that the second reference event has occurred.

14. The system of claim 10, wherein the one or more processors are further configured to initiate the continued presentation of the audio content via the HMD by fading in the audio content from a first volume to a second, louder volume.

15. The system of claim 9, wherein the one or more processors are further configured to initiate the continued presentation of the video content via the HMD by fading in a brightness of the video content to be presented via the HMD.

16. A system for managing content presentation involving a head mounted display (HMD), wherein the HMD is configured to permit a field of view of at least a portion of a surrounding environment, the system comprising:

means for determining that video content output of a presentation device separate from the HMD is within the field of view, wherein the presentation device outputs the video content and audio content;

means for detecting a first reference event indicating that the video content output of the presentation device is no longer within the field of view, wherein the means for detecting the first reference event comprises;

means for measuring a first color temperature of at least a portion of the field of view;

means for comparing the measured first color temperature with a first reference color temperature; and

means for determining that the first reference event has occurred based on comparing the measured first color temperature with the first reference color temperature;

means for initiating continued presentation of the video content via the HMD in response to the first reference event.

17. The system for managing content presentation involving the HMD of claim 16, further comprising:

means for detecting a second reference event after the first reference event; and

means for initiating continued presentation of the audio content via the HMD in response to the second reference event, wherein

the HMD initiates continued presentation of the audio content at a later time than when the HMD initiates the continued presentation of the video content.

18. The system for managing content presentation involving the HMD of claim 16, wherein the means for determining that the video content output of the presentation device is no longer within the field of view comprises:

means for measuring a second color temperature of at least a portion of the field of view before or after the measuring of the first color temperature;

means for comparing the measured second color temperature with a second threshold color temperature, the second threshold color temperature being the same or different than the first reference color temperature; and

means for determining that a user is viewing the video content output by the presentation device based on the comparison.

19. The system for managing content presentation involving the HMD of claim 17, wherein the means for detecting the second reference event comprises:

means for determining a first location of the HMD;

means for calculating a distance from the first location to a second location of the presentation device;

means for comparing the distance to a threshold distance; and

means for determining that the second reference event has occurred based upon comparing the distance to the threshold distance.

20. The system for managing content presentation involving the HMD of claim 17, wherein the means for detecting the second reference event comprises:

means for measuring, at the HMD, a signal-to-noise ratio of the audio content output by the presentation device;

means for comparing the measured signal-to-noise ratio of the audio content to a threshold signal-to-noise ratio; and

means for determining that the second reference event has occurred based upon comparing the measured signal-to-noise ratio of the audio content to the threshold signal-to-noise ratio.

21. The system for managing content presentation involving the HMD of claim 17, wherein the means for initiating the continued presentation of the audio content via the HMD comprises means for fading in the audio content from a first volume to a second, louder volume.

22. The system for managing content presentation involving the HMD of claim 16, wherein the means for initiating the continued presentation of the video content via the HMD comprises means for fading in a brightness of the video content to be presented via the HMD.

23. A method for managing content presentation, the method comprising:

determining, by a first head mounted display (HMD) configured to permit a first field of view of at least a portion of a surrounding environment, that video content output of a presentation device is within the first field of view, wherein;

the presentation device outputs the video content; and

determining that the video content output of the presentation device is within the first field of view comprises;

measuring a first color temperature of at least a portion of the first field of view; and

determining that the video content output of the presentation device is within the first field of view based, at least in part, on a comparison of the first measured color temperature with a threshold color temperature;

detecting, by the first HMD, a first reference event indicating that the video content output of the presentation device is no longer within the first field of view;

in response to the first reference event, initiating, by the first HMD, continued presentation of the video content via the first HMD;

determining that the video content output of the presentation device is still being viewed; and

in response to determining the video content output of the presentation device is still being viewed, continuing presentation of the video content at the presentation device, wherein the video content presented by the presentation device corresponds to the video content presented by the first HMD.

24. The method for managing content presentation of claim 23, wherein detecting the first reference event comprises:

measuring a second color temperature of the at least a portion of the first field of view; and

determining that the first reference event has occurred based, at least in part, on a comparison of the second measured color temperature with a threshold color temperature.

25. The method for managing content presentation of claim 23, wherein determining that the video content output of the presentation device is still being viewed comprises:

analyzing a captured image of a viewing region of the video content of the presentation device; and

determining, based on the captured image, a user is present in the viewing region.

26. The method for managing content presentation of claim 23, wherein determining that the video content output by the presentation device is still being viewed is based on a location of a second HMD.

27. The method for managing content presentation of claim 23, further comprising:

detecting, by a second HMD configured to permit a second field of view of at least a second portion of the surrounding environment, a second reference event indicating that the presentation device is no longer within the second field of view; and

in response to detecting the first reference event and the second reference event, ceasing continued presentation of the video content by the presentation device.

28. A system for managing content presentation, the system comprising:

memory; and

one or more processors coupled to the memory and configured to;

determine that, for a first head mounted display (HMD) configured to permit a first field of view of at least a portion of a surrounding environment, video content output of a presentation device is within the first field of view, wherein;

the presentation device is outputting the video content; and

determining that the video content output of the presentation device is within the first field of view comprises;

measuring a first color temperature of at least a portion of the first field of view; and

determining that the video content output of the presentation device is within the first field of view based, at least in part, on a comparison of the first measured color temperature with a threshold color temperature;

detect a first reference event indicating that the video content output of the presentation device is no longer within the first field of view;

in response to the first reference event, initiate continued presentation of the video content via the first HMD;

determine that the video content output by the presentation device is still being viewed; and

in response to determining the video content output of the presentation device is still being viewed, continue presentation of the video content at the presentation device, wherein the video content presented by the presentation device corresponds to the video content presented by the first HMD.

29. The system of claim 28, wherein the one or more processors are further configured to:

measure, via the first HMD, a second color temperature of the at least a portion of the first field of view;

compare the second measured color temperature with a threshold color temperature; and

based on the comparison, determine that the first reference event has occurred.

30. The system of claim 28, wherein the one or more processors are further configured to:

analyze a captured image of a viewing region of the video content of the presentation device; and

determine, based on the captured image, a user is present in the viewing region.

31. The system of claim 28, wherein the one or more processors are further configured to determine that the video content output by the presentation device is still being viewed is based on a location of a second HMD.

32. The system of claim 28, wherein the one or more processors are configured to:

detect, by a second HMD configured to permit a second field of view of at least a second portion of the surrounding environment, a second reference event indicating that the presentation device is no longer within the second field of view; and

in response to detecting the first reference event and the second reference event, cease continued presentation of the video content by the presentation device.

33. The system of claim 28, wherein the system comprises the first HMD and a second HMD.

34. A system for managing content presentation, the system comprising:

means for determining that, for a first head mounted display (HMD) configured to permit a first field of view of at least a portion of a surrounding environment, video content output of a presentation device is within the first field of view, wherein;

the presentation device outputs the video content; and

the means for determining that the video content output of the presentation device is within the first field of view comprise;

means for measuring a first color temperature of at least a portion of the first field of view; and

means for determining that the video content output of the presentation device is within the first field of view based, at least in part, on a comparison of the first measured color temperature with a threshold color temperature;

means for detecting, via the first HMD, a first reference event indicating that the video content output of the presentation device is no longer within the first field of view;

means for initiating continued presentation of the video content via the first HMD in response to the first reference event;

means for determining that the video content output of the presentation device is still being viewed; and

means for continuing presentation of the video content at the presentation device in response to determining the video content output of the presentation device is still being viewed, wherein the video content presented by the presentation device corresponds to the video content presented by the first HMD.

35. The system of claim 34, wherein the means for detecting the first reference event comprises:

means for measuring a color second temperature of the at least a portion of the first field of view;

means for comparing the second measured color temperature with a threshold color temperature; and

means for determining that the first reference event has occurred based on the comparison.

36. The system of claim 34, wherein the means for determining that the video content output of the presentation device is still being viewed comprises:

means for analyzing a captured image of a viewing region of the video content of the presentation device; and

means for determining, based on the captured image, a user is present in the viewing region.

37. The system of claim 34, wherein the means for determining that the video content output by the presentation device is still being viewed uses a location of a second HMD.

38. The system of claim 34, further comprising:

means for detecting, by a second HMD configured to permit a second field of view of at least a second portion of the surrounding environment, a second reference event indicating that the presentation device is no longer within the second field of view; and

means for ceasing continued presentation of the video content by the presentation device in response to detecting the first reference event and the second reference event.