Dynamic display markers

• US 9,466,266 B2
• Filed: 08/28/2013
• Issued: 10/11/2016
• Est. Priority Date: 08/28/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hildreth, Evan Robert, Forutanpour, Babak, Ton, Phuong Lam
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Liang, Dong Hui
• Application Number:
  US14/012,457
• Publication Number:
  US 20150062159A1
• Time in Patent Office: 1,140 Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 21/84 output devices, e.g. displays or monitors
• CPC Class Codes: G06F 2221/032 Protect output to user by software means
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41415 involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk

Abstract

Various arrangements for defining a marker are presented. A first defined marker presented by a public display device may be determined to be insufficient for use by a head mounted display. The first defined marker may be used as a reference point for positioning information for display by the head mounted display. In response to determining that the first defined marker is insufficient, a second marker displayed by the public display device may be defined. The second marker may have a display characteristic different from the first defined marker. The second defined marker may then be used as the reference point for positioning the information for display by the head mounted display. An indication of the second marker may be transmitted to the head mounted display.

Claims

1. A method for defining a marker, the method comprising:

determining, by a display control system, that a first defined marker presented by a public display device separate from and communicatively coupled to the display control system is insufficient for use by a head mounted display separate from and communicatively coupled to the display control system, wherein

the first defined marker is used as a reference point for positioning information for display by the head mounted display;

in response to determining that the first defined marker is insufficient, defining, by the display control system, a second marker displayed by the public display device, the second marker being at a different location than the first defined marker, wherein

the second defined marker is used as the reference point for positioning the information for display by the head mounted display; and

transmitting, by the display control system, an indication of the second marker to the head mounted display enabling the head mounted display to locate the second marker.

2. The method for defining the marker of claim 1, wherein determining that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises:

receiving, by the display control system, feedback from the head mounted display, that indicates the first defined marker cannot be located.

3. The method for defining the marker of claim 1, wherein determining that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises:

receiving, by the display control system, distance data indicating a distance between the public display device and the head mounted display; and

determining, by the display control system, that the first defined marker is insufficient based at least on the distance between the public display device and the head mounted display.

4. The method for defining the marker of claim 1, wherein determining that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises:

measuring, by the display control system, an amount of ambient lighting in a vicinity of the public display device; and

determining, by the display control system, that the first defined marker is insufficient based at least on the amount of ambient lighting.

5. The method for defining the marker of claim 1, wherein determining the indication that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises:

calculating, by the head mounted display, a distance between the head mounted display and the public display device; and

transmitting, by the head mounted display, an indication of the distance to the display control system.

6. The method for defining the marker of claim 1, wherein:

the second defined marker is larger in size than the first defined marker.

7. The method for defining the marker of claim 1, further comprising:

defining, by the display control system, a third marker displayed by the public display device concurrently with the second marker, the third marker having a display characteristic different from display characteristics of the second defined marker, wherein

the third defined marker is used as the reference point for positioning information for display by a second head mounted display; and

transmitting, by the display control system, the third marker to the second head mounted display.

8. The method for defining the marker of claim 7, wherein the third defined marker and the second defined marker are presented simultaneously as part of public information presented by the public display device.

9. The method for defining the marker of claim 1, wherein the second defined marker is a dedicated marker presented by the public display device.

10. The method for defining the marker of claim 1, wherein the display control system determines information to be displayed on the public display device and the head mounted display.

11. The method of claim 1, wherein determining the first defined marker presented by the public display device is insufficient for use by the head mounted display is performed by the display control system automatically without user input.

12. A system for defining a marker, the system comprising:

one or more processors; and

a memory communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions which, when executed by the one or more processors, cause the one or more processors to;

determine that a first defined marker presented by a public display device separate from and communicatively coupled to the system is insufficient for use by a head mounted display separate from and communicatively coupled to the system, wherein

the first defined marker is used as a reference point for positioning information for display by the head mounted display;

in response to determining that the first defined marker is insufficient, define a second marker displayed by the public display device, the second marker being at a different location than the first defined marker, wherein

the second defined marker is used as the reference point for positioning the information for display by the head mounted display; and

transmit an indication of the second marker to the head mounted display enabling the head mounted display to locate the second marker.

13. The system for defining the marker of claim 12, wherein the processor-readable instructions that cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions which, when executed, cause the one or more processors to:

receive feedback from the head mounted display, that indicates the first defined marker cannot be located.

14. The system for defining the marker of claim 12, wherein the processor-readable instructions that cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions which, when executed, cause the one or more processors to:

receive distance data indicating a distance between the public display device and the head mounted display; and

determine that the first defined marker is insufficient based at least on the distance between the public display device and the head mounted display.

15. The system for defining the marker of claim 12, wherein the processor-readable instructions that cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions which, when executed, cause the one or more processors to:

measure an amount of ambient lighting in a vicinity of the public display device; and

determine that the first defined marker is insufficient based at least on the amount of ambient lighting.

16. The system for defining the marker of claim 12, further comprising:

the head mounted display, configured to;

calculate a distance between the head mounted display and the public display device; and

transmit an indication of the distance to the display control system.

17. The system for defining the marker of claim 12, wherein the second defined marker is larger in size than the first defined marker.

18. The system for defining the marker of claim 12, wherein the processor-readable instructions, when executed, further cause the one or more processors to:

define a third marker displayed by the public display device concurrently with the second marker, the third marker having a display characteristic different from display characteristics of the second defined marker, wherein

the third defined marker is used as the reference point for positioning information for display by a second head mounted display; and

transmit the third marker to the second head mounted display.

19. The system for defining the marker of claim 18, wherein the third defined marker and the second defined marker are presented simultaneously as part of public information presented by the public display device.

20. The system for defining the marker of claim 12, wherein the second defined marker is a dedicated marker presented by the public display device.

21. A non-transitory processor-readable medium for defining a marker, comprising processor-readable instructions configured to cause one or more processors of a display control system to:

determine that a first defined marker presented by a public display device separate from and communicatively coupled to the display control system is insufficient for use by a head mounted display separate from and communicatively coupled to the display control system, wherein

the first defined marker is used as a reference point for positioning information for display by the head mounted display;

in response to determining that the first defined marker is insufficient, define a second marker displayed by the public display device, the second marker being at a different location than the first defined marker, wherein

the second defined marker is used as the reference point for positioning the information for display by the head mounted display; and

transmit an indication of the second marker to the head mounted display enabling the head mounted display to locate the second marker.

22. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the processor-readable instructions configured to cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions configured to cause the one or more processors to:

receive feedback from the head mounted display, that indicates the first defined marker cannot be located.

23. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the processor-readable instructions configured to cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions configured to cause the one or more processors to:

receive distance data indicating a distance between the public display device and the head mounted display; and

determine that the first defined marker is insufficient based at least on the distance between the public display device and the head mounted display.

24. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the processor-readable instructions configured to cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions configured to cause the one or more processors to:

measure an amount of ambient lighting in a vicinity of the public display device; and

determine that the first defined marker is insufficient based at least on the amount of ambient lighting.

25. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the processor-readable instructions configured to cause the one or more processors to determine that the first defined marker presented by the public display device is insufficient for use by the head mounted display comprises processor-readable instructions configured to cause the one or more processors to:

receive, from the head mounted display, an indication of a distance between the head mounted display and the public display device to the display control system.

26. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the second defined marker is larger in size than the first defined marker.

27. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the processor-readable instructions are further configured to cause the one or more processors to:

define a third marker displayed by the public display device concurrently with the second marker, the third marker having a display characteristic different from display characteristics of the second defined marker, wherein

the third defined marker is used as the reference point for positioning information for display by a second head mounted display; and

transmit the third marker to the second head mounted display.

28. The non-transitory processor-readable medium for defining the marker of claim 27, wherein the third defined marker and the second defined marker are presented simultaneously as part of public information presented by the public display device.

29. The non-transitory processor-readable medium for defining the marker of claim 21, wherein the second defined marker is a dedicated marker presented by the public display device.

30. An apparatus for defining a marker, the apparatus comprising:

means for determining that a first defined marker presented by a means for public display separate from and communicatively coupled to the apparatus is insufficient for use by a means for private display separate from and communicatively coupled to the apparatus, wherein

the first defined marker is used as a reference point for positioning information for display by the means for private display;

means for defining a second marker displayed by the means for public display in response to determining that the first defined marker is insufficient, the second marker being at a different location than the first defined marker, wherein

the second defined marker is used as the reference point for positioning the information for display by the means for private display; and

means for transmitting an indication of the second marker to the means for private display enabling the means for private display to locate the second marker.

31. The apparatus for defining the marker of claim 30, wherein the means for determining that the first defined marker presented by the means for public display is insufficient for use by the means for private display comprises:

means for receiving feedback from the means for private display, that indicates the first defined marker cannot be located.

32. The apparatus for defining the marker of claim 30, wherein the means for determining that the first defined marker presented by the means for public display is insufficient for use by the means for private display comprises:

means for receiving distance data indicating a distance between the means for public display and the means for private display; and

means for determining that the first defined marker is insufficient based at least on the distance between the means for public display and the means for private display.

33. The apparatus for defining the marker of claim 30, wherein the means for determining that the first defined marker presented by the means for public display is insufficient for use by the means for private display comprises:

means for measuring an amount of ambient lighting in a vicinity of the means for public display; and

means for determining that the first defined marker is insufficient based at least on the amount of ambient lighting.

34. The apparatus for defining the marker of claim 30, wherein the means for determining that the first defined marker presented by the means for public display is insufficient for use by the means for private display comprises:

means for calculating a distance between the means for private display and the means for public display; and

means for transmitting an indication of the distance to the display control system.

35. The apparatus for defining the marker of claim 30, wherein the second defined marker is larger in size than the first defined marker.

36. The apparatus for defining the marker of claim 30, further comprising:

means for defining a third marker displayed by the means for public display concurrently with the second marker, the third marker having a display characteristic different from display characteristics of the second defined marker, wherein

the third defined marker is used as the reference point for positioning information for display by a second means for private display; and

means for transmitting the third marker to the second means for private display.

37. The apparatus for defining the marker of claim 36, wherein the third defined marker and the second defined marker are presented simultaneously as part of public information presented by the means for public display.

38. The apparatus for defining the marker of claim 30, wherein the second defined marker is a dedicated marker presented by the means for public display.