TECHNIQUE FOR MORE EFFICIENTLY DISPLAYING TEXT IN VIRTUAL IMAGE GENERATION SYSTEM

• US 20170032575A1
• Filed: 06/30/2016
• Published: 02/02/2017
• Est. Priority Date: 06/30/2015
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Yeoh, Ivan, Hand, Randall E., O'Connor, Philip, Schwab, Brian, Lindsay, Spencer, Miller, Samuel A., Edwin, Lionel Ernest
• Granted Patent: US 9,978,182 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A virtual image generation system and method of operating same is provided. An end user is allowed to visualize the object of interest in a three-dimensional scene. A text region is spatially associated with the object of interest. A textual message that identifies at least one characteristic of the object of interest is generated. A textual message is streamed within the text region.

Claims

1. A method of operating a virtual image generation system, the method comprising:

allowing an end user to visualize a three-dimensional scene;

spatially associating a text region within a field of view of the user;

generating a textual message; and

streaming the textual message within the text region.

2. The method of claim 1, wherein streaming the textual message within the text region comprises displaying the textual message only one word at a time.

3. The method of claim 1, wherein streaming the textual message within the text region comprises displaying the textual message at least two words at a time while emphasizing only one of the at least two displayed words.

4. The method of claim 1, further comprising sensing a gestural command from the end user, wherein streaming the textual message is controlled by the gestural command.

5. The method of claim 1, further comprising allowing the end user to visualize an object of interest in the three-dimensional scene, wherein the text region is spatially associated with the object of interest, and the textual image identifies at least one characteristic of the object of interest.

6. The method of claim 5, wherein the object of interest is an actual object.

7. The method of claim 6, wherein allowing the end user to visualize the actual object comprises allowing the end user to visualize directly light from the actual object.

8. The method of claim 5, wherein the object of interest is movable, and wherein spatially associating the text region with the object of interest comprises linking the text region with the object of interest, such that text region moves in coordination with movement of the object of interest.

9. The method of claim 5, further comprising associating a gesture reference with the object of interest, wherein sensing the gestural command from the end user comprises detecting an angular position of an anatomical part of the end user relative to a gesture reference.

10. The method of claim 5, further comprising:

identifying a focal plane in which the object of interest is disposed; and

adjusting the streaming speed of the textual message based on the identified focal plane.

11. The method of claim 5, further comprising:

displaying a text region indicator adjacent the object of interest;

sensing a focal point of the end user; and

activating the text region when the focal point of the end user is coincident with the text region indicator.

12. The method of claim 1, further comprising sensing blinking of the eyes of the end user, wherein the streaming of the textual message pauses when the eyes of the end user are closed, and continues when the eyes of the end user are opened.

13. The method of claim 1, wherein streaming the textual message comprises varying pauses between words of the textual message.

14. The method of claim 1, further comprising generating a pattern of audible tones that respectively correspond temporally with words in the textual message as they are streamed.

15. A virtual image generation system for use by an end user, comprising:

a display system configured for allowing the end user to visualize a three-dimensional scene; and

a control system configured for spatially associating a text region with a field of view of the end user, generating a textual message, and instructing the display system to stream the textual message within the text region.

16. The virtual image generation system of claim 15, wherein the display system includes a projection subsystem and a partially transparent display surface, the projection subsystem configured for projecting the frame onto the partially transparent display surface, and the partially transparent display surface configured for being position in the field of view between the eyes of the end user and an ambient environment.

17. The virtual image generation system of claim 15, wherein the display system is configured for streaming the textual message within the text region by displaying the textual message at least two words at a time while emphasizing only one of the at least two displayed words,

wherein the display system is configured for emphasizing the only one word by displaying the one word with a brightness intensity more than the remaining word or words of the at least two words, and

wherein the text region is a three-dimensional text region, and wherein the display system is configured for emphasizing the only one word by displaying the one word in a foreground of the three-dimensional text region, and displaying the remaining word or words of the at least two words in a background of the three-dimensional text region.

18. The virtual image generation system of claim 15, further comprising at least one sensor configured for sensing a gestural command from the end user, wherein the control system is configured for controlling the streaming of the textual message based on the gestural command.

19. The virtual image generation system of claim 15, further comprising one or more sensors configured for sensing blinking of the eyes of the end user, wherein the control system is configured for pausing the streaming of the textual message when the eyes of the end user are closed, and continue the streaming of the textual message when the eyes of the end user are opened.

20. The virtual image generation system of claim 15, further comprising one or more speakers, wherein the control system is configured for instructing the one or more speakers to generate a pattern of audible tones that respectively correspond temporally with words in the textual message as they are streamed.