×

Methods and systems for creating virtual and augmented reality

  • US 10,203,762 B2
  • Filed: 06/13/2015
  • Issued: 02/12/2019
  • Est. Priority Date: 03/11/2014
  • Status: Active Grant
First Claim
Patent Images

1. An augmented reality display system, comprising:

  • an image capturing device of the augmented reality display system to capture at least one image, whereinthe image capturing device comprises one or more image capturing sensors,at least a portion of the at least one image is perceived within a field of view of a user, andthe at least one image captures at least one gesture that is created by the user and interacts with virtual content projected by the augmented reality display system to the user; and

    a processor coupled directly with no intervening elements or indirectly with one or more intervening elements to the image capturing device to recognize the at least one gesture as at least one recognized gesture, the processor configured to recognize the at least one gesture as the at least one recognized gesture is further configured to;

    identify a plurality of candidate gestures and a plurality of computational utilization or expense requirements for gesture recognition of the at least one gesture;

    determine whether the at least one image includes one or more identifiable depth points at least by performing a line search for the at least one image with one or more lines or line segments;

    determine an order of processing in which a plurality of analysis nodes is executed to perform respective gesture identification processes on the at least one gesture with respect to the plurality of candidate gestures based at least in part upon the plurality of computational resource utilization or expense requirements;

    during one or more earlier stages in the order of processing, generate one or more reduced sets of candidate gestures from the plurality of candidate gestures at least by executing one or more first gesture identification processes of the respective gesture identification processes that analyze the at least one image with a first analysis node to remove one or more candidate gestures from the plurality of candidate gestures based at least in part upon a first computational resource utilization or expense requirement of the plurality of computational resource utilization or expense requirements; and

    during one or more later stages in the order of processing, determine and recognize the at least one gesture from the one or more reduced sets of candidate gestures as the at least one recognized gesture at least by analyzing the at least one image based at least in part on the one or more reduced sets of candidate gestures with a second analysis node corresponding to a second computational expense criterion and at least by executing one or more second gesture identification processes on the at least one gesture and the one or more reduced sets of candidate gestures, whereinthe one or more second gesture identification processes consume a larger amount of processing power than the one or more first gesture identification processes; and

    the processor further configured to determine a user input based at least in part on the at least one recognized gesture.

View all claims
  • 4 Assignments
Timeline View
Assignment View
    ×
    ×