Method and apparatus for evoking perceptions of affordances in virtual environments

• US 7,557,775 B2
• Filed: 09/30/2004
• Issued: 07/07/2009
• Est. Priority Date: 09/30/2004
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Gross, David C.
• Primary Examiner(s): Dinh; Duc Q
• Application Number:
  US10/957,288
• Publication Number:
  US 20060066509A1
• Time in Patent Office: 1,741 Days
• Field of Search: 345 7- 9, 345632-633
• US Class Current: 345/7
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

Methods and apparatus are provided for evoking perceptions of affordances in a user/virtual environment interface. The method involves recognizing the absence or inadequacy of certain sensory stimuli in the user/virtual environment interface, and then creating sensory stimuli in the virtual environment to substitute for the recognized absent or inadequate sensory stimuli. The substitute sensory stimuli are typically communicated to the user (e.g., visually and/or audibly) as properties and behavior of objects in the virtual environment. Appropriately designed substitute sensory stimuli can evoke perceptions of affordances for the recognized absent or inadequate sensory stimuli in the user/virtual environment interface.

Claims

1. A method of evoking perceptions of affordances in a user/virtual environment interface, comprising the steps of:

recognizing an absence or inadequacy of certain sensory stimuli in the user/virtual environment interface;

creating substitute sensory stimuli in a virtual environment using design parameters to substitute for the recognized absence or inadequacy of the certain sensory stimuli, wherein the design parameters are selected from at least one of a sensory modality, a magnitude of the substitute sensory stimuli, and an optimal form of the substitute sensory stimuli, wherein the substitute sensory stimuli evoke perceptions of affordances for the recognized absence or inadequacy of the certain sensory stimuli in the user/virtual environment interface, wherein the substitute sensory stimuli represent substitutional cues to replace missing affordances, and wherein the affordances comprise inherent uses that an object in an environment furnishes to a user of the user/virtual environment interface; and

enabling completion of a percept for cognitive activities using the substitute sensory stimuli, wherein the cognitive activities include at least one of decision-making and execution, wherein the cognitive activities influence the virtual environment by changing at least one of the virtual environment and the position of the user within the virtual environment, wherein the affordances are realized through integration of environmental stimuli of the user/virtual environment interface and internal state stimuli of the user interacting with user experience gained through the decision-making, and wherein the affordances are generated by integrating external stimuli from objects of the user/virtual environment interface, internal stimuli, and state stimuli.

2. The method of claim 1 wherein the substitute sensory stimuli comprise visual cues.

3. The method of claim 1 wherein the substitute sensory stimuli comprise auditory cues.

4. The method of claim 1 wherein the substitute sensory stimuli exceed a minimum response threshold for user perception.

5. The method of claim 1 wherein the recognized absence or inadequacy of the certain sensory stimuli relate to properties and behavior of objects in the virtual environment.

6. The method of claim 1 wherein the recognized absence or inadequacy of the certain sensory stimuli relate to body stature of the user.

7. The method of claim 1 wherein the recognized absence or inadequacy of the certain sensory stimuli relate to action capabilities of the user.

8. The method of claim 1 wherein the external stimuli are generated via extroceptors and proprioceptors.

9. The method of claim 1 wherein the internal stimuli are generated via interceptors.

10. The method of claim 1 wherein the state stimuli are generated via action capabilities and body stature.

11. A method of evoking perceptions of affordances in a user/virtual environment interface, comprising the steps of:

recognizing an absence or inadequacy of certain sensory stimuli in the user/virtual environment interface, wherein the recognized absence or inadequacy of the certain sensory stimuli relate to at least one of properties and behavior of objects in the virtual environment, body stature of the user, and action capabilities of the user; and

creating substitute sensory stimuli in a virtual environment using design parameters to substitute for the recognized absence or inadequacy of the certain sensory stimuli, wherein the design parameters are selected from at least one of a sensory modality, a magnitude of the substitute sensory stimuli, and an optimal form of the substitute sensory stimuli, wherein the substitute sensory stimuli evoke perceptions of affordances for the recognized absence or inadequacy of the certain sensory stimuli in the user/virtual environment interface, wherein the substitute sensory stimuli represent substitutional cues to replace missing affordances, wherein the substitute sensory stimuli comprise at least one of visual cues and auditory cues, wherein the substitute sensory stimuli exceed a minimum response threshold for user perception, wherein the affordances comprise inherent uses that an object in an environment furnishes to a user of the user/virtual environment interface, wherein the affordances are realized through integration of environmental stimuli of the user/virtual environment interface and internal state stimuli of the user interacting with user experience gained through decision-making, wherein the affordances are generated by integrating external stimuli from objects of the user/virtual environment interface, internal stimuli, and state stimuli, wherein integrating enables completion of a percept for cognitive activities including decision-making and execution, wherein the cognitive activities influence the virtual environment by changing at least one of the virtual environment and the position of the user within the virtual environment, wherein the external stimuli are generated via extroceptors and proprioceptors, wherein the internal stimuli are generated via interceptors, and wherein the state stimuli are generated via action capabilities and body stature.