Method and apparatus for evoking perceptions of affordances in virtual environments

• US 9,389,680 B2
• Filed: 01/27/2012
• Issued: 07/12/2016
• Est. Priority Date: 09/30/2004
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Gross, David C.
• Primary Examiner(s): DINH, DUC Q
• Application Number:
  US13/360,377
• Publication Number:
  US 20120188157A1
• Time in Patent Office: 1,628 Days
• Field of Search: 345/633, 345/156, 345 7- 9, 345/169
• US Class Current: 1/1
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

Methods and apparatus are provided for evoking perceptions of affordances in a user/virtual environment interface. The method involves recognizing the absence or inadequacy of certain sensory stimuli in the user/virtual environment interface, and then creating sensory stimuli in the virtual environment to substitute for the recognized absent or inadequate sensory stimuli. The substitute sensory stimuli are typically communicated to the user (e.g., visually and/or audibly) as properties and behavior of objects in the virtual environment. Appropriately designed substitute sensory stimuli can evoke perceptions of affordances for the recognized absent or inadequate sensory stimuli in the user/virtual environment interface.

Claims

1. An apparatus for evoking perceptions of affordances in a virtual environment, comprising:

a processor configured with virtual reality software for generating the virtual environment;

the virtual environment comprising a display arrangement in communication with the processor, the display arrangement configured to interface with a user; and

an interactive control device in communication with the virtual environment, the interactive control device configured to enable the user to interact with the virtual environment, wherein the processor is further configured to determine an affordance for an object in the virtual environment, wherein the affordance is defined as an inherent use that the object furnishes to the user of the virtual environment;

wherein the processor is further configured to determine whether sufficient virtual stimuli are generated for the object in order for the user to recognize the affordance and use the object in the virtual environment;

wherein the processor is further configured, responsive to the virtual stimuli being insufficient for the user to recognize the affordance, to generate substitute sensory stimuli for recognized absent or inadequate sensory stimuli in the virtual environment to a degree such that the user is capable of recognizing the affordance and is enabled to use the object in the virtual environment.

2. The apparatus of claim 1 wherein the display arrangement comprises a head-mounted display.

3. The apparatus of claim 1 wherein the display arrangement comprises a computer display screen.

4. The apparatus of claim 1 wherein the display arrangement comprises a boom-mounted head-coupled display device.

5. The apparatus of claim 1 wherein the display arrangement comprises a projection system.

6. The apparatus of claim 1 wherein the substitute sensory stimuli comprise visual cues.

7. The apparatus of claim 1 wherein the substitute sensory stimuli comprise auditory cues.

8. The apparatus of claim 1 wherein the substitute sensory stimuli comprise visual cues for evoking spatial affordances.

9. The apparatus of claim 1 wherein the substitute sensory stimuli comprise a combination of visual and auditory cues for evoking temporal affordances.

10. The apparatus of claim 1 wherein the substitute sensory stimuli exceed a minimum response threshold for user perception.

11. The apparatus of claim 1 wherein the recognized absent or inadequate sensory stimuli relate to properties and behavior of objects in the virtual environment.

12. The apparatus of claim 1 wherein the recognized absent or inadequate sensory stimuli relate to body stature of the user.

13. The apparatus of claim 1 wherein the recognized absent or inadequate sensory stimuli relate to action capabilities of the user.

14. The apparatus of claim 1, wherein the substitute sensory stimuli is generated such that the user is capable of manipulating the object.

15. A method for evoking perceptions of affordances in a virtual environment, the method comprising:

generating the virtual environment using a processor;

interfacing, in the virtual environment, with a user using a display arrangement in communication with the processor;

enabling the user, using an interactive control device, to interact with the virtual environment;

determining, using the interactive control device, an affordance for an object in the virtual environment, wherein the affordance is defined as an inherent use that the object furnishes to the user of the virtual environment;

determining, using the interactive control device, whether sufficient virtual stimuli are generated for the object in order for the user to recognize the affordance and use the object in the virtual environment; and

generating, using the interactive control device and responsive to the virtual stimuli being insufficient for the user to recognize the affordance, substitute sensory stimuli for recognized absent or inadequate sensory stimuli in the virtual environment to a degree such that the user is capable of recognizing the affordance and is enabled to use the object in the virtual environment.

16. The method of claim 15, wherein the substitute sensory stimuli comprise visual cues for evoking spatial affordances.

17. The method of claim 15, wherein the substitute sensory stimuli comprise a combination of visual and auditory cues for evoking temporal affordances.

18. The method of claim 15, wherein the substitute sensory stimuli exceed a minimum response threshold for user perception.

19. The method of claim 15, wherein the recognized absent or inadequate sensory stimuli relate to properties and behavior of objects in the virtual environment.

20. The method of claim 15 further comprising:

generating the substitute sensory stimuli such that the user is capable of manipulating the object.