Ambulatory based human-computer interface

• US 20060262120A1
• Filed: 03/02/2006
• Published: 11/23/2006
• Est. Priority Date: 05/19/2005
• Status: Abandoned Application

• Current Assignee: Outland Research LLC
• Original Assignee: Outland Research LLC
• Inventors: Rosenberg, Louis B.
• Application Number:
  US11/367,178
• Publication Number:
  US 20060262120A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

A human computer interface system includes a user interface having sensors adapted to detect footfalls of a user'"'"'s feet and generate corresponding sensor signals, a host computer communicatively coupled to the user interface and adapted to manage a virtual environment containing an avatar associated with the user, and control circuitry adapted to control the avatar within the virtual environment to perform one of a plurality of virtual activities based at least in part upon at least one of a sequence and timing of detected footfalls of the user. The virtual activities include at least two of standing, walking, jumping, hopping, jogging, and running. The host computer is further adapted to drive a display to present a view to the user of the avatar performing the at least one virtual activity within the virtual environment.

Claims

1. A human computer interface system, comprising:

a user interface comprising a plurality of sensors, the sensors adapted to detect footfalls of a user'"'"'s feet and generate corresponding sensor signals;

a host computer communicatively coupled to the user interface, the host computer adapted to manage a virtual environment containing an avatar associated with a user; and

control circuitry adapted to;

identify, from the sensor signals, a physical activity being currently performed by the user from among a plurality of physical activities based at least in part upon at least one of a sequence and a timing of detected footfalls of the user, the plurality of physical activities including at least two of standing, walking, jumping, hopping, jogging, and running; and

control the avatar within the virtual environment to perform one of a plurality of virtual activities based at least in part upon the identified physical activity of the user, the plurality of virtual activities including at least two of standing, walking, jumping, hopping, jogging, and running, wherein

the host computer is further adapted to drive a display to present a view to the user of the avatar performing the virtual activity within the virtual environment.

2. The interface system of claim 1, wherein the control circuitry is adapted to control a speed at which the avatar performs at least one virtual activity of walking, jogging, and running based at least in part upon the rate of detected footfalls of the user.

3. The interface system of claim 1, wherein the control circuitry is adapted to control a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon an elapsed time between a first detected footfall of the user and a second detected footfall of the user.

4. The interface system of claim 1, wherein the control circuitry is adapted to control a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon a detected force magnitude of at least one detected footfall of the user.

5. The interface system of claim 1, wherein the user interface comprises:

a ground level pad adapted to be stepped on by the user, the ground level pad having a left sensor region and a right sensor region defined therein; and

at least one sensor disposed within each of the left sensor region and the right sensor region of the ground level pad.

6. The interface system of claim 5, wherein the user interface further comprises:

a step-up level pad adapted to be stepped on by the user and disposed above the ground level pad, the step-up level pad having a left sensor region and a right sensor region defined therein; and

at least one sensor disposed within each of a left sensor region and a right sensor regions of the step-up level pad.

7. The interface system of claim 1, wherein the user interface comprises at least one sensor coupled to a pair of articles of footwear adapted to be worn by the user.

8. The interface system of claim 7, wherein the at least one sensor is integrated into a resilient underside of each of the pair of articles of footwear.

9. The interface system of claim 7, wherein the host computer is a portable computing device adapted to be held in the hands of the user.

10. The interface system of claim 9, wherein the host computer is interfaced to the at least one sensor of pair of articles of footwear by a wireless communication connection.

11. The interface system of claim 1, wherein the plurality of physical activities include all of walking, running, and jumping.

12. The interface system of claim 1, wherein at least one of the plurality of sensors is an analog sensor.

13. The interface system of claim 1, wherein at least one of the plurality of sensors is a contact switch adapted to detect a presence of a user'"'"'s foot within a sensor region of the user interface.

14. The interface system of claim 1, wherein at least one of the plurality of sensors is a pressure sensor adapted to detect an amount of force applied by a user'"'"'s foot within a sensor region of the user interface.

15. The interface system of claim 1, wherein the host computer is adapted to drive the display to present a first person view or a third person view of the avatar within the virtual environment.

16. The interface system of claim 1, wherein the control circuitry is arranged within the user interface, is arranged within the host computer, or is distributed across the user interface and the host computer.

17. The interface system of claim 1, further comprising a hand-piece adapted to be held by the user and generate hand-piece data when engaged by the user, wherein

the control circuitry is further adapted to control actions of the avatar within the virtual environment based on the hand-piece data.

18. The interface system of claim 17, wherein the control circuitry is adapted to control a direction in which the avatar performs at least one virtual activity of walking, jogging, running, jumping, and hopping based at least in part upon input provided by the user to the hand-piece.

19. A human computer interface method, comprising:

detecting footfalls of a user'"'"'s feet with a plurality of sensors;

generating sensor signals corresponding to the detected footfalls;

identifying, based on the sensor signals, a physical activity being currently performed by the user among a plurality of physical activities based at least in part upon at least one of a sequence and a timing of detected footfalls of the user, the plurality of physical activities including at least two of standing, walking, jumping, hopping, jogging, and running;

controlling an avatar within a virtual environment to perform one of a plurality of virtual activities based at least in part upon the identified current physical activity of the user, the plurality of virtual activities including at least two of standing, walking, jumping, hopping, jogging, and running; and

driving a display to present a view to the user of the avatar performing the virtual activity within the virtual environment.

20. The interface method of claim 19, wherein the controlling comprises controlling a speed at which the avatar performs at least one virtual activity of walking, jogging, and running based at least in part upon the rate of detected footfalls of the user.

21. The interface method of claim 19, wherein the controlling comprises controlling a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon an elapsed time between a first detected footfall of the user and a second detected footfall of the user.

22. The interface method of claim 19, wherein the controlling comprises controlling a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon a detected force magnitude of at least one detected footfall of the user.

23. The interface method of claim 19, wherein the detecting comprises detecting a presence of a user'"'"'s foot within a sensor region of a user interface.

24. The interface method of claim 19, wherein the detecting comprises detecting an amount of force applied by a user'"'"'s foot within a sensor region of a user interface.

25. The interface method of claim 19, wherein the plurality of physical activities include all of walking, running, and jumping.

26. The interface method of claim 19, wherein generating the sensor data comprises generating an analog signal.

27. The interface method of claim 19, further comprising driving the display to present a first- or a third-person view of the avatar within the virtual environment.

28. The interface method of claim 19, further comprising:

detecting a user'"'"'s engagement with a hand-piece;

generating hand-piece data corresponding to an engagement detected; and

controlling the at least one action of the avatar within the virtual environment based on the hand-piece data.

29. The interface system of claim 19, further comprising identifying the detected physical activity by determining at least one of a timing, a frequency, a duty cycle, and a magnitude of a characteristic pattern contained within the sensor signals.

30. The interface method of claim 29, wherein the controlling comprises controlling a direction in which the avatar performs at least one virtual activity of walking, jogging, running, jumping, and hopping based at least in part upon input provided by the user to the hand-piece.

31. A human computer interface system, comprising:

a user interface comprising a plurality of sensors, the sensors adapted to detect footfalls of a user'"'"'s feet and generate corresponding sensor signals;

a host computer communicatively coupled to the user interface, the host computer adapted to manage a virtual environment containing an avatar associated with the user; and

control circuitry adapted to control the avatar within the virtual environment to perform at least one of a plurality of virtual activities based at least in part upon at least one of a sequence and timing of detected footfalls of the user, the plurality of virtual activities comprising at least two of standing, walking, jumping, hopping, jogging, and running, wherein the host computer is further adapted to drive a display to present a view to the user of the avatar performing the at least one virtual activity within the virtual environment.

32. The interface system of claim 31, wherein the control circuitry is adapted to control a speed at which the avatar performs at least one virtual activity of walking, jogging, and running based at least in part upon the rate of detected footfalls of the user.

33. The interface system of claim 31, wherein the control circuitry is adapted to control a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon an elapsed time between a first detected footfall of the user and a second detected footfall of the user.

34. The interface system of claim 31, wherein the control circuitry is adapted to control a height at which the avatar performs at least one virtual activity of jumping and hopping based at least in part upon a detected force magnitude of at least one detected footfall of the user.