Closed-loop augmented reality apparatus

• US 6,734,834 B1
• Filed: 08/02/2000
• Issued: 05/11/2004
• Est. Priority Date: 02/11/2000
• Status: Expired due to Fees

• Current Assignee: Yoram Baram
• Original Assignee: Yoram Baram
• Inventors: Baram, Yoram
• Primary Examiner(s): Liang, Regina
• Assistant Examiner(s): Dinh, Duc Q
• Application Number:
  US09/631,292
• Time in Patent Office: 1,378 Days
• Field of Search: 345/7-8, 345/156, 345/158, 600/595, 600/415-416, 382/155-156
• US Class Current: 345/8
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 5/1101 Detecting tremor
• CPC Class Codes: A61B 5/4082 Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/6814 Head
• CPC Class Codes: A61B 5/7445 Display arrangements, e.g. multiple display units
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/63 for local operation

Abstract

Apparatus and system for adaptive augmented reality includes at least one non-radiating sensor, mountable on a body, for detecting body movements and producing signals related to the body movements, and a processor configured to receive the signals and generate an image, wherein the generated image is adapted according to the detected body movements.

The invention provides closed-loop biofeedback for adaptation of body movements, and may be used for treating a movement disorder, such as Parkinson'"'"'s Disease.

System and method for reducing involuntary movement artifacts from a signal, include a processor for filtering a signal representative of a voluntary movement having involuntary movements therein, an adaptive processor for adaptively filtering a vertical motion signal, and a subtractor for subtracting the involuntary movements from the voluntary movement signal to produce a reduced artifact signal. The adaptive involuntary movement processor adapts its processing using the reduced artifact signal. Method for adaptive augmented reality and for treating a movement disorder includes the steps of providing an image to a person, receiving signals related to movements of the person, adapting the image according to the received signals, and providing the adapted image to the person, wherein the adapted image enables the person to adjust body movements.

Claims

1. Apparatus for adaptive image generation, the apparatus comprising:

at least one non-radiating sensor, mountable on a body, for detecting body movements and producing signals related to said body movements;

a processor configured to receive said signals, said processor comprising

a closed loop biofeedback adaptive filtering unit which filters tremors from said signals, thereby producing filtered signals, said filtering unit comprising at least one adaptive filtering element capable of learning and filtering tremors; and

an image generator for providing filtered images from said filtered signals.

2. Apparatus as in claim 1 wherein said filtering unit comprises linear elements and non-linear elements.

3. Apparatus as in claim 1, wherein said filtering unit is a neural network.

4. Apparatus as in claim 1, wherein said at least one non-radiating sensor includes an accelerometer.

5. Apparatus as in claim 1, wherein said generated image includes a geometric pattern.

6. Apparatus as in claim 1, wherein said generated image includes a view from real life.

7. Apparatus for augmented reality, the apparatus comprising:

at least one sensor mountable on a body for producing signals from movements of said at least one part of a body;

a processor for adapting an augmented image based on said signals, said processor comprising a closed loop biofeedback adapting filtering unit which filters tremors from said signals, thereby producing filtered signals and comprising at least one adaptive filtering element capable of learning and filtering tremors; and

an image generator for providing images from said filtered signals.

8. Apparatus as in claim 7, wherein said filtering unit comprises linear elements and non-linear elements.

9. Apparatus as in claim 7, wherein said filtering unit is a neural network.

10. Apparatus as in claim 7, wherein said at least one sensor includes an accelerometer.

11. Apparatus as in claim 7, wherein said virtual image includes a geometric pattern.

12. A system for adaptive augmented reality, the system comprising:

at least one non-radiating sensor, mountable on a body, for detecting body movements and producing signals related to said body movements;

a processor configured to receive said signals relating to said body movements, said processor comprising a closed loop biofeedback adaptive filtering unit which filters tremors from said received signals, thereby producing filtered signals and comprising at least one adaptive filtering element capable of learning and filtering tremors;

an image generator for providing images from said filtered signals; and

a display for displaying said filtered images.

13. Apparatus as in claim 12, wherein said filtering unit comprises linear elements and non-linear elements.

14. Apparatus as in claim 12, wherein said filtering unit is a neural network.

15. A system as in claim 12, wherein said at least one non-radiating sensor includes an accelerometer.

16. A system as in claim 12, wherein said generated image includes a geometric pattern.

17. A system for adaptive virtual reality, the system comprising:

at least one non-radiating sensor, mountable on a body, for detecting body movements and producing signals related to said body movements;

a processor configured to receive said signals, said processor comprising a closed loop biofeedback adaptive filtering unit which filters tremors from said received signals, thereby producing filtered signals and comprising at least one adaptive filtering element capable of learning and filtering tremors;

an image generator for providing said images from said filtered signals; and

a display for displaying said generated and adapted images.

18. Apparatus as in claim 17, wherein said filtering unit comprises linear elements and non-linear elements.

19. Apparatus as in claim 17, wherein said filtering unit is a neural network.

20. A system as in claim 17, wherein said at least one of said radiating sensors includes an accelerometer.

21. A system as in claim 17, wherein said generated image includes a geometric pattern.

22. A system as in claim 17, wherein said generated image includes a view from real life.

23. Apparatus for treating a movement disorder, the apparatus comprising:

at least one sensor, mountable on a body, for detecting body movements and producing signals related to said body movements;

a processor configured to receive said signals, said processor comprising a closed loop biofeedback adapting filtering unit which filters tremors from said received signals, thereby producing filtered signals, and further comprising at least one adaptive filtering element, capable of learning and filtering tremors; and

an image generator for providing said generated and adapted images from said filtered and received signals.

24. Apparatus as in claim 23, wherein said filtering unit comprises linear elements and non-linear elements.

25. Apparatus as in claim 23, wherein said filtering unit is a neural network.

26. A system as in claim 23, wherein said at least one non-radiating sensor includes an accelerometer.

27. A system as in claim 23, wherein said movement disorder is Parkinson'"'"'s disease.

28. A system as in claim 23, wherein said generated image includes a geometric pattern.

29. A system for reducing involuntary movement artifacts from a signal, the system comprising:

a voluntary movement processor for filtering a voluntary movement signal representative of a voluntary movement, said voluntary movement signal including involuntary movements therein;

an adaptive involuntary movement processor for adaptively filtering a vertical motion signal; and

a subtractor for subtracting said involuntary movements from said voluntary movement signal to produce a reduced artifact signal, wherein said adaptive involuntary movement processor adapts its processing using said reduced artifact signal.

30. A system as in claim 29, wherein said involuntary movement includes tremor.

31. A system as in claim 29, wherein said voluntary movement includes walking.

32. A system as in claim 29, wherein said voluntary movement processor comprises linear and non-linear filtering elements.

33. A system as in claim 29, wherein said adaptive involuntary movement processor comprises linear and non-linear filtering elements.

34. A method for treating a movement disorder, the method comprising the steps of:

providing an image to a person with a movement disorder;

receiving at least one signals from said person;

filtering tremors from said at least one signal with a closed loop adaptive filter;

adapting said image based on said received and filtered at least one signal; and

providing said adapted image to said person,

wherein said adapted image enables said person to adjust body movements.

35. A method as in claim 34 wherein said image is a virtual image.

36. A method as in claim 34 wherein said image is an augmented image.

37. A method as in claim 34 wherein said step of filtering is accomplished using filtering unit comprising a closed loop adaptive filtering element.

38. A method as in claim 34 further comprising the step of measuring a walking parameter.

39. A method for reducing involuntary movement artifacts from a signal, the method comprising the steps of:

filtering voluntary movement signals representative of voluntary movements, said signals having involuntary movement artifacts, with a closed loop biofeedback adaptive filter;

filtering vertical motion signals representative of involuntary movements;

subtracting said filtered vertical motion signals from said filtered voluntary movement signals to produce a reduced artifact signal; and

adapting said filtering of vertical motion signals using said reduced artifact signal.