Computer display pointer device for a display

• US 8,325,136 B2
• Filed: 12/01/2009
• Issued: 12/04/2012
• Est. Priority Date: 12/01/2009
• Status: Active Grant

• Current Assignee: Raytheon Company (Rtx Corporation)
• Original Assignee: Raytheon Company (Rtx Corporation)
• Inventors: Wilkinson, Aaron C., Menefee, Michael C.
• Primary Examiner(s): Tzeng, Fred
• Application Number:
  US12/628,852
• Publication Number:
  US 20110128221A1
• Time in Patent Office: 1,099 Days
• Field of Search: 345/158, 345/156, 345/166, 382/103, 382/100, 382/154, 348/335, 348/144, 348/115
• US Class Current: 345/158
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033

Abstract

According to one embodiment, a computer display pointer device includes an image processor coupled to a display and a video camera. The display is configured to be worn by a user and display a computer image over a portion of the user'"'"'s field-of-view. The video camera is operable to be worn by the user and boresighted to a field-of-view of the user. The image processor receives a video signal from the video camera that includes an image of a pointer element configured on a hand of the user, determines a position of the pointer element according to the received video image, and moves a cursor on the display according to the position of the pointer element.

Claims

1. A computer display pointer device comprising:

an image processor coupled to a display and a video camera, the display configured to be worn by a user and display a computer image over a portion of the user'"'"'s field-of-view, the video camera operable to the worn by the user and boresighted to a field-of-view of the user;

the image processor operable to;

receive a video signal from the video camera, the video signal including an image of a pointer element configured on a hand of the user;

determine a position of the pointer element according to the received video image; and

actuate a signal according to the determined position of the pointer element.

2. The computer display pointer device of claim 1, wherein the image processor is operable to move a cursor on the display according to the determined position of the pointer element.

3. The computer display pointer device of claim 1, wherein the video signal includes an image of two pointer elements configured on the hand of the user, the image processor operable to actuate the signal according to the relative position of the two pointer elements.

4. The computer display pointer device of claim 3, wherein the image processor is operable to display a selectable icon on the display, and actuate the signal according to the position of the cursor relative to that of the selectable icon.

5. The computer display pointer device of claim 1, wherein the video camera comprises an infrared camera that is sensitive to infrared light and the pointer element is operable to transmit infrared light.

6. The computer display pointer device of claim 1, wherein the image processor, the display, and the video camera are mounted on a helmet.

7. The computer display pointer device of claim 6, wherein the user is a ground soldier and the helmet is configured to be worn by the ground soldier.

8. The computer display pointer device of claim 1, wherein the image processor is operable to display one or more display elements on the display and superimpose imagery generated by the video camera on the display with the one or more display elements.

9. The computer display pointer device of claim 8, wherein the display comprises a monocular display.

10. A computer display pointing method comprising:

receiving a video signal from a video camera operable to the worn by a user, the video signal including an image of a pointer element configured on a hand of the user;

determining a position of the pointer element according to the received video image; and

actuating a signal according to the determined position of the pointer element on a display, the display configured to be worn by a user and boresighted to the user'"'"'s field-of-view.

11. The method of claim 10, further comprising moving a cursor on the display according to the determined position of the pointer element.

12. The method of claim 10, further comprising actuating the signal according to a relative position of two pointer elements configured on the hand of the user.

13. The method of claim 12, further comprising:

displaying a selectable icon on the display; and

actuating the signal according to the position of the cursor relative to that of the selectable icon.

14. The method of claim 10, wherein receiving the video signal from the video camera comprises receiving the video signal from an infrared camera representing infrared light transmitted by the pointer element.

15. The method of claim 10, further comprising providing the image processor, the display, and the video camera that are mounted on a helmet.

16. The method of claim 15, wherein the user is a ground soldier and the helmet is configured to be worn by the ground soldier.

17. The method of claim 10, further comprising:

displaying one or more display elements on the display; and

superimposing imagery generated by the video camera on the display with the one or more display elements.

18. The method of claim 17, wherein the display comprises a monocular display.

19. A head mounted display comprising:

a display configured to be worn by a user and display a computer image over a portion of the user'"'"'s field-of-view;

a video camera operable to the worn by the user and boresighted to the field-of-view of the user; and

an image processor coupled to the display and the video camera, the image processor operable to;

receive a video signal from the video camera, the video signal including an image a pointer element configured on the hand of the user;

determine a position of the pointer element according to the received video image; and

actuate a signal according to the determined position of the pointer element.

20. The head mounted display of claim 19, wherein the image processor is operable to move a cursor on the display according to the determined position of the pointer element.

21. The head mounted display of claim 19, wherein the video signal includes an image of two pointer elements configured on the hand of the user, the image processor operable to actuate the signal according to the relative position of the two pointer elements.

22. The head mounted display of claim 21, wherein the image processor is operable to display a selectable icon on the display, and actuate the signal according to the position of the cursor relative to that of the selectable icon.

23. The head mounted display of claim 19, wherein the video camera comprises an infrared camera that is sensitive to infrared light and the pointer element is operable to transmit infrared light.

24. The head mounted display of claim 23, wherein the user is a ground soldier and the helmet is configured to be worn by the ground soldier.

25. The head mounted display of claim 19, wherein the image processor is operable to display one or more display elements on the display and superimpose imagery generated by the video camera on the display with the one or more display elements.

26. The head mounted display of claim 25, wherein the monocular display comprises a monocular display.