Personal electronic target vision system, device and method

• US 9,625,720 B2
• Filed: 01/24/2012
• Issued: 04/18/2017
• Est. Priority Date: 01/24/2012
• Status: Active Grant

• Current Assignee: Accipiter Radar Technologies Inc.
• Original Assignee: Accipiter Radar Technologies Inc.
• Inventors: Nohara, Timothy J.
• Primary Examiner(s): Edwards, Carolyn R
• Assistant Examiner(s): Gyawali, Bipin
• Application Number:
  US13/356,872
• Publication Number:
  US 20130187834A1
• Time in Patent Office: 1,911 Days
• Field of Search: None
• CPC Class Codes: G01S 13/42 Simultaneous measurement of distance and other co-ordinates indirect measurement G01S13/46
• CPC Class Codes: G01S 13/88 Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G01S 7/04 Display arrangements
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0189 Sight systems

Abstract

A personal, electronic target vision system renders targets in the field of view of the user in real-time so that the user can visualize where the targets are relative to him, in an orientation analogous to unaided human vision. An electronic vision device exchanges target selection information with a target vision server which returns to the electronic vision device the corresponding selected target location information for rendering selected targets in accordance with the user'"'"'s changing viewpoint. The target vision server queries a target information server in order to access, filter and provide the real-time target location information required by the electronic vision device. A surveillance system of sensors and target tracking systems provides the target information server with target location information.

Claims

1. A personal, electronic target vision system for displaying moving targets to one or more users relative to each user'"'"'s respective location, comprising:

one or more personal electronic vision devices (PEVDs) each held or worn by a respective user; and

at least one remote computer connected to each said PEVD over a network;

each said PEVD being configured to periodically send respective user data over said network to said remote computer, said user data including location of the respective user and look direction or orientation of said PEVD, the look direction or orientation of said PEVD including at least a horizontal bearing angle, and said remote computer being configured to acquire, from a source remote to each said user and to send to each said PEVD, respective target data selected by said remote computer in response to said respective user data including the location of the respective user and the horizontal bearing angle of said PEVD, said respective target data pertaining at least in part to near-real-time locations of moving objects within a determinable distance of the respective user, each said PEVD being configured to display, on a user-centric display, targets taken from the respective selected target data and to render the displayed targets in a user-centric view at respective locations relative to the location of the respective user and the horizontal bearing angle of said PEVD.

2. The system of claim 1 wherein each said PEVD is taken from the group consisting of a head-mounted device, a hand-held device, a smart-phone device or a mobile computing device.

3. The system of claim 1 wherein each said PEVD is further configured to acquire user preference information taken from the group consisting of:

field of view (FOV) information which includes user viewing geometry information indicative of the direction in which the respective user is currently looking and horizontal and vertical angular sectors of interest to said respective user, range-interval information indicative of the range of interest to said respective user, zoom information indicative of user preference for display magnification, and target of interest (TOI) information indicative of the types of targets said respective user wishes to see rendered on said user display, the TOIs including dynamic targets taken from the set consisting of aircraft, birds, planets, space objects, vessels, vehicles, animals and persons, along with an indicator of whether real-time or historical target data is desired;

the targets displayed on said user-centric display for said respective user and the user-centric view being in conformity with the user preference information of said respective user.

4. The system of claim 3 wherein each said PEVD is further configured to update said targets and said user-centric display regularly as said respective user turns and as said respective user moves.

5. The system of claim 1 wherein said target location information consists of latitude, longitude and altitude for air targets, and latitude and longitude for surface targets.

6. The system of claim 3 wherein each said PEVD is adapted to render on the respective user-centric display with said magnification only those TOIs contained in the respective user preferred FOV and range-interval.

7. The system of claim 1 wherein said network consists of one or more network segments taken from the group consisting of wireless, cellular, WiFi, SATCOM, wired and the Internet.

8. The system of claim 1 wherein said remote computer is a target vision server and said source is a target information server, said target information server providing target location information to said target vision server in response to queries made by said target vision server in response to said user data from any one of said PEVDs.

9. The system of claim 8 wherein said target information server communicates with a surveillance system including one or more sensors for collecting target location information.

10. The system of claim 1 wherein said remote computer includes at least one, dedicated target vision server which provides said selected target data to said one or more PEVDs.

11. The system of claim 10 wherein said target vision server further communicates with a target information server, said target information server providing target location information to said target vision server in response to queries made by said target vision server in response to respective user data from any one of said PEVDs.

12. The system of claim 11 wherein said target information server communicates with a surveillance system including one or more sensors for collecting target location information.

13. The system of claim 4 wherein said targets are for TOIs that include cooperative targets, whose location updates are obtained from cooperative communication devices taken from the group consisting of automatic identification systems on vessels, GPS on vehicles and aircraft, RFIDs and satellite tags on birds, and computer model updates for planets and space objects.

14. The system of claim 1 wherein each said PEVD includes controls to select and lock onto a particular target to keep the target within display limits of said user-centric display.

15. The system of claim 14 wherein said controls are taken from the group consisting of automatic target lock, user-pan, user set-range-interval and user zoom controls.

16. The system of claim 3 wherein the user preference information further includes information for restricting the displayed targets based on user specified ranges for target attributes taken from the group consisting of speed, heading, radar cross section and identity information.

17. The system of claim 1 wherein each said PEVD, in addition to said user-centric display, includes a user geometry module for continuously calculating the user'"'"'s dynamic field of view, a user vision processor for carrying out the functions of said device and a graphical user interface for obtaining user preferences and providing controls to users to operate such PEVD.

18. The system of claim 17 wherein each said PEVD is further configured to automatically notify or alert the respective user when a target of interest appears in accordance with said respective target selection information.

19. The system of claim 1 wherein said rendering of targets on said user-centric display includes visualizations taken from the group consisting of 2D plan views, 3D projection views, target images, target videos, target animations, target remote sensing imagery, and earth-views showing the geographic surroundings.

20. The system of claim 2 wherein said head-mounted device includes said user-centric display offset from the user'"'"'s eyes allowing said user to use the personal electronic vision system to direct his eyes to a particular target.

21. The system of claim 1 wherein each said PEVD includes integrated binoculars or camera to allow the respective user to more easily find and view video of distant and hard to see targets.

22. The system of claim 21 wherein said respective user is a blind person, said video being transmitted to a microchip implanted in the retina of said blind person, allowing said blind person to find and see targets of interest.

23. The system of claim 1 wherein said personal electronic vision system further includes a recording function to capture the activity of said PEVDs and a playback function for subsequent use in simulation and training.

24. A method for facilitating visual tracking of objects by one or more users holding or wearing respective personal electronic target devices (PEVDs) each having a user display and each with means for rendering on said display targets relative to each user'"'"'s respective location, comprising:

operating at least one remote computer to receive over a network from each said PEVD respective user data, said user data including location of the respective user and look direction or orientation of the respective PEVD, the look direction or orientation including at least a horizontal bearing angle of the respective PEVD, and further operating said remote computer to acquire, from a source remote to each said user and to send to each said PEVD, respective target data selected by said remote computer in response to said respective user data including the location of the respective user and the horizontal bearing angle of the respective PEVD, said respective target data pertaining at least in part to near-real-time locations of moving objects within a determinable distance of the respective user, each said PEVD being configured by said means for rendering to render, in a user-centric view on the respective user display, targets taken from the respective selected target data, the targets in said user-centric view being at respective locations relative to the location of the respective user and in respective fields of view determined in part by the horizontal bearing angles of the respective PEVDs.

25. The method of claim 24, further comprising operating at least one of said PEVDs to acquire user preference information taken from the group consisting of:

field of view (FOV) information which includes user viewing geometry information indicative of the direction in which the respective user is currently looking and horizontal and vertical angular sectors of interest to said respective user, range-interval information indicative of the range of interest to said respective user, zoom information indicative of user preference for display magnification, and target of interest (TOI) information indicative of the types of targets said respective user wishes to see rendered on said user display, the TOIs including dynamic targets taken from the set consisting of aircraft, birds, planets, space objects, vessels, vehicles, animals and persons, along with an indicator of whether real-time or historical target data is desired, also comprising operating said at least one of said PEVDs to display, in the respective user-centric view on the respective user display, targets in conformity with the user preference information of the respective user.

26. The method of claim 25, further comprising operating said at least one of said PEVDs to update the respective user-centric view with a regular periodicity, also comprising operating said at least one of said PEVDs to vary the displayed respective user-centric view to account for changes in location and orientation of the respective user.

27. The method of claim 26, further comprising operating said remote computer to periodically update said target data for each said PEVD to enable display of changes in target location in the respective user-centric view.

28. The method of claim 25 wherein the user preference information further includes information for restricting the displayed targets based on user specified ranges for target attributes taken from the group consisting of speed, heading, radar cross section and identity information.

29. The method of claim 25, further comprising operating said at least one of said PEVDs to communicate the respective user preference information to said remote computer and operating said remote computer to select the respective target data in accordance with the communicated user preference information.

30. The method of claim 25, further comprising operating said at least one of said PEVDs to render in the respective user-centric view on the respective user display only those TOIs contained in the respective user preferred FOV and range-interval.

31. The method of claim 25 wherein said targets are for TOIs that include cooperative targets, further comprising obtaining target location updates from cooperative communication devices taken from the group consisting of automatic identification systems on vessels, GPS on vehicles and aircraft, RFIDs and satellite tags on birds, and computer models for planets and space objects.

32. The method of claim 24 wherein said target data includes respective target location information consisting of latitude, longitude and altitude for air targets, and latitude and longitude for surface targets, the operating of each said PEVD including displaying targets in accordance with the respective target location information.

33. The method of claim 24, further comprising receiving said user data at said remote computer over one or more network segments taken from the group consisting of wireless, cellular, WiFi, SATCOM, wired and the Internet, also comprising transmitting selected target data from said remote computer to each said PEVD over one or more network segments taken from the group consisting of wireless, cellular, WiFi, SATCOM, wired and the Internet.

34. The method of claim 24 wherein said remote computer includes at least one target vision server and said source includes at least one target information server, further comprising operating said target vision server to generate and transmit to said target information server queries in accordance with user data from said PEVDs, also comprising operating said target vision server to receive target location information transmitted from said target information server in response to said queries from said target vision server.

35. The method of claim 34, further comprising operating said target information server to communicate with a surveillance system including one or more sensors for collecting target location information.

36. The method of claim 24 wherein said remote computer includes at least one, dedicated target vision server, further comprising:

operating said target vision server to transmit to a target information server queries in accordance with the user data from the respective PEVDs;

operating said target vision server to receive from said target information server target location information in response to the transmitted queries; and

operating said target vision server to provide selected target data to each respective PEVD.

37. The method of claim 36, further comprising operating said target information server to communicate with a surveillance system including one or more sensors for collecting target location information.

38. The method of claim 24, further comprising operating at least one of said PEVDs to select and lock onto a particular target to keep the target within display limits of the user-centric view on the respective user display.

39. The method of claim 38 wherein the operating of said at least one of said PEVDs to select and lock onto a particular target includes monitoring controls taken from the group consisting of automatic target lock, user-pan, user set-range-interval and user zoom controls.

40. The method of claim 24, further comprising operating at least one of said PEVDs to continuously calculate the user'"'"'s dynamic field of view.

41. The method of claim 24, further comprising operating at least one of said PEVDs to recognize or detect target selection information input by a user into the respective PEVD, and automatically alert or notify the respective user when a target of interest appears in accordance with the input target selection information.

42. The method of claim 24 wherein said user-centric view on said user display includes views taken from the group consisting of 2D plan views, 3D projection views, target images, target videos, target animations, target remote sensing imagery, and earth-views showing the geographic surroundings.

43. The method of claim 24 wherein each said PEVD is taken from the group consisting of a head-mounted device, a hand-held device, a smart-phone device or a mobile computing device.

44. The method of claim 43 wherein said head-mounted device includes said user-centric display offset from the user'"'"'s eyes allowing said user to use the personal electronic vision system to direct his eyes to a particular target.

45. The method of claim 24, wherein at least one of said PEVDs includes integrated binoculars or camera, further comprising operating said at least one of said PEVDs to obtain a video via said binoculars or camera to allow the respective user to more easily find and view video of distant and hard to see targets.

46. The method of claim 45 wherein the user of said at least one of said PEVDs is a blind person, further comprising transmitting said video of said at least one of said PEVDs to a microchip implanted in the retina of said blind person, allowing said blind person to find and see targets of interest.

47. The method of claim 24, further comprising recording target display activity of one or more of said PEVDs and playing back the recorded target display activity for use in simulation and training.

48. The method of claim 24 wherein said means for rendering comprises programmed generic digital processor circuits, further comprising operating said remote computer to transmit software modifying said generic digital processor circuits to render on said display representations of targets relative to each user'"'"'s respective location.

49. A personal electronic target vision device holdable or wearable by a user for displaying representations of targets to the user relative to the user'"'"'s respective location, comprising:

a user geometry module, a user vision processor, and a user display and graphical user interface, said user geometry module being configured to generate user data including user location data and device orientation or directional data for transmission by said device over a network to a remote computer, said device orientation or directional data including at least a horizontal bearing angle of the personal electronic target vision device, said user vision processor being configured to process incoming target data, acquired and selected by said remote computer in accordance with said user data, and to display renderings of one or more moving targets on said user display wherein the renderings are relative to the user in a user-centric view showing the one or more moving targets at respective locations relative to the location of the respective user and as determined in part by the horizontal bearing angle of the personal electronic target vision device.

50. The device in claim 49 wherein said graphical user interface is configured to acquire user target filtering selector information from the user, said device further configured to include said target filtering selector information with said user data, said target filtering selector information including information taken from the group consisting of target-of-interest preferences, field-of-view definitions including set-range-interval and zoom features, and automatic target locking selections.

51. The device of claim 50 wherein said user target filtering selector information further includes information for restricting the displayed targets based on user specified ranges for target attributes taken from the group consisting of speed, heading, radar cross section and identity information.

52. The device of claim 50 wherein said device is configured to communicate said user target filtering selector information as user data to said remote computer, whereby said remote computer informs the acquisition and selection of target data.

53. The device of claim 50 wherein said user vision processor is configured to render, in the respective user-centric view on the respective user display, only those targets of interest contained in the respective user preferred field of view definitions including range-interval.

54. The device of claim 49 wherein said user data further includes heading, speed and acceleration information.

55. The device of claim 49 wherein said network functions in part as a cloud computing network, said remote computer being part of said cloud computing network, said remote computer providing said selected target data as a service to the personal electronic target vision device.

56. The device of claim 52 wherein said remote computer is a target vision server which provides said selected target data to said personal electronic vision device via the cloud computing network.

57. The device of claim 49 wherein said user geometry module is configured to update said user data with a regular periodicity and said user vision processor is configured to update said user-centric view with a regular periodicity to account for changes in location and orientation of the respective user.

58. The device of claim 49 wherein said target data includes respective target location information consisting of latitude, longitude and altitude for air targets, and latitude and longitude for surface targets.

59. The device of claim 49 wherein said graphical user interface is configured to acquire target selection and locking controls taken from the group consisting of automatic target lock, user-pan, user set-range-interval and user zoom controls.

60. The device of claim 49 wherein said user vision processor is configured to select and lock onto a particular target to keep the target within display limits of the user-centric view on the respective user display.

61. The device of claim 49 wherein said user geometry module is configured to continuously calculate the user'"'"'s dynamic field of view.

62. The device of claim 49 wherein said graphical user interface is configured to acquire target selection information input by a user, said user vision processor being configured to recognize and to automatically alert or notify the respective user when a target of interest appears in accordance with the input target selection information.

63. The device of claim 49 wherein said user-centric view on said user display includes views taken from the group consisting of 2D plan views, 3D projection views, target images, target videos, target animations, target remote sensing imagery, and earth-views showing the geographic surroundings.

64. The device of claim 49, further comprising a head mounting wherein the user-centric display is offset from the user'"'"'s eyes, allowing said user to use the device to direct his eyes to a particular target.

65. The device of claim 49, further comprising integrated binoculars or camera operable to obtain a video to allow the respective user to more easily find and view video of distant and hard to see targets.

66. A personal electronic target vision method comprising:

operating a portable vision assistance device to automatically generate user data including user location data and orientation or directional data including at least a horizontal bearing angle;

transmitting said user data over a network to a remote computer;

receiving, from said remote computer, moving-target data, acquired and selected by said remote computer in accordance with said user data; and

displaying renderings of one or more moving targets on a user display of a portable vision assistance device wherein the renderings are relative to the user in a user-centric view showing the one or more moving targets at respective locations relative to the location of the respective user and as determined in part by the horizontal bearing angle of the personal electronic target vision device.

67. The method of claim 66 wherein the generating of said user data includes generating user target filtering selector information including information taken from the group consisting of target-of-interest preferences, field-of-view definitions including set-range-interval and zoom features, and automatic target locking selections.

68. The method of claim 67 wherein said user target filtering selector information further includes information for restricting the displayed targets based on user specified ranges for target attributes taken from the group consisting of speed, heading, radar cross section and identity information.

69. The method of claim 67 wherein the displaying of said renderings on said user display includes rendering, in the said user-centric view, only those targets of interest contained in said field of view definitions including range-interval.

70. The method of claim 66 wherein said user data further includes heading, speed and acceleration information.

71. The method of claim 66 wherein the generating of said user data includes updating said user data with a regular periodicity and wherein the displaying of said renderings on said display includes updating said user-centric view with a regular periodicity to account for changes, in location and orientation of the respective user.

72. The method of claim 66 wherein said target data includes respective target location information consisting of latitude, longitude and altitude for air targets, and latitude and longitude for surface targets.

73. The method of claim 66 wherein the displaying of said rendering includes selecting and locking onto a particular target and updating said rendering to keep the target within display limits of the user-centric view on said user display.

74. The method of claim 66, further comprising continuously calculating the user'"'"'s dynamic field of view.

75. The method of claim 66, further comprising automatically recognizing and automatically issuing an alert signal when a target of interest appears in accordance with target selection information.

76. The method of claim 66 wherein the renderings of one or more moving targets on said user display includes views taken from the group consisting of 2D plan views, 3D projection views, target images, target videos, target animations, target remote sensing imagery, and earth-views showing the geographic surroundings.

77. The method of claim 66 wherein said moving targets are taken from the group consisting of vessels, land vehicles, birds, aircraft, planets, space objects, animals, and people.